2024-04-20T22:41:50.936558236Z .. 2024-04-20T22:41:51.548767877Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-20T22:41:52.607827710Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-20T22:41:57.714221834Z [2024-04-20T22:41:57.703+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-20T22:41:58.732322289Z [2024-04-20T22:41:58.731+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-20T22:41:59.736316732Z [2024-04-20T22:41:59.735+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-04-20T22:42:15.807919839Z 2024-04-20T22:42:16.499730306Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-20T22:42:18.489689749Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-20T22:42:22.276028139Z [2024-04-20 22:42:22 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-04-20T22:42:22.288053651Z [2024-04-20 22:42:22 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-04-20T22:42:22.288069326Z [2024-04-20 22:42:22 +0000] [16] [INFO] Using worker: sync 2024-04-20T22:42:22.302845883Z [2024-04-20 22:42:22 +0000] [17] [INFO] Booting worker with pid: 17 2024-04-20T22:42:22.369556489Z [2024-04-20 22:42:22 +0000] [18] [INFO] Booting worker with pid: 18 2024-04-20T22:42:24.720638644Z 2024-04-20T22:42:24.720656648Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-04-20T22:42:24.720661552Z --- ***** ----- 2024-04-20T22:42:24.720665359Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-04-20 22:42:24 2024-04-20T22:42:24.720681065Z - *** --- * --- 2024-04-20T22:42:24.720684731Z - ** ---------- [config] 2024-04-20T22:42:24.720688532Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f68a35d0310 2024-04-20T22:42:24.720691940Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-04-20T22:42:24.720695093Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-04-20T22:42:24.720702094Z - *** --- * --- .> concurrency: 16 (prefork) 2024-04-20T22:42:24.720705143Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-04-20T22:42:24.720718903Z --- ***** ----- 2024-04-20T22:42:24.720722166Z -------------- [queues] 2024-04-20T22:42:24.720725223Z .> default exchange=default(direct) key=default 2024-04-20T22:42:24.720728410Z 2024-04-20T22:42:24.720731332Z 2024-04-20T22:42:24.720734356Z [tasks] 2024-04-20T22:42:24.720737437Z . airflow.executors.celery_executor.execute_command 2024-04-20T22:42:24.720740298Z 2024-04-20T22:42:29.467441624Z [2024-04-20 22:42:29,462: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-04-20T22:42:29.476407200Z [2024-04-20 22:42:29,476: INFO/MainProcess] mingle: searching for neighbors 2024-04-20T22:42:30.496163239Z [2024-04-20 22:42:30,495: INFO/MainProcess] mingle: all alone 2024-04-20T22:42:30.536272144Z [2024-04-20 22:42:30,534: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-04-20T22:43:24.882789507Z [2024-04-20 22:43:24,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f17cd91c-dd6a-4826-878d-3efba82cff02] received 2024-04-20T22:43:24.956961149Z [2024-04-20 22:43:24,956: INFO/ForkPoolWorker-15] [f17cd91c-dd6a-4826-878d-3efba82cff02] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:43:25.293073008Z [2024-04-20 22:43:25,289: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:43:25.662684553Z [2024-04-20 22:43:25,662: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:43:56.414462935Z [2024-04-20 22:43:56,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f17cd91c-dd6a-4826-878d-3efba82cff02] succeeded in 31.528534396000055s: None 2024-04-20T22:44:06.375914004Z [2024-04-20 22:44:06,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86cfe41c-ecdc-4998-9e2d-971d864560d0] received 2024-04-20T22:44:06.412846680Z [2024-04-20 22:44:06,412: INFO/ForkPoolWorker-15] [86cfe41c-ecdc-4998-9e2d-971d864560d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:44:06.713032185Z [2024-04-20 22:44:06,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:44:06.955949171Z [2024-04-20 22:44:06,955: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:44:37.561529879Z [2024-04-20 22:44:37,560: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86cfe41c-ecdc-4998-9e2d-971d864560d0] succeeded in 31.174059479999983s: None 2024-04-20T22:44:39.135894685Z [2024-04-20 22:44:39,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8812db2d-aa66-4800-8ab7-bcbc09415dd2] received 2024-04-20T22:44:39.144289145Z [2024-04-20 22:44:39,143: INFO/ForkPoolWorker-15] [8812db2d-aa66-4800-8ab7-bcbc09415dd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:44:39.457277142Z [2024-04-20 22:44:39,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:44:39.727896196Z [2024-04-20 22:44:39,727: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:45:10.381716476Z [2024-04-20 22:45:10,380: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8812db2d-aa66-4800-8ab7-bcbc09415dd2] succeeded in 31.24261147300001s: None 2024-04-20T22:45:20.725349216Z [2024-04-20 22:45:20,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee8f8a3b-8229-4f9a-8086-a4757f0fe62e] received 2024-04-20T22:45:20.734719864Z [2024-04-20 22:45:20,734: INFO/ForkPoolWorker-15] [ee8f8a3b-8229-4f9a-8086-a4757f0fe62e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:45:21.015409873Z [2024-04-20 22:45:21,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:45:21.233769809Z [2024-04-20 22:45:21,233: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:45:45.334622036Z [2024-04-20 22:45:45,276: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee8f8a3b-8229-4f9a-8086-a4757f0fe62e] succeeded in 24.54824083599999s: None 2024-04-20T22:46:00.953403735Z [2024-04-20 22:46:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0d850ef-5585-40cc-ac59-7e7dd17be3b8] received 2024-04-20T22:46:00.965039835Z [2024-04-20 22:46:00,964: INFO/ForkPoolWorker-15] [f0d850ef-5585-40cc-ac59-7e7dd17be3b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:46:01.308095365Z [2024-04-20 22:46:01,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:46:01.654482530Z [2024-04-20 22:46:01,654: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:46:02.229939906Z [2024-04-20 22:46:02,229: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0d850ef-5585-40cc-ac59-7e7dd17be3b8] succeeded in 1.2738258059999907s: None 2024-04-20T22:48:00.807339708Z [2024-04-20 22:48:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f9239b0-4551-4a8b-be24-cf6dd999c5df] received 2024-04-20T22:48:00.826875672Z [2024-04-20 22:48:00,826: INFO/ForkPoolWorker-15] [8f9239b0-4551-4a8b-be24-cf6dd999c5df] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:48:01.131860799Z [2024-04-20 22:48:01,127: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:48:01.394623828Z [2024-04-20 22:48:01,394: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:48:02.023841022Z [2024-04-20 22:48:02,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f9239b0-4551-4a8b-be24-cf6dd999c5df] succeeded in 1.2118398830000388s: None 2024-04-20T22:50:00.438283878Z [2024-04-20 22:50:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c323a3a5-6967-426a-87c1-a7552b2ca42f] received 2024-04-20T22:50:00.467408205Z [2024-04-20 22:50:00,467: INFO/ForkPoolWorker-15] [c323a3a5-6967-426a-87c1-a7552b2ca42f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:50:00.847927681Z [2024-04-20 22:50:00,843: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:50:01.155411741Z [2024-04-20 22:50:01,155: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:50:01.964867342Z [2024-04-20 22:50:01,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c323a3a5-6967-426a-87c1-a7552b2ca42f] succeeded in 1.5218181499999446s: None 2024-04-20T22:52:00.195998448Z [2024-04-20 22:52:00,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37f92f97-fd36-431c-b32c-79b88060c026] received 2024-04-20T22:52:00.210499877Z [2024-04-20 22:52:00,210: INFO/ForkPoolWorker-15] [37f92f97-fd36-431c-b32c-79b88060c026] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:52:00.559162685Z [2024-04-20 22:52:00,555: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:52:00.876067429Z [2024-04-20 22:52:00,875: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:01.472297142Z [2024-04-20 22:52:01,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37f92f97-fd36-431c-b32c-79b88060c026] succeeded in 1.2733694710000236s: None 2024-04-20T22:52:22.427304872Z [2024-04-20 22:52:22,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b686cb28-be77-4862-8fe6-85269a0cd0b4] received 2024-04-20T22:52:22.444777368Z [2024-04-20 22:52:22,444: INFO/ForkPoolWorker-15] [b686cb28-be77-4862-8fe6-85269a0cd0b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:52:22.720178686Z [2024-04-20 22:52:22,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:52:24.122913761Z [2024-04-20 22:52:24,122: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:52:24.128649692Z [2024-04-20 22:52:24,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:24.147747164Z [2024-04-20 22:52:24,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:52:24.148862479Z [2024-04-20 22:52:24,148: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:52:24.148881842Z [2024-04-20 22:52:24,148: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:52:24.149042300Z [2024-04-20 22:52:24,148: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:52:24.149052949Z [2024-04-20 22:52:24,148: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:52:24.149230153Z [2024-04-20 22:52:24,149: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:52:24.149242770Z [2024-04-20 22:52:24,149: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:52:24.233754413Z [2024-04-20 22:52:24,233: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:24.821578242Z [2024-04-20 22:52:24,821: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b686cb28-be77-4862-8fe6-85269a0cd0b4] succeeded in 2.382245935000128s: None 2024-04-20T22:52:24.988865013Z [2024-04-20 22:52:24,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbfad8e6-b318-450f-8912-818da3a7d7be] received 2024-04-20T22:52:24.999429828Z [2024-04-20 22:52:24,999: INFO/ForkPoolWorker-15] [cbfad8e6-b318-450f-8912-818da3a7d7be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:52:25.334440066Z [2024-04-20 22:52:25,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:52:26.574664658Z [2024-04-20 22:52:26,574: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:52:26.577787722Z [2024-04-20 22:52:26,577: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:26.606142179Z [2024-04-20 22:52:26,605: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:52:26.607280471Z [2024-04-20 22:52:26,607: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:52:26.607575154Z [2024-04-20 22:52:26,607: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:52:26.607944736Z [2024-04-20 22:52:26,607: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:52:26.608082012Z [2024-04-20 22:52:26,607: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:52:26.608409752Z [2024-04-20 22:52:26,608: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:52:26.608603383Z [2024-04-20 22:52:26,608: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:52:26.684606003Z [2024-04-20 22:52:26,684: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:27.334730506Z [2024-04-20 22:52:27,334: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbfad8e6-b318-450f-8912-818da3a7d7be] succeeded in 2.342217792999918s: None 2024-04-20T22:52:27.518863278Z [2024-04-20 22:52:27,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d4ce07f-8597-40f8-bc96-a1edc7aab9aa] received 2024-04-20T22:52:27.524830131Z [2024-04-20 22:52:27,524: INFO/ForkPoolWorker-15] [9d4ce07f-8597-40f8-bc96-a1edc7aab9aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T22:52:27.809651820Z [2024-04-20 22:52:27,806: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:52:29.237629527Z [2024-04-20 22:52:29,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:52:29.242435900Z [2024-04-20 22:52:29,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:29.265897827Z [2024-04-20 22:52:29,265: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:52:29.267994309Z [2024-04-20 22:52:29,267: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:52:29.268487093Z [2024-04-20 22:52:29,267: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:52:29.268951619Z [2024-04-20 22:52:29,268: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:52:29.269124872Z [2024-04-20 22:52:29,268: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:52:29.269577958Z [2024-04-20 22:52:29,269: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:52:29.269725742Z [2024-04-20 22:52:29,269: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:52:29.465705190Z [2024-04-20 22:52:29,465: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:30.185075880Z [2024-04-20 22:52:30,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d4ce07f-8597-40f8-bc96-a1edc7aab9aa] succeeded in 2.6641262420000658s: None 2024-04-20T22:52:31.114578795Z [2024-04-20 22:52:31,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98662b1c-2016-4d54-8b06-0e7d873c682b] received 2024-04-20T22:52:31.181856878Z [2024-04-20 22:52:31,181: INFO/ForkPoolWorker-15] [98662b1c-2016-4d54-8b06-0e7d873c682b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:52:31.568009555Z [2024-04-20 22:52:31,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:52:32.850539190Z [2024-04-20 22:52:32,850: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:52:32.853958645Z [2024-04-20 22:52:32,853: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:32.874832053Z [2024-04-20 22:52:32,874: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:52:32.876070264Z [2024-04-20 22:52:32,875: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:52:32.876089356Z [2024-04-20 22:52:32,875: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:52:32.876283090Z [2024-04-20 22:52:32,876: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:52:32.876297343Z [2024-04-20 22:52:32,876: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:52:32.876563280Z [2024-04-20 22:52:32,876: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:52:32.876575776Z [2024-04-20 22:52:32,876: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:52:32.964236976Z [2024-04-20 22:52:32,961: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:33.529214170Z [2024-04-20 22:52:33,528: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98662b1c-2016-4d54-8b06-0e7d873c682b] succeeded in 2.410308121000071s: None 2024-04-20T22:52:38.882238251Z [2024-04-20 22:52:38,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[165e6031-71dc-4da0-9648-e5c5362339c2] received 2024-04-20T22:52:38.899275364Z [2024-04-20 22:52:38,899: INFO/ForkPoolWorker-15] [165e6031-71dc-4da0-9648-e5c5362339c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:52:39.235055021Z [2024-04-20 22:52:39,231: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:52:40.227035984Z [2024-04-20 22:52:40,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78989173-8e7f-42f2-b721-3d9dc471bf1b] received 2024-04-20T22:52:40.236093521Z [2024-04-20 22:52:40,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bdd823f-cb10-480a-a429-e3fe3835a11c] received 2024-04-20T22:52:40.298215406Z [2024-04-20 22:52:40,297: INFO/ForkPoolWorker-16] [78989173-8e7f-42f2-b721-3d9dc471bf1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T22:52:40.321601859Z [2024-04-20 22:52:40,321: INFO/ForkPoolWorker-1] [9bdd823f-cb10-480a-a429-e3fe3835a11c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:52:40.619345952Z [2024-04-20 22:52:40,619: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:52:40.622913200Z [2024-04-20 22:52:40,622: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:40.639997419Z [2024-04-20 22:52:40,637: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T22:52:40.659969818Z [2024-04-20 22:52:40,659: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:52:40.662523464Z [2024-04-20 22:52:40,662: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:52:40.662652324Z [2024-04-20 22:52:40,662: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:52:40.662794569Z [2024-04-20 22:52:40,662: INFO/ForkPoolWorker-15] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:52:40.663012622Z [2024-04-20 22:52:40,662: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:52:40.663111772Z [2024-04-20 22:52:40,662: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:52:40.663369490Z [2024-04-20 22:52:40,663: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:52:40.663457033Z [2024-04-20 22:52:40,663: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:52:40.668291169Z [2024-04-20 22:52:40,668: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:52:40.699453383Z [2024-04-20 22:52:40,696: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:52:40.737106306Z [2024-04-20 22:52:40,736: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:40.806398932Z [2024-04-20 22:52:40,806: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T22:52:40.810864813Z [2024-04-20 22:52:40,810: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:40.834811889Z [2024-04-20 22:52:40,834: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:52:40.836784456Z [2024-04-20 22:52:40,836: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T22:52:40.836976716Z [2024-04-20 22:52:40,836: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T22:52:40.837058246Z [2024-04-20 22:52:40,836: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T22:52:40.837279888Z [2024-04-20 22:52:40,837: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T22:52:40.960302376Z [2024-04-20 22:52:40,960: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:41.777409134Z [2024-04-20 22:52:41,777: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78989173-8e7f-42f2-b721-3d9dc471bf1b] succeeded in 1.5483851930000583s: None 2024-04-20T22:52:42.361409050Z [2024-04-20 22:52:42,361: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T22:52:42.364696958Z [2024-04-20 22:52:42,364: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:42.385631378Z [2024-04-20 22:52:42,385: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:52:42.386736231Z [2024-04-20 22:52:42,386: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:52:42.386763427Z [2024-04-20 22:52:42,386: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:52:42.386831597Z [2024-04-20 22:52:42,386: INFO/ForkPoolWorker-1] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:52:42.386946163Z [2024-04-20 22:52:42,386: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:52:42.386970522Z [2024-04-20 22:52:42,386: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T22:52:42.387208921Z [2024-04-20 22:52:42,387: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:52:42.387216400Z [2024-04-20 22:52:42,387: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:52:42.391462986Z [2024-04-20 22:52:42,391: INFO/ForkPoolWorker-1] Creating DAG vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:52:42.483948006Z [2024-04-20 22:52:42,483: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:42.846263136Z [2024-04-20 22:52:42,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[165e6031-71dc-4da0-9648-e5c5362339c2] succeeded in 3.960846591000063s: None 2024-04-20T22:52:44.004898412Z [2024-04-20 22:52:44,004: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9bdd823f-cb10-480a-a429-e3fe3835a11c] succeeded in 3.7633971079999355s: None 2024-04-20T22:52:55.175105432Z [2024-04-20 22:52:55,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1858284-813b-473b-bcd6-6f4a53194fc4] received 2024-04-20T22:52:55.184231935Z [2024-04-20 22:52:55,183: INFO/ForkPoolWorker-15] [f1858284-813b-473b-bcd6-6f4a53194fc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:52:55.475130555Z [2024-04-20 22:52:55,472: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:52:56.642061880Z [2024-04-20 22:52:56,641: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:52:56.645658359Z [2024-04-20 22:52:56,644: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:56.674270657Z [2024-04-20 22:52:56,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:52:56.675536143Z [2024-04-20 22:52:56,675: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:52:56.675636770Z [2024-04-20 22:52:56,675: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:52:56.675648143Z [2024-04-20 22:52:56,675: INFO/ForkPoolWorker-15] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:52:56.675769225Z [2024-04-20 22:52:56,675: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:52:56.675804230Z [2024-04-20 22:52:56,675: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:52:56.675912316Z [2024-04-20 22:52:56,675: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:52:56.675935444Z [2024-04-20 22:52:56,675: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:52:56.681218729Z [2024-04-20 22:52:56,680: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:52:56.752058448Z [2024-04-20 22:52:56,751: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:57.326021328Z [2024-04-20 22:52:57,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1858284-813b-473b-bcd6-6f4a53194fc4] succeeded in 2.1488975090001077s: None 2024-04-20T22:52:57.697760090Z [2024-04-20 22:52:57,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec512f3e-663e-426d-8b20-b977a2330164] received 2024-04-20T22:52:57.714843798Z [2024-04-20 22:52:57,714: INFO/ForkPoolWorker-15] [ec512f3e-663e-426d-8b20-b977a2330164] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'split_metrics', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:52:57.971318462Z [2024-04-20 22:52:57,968: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:52:59.034046098Z [2024-04-20 22:52:59,033: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:52:59.037574302Z [2024-04-20 22:52:59,037: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:52:59.065924755Z [2024-04-20 22:52:59,065: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:52:59.067474885Z [2024-04-20 22:52:59,067: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:52:59.067644887Z [2024-04-20 22:52:59,067: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:52:59.067854707Z [2024-04-20 22:52:59,067: INFO/ForkPoolWorker-15] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:52:59.068051651Z [2024-04-20 22:52:59,067: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:52:59.068205430Z [2024-04-20 22:52:59,068: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:52:59.068418335Z [2024-04-20 22:52:59,068: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:52:59.068487493Z [2024-04-20 22:52:59,068: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:52:59.076181283Z [2024-04-20 22:52:59,075: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:52:59.144995694Z [2024-04-20 22:52:59,144: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:52:59.789404207Z [2024-04-20 22:52:59,788: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec512f3e-663e-426d-8b20-b977a2330164] succeeded in 2.088490890999992s: None 2024-04-20T22:53:00.410024116Z [2024-04-20 22:53:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b123f854-dab1-409f-bfc5-828a9f3239cd] received 2024-04-20T22:53:00.417147129Z [2024-04-20 22:53:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f45acbee-c04c-4aeb-ac9a-cb5783899d5c] received 2024-04-20T22:53:00.418549013Z [2024-04-20 22:53:00,418: INFO/ForkPoolWorker-15] [b123f854-dab1-409f-bfc5-828a9f3239cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'collect_metrics', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T22:53:00.440456843Z [2024-04-20 22:53:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5313a71d-12e4-448d-9ca6-b86f6fafbca4] received 2024-04-20T22:53:00.445343400Z [2024-04-20 22:53:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afbe34af-6f64-455b-8121-5135841a9eb3] received 2024-04-20T22:53:00.451783652Z [2024-04-20 22:53:00,448: INFO/ForkPoolWorker-16] [f45acbee-c04c-4aeb-ac9a-cb5783899d5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:53:00.454626045Z [2024-04-20 22:53:00,454: INFO/ForkPoolWorker-1] [5313a71d-12e4-448d-9ca6-b86f6fafbca4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T22:53:00.526841686Z [2024-04-20 22:53:00,526: INFO/ForkPoolWorker-2] [afbe34af-6f64-455b-8121-5135841a9eb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:53:00.829894319Z [2024-04-20 22:53:00,826: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:53:00.875622747Z [2024-04-20 22:53:00,872: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:53:00.885196762Z [2024-04-20 22:53:00,882: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:53:01.050754972Z [2024-04-20 22:53:01,045: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T22:53:01.320878154Z [2024-04-20 22:53:01,318: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T22:53:01.328035241Z [2024-04-20 22:53:01,327: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:53:01.388067012Z [2024-04-20 22:53:01,387: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:53:01.393466466Z [2024-04-20 22:53:01,393: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T22:53:01.393566032Z [2024-04-20 22:53:01,393: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T22:53:01.393651196Z [2024-04-20 22:53:01,393: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T22:53:01.394070035Z [2024-04-20 22:53:01,393: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T22:53:01.630606423Z [2024-04-20 22:53:01,630: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:53:02.642338561Z [2024-04-20 22:53:02,641: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:53:02.645475916Z [2024-04-20 22:53:02,645: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:53:02.685897551Z [2024-04-20 22:53:02,685: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:53:02.692916598Z [2024-04-20 22:53:02,692: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:53:02.693033397Z [2024-04-20 22:53:02,692: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:53:02.693125043Z [2024-04-20 22:53:02,693: INFO/ForkPoolWorker-2] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:53:02.693327102Z [2024-04-20 22:53:02,693: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:53:02.693344474Z [2024-04-20 22:53:02,693: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:53:02.693584511Z [2024-04-20 22:53:02,693: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:53:02.693595981Z [2024-04-20 22:53:02,693: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:53:02.698096916Z [2024-04-20 22:53:02,697: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:53:02.719638713Z [2024-04-20 22:53:02,719: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5313a71d-12e4-448d-9ca6-b86f6fafbca4] succeeded in 2.277296170999989s: None 2024-04-20T22:53:02.787570816Z [2024-04-20 22:53:02,787: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:53:02.789918800Z [2024-04-20 22:53:02,789: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:53:02.798335383Z [2024-04-20 22:53:02,797: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:53:02.840639890Z [2024-04-20 22:53:02,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:53:02.844826475Z [2024-04-20 22:53:02,844: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:53:02.844838582Z [2024-04-20 22:53:02,844: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:53:02.844976579Z [2024-04-20 22:53:02,844: INFO/ForkPoolWorker-15] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:53:02.845150695Z [2024-04-20 22:53:02,844: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:53:02.845210536Z [2024-04-20 22:53:02,845: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:53:02.845465495Z [2024-04-20 22:53:02,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:53:02.845541425Z [2024-04-20 22:53:02,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:53:02.851951985Z [2024-04-20 22:53:02,851: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:53:02.948878636Z [2024-04-20 22:53:02,948: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:53:02.955273507Z [2024-04-20 22:53:02,954: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:53:02.959058029Z [2024-04-20 22:53:02,958: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:53:02.994351358Z [2024-04-20 22:53:02,994: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:53:02.998115213Z [2024-04-20 22:53:02,997: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:53:02.998238606Z [2024-04-20 22:53:02,998: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:53:02.998688184Z [2024-04-20 22:53:02,998: INFO/ForkPoolWorker-16] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:53:02.998967219Z [2024-04-20 22:53:02,998: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:53:02.999085989Z [2024-04-20 22:53:02,998: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:53:02.999717438Z [2024-04-20 22:53:02,999: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:53:02.999897521Z [2024-04-20 22:53:02,999: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:53:03.008922026Z [2024-04-20 22:53:03,008: INFO/ForkPoolWorker-16] Creating DAG vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:53:03.140038799Z [2024-04-20 22:53:03,139: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:53:03.747739306Z [2024-04-20 22:53:03,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b123f854-dab1-409f-bfc5-828a9f3239cd] succeeded in 3.335848143000021s: None 2024-04-20T22:53:04.374354354Z [2024-04-20 22:53:04,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eef16723-8b4b-44cc-a4b3-78047636b6b4] received 2024-04-20T22:53:04.383515341Z [2024-04-20 22:53:04,383: INFO/ForkPoolWorker-15] [eef16723-8b4b-44cc-a4b3-78047636b6b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'send_prometheus', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:53:04.770022510Z [2024-04-20 22:53:04,767: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:53:05.242968850Z [2024-04-20 22:53:05,242: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[afbe34af-6f64-455b-8121-5135841a9eb3] succeeded in 4.794145112000024s: None 2024-04-20T22:53:05.245677591Z [2024-04-20 22:53:05,245: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f45acbee-c04c-4aeb-ac9a-cb5783899d5c] succeeded in 4.822394583999994s: None 2024-04-20T22:53:05.987614511Z [2024-04-20 22:53:05,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:53:05.990832232Z [2024-04-20 22:53:05,990: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:53:06.024078751Z [2024-04-20 22:53:06,023: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:53:06.025657166Z [2024-04-20 22:53:06,025: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:53:06.025673581Z [2024-04-20 22:53:06,025: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:53:06.025683828Z [2024-04-20 22:53:06,025: INFO/ForkPoolWorker-15] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:53:06.025882070Z [2024-04-20 22:53:06,025: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:53:06.025986813Z [2024-04-20 22:53:06,025: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:53:06.026248364Z [2024-04-20 22:53:06,026: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:53:06.026397960Z [2024-04-20 22:53:06,026: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:53:06.032758062Z [2024-04-20 22:53:06,032: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:53:06.140170212Z [2024-04-20 22:53:06,139: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:53:06.689115156Z [2024-04-20 22:53:06,688: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eef16723-8b4b-44cc-a4b3-78047636b6b4] succeeded in 2.313433391999979s: None 2024-04-20T22:53:11.759727985Z [2024-04-20 22:53:11,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1d4824d-9f69-4d5d-a2a9-c41d8cca9e0c] received 2024-04-20T22:53:11.796485406Z [2024-04-20 22:53:11,796: INFO/ForkPoolWorker-15] [d1d4824d-9f69-4d5d-a2a9-c41d8cca9e0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:53:11.925538965Z [2024-04-20 22:53:11,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22e096c6-8970-4375-997b-d7daf387917a] received 2024-04-20T22:53:11.966529253Z [2024-04-20 22:53:11,966: INFO/ForkPoolWorker-16] [22e096c6-8970-4375-997b-d7daf387917a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:53:12.213874753Z [2024-04-20 22:53:12,210: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:53:12.345535222Z [2024-04-20 22:53:12,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:53:13.517641011Z [2024-04-20 22:53:13,517: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:53:13.520987611Z [2024-04-20 22:53:13,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:53:13.554239389Z [2024-04-20 22:53:13,554: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:53:13.556361211Z [2024-04-20 22:53:13,556: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:53:13.557582543Z [2024-04-20 22:53:13,557: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:53:13.558445082Z [2024-04-20 22:53:13,558: INFO/ForkPoolWorker-15] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:53:13.558586263Z [2024-04-20 22:53:13,558: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:53:13.563369213Z [2024-04-20 22:53:13,563: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:53:13.563817147Z [2024-04-20 22:53:13,563: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:53:13.568124472Z [2024-04-20 22:53:13,567: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:53:13.579026342Z [2024-04-20 22:53:13,578: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:53:13.688259638Z [2024-04-20 22:53:13,683: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:53:13.698067272Z [2024-04-20 22:53:13,697: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:53:13.701273548Z [2024-04-20 22:53:13,700: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:53:13.719669917Z [2024-04-20 22:53:13,719: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:53:13.721448525Z [2024-04-20 22:53:13,721: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:53:13.721682287Z [2024-04-20 22:53:13,721: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:53:13.721870894Z [2024-04-20 22:53:13,721: INFO/ForkPoolWorker-16] Read VIM 9ddf6c24-59d7-471b-add2-4d9cb922c5b5 (basic01_533976) 2024-04-20T22:53:13.722122379Z [2024-04-20 22:53:13,721: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'name': 'basic01_533976', 'vim_type': 'openstack'}] 2024-04-20T22:53:13.722316252Z [2024-04-20 22:53:13,722: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:53:13.722644973Z [2024-04-20 22:53:13,722: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:53:13.723897492Z [2024-04-20 22:53:13,722: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:53:13.743020467Z [2024-04-20 22:53:13,742: INFO/ForkPoolWorker-16] Creating DAG vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5 2024-04-20T22:53:13.846778626Z [2024-04-20 22:53:13,846: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:53:15.364875239Z [2024-04-20 22:53:15,364: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22e096c6-8970-4375-997b-d7daf387917a] succeeded in 3.409886809999989s: None 2024-04-20T22:53:15.664324574Z [2024-04-20 22:53:15,663: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1d4824d-9f69-4d5d-a2a9-c41d8cca9e0c] succeeded in 3.8932084170000962s: None 2024-04-20T22:53:58.152224517Z [2024-04-20 22:53:58,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e559079-85c8-40a9-bc27-98b9017fb1d8] received 2024-04-20T22:53:58.161984918Z [2024-04-20 22:53:58,161: INFO/ForkPoolWorker-15] [7e559079-85c8-40a9-bc27-98b9017fb1d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:53:58.473089454Z [2024-04-20 22:53:58,469: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:53:59.673647506Z [2024-04-20 22:53:59,673: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:53:59.685027872Z [2024-04-20 22:53:59,684: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:53:59.705103257Z [2024-04-20 22:53:59,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:53:59.706205503Z [2024-04-20 22:53:59,706: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:53:59.706215428Z [2024-04-20 22:53:59,706: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:53:59.706327152Z [2024-04-20 22:53:59,706: INFO/ForkPoolWorker-15] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:53:59.706460474Z [2024-04-20 22:53:59,706: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:53:59.706492022Z [2024-04-20 22:53:59,706: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:53:59.706724184Z [2024-04-20 22:53:59,706: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:53:59.706802629Z [2024-04-20 22:53:59,706: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:53:59.712596292Z [2024-04-20 22:53:59,712: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:53:59.789159040Z [2024-04-20 22:53:59,788: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:00.409089494Z [2024-04-20 22:54:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f7e8c3f-d25a-4342-b020-4105f46a94b0] received 2024-04-20T22:54:00.414712757Z [2024-04-20 22:54:00,414: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e559079-85c8-40a9-bc27-98b9017fb1d8] succeeded in 2.260927615000128s: None 2024-04-20T22:54:00.419737387Z [2024-04-20 22:54:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0d50cb5-c0e5-45e0-9c97-3b010661b177] received 2024-04-20T22:54:00.423776151Z [2024-04-20 22:54:00,423: INFO/ForkPoolWorker-16] [3f7e8c3f-d25a-4342-b020-4105f46a94b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'split_metrics', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:54:00.424135877Z [2024-04-20 22:54:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b149ae1-3fe3-438f-bae7-cb7e035cf17e] received 2024-04-20T22:54:00.434389721Z [2024-04-20 22:54:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f554744e-3614-4a0b-a597-cf7d868cdb8e] received 2024-04-20T22:54:00.437057242Z [2024-04-20 22:54:00,436: INFO/ForkPoolWorker-1] [7b149ae1-3fe3-438f-bae7-cb7e035cf17e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:54:00.441046367Z [2024-04-20 22:54:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f7705fa-f7ce-4e54-bdf0-5fb47dfe0724] received 2024-04-20T22:54:00.445728967Z [2024-04-20 22:54:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c5da127-e0f9-4564-8343-ba7a79300a3f] received 2024-04-20T22:54:00.457275508Z [2024-04-20 22:54:00,455: INFO/ForkPoolWorker-15] [f0d50cb5-c0e5-45e0-9c97-3b010661b177] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:54:00.464828194Z [2024-04-20 22:54:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c9e0d6a-6042-4ca1-aff5-fb513645edb6] received 2024-04-20T22:54:00.472740223Z [2024-04-20 22:54:00,472: INFO/ForkPoolWorker-2] [f554744e-3614-4a0b-a597-cf7d868cdb8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:54:00.501032753Z [2024-04-20 22:54:00,500: INFO/ForkPoolWorker-4] [6c5da127-e0f9-4564-8343-ba7a79300a3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:54:00.561837703Z [2024-04-20 22:54:00,561: INFO/ForkPoolWorker-3] [1f7705fa-f7ce-4e54-bdf0-5fb47dfe0724] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:54:00.565252416Z [2024-04-20 22:54:00,564: INFO/ForkPoolWorker-5] [9c9e0d6a-6042-4ca1-aff5-fb513645edb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T22:54:00.849476282Z [2024-04-20 22:54:00,842: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:54:01.022727524Z [2024-04-20 22:54:01,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:54:01.135399923Z [2024-04-20 22:54:01,125: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:54:01.284427811Z [2024-04-20 22:54:01,277: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:54:01.292545968Z [2024-04-20 22:54:01,276: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:54:01.430777490Z [2024-04-20 22:54:01,427: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:54:01.527861441Z [2024-04-20 22:54:01,499: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T22:54:01.787747966Z [2024-04-20 22:54:01,787: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:01.868457373Z [2024-04-20 22:54:01,867: INFO/ForkPoolWorker-5] Getting SDNC list 2024-04-20T22:54:01.876098120Z [2024-04-20 22:54:01,875: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:01.963263013Z [2024-04-20 22:54:01,963: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-20T22:54:01.965584795Z [2024-04-20 22:54:01,965: INFO/ForkPoolWorker-5] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T22:54:01.965704864Z [2024-04-20 22:54:01,965: INFO/ForkPoolWorker-5] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T22:54:01.965831026Z [2024-04-20 22:54:01,965: INFO/ForkPoolWorker-5] Getting SDNC list OK 2024-04-20T22:54:01.967760120Z [2024-04-20 22:54:01,966: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T22:54:02.092124639Z [2024-04-20 22:54:02,091: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:02.957071852Z [2024-04-20 22:54:02,956: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[9c9e0d6a-6042-4ca1-aff5-fb513645edb6] succeeded in 2.488864874000001s: None 2024-04-20T22:54:02.960134308Z [2024-04-20 22:54:02,959: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7b149ae1-3fe3-438f-bae7-cb7e035cf17e] succeeded in 2.5316493959999207s: None 2024-04-20T22:54:03.667375370Z [2024-04-20 22:54:03,667: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:54:03.677407959Z [2024-04-20 22:54:03,676: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:03.761318803Z [2024-04-20 22:54:03,761: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:54:03.773122951Z [2024-04-20 22:54:03,772: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:03.775768696Z [2024-04-20 22:54:03,773: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:03.775780492Z [2024-04-20 22:54:03,773: INFO/ForkPoolWorker-15] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:03.775796429Z [2024-04-20 22:54:03,773: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:03.775800697Z [2024-04-20 22:54:03,773: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:54:03.775803497Z [2024-04-20 22:54:03,773: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:54:03.775807163Z [2024-04-20 22:54:03,773: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:03.779899005Z [2024-04-20 22:54:03,778: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:03.787770026Z [2024-04-20 22:54:03,786: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:54:03.787785270Z [2024-04-20 22:54:03,786: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:54:03.793805190Z [2024-04-20 22:54:03,793: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:54:03.802419775Z [2024-04-20 22:54:03,802: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:03.884579181Z [2024-04-20 22:54:03,884: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:54:03.887081505Z [2024-04-20 22:54:03,886: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:03.887299927Z [2024-04-20 22:54:03,887: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:03.887414971Z [2024-04-20 22:54:03,887: INFO/ForkPoolWorker-15] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:03.888245609Z [2024-04-20 22:54:03,887: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:03.891718452Z [2024-04-20 22:54:03,888: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:54:03.891731258Z [2024-04-20 22:54:03,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:54:03.891734759Z [2024-04-20 22:54:03,889: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:03.892043118Z [2024-04-20 22:54:03,891: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:03.895743077Z [2024-04-20 22:54:03,895: ERROR/ForkPoolWorker-15] [f0d50cb5-c0e5-45e0-9c97-3b010661b177] Failed to execute task Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:54:03.895757561Z Traceback (most recent call last): 2024-04-20T22:54:03.895762169Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:54:03.895766373Z args.func(args) 2024-04-20T22:54:03.895781612Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:54:03.895785856Z return func(*args, **kwargs) 2024-04-20T22:54:03.895789185Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:54:03.895792074Z return f(*args, **kwargs) 2024-04-20T22:54:03.895795078Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:54:03.895798181Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:54:03.895801065Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:54:03.895803933Z raise AirflowException( 2024-04-20T22:54:03.895808055Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:54:03.917803519Z [2024-04-20 22:54:03,917: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:54:03.931225272Z [2024-04-20 22:54:03,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:04.069370610Z [2024-04-20 22:54:04,069: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:54:04.070520984Z [2024-04-20 22:54:04,070: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T22:54:04.073750672Z [2024-04-20 22:54:04,073: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:04.073910127Z [2024-04-20 22:54:04,073: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:04.074163060Z [2024-04-20 22:54:04,074: INFO/ForkPoolWorker-16] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:04.074663443Z [2024-04-20 22:54:04,074: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:04.075099688Z [2024-04-20 22:54:04,074: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:04.075263902Z [2024-04-20 22:54:04,075: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:54:04.075621800Z [2024-04-20 22:54:04,075: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:54:04.075853374Z [2024-04-20 22:54:04,075: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:04.087994413Z [2024-04-20 22:54:04,087: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:04.099322384Z [2024-04-20 22:54:04,098: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0d50cb5-c0e5-45e0-9c97-3b010661b177] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f0d50cb5-c0e5-45e0-9c97-3b010661b177') 2024-04-20T22:54:04.099339566Z Traceback (most recent call last): 2024-04-20T22:54:04.099343644Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:54:04.099377162Z R = retval = fun(*args, **kwargs) 2024-04-20T22:54:04.099380505Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:54:04.099383464Z return self.run(*args, **kwargs) 2024-04-20T22:54:04.099386951Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:54:04.099391338Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:54:04.099394322Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:54:04.099398608Z raise AirflowException(msg) 2024-04-20T22:54:04.099402728Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f0d50cb5-c0e5-45e0-9c97-3b010661b177 2024-04-20T22:54:04.114214871Z [2024-04-20 22:54:04,114: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T22:54:04.122010947Z [2024-04-20 22:54:04,120: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:04.123336694Z [2024-04-20 22:54:04,122: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:04.123509627Z [2024-04-20 22:54:04,123: INFO/ForkPoolWorker-3] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:04.124070596Z [2024-04-20 22:54:04,123: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:04.124211130Z [2024-04-20 22:54:04,124: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T22:54:04.124695485Z [2024-04-20 22:54:04,124: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:54:04.125807105Z [2024-04-20 22:54:04,124: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:04.131317583Z [2024-04-20 22:54:04,131: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:04.194154286Z [2024-04-20 22:54:04,193: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:54:04.198358467Z [2024-04-20 22:54:04,197: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:04.252916909Z [2024-04-20 22:54:04,252: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:54:04.255520649Z [2024-04-20 22:54:04,255: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:04.255536853Z [2024-04-20 22:54:04,255: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:04.255549294Z [2024-04-20 22:54:04,255: INFO/ForkPoolWorker-2] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:04.255749276Z [2024-04-20 22:54:04,255: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:04.255760874Z [2024-04-20 22:54:04,255: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:54:04.256066258Z [2024-04-20 22:54:04,255: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:54:04.256107034Z [2024-04-20 22:54:04,256: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:04.268378797Z [2024-04-20 22:54:04,268: INFO/ForkPoolWorker-2] Creating DAG vim_status_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:04.277021524Z [2024-04-20 22:54:04,276: WARNING/ForkPoolWorker-2] Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:54:04.279535712Z [2024-04-20 22:54:04,278: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:54:04.282648333Z [2024-04-20 22:54:04,282: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:54:04.285354622Z [2024-04-20 22:54:04,285: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:04.306707429Z [2024-04-20 22:54:04,306: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:04.309799545Z [2024-04-20 22:54:04,309: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:54:04.310820386Z [2024-04-20 22:54:04,310: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:04.323867936Z [2024-04-20 22:54:04,323: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:04.323883987Z [2024-04-20 22:54:04,323: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:04.324296991Z [2024-04-20 22:54:04,323: INFO/ForkPoolWorker-2] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:04.325965057Z [2024-04-20 22:54:04,324: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:04.326095894Z [2024-04-20 22:54:04,325: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:54:04.326377207Z [2024-04-20 22:54:04,326: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:54:04.326382522Z [2024-04-20 22:54:04,326: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:04.331462665Z [2024-04-20 22:54:04,331: INFO/ForkPoolWorker-2] Creating DAG vim_status_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:04.340813530Z [2024-04-20 22:54:04,338: ERROR/ForkPoolWorker-2] [f554744e-3614-4a0b-a597-cf7d868cdb8e] Failed to execute task Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:54:04.340825971Z Traceback (most recent call last): 2024-04-20T22:54:04.340829979Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:54:04.340835296Z args.func(args) 2024-04-20T22:54:04.340850975Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:54:04.340854818Z return func(*args, **kwargs) 2024-04-20T22:54:04.340870263Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:54:04.340873258Z return f(*args, **kwargs) 2024-04-20T22:54:04.340876183Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:54:04.340879446Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:54:04.340882378Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:54:04.340885443Z raise AirflowException( 2024-04-20T22:54:04.340890014Z airflow.exceptions.AirflowException: Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:54:04.416315281Z [2024-04-20 22:54:04,415: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f554744e-3614-4a0b-a597-cf7d868cdb8e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f554744e-3614-4a0b-a597-cf7d868cdb8e') 2024-04-20T22:54:04.416332773Z Traceback (most recent call last): 2024-04-20T22:54:04.416337181Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:54:04.416340318Z R = retval = fun(*args, **kwargs) 2024-04-20T22:54:04.416343459Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:54:04.416347224Z return self.run(*args, **kwargs) 2024-04-20T22:54:04.416363352Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:54:04.416367738Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:54:04.416370802Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:54:04.416374293Z raise AirflowException(msg) 2024-04-20T22:54:04.416378385Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f554744e-3614-4a0b-a597-cf7d868cdb8e 2024-04-20T22:54:05.031766321Z [2024-04-20 22:54:05,031: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-20T22:54:05.035379756Z [2024-04-20 22:54:05,034: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:05.055791066Z [2024-04-20 22:54:05,055: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-20T22:54:05.056972152Z [2024-04-20 22:54:05,056: INFO/ForkPoolWorker-4] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:05.057063661Z [2024-04-20 22:54:05,056: INFO/ForkPoolWorker-4] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:05.057211897Z [2024-04-20 22:54:05,057: INFO/ForkPoolWorker-4] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:05.069336904Z [2024-04-20 22:54:05,065: INFO/ForkPoolWorker-4] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:05.069383291Z [2024-04-20 22:54:05,066: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-20T22:54:05.069388068Z [2024-04-20 22:54:05,066: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:54:05.069391123Z [2024-04-20 22:54:05,066: INFO/ForkPoolWorker-4] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:05.072012664Z [2024-04-20 22:54:05,071: INFO/ForkPoolWorker-4] Creating DAG vim_status_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:05.087250443Z [2024-04-20 22:54:05,086: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f7e8c3f-d25a-4342-b020-4105f46a94b0] succeeded in 4.6733479160000115s: None 2024-04-20T22:54:05.160804928Z [2024-04-20 22:54:05,160: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:05.576414362Z [2024-04-20 22:54:05,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a40688ae-ba14-41f2-822b-56694df09217] received 2024-04-20T22:54:05.582495309Z [2024-04-20 22:54:05,581: INFO/ForkPoolWorker-15] [a40688ae-ba14-41f2-822b-56694df09217] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'collect_metrics', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T22:54:05.909551446Z [2024-04-20 22:54:05,906: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:54:06.531878450Z [2024-04-20 22:54:06,531: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1f7705fa-f7ce-4e54-bdf0-5fb47dfe0724] succeeded in 6.0875514110000495s: None 2024-04-20T22:54:06.718501267Z [2024-04-20 22:54:06,718: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[6c5da127-e0f9-4564-8343-ba7a79300a3f] succeeded in 6.270354176999945s: None 2024-04-20T22:54:07.310607806Z [2024-04-20 22:54:07,310: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:54:07.313910072Z [2024-04-20 22:54:07,313: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:07.343067166Z [2024-04-20 22:54:07,342: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:54:07.344250369Z [2024-04-20 22:54:07,343: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:07.344271617Z [2024-04-20 22:54:07,344: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:07.344302336Z [2024-04-20 22:54:07,344: INFO/ForkPoolWorker-15] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:07.344417105Z [2024-04-20 22:54:07,344: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:07.344528168Z [2024-04-20 22:54:07,344: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:54:07.344765423Z [2024-04-20 22:54:07,344: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:54:07.344777160Z [2024-04-20 22:54:07,344: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:07.350617346Z [2024-04-20 22:54:07,350: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:07.427165254Z [2024-04-20 22:54:07,426: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:07.936935099Z [2024-04-20 22:54:07,936: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a40688ae-ba14-41f2-822b-56694df09217] succeeded in 2.359174583999902s: None 2024-04-20T22:54:08.296235660Z [2024-04-20 22:54:08,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd97d548-17b3-4444-b5da-dbf04d6ae031] received 2024-04-20T22:54:08.307140663Z [2024-04-20 22:54:08,306: INFO/ForkPoolWorker-15] [cd97d548-17b3-4444-b5da-dbf04d6ae031] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'send_prometheus', 'scheduled__2024-04-20T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:54:08.595150053Z [2024-04-20 22:54:08,592: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:54:09.737082421Z [2024-04-20 22:54:09,736: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:54:09.740681741Z [2024-04-20 22:54:09,740: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:09.759429585Z [2024-04-20 22:54:09,759: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:54:09.761015189Z [2024-04-20 22:54:09,760: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:09.761078012Z [2024-04-20 22:54:09,760: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:09.761266678Z [2024-04-20 22:54:09,761: INFO/ForkPoolWorker-15] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:09.761519302Z [2024-04-20 22:54:09,761: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:09.761596389Z [2024-04-20 22:54:09,761: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:54:09.762056880Z [2024-04-20 22:54:09,761: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:54:09.762244593Z [2024-04-20 22:54:09,762: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:09.768397530Z [2024-04-20 22:54:09,768: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:09.848407111Z [2024-04-20 22:54:09,848: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:10.371042228Z [2024-04-20 22:54:10,370: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd97d548-17b3-4444-b5da-dbf04d6ae031] succeeded in 2.070998280999902s: None 2024-04-20T22:54:14.692892451Z [2024-04-20 22:54:14,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8f6b1f3-1fd9-44ac-9c9a-95359b90a689] received 2024-04-20T22:54:14.704020286Z [2024-04-20 22:54:14,703: INFO/ForkPoolWorker-15] [f8f6b1f3-1fd9-44ac-9c9a-95359b90a689] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:54:15.106530981Z [2024-04-20 22:54:15,103: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:54:16.166751735Z [2024-04-20 22:54:16,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d274ce1-2071-4605-926b-15822635d396] received 2024-04-20T22:54:16.206722599Z [2024-04-20 22:54:16,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52a1a6ac-fa66-4503-9ac2-0b7eff1e7629] received 2024-04-20T22:54:16.214677071Z [2024-04-20 22:54:16,210: INFO/ForkPoolWorker-16] [4d274ce1-2071-4605-926b-15822635d396] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:54:16.214694649Z [2024-04-20 22:54:16,212: INFO/ForkPoolWorker-1] [52a1a6ac-fa66-4503-9ac2-0b7eff1e7629] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:54:16.530015311Z [2024-04-20 22:54:16,529: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:54:16.533654727Z [2024-04-20 22:54:16,533: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:16.579842412Z [2024-04-20 22:54:16,579: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:54:16.581990937Z [2024-04-20 22:54:16,581: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:16.582547587Z [2024-04-20 22:54:16,582: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:16.582761919Z [2024-04-20 22:54:16,582: INFO/ForkPoolWorker-15] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:16.583061167Z [2024-04-20 22:54:16,582: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:16.583176565Z [2024-04-20 22:54:16,583: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:54:16.583553681Z [2024-04-20 22:54:16,583: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:54:16.583863765Z [2024-04-20 22:54:16,583: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:16.588571297Z [2024-04-20 22:54:16,588: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:16.593910177Z [2024-04-20 22:54:16,593: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:54:16.594966029Z [2024-04-20 22:54:16,594: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:54:16.595958419Z [2024-04-20 22:54:16,595: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:54:16.598735663Z [2024-04-20 22:54:16,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:16.600253467Z [2024-04-20 22:54:16,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95e898b3-88b6-4170-a2d9-865e4ad98d3a] received 2024-04-20T22:54:16.619986197Z [2024-04-20 22:54:16,619: INFO/ForkPoolWorker-2] [95e898b3-88b6-4170-a2d9-865e4ad98d3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:54:16.626132713Z [2024-04-20 22:54:16,625: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:54:16.627289964Z [2024-04-20 22:54:16,627: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:16.627392899Z [2024-04-20 22:54:16,627: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:16.627452590Z [2024-04-20 22:54:16,627: INFO/ForkPoolWorker-15] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:16.627621084Z [2024-04-20 22:54:16,627: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:16.627743814Z [2024-04-20 22:54:16,627: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:54:16.627927532Z [2024-04-20 22:54:16,627: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:54:16.628002940Z [2024-04-20 22:54:16,627: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:16.629895146Z [2024-04-20 22:54:16,629: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:16.633347910Z [2024-04-20 22:54:16,632: ERROR/ForkPoolWorker-15] [f8f6b1f3-1fd9-44ac-9c9a-95359b90a689] Failed to execute task Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:54:16.633359552Z Traceback (most recent call last): 2024-04-20T22:54:16.633366059Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:54:16.633369405Z args.func(args) 2024-04-20T22:54:16.633372764Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:54:16.633375748Z return func(*args, **kwargs) 2024-04-20T22:54:16.633378492Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:54:16.633381475Z return f(*args, **kwargs) 2024-04-20T22:54:16.633384296Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:54:16.633387187Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:54:16.633407685Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:54:16.633410709Z raise AirflowException( 2024-04-20T22:54:16.633414735Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:54:16.692306035Z [2024-04-20 22:54:16,691: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8f6b1f3-1fd9-44ac-9c9a-95359b90a689] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f8f6b1f3-1fd9-44ac-9c9a-95359b90a689') 2024-04-20T22:54:16.692318824Z Traceback (most recent call last): 2024-04-20T22:54:16.692322416Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:54:16.692325169Z R = retval = fun(*args, **kwargs) 2024-04-20T22:54:16.692328089Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:54:16.692331041Z return self.run(*args, **kwargs) 2024-04-20T22:54:16.692334387Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:54:16.692338246Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:54:16.692341032Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:54:16.692343963Z raise AirflowException(msg) 2024-04-20T22:54:16.692347997Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f8f6b1f3-1fd9-44ac-9c9a-95359b90a689 2024-04-20T22:54:16.777076453Z [2024-04-20 22:54:16,766: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:54:16.801266451Z [2024-04-20 22:54:16,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:54:17.019601709Z [2024-04-20 22:54:16,999: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:54:18.184866435Z [2024-04-20 22:54:18,184: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:54:18.188450999Z [2024-04-20 22:54:18,187: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:18.199552942Z [2024-04-20 22:54:18,199: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T22:54:18.203401734Z [2024-04-20 22:54:18,203: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:18.225386276Z [2024-04-20 22:54:18,225: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:54:18.226383704Z [2024-04-20 22:54:18,226: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:18.226404952Z [2024-04-20 22:54:18,226: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:18.226516600Z [2024-04-20 22:54:18,226: INFO/ForkPoolWorker-1] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:18.226665885Z [2024-04-20 22:54:18,226: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:18.226696821Z [2024-04-20 22:54:18,226: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T22:54:18.227001367Z [2024-04-20 22:54:18,226: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:54:18.227013836Z [2024-04-20 22:54:18,226: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:18.231931237Z [2024-04-20 22:54:18,231: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:18.232767432Z [2024-04-20 22:54:18,232: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:54:18.234903793Z [2024-04-20 22:54:18,234: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:18.234915476Z [2024-04-20 22:54:18,234: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:18.234929837Z [2024-04-20 22:54:18,234: INFO/ForkPoolWorker-16] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:18.235110436Z [2024-04-20 22:54:18,234: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:18.235122450Z [2024-04-20 22:54:18,235: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:54:18.235264716Z [2024-04-20 22:54:18,235: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:54:18.235299646Z [2024-04-20 22:54:18,235: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:18.240477037Z [2024-04-20 22:54:18,240: INFO/ForkPoolWorker-16] Creating DAG vim_status_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:18.245253536Z [2024-04-20 22:54:18,245: WARNING/ForkPoolWorker-16] Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:54:18.245921670Z [2024-04-20 22:54:18,245: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:54:18.246608686Z [2024-04-20 22:54:18,246: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:54:18.249643460Z [2024-04-20 22:54:18,249: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:18.280660582Z [2024-04-20 22:54:18,280: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:54:18.284256902Z [2024-04-20 22:54:18,284: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:18.284358832Z [2024-04-20 22:54:18,284: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:18.284453145Z [2024-04-20 22:54:18,284: INFO/ForkPoolWorker-16] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:18.284620363Z [2024-04-20 22:54:18,284: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:18.284695000Z [2024-04-20 22:54:18,284: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:54:18.284946732Z [2024-04-20 22:54:18,284: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:54:18.285036653Z [2024-04-20 22:54:18,284: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:18.287013312Z [2024-04-20 22:54:18,286: INFO/ForkPoolWorker-16] Creating DAG vim_status_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:18.291648223Z [2024-04-20 22:54:18,291: ERROR/ForkPoolWorker-16] [4d274ce1-2071-4605-926b-15822635d396] Failed to execute task Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:54:18.291655787Z Traceback (most recent call last): 2024-04-20T22:54:18.291659279Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:54:18.291662830Z args.func(args) 2024-04-20T22:54:18.291666364Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:54:18.291669432Z return func(*args, **kwargs) 2024-04-20T22:54:18.291736365Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:54:18.291739646Z return f(*args, **kwargs) 2024-04-20T22:54:18.291742494Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:54:18.291745535Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:54:18.291748361Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:54:18.291751297Z raise AirflowException( 2024-04-20T22:54:18.291754749Z airflow.exceptions.AirflowException: Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:54:18.311181596Z [2024-04-20 22:54:18,309: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:18.338034340Z [2024-04-20 22:54:18,337: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d274ce1-2071-4605-926b-15822635d396] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4d274ce1-2071-4605-926b-15822635d396') 2024-04-20T22:54:18.338051999Z Traceback (most recent call last): 2024-04-20T22:54:18.338057143Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:54:18.338062135Z R = retval = fun(*args, **kwargs) 2024-04-20T22:54:18.338066479Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:54:18.338071009Z return self.run(*args, **kwargs) 2024-04-20T22:54:18.338117126Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:54:18.338122889Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:54:18.338127085Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:54:18.338145830Z raise AirflowException(msg) 2024-04-20T22:54:18.338151434Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4d274ce1-2071-4605-926b-15822635d396 2024-04-20T22:54:18.370121124Z [2024-04-20 22:54:18,369: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:54:18.373793399Z [2024-04-20 22:54:18,373: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:54:18.403603227Z [2024-04-20 22:54:18,403: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:54:18.409047714Z [2024-04-20 22:54:18,408: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:54:18.409161863Z [2024-04-20 22:54:18,409: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:54:18.409575414Z [2024-04-20 22:54:18,409: INFO/ForkPoolWorker-2] Read VIM 7e5df66a-64d4-4678-8e20-794872028ce3 (basic01_627169) 2024-04-20T22:54:18.410067842Z [2024-04-20 22:54:18,409: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7e5df66a-64d4-4678-8e20-794872028ce3', 'name': 'basic01_627169', 'vim_type': 'openstack'}] 2024-04-20T22:54:18.410212261Z [2024-04-20 22:54:18,410: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:54:18.410464417Z [2024-04-20 22:54:18,410: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:54:18.410557824Z [2024-04-20 22:54:18,410: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:54:18.415040494Z [2024-04-20 22:54:18,414: INFO/ForkPoolWorker-2] Creating DAG vim_status_7e5df66a-64d4-4678-8e20-794872028ce3 2024-04-20T22:54:18.500590021Z [2024-04-20 22:54:18,500: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:54:19.968388575Z [2024-04-20 22:54:19,968: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95e898b3-88b6-4170-a2d9-865e4ad98d3a] succeeded in 3.3665981049998663s: None 2024-04-20T22:54:20.027060283Z [2024-04-20 22:54:20,026: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52a1a6ac-fa66-4503-9ac2-0b7eff1e7629] succeeded in 3.8320240610000837s: None 2024-04-20T22:55:00.951235970Z [2024-04-20 22:55:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[660b6da6-71e3-4836-a852-83174b11a9e1] received 2024-04-20T22:55:00.957283031Z [2024-04-20 22:55:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be6a5b24-358f-4492-9035-f1ae73e7e3de] received 2024-04-20T22:55:00.963654676Z [2024-04-20 22:55:00,963: INFO/ForkPoolWorker-15] [660b6da6-71e3-4836-a852-83174b11a9e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:55:00.971925825Z [2024-04-20 22:55:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e83a5b9-6102-4148-b900-fe8cbf8e2f40] received 2024-04-20T22:55:00.978930904Z [2024-04-20 22:55:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6eb4edd2-2436-4ca1-8bcd-ad91b8e139e5] received 2024-04-20T22:55:00.985945680Z [2024-04-20 22:55:00,985: INFO/ForkPoolWorker-16] [be6a5b24-358f-4492-9035-f1ae73e7e3de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:55:00.993961445Z [2024-04-20 22:55:00,993: INFO/ForkPoolWorker-2] [6eb4edd2-2436-4ca1-8bcd-ad91b8e139e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:55:00.995100678Z [2024-04-20 22:55:00,994: INFO/ForkPoolWorker-1] [6e83a5b9-6102-4148-b900-fe8cbf8e2f40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:55:01.013279395Z [2024-04-20 22:55:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e49aefb7-303b-4a91-8854-ed6926add629] received 2024-04-20T22:55:01.017981618Z [2024-04-20 22:55:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc99cfab-9422-45ff-8db5-faed92c22771] received 2024-04-20T22:55:01.025892963Z [2024-04-20 22:55:01,025: INFO/ForkPoolWorker-3] [e49aefb7-303b-4a91-8854-ed6926add629] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:55:01.035105033Z [2024-04-20 22:55:01,034: INFO/ForkPoolWorker-4] [cc99cfab-9422-45ff-8db5-faed92c22771] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T22:55:01.085969255Z [2024-04-20 22:55:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cc6f227-89fd-4f73-8270-aa539e2b55b8] received 2024-04-20T22:55:01.099766584Z [2024-04-20 22:55:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6915382e-b674-4d5a-af8d-006883e64551] received 2024-04-20T22:55:01.131873666Z [2024-04-20 22:55:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a73dd49-1941-4509-91dc-a5879d486d88] received 2024-04-20T22:55:01.150675330Z [2024-04-20 22:55:01,140: INFO/ForkPoolWorker-5] [8cc6f227-89fd-4f73-8270-aa539e2b55b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:55:01.150701795Z [2024-04-20 22:55:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6885e05d-576d-454e-9902-c9b03fcb5f98] received 2024-04-20T22:55:01.264336788Z [2024-04-20 22:55:01,263: INFO/ForkPoolWorker-7] [8a73dd49-1941-4509-91dc-a5879d486d88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:55:01.374121882Z [2024-04-20 22:55:01,372: INFO/ForkPoolWorker-6] [6915382e-b674-4d5a-af8d-006883e64551] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:55:01.477156161Z [2024-04-20 22:55:01,476: INFO/ForkPoolWorker-8] [6885e05d-576d-454e-9902-c9b03fcb5f98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:55:01.814100718Z [2024-04-20 22:55:01,810: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:02.534174387Z [2024-04-20 22:55:02,530: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T22:55:02.558318608Z [2024-04-20 22:55:02,554: INFO/ForkPoolWorker-7] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:02.908403037Z [2024-04-20 22:55:02,905: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:03.050441780Z [2024-04-20 22:55:03,042: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:03.360626447Z [2024-04-20 22:55:03,356: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:03.983599357Z [2024-04-20 22:55:03,964: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:04.316609688Z [2024-04-20 22:55:04,312: INFO/ForkPoolWorker-8] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:04.513602664Z [2024-04-20 22:55:04,431: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:04.626669069Z [2024-04-20 22:55:04,626: INFO/ForkPoolWorker-4] Getting SDNC list 2024-04-20T22:55:04.670228909Z [2024-04-20 22:55:04,669: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:04.817100238Z [2024-04-20 22:55:04,774: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:04.821988167Z [2024-04-20 22:55:04,821: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-20T22:55:04.823193786Z [2024-04-20 22:55:04,822: INFO/ForkPoolWorker-4] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T22:55:04.823426539Z [2024-04-20 22:55:04,823: INFO/ForkPoolWorker-4] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T22:55:04.823589325Z [2024-04-20 22:55:04,823: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-04-20T22:55:04.824225044Z [2024-04-20 22:55:04,824: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T22:55:05.123973048Z [2024-04-20 22:55:05,123: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:55:06.342599332Z [2024-04-20 22:55:06,342: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[cc99cfab-9422-45ff-8db5-faed92c22771] succeeded in 5.3196733080001195s: None 2024-04-20T22:55:06.869915115Z [2024-04-20 22:55:06,869: INFO/ForkPoolWorker-7] Getting VIM list 2024-04-20T22:55:06.873101491Z [2024-04-20 22:55:06,872: INFO/ForkPoolWorker-7] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:06.912650238Z [2024-04-20 22:55:06,912: INFO/ForkPoolWorker-7] Connected to database osm version 1.2 2024-04-20T22:55:06.915447206Z [2024-04-20 22:55:06,915: INFO/ForkPoolWorker-7] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:06.916333464Z [2024-04-20 22:55:06,915: INFO/ForkPoolWorker-7] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:06.916532348Z [2024-04-20 22:55:06,916: INFO/ForkPoolWorker-7] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:06.916566001Z [2024-04-20 22:55:06,916: INFO/ForkPoolWorker-7] Getting VIM list OK 2024-04-20T22:55:06.916786421Z [2024-04-20 22:55:06,916: INFO/ForkPoolWorker-7] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:06.916827483Z [2024-04-20 22:55:06,916: INFO/ForkPoolWorker-7] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:06.922717917Z [2024-04-20 22:55:06,922: WARNING/ForkPoolWorker-7] Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:06.923506832Z [2024-04-20 22:55:06,922: INFO/ForkPoolWorker-7] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:06.929131379Z [2024-04-20 22:55:06,928: INFO/ForkPoolWorker-7] Getting VIM list 2024-04-20T22:55:06.934171714Z [2024-04-20 22:55:06,933: INFO/ForkPoolWorker-7] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:06.999533234Z [2024-04-20 22:55:06,999: INFO/ForkPoolWorker-7] Connected to database osm version 1.2 2024-04-20T22:55:07.005880277Z [2024-04-20 22:55:07,005: INFO/ForkPoolWorker-7] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:07.005934628Z [2024-04-20 22:55:07,005: INFO/ForkPoolWorker-7] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:07.006043938Z [2024-04-20 22:55:07,005: INFO/ForkPoolWorker-7] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:07.006095551Z [2024-04-20 22:55:07,006: INFO/ForkPoolWorker-7] Getting VIM list OK 2024-04-20T22:55:07.006350220Z [2024-04-20 22:55:07,006: INFO/ForkPoolWorker-7] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:07.006358596Z [2024-04-20 22:55:07,006: INFO/ForkPoolWorker-7] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:07.010642027Z [2024-04-20 22:55:07,010: ERROR/ForkPoolWorker-7] [8a73dd49-1941-4509-91dc-a5879d486d88] Failed to execute task Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:07.010666703Z Traceback (most recent call last): 2024-04-20T22:55:07.010670634Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:07.010674351Z args.func(args) 2024-04-20T22:55:07.010677875Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:07.010681949Z return func(*args, **kwargs) 2024-04-20T22:55:07.010684922Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:07.010688065Z return f(*args, **kwargs) 2024-04-20T22:55:07.010690987Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:07.010693907Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:07.010696799Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:07.010699643Z raise AirflowException( 2024-04-20T22:55:07.010703766Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:07.198337167Z [2024-04-20 22:55:07,197: ERROR/ForkPoolWorker-7] Task airflow.executors.celery_executor.execute_command[8a73dd49-1941-4509-91dc-a5879d486d88] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8a73dd49-1941-4509-91dc-a5879d486d88') 2024-04-20T22:55:07.198352409Z Traceback (most recent call last): 2024-04-20T22:55:07.198356586Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:07.198359672Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:07.198362719Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:07.198365726Z return self.run(*args, **kwargs) 2024-04-20T22:55:07.198369238Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:07.198372684Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:07.198375675Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:07.198400314Z raise AirflowException(msg) 2024-04-20T22:55:07.198403958Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8a73dd49-1941-4509-91dc-a5879d486d88 2024-04-20T22:55:07.580367422Z [2024-04-20 22:55:07,579: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T22:55:07.603047718Z [2024-04-20 22:55:07,602: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:07.679784235Z [2024-04-20 22:55:07,671: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T22:55:07.698216191Z [2024-04-20 22:55:07,697: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:07.698347155Z [2024-04-20 22:55:07,698: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:07.698549493Z [2024-04-20 22:55:07,698: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:07.698640823Z [2024-04-20 22:55:07,698: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T22:55:07.698927300Z [2024-04-20 22:55:07,698: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:07.699340807Z [2024-04-20 22:55:07,699: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:07.828938612Z [2024-04-20 22:55:07,828: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:55:07.979037323Z [2024-04-20 22:55:07,978: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:55:07.982366762Z [2024-04-20 22:55:07,981: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.041550197Z [2024-04-20 22:55:08,041: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:55:08.045250918Z [2024-04-20 22:55:08,045: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.045489665Z [2024-04-20 22:55:08,045: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.045649013Z [2024-04-20 22:55:08,045: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.045742386Z [2024-04-20 22:55:08,045: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:55:08.045983203Z [2024-04-20 22:55:08,045: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:08.046364996Z [2024-04-20 22:55:08,046: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.054706446Z [2024-04-20 22:55:08,054: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:08.055442486Z [2024-04-20 22:55:08,054: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:08.057112453Z [2024-04-20 22:55:08,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:55:08.067787688Z [2024-04-20 22:55:08,063: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.068774573Z [2024-04-20 22:55:08,068: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-20T22:55:08.082709406Z [2024-04-20 22:55:08,082: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.112179461Z [2024-04-20 22:55:08,111: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:55:08.137269511Z [2024-04-20 22:55:08,136: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.137340772Z [2024-04-20 22:55:08,137: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.137538398Z [2024-04-20 22:55:08,137: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.137633972Z [2024-04-20 22:55:08,137: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:55:08.137948676Z [2024-04-20 22:55:08,137: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:08.138041585Z [2024-04-20 22:55:08,137: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.141767922Z [2024-04-20 22:55:08,141: ERROR/ForkPoolWorker-16] [be6a5b24-358f-4492-9035-f1ae73e7e3de] Failed to execute task Dag 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:08.141782546Z Traceback (most recent call last): 2024-04-20T22:55:08.141786547Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:08.141790431Z args.func(args) 2024-04-20T22:55:08.141793982Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:08.141798503Z return func(*args, **kwargs) 2024-04-20T22:55:08.141832606Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:08.141836210Z return f(*args, **kwargs) 2024-04-20T22:55:08.141839220Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:08.141842330Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:08.141845419Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:08.141848447Z raise AirflowException( 2024-04-20T22:55:08.141852071Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:08.188929780Z [2024-04-20 22:55:08,188: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-20T22:55:08.195443993Z [2024-04-20 22:55:08,195: INFO/ForkPoolWorker-5] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.195456997Z [2024-04-20 22:55:08,195: INFO/ForkPoolWorker-5] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.195596365Z [2024-04-20 22:55:08,195: INFO/ForkPoolWorker-5] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.195786081Z [2024-04-20 22:55:08,195: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-20T22:55:08.198731102Z [2024-04-20 22:55:08,198: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:08.198744958Z [2024-04-20 22:55:08,198: INFO/ForkPoolWorker-5] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.208684822Z [2024-04-20 22:55:08,207: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be6a5b24-358f-4492-9035-f1ae73e7e3de] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id be6a5b24-358f-4492-9035-f1ae73e7e3de') 2024-04-20T22:55:08.208707388Z Traceback (most recent call last): 2024-04-20T22:55:08.208711434Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:08.208714489Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:08.208717574Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:08.208720707Z return self.run(*args, **kwargs) 2024-04-20T22:55:08.208724417Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:08.208727941Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:08.208743326Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:08.208747068Z raise AirflowException(msg) 2024-04-20T22:55:08.208750539Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id be6a5b24-358f-4492-9035-f1ae73e7e3de 2024-04-20T22:55:08.269132110Z [2024-04-20 22:55:08,267: WARNING/ForkPoolWorker-5] Dag 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:08.271769385Z [2024-04-20 22:55:08,269: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:08.274572544Z [2024-04-20 22:55:08,274: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-20T22:55:08.296870888Z [2024-04-20 22:55:08,296: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.338097536Z [2024-04-20 22:55:08,337: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-20T22:55:08.341112917Z [2024-04-20 22:55:08,340: INFO/ForkPoolWorker-5] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.341124479Z [2024-04-20 22:55:08,341: INFO/ForkPoolWorker-5] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.341230230Z [2024-04-20 22:55:08,341: INFO/ForkPoolWorker-5] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.341254920Z [2024-04-20 22:55:08,341: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-20T22:55:08.343842549Z [2024-04-20 22:55:08,343: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:08.343859017Z [2024-04-20 22:55:08,343: INFO/ForkPoolWorker-5] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.349750911Z [2024-04-20 22:55:08,349: ERROR/ForkPoolWorker-5] [8cc6f227-89fd-4f73-8270-aa539e2b55b8] Failed to execute task Dag 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:08.349778552Z Traceback (most recent call last): 2024-04-20T22:55:08.349782758Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:08.349786288Z args.func(args) 2024-04-20T22:55:08.349789762Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:08.349842711Z return func(*args, **kwargs) 2024-04-20T22:55:08.349846109Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:08.349848778Z return f(*args, **kwargs) 2024-04-20T22:55:08.349851625Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:08.349854515Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:08.349857220Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:08.349859986Z raise AirflowException( 2024-04-20T22:55:08.349863363Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:08.420946881Z [2024-04-20 22:55:08,420: ERROR/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[8cc6f227-89fd-4f73-8270-aa539e2b55b8] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8cc6f227-89fd-4f73-8270-aa539e2b55b8') 2024-04-20T22:55:08.420961981Z Traceback (most recent call last): 2024-04-20T22:55:08.420966376Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:08.420969820Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:08.420972815Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:08.420975811Z return self.run(*args, **kwargs) 2024-04-20T22:55:08.420979825Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:08.420983576Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:08.420999290Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:08.421003185Z raise AirflowException(msg) 2024-04-20T22:55:08.421007134Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8cc6f227-89fd-4f73-8270-aa539e2b55b8 2024-04-20T22:55:08.508452374Z [2024-04-20 22:55:08,507: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:55:08.533652352Z [2024-04-20 22:55:08,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.608639121Z [2024-04-20 22:55:08,608: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:55:08.616807928Z [2024-04-20 22:55:08,616: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.616826840Z [2024-04-20 22:55:08,616: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.616910969Z [2024-04-20 22:55:08,616: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.616923923Z [2024-04-20 22:55:08,616: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:55:08.617168804Z [2024-04-20 22:55:08,617: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:08.617198319Z [2024-04-20 22:55:08,617: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.626480439Z [2024-04-20 22:55:08,626: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:08.627303293Z [2024-04-20 22:55:08,626: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:08.628255089Z [2024-04-20 22:55:08,628: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:55:08.631265698Z [2024-04-20 22:55:08,631: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.672652756Z [2024-04-20 22:55:08,672: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T22:55:08.696149919Z [2024-04-20 22:55:08,688: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.700583395Z [2024-04-20 22:55:08,700: INFO/ForkPoolWorker-6] Getting VIM list 2024-04-20T22:55:08.703781584Z [2024-04-20 22:55:08,703: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.704613446Z [2024-04-20 22:55:08,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:55:08.707091141Z [2024-04-20 22:55:08,706: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.707697661Z [2024-04-20 22:55:08,707: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.707943301Z [2024-04-20 22:55:08,707: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.708063327Z [2024-04-20 22:55:08,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:55:08.709024977Z [2024-04-20 22:55:08,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:08.709588391Z [2024-04-20 22:55:08,709: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.713333181Z [2024-04-20 22:55:08,712: ERROR/ForkPoolWorker-15] [660b6da6-71e3-4836-a852-83174b11a9e1] Failed to execute task Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:08.713344442Z Traceback (most recent call last): 2024-04-20T22:55:08.713348025Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:08.713351593Z args.func(args) 2024-04-20T22:55:08.713355063Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:08.713358961Z return func(*args, **kwargs) 2024-04-20T22:55:08.713361830Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:08.713365183Z return f(*args, **kwargs) 2024-04-20T22:55:08.713375943Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:08.713378978Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:08.713381941Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:08.713384834Z raise AirflowException( 2024-04-20T22:55:08.713388562Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:08.748361592Z [2024-04-20 22:55:08,747: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[660b6da6-71e3-4836-a852-83174b11a9e1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 660b6da6-71e3-4836-a852-83174b11a9e1') 2024-04-20T22:55:08.748375855Z Traceback (most recent call last): 2024-04-20T22:55:08.748379855Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:08.748383281Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:08.748386333Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:08.748389307Z return self.run(*args, **kwargs) 2024-04-20T22:55:08.748392858Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:08.748396441Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:08.748399443Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:08.748403056Z raise AirflowException(msg) 2024-04-20T22:55:08.748415331Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 660b6da6-71e3-4836-a852-83174b11a9e1 2024-04-20T22:55:08.760808076Z [2024-04-20 22:55:08,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:55:08.762765644Z [2024-04-20 22:55:08,762: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.762908519Z [2024-04-20 22:55:08,762: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.763159844Z [2024-04-20 22:55:08,763: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.763236860Z [2024-04-20 22:55:08,763: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T22:55:08.763483457Z [2024-04-20 22:55:08,763: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:08.763578778Z [2024-04-20 22:55:08,763: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.769469270Z [2024-04-20 22:55:08,769: WARNING/ForkPoolWorker-1] Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:08.770087829Z [2024-04-20 22:55:08,769: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:08.770863717Z [2024-04-20 22:55:08,770: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T22:55:08.772910936Z [2024-04-20 22:55:08,772: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-04-20T22:55:08.775109571Z [2024-04-20 22:55:08,774: INFO/ForkPoolWorker-6] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.775173695Z [2024-04-20 22:55:08,775: INFO/ForkPoolWorker-6] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.775340305Z [2024-04-20 22:55:08,775: INFO/ForkPoolWorker-6] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.775440311Z [2024-04-20 22:55:08,775: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-04-20T22:55:08.775726806Z [2024-04-20 22:55:08,775: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:08.775779847Z [2024-04-20 22:55:08,775: INFO/ForkPoolWorker-6] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.778980740Z [2024-04-20 22:55:08,778: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.783434726Z [2024-04-20 22:55:08,783: WARNING/ForkPoolWorker-6] Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:08.784563096Z [2024-04-20 22:55:08,783: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:08.785302890Z [2024-04-20 22:55:08,785: INFO/ForkPoolWorker-6] Getting VIM list 2024-04-20T22:55:08.788151562Z [2024-04-20 22:55:08,787: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.816489347Z [2024-04-20 22:55:08,816: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:55:08.819326297Z [2024-04-20 22:55:08,819: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.819737420Z [2024-04-20 22:55:08,819: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.819980119Z [2024-04-20 22:55:08,819: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.820147127Z [2024-04-20 22:55:08,819: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T22:55:08.820477236Z [2024-04-20 22:55:08,820: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:08.820582812Z [2024-04-20 22:55:08,820: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.824046596Z [2024-04-20 22:55:08,823: ERROR/ForkPoolWorker-1] [6e83a5b9-6102-4148-b900-fe8cbf8e2f40] Failed to execute task Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:08.824059794Z Traceback (most recent call last): 2024-04-20T22:55:08.824064163Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:08.824068184Z args.func(args) 2024-04-20T22:55:08.824111528Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:08.824115972Z return func(*args, **kwargs) 2024-04-20T22:55:08.824119022Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:08.824122257Z return f(*args, **kwargs) 2024-04-20T22:55:08.824125328Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:08.824128363Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:08.824131392Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:08.824134629Z raise AirflowException( 2024-04-20T22:55:08.824140086Z airflow.exceptions.AirflowException: Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:08.843732985Z [2024-04-20 22:55:08,843: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-04-20T22:55:08.845686353Z [2024-04-20 22:55:08,845: INFO/ForkPoolWorker-6] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.846240485Z [2024-04-20 22:55:08,845: INFO/ForkPoolWorker-6] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.846721253Z [2024-04-20 22:55:08,846: INFO/ForkPoolWorker-6] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.846926536Z [2024-04-20 22:55:08,846: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-04-20T22:55:08.847924568Z [2024-04-20 22:55:08,847: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:08.847934448Z [2024-04-20 22:55:08,847: INFO/ForkPoolWorker-6] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:08.850504638Z [2024-04-20 22:55:08,850: ERROR/ForkPoolWorker-6] [6915382e-b674-4d5a-af8d-006883e64551] Failed to execute task Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:08.850515015Z Traceback (most recent call last): 2024-04-20T22:55:08.850518820Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:08.850522422Z args.func(args) 2024-04-20T22:55:08.850525733Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:08.850529162Z return func(*args, **kwargs) 2024-04-20T22:55:08.850532105Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:08.850535062Z return f(*args, **kwargs) 2024-04-20T22:55:08.850538079Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:08.850541052Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:08.850543964Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:08.850546886Z raise AirflowException( 2024-04-20T22:55:08.850550567Z airflow.exceptions.AirflowException: Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:08.864298007Z [2024-04-20 22:55:08,863: INFO/ForkPoolWorker-8] Getting VIM list 2024-04-20T22:55:08.868054717Z [2024-04-20 22:55:08,867: INFO/ForkPoolWorker-8] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:08.892503873Z [2024-04-20 22:55:08,891: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6e83a5b9-6102-4148-b900-fe8cbf8e2f40] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6e83a5b9-6102-4148-b900-fe8cbf8e2f40') 2024-04-20T22:55:08.892515168Z Traceback (most recent call last): 2024-04-20T22:55:08.892518744Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:08.892521800Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:08.892524814Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:08.892527848Z return self.run(*args, **kwargs) 2024-04-20T22:55:08.892531695Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:08.892535507Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:08.892538748Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:08.892542161Z raise AirflowException(msg) 2024-04-20T22:55:08.892546080Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6e83a5b9-6102-4148-b900-fe8cbf8e2f40 2024-04-20T22:55:08.893307399Z [2024-04-20 22:55:08,891: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[6915382e-b674-4d5a-af8d-006883e64551] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6915382e-b674-4d5a-af8d-006883e64551') 2024-04-20T22:55:08.893319054Z Traceback (most recent call last): 2024-04-20T22:55:08.893323193Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:08.893326245Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:08.893329357Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:08.893332298Z return self.run(*args, **kwargs) 2024-04-20T22:55:08.893335766Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:08.893339240Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:08.893342420Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:08.893345780Z raise AirflowException(msg) 2024-04-20T22:55:08.893349398Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6915382e-b674-4d5a-af8d-006883e64551 2024-04-20T22:55:08.934993300Z [2024-04-20 22:55:08,934: INFO/ForkPoolWorker-8] Connected to database osm version 1.2 2024-04-20T22:55:08.936897469Z [2024-04-20 22:55:08,936: INFO/ForkPoolWorker-8] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:08.937122913Z [2024-04-20 22:55:08,936: INFO/ForkPoolWorker-8] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:08.937344397Z [2024-04-20 22:55:08,937: INFO/ForkPoolWorker-8] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:08.937504899Z [2024-04-20 22:55:08,937: INFO/ForkPoolWorker-8] Getting VIM list OK 2024-04-20T22:55:08.937831733Z [2024-04-20 22:55:08,937: INFO/ForkPoolWorker-8] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:08.938041850Z [2024-04-20 22:55:08,937: INFO/ForkPoolWorker-8] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:09.028037000Z [2024-04-20 22:55:09,027: INFO/ForkPoolWorker-8] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:55:09.210383628Z [2024-04-20 22:55:09,210: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:55:09.213613894Z [2024-04-20 22:55:09,213: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:09.243592795Z [2024-04-20 22:55:09,243: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:55:09.244913721Z [2024-04-20 22:55:09,244: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:09.244934103Z [2024-04-20 22:55:09,244: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:09.245078840Z [2024-04-20 22:55:09,244: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:09.245096019Z [2024-04-20 22:55:09,245: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:55:09.245422838Z [2024-04-20 22:55:09,245: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:09.245465914Z [2024-04-20 22:55:09,245: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:09.349767281Z [2024-04-20 22:55:09,349: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:55:09.812855312Z [2024-04-20 22:55:09,812: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e49aefb7-303b-4a91-8854-ed6926add629] succeeded in 8.797788096999966s: None 2024-04-20T22:55:10.025174239Z [2024-04-20 22:55:10,024: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6eb4edd2-2436-4ca1-8bcd-ad91b8e139e5] succeeded in 9.043497207999962s: None 2024-04-20T22:55:10.466239585Z [2024-04-20 22:55:10,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af4a2bf6-7f75-4cfd-8238-8e06d2bcdb67] received 2024-04-20T22:55:10.481650058Z [2024-04-20 22:55:10,481: INFO/ForkPoolWorker-15] [af4a2bf6-7f75-4cfd-8238-8e06d2bcdb67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:55:10.824145365Z [2024-04-20 22:55:10,818: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:11.000757649Z [2024-04-20 22:55:10,999: INFO/ForkPoolWorker-8] Task airflow.executors.celery_executor.execute_command[6885e05d-576d-454e-9902-c9b03fcb5f98] succeeded in 9.843175661000032s: None 2024-04-20T22:55:12.038458573Z [2024-04-20 22:55:12,038: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:55:12.041707172Z [2024-04-20 22:55:12,041: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:12.058641149Z [2024-04-20 22:55:12,058: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:55:12.059876256Z [2024-04-20 22:55:12,059: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:12.059950593Z [2024-04-20 22:55:12,059: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:12.060151277Z [2024-04-20 22:55:12,059: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:12.060274963Z [2024-04-20 22:55:12,060: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:55:12.060608166Z [2024-04-20 22:55:12,060: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:12.060694963Z [2024-04-20 22:55:12,060: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:12.154782994Z [2024-04-20 22:55:12,154: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:55:12.934531933Z [2024-04-20 22:55:12,934: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af4a2bf6-7f75-4cfd-8238-8e06d2bcdb67] succeeded in 2.4669783910001115s: None 2024-04-20T22:55:13.638162325Z [2024-04-20 22:55:13,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86ff6d13-b6aa-46e2-96c3-e5ef9b485731] received 2024-04-20T22:55:13.646670072Z [2024-04-20 22:55:13,646: INFO/ForkPoolWorker-15] [86ff6d13-b6aa-46e2-96c3-e5ef9b485731] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T22:55:14.014846090Z [2024-04-20 22:55:14,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:15.159377523Z [2024-04-20 22:55:15,159: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:55:15.162631059Z [2024-04-20 22:55:15,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:15.189911503Z [2024-04-20 22:55:15,189: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:55:15.192027754Z [2024-04-20 22:55:15,191: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:15.192091152Z [2024-04-20 22:55:15,191: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:15.192296649Z [2024-04-20 22:55:15,192: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:15.192432577Z [2024-04-20 22:55:15,192: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:55:15.195213368Z [2024-04-20 22:55:15,194: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:15.195283877Z [2024-04-20 22:55:15,195: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:15.301296338Z [2024-04-20 22:55:15,300: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:55:15.927912673Z [2024-04-20 22:55:15,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86ff6d13-b6aa-46e2-96c3-e5ef9b485731] succeeded in 2.285689858999831s: None 2024-04-20T22:55:16.291137164Z [2024-04-20 22:55:16,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4359db2-6210-43ed-84f9-6defe763a271] received 2024-04-20T22:55:16.299511292Z [2024-04-20 22:55:16,299: INFO/ForkPoolWorker-15] [b4359db2-6210-43ed-84f9-6defe763a271] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:55:16.633256325Z [2024-04-20 22:55:16,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:17.691869964Z [2024-04-20 22:55:17,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8abfb278-050c-4960-bc1b-ffd1d555a045] received 2024-04-20T22:55:17.733130748Z [2024-04-20 22:55:17,732: INFO/ForkPoolWorker-16] [8abfb278-050c-4960-bc1b-ffd1d555a045] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:55:18.225996622Z [2024-04-20 22:55:18,225: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:55:18.232591065Z [2024-04-20 22:55:18,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:18.299435126Z [2024-04-20 22:55:18,299: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:55:18.303569591Z [2024-04-20 22:55:18,303: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:18.303758798Z [2024-04-20 22:55:18,303: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:18.303981255Z [2024-04-20 22:55:18,303: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:18.304156604Z [2024-04-20 22:55:18,304: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:55:18.304505020Z [2024-04-20 22:55:18,304: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:18.304631950Z [2024-04-20 22:55:18,304: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:18.358565596Z [2024-04-20 22:55:18,355: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:18.414637890Z [2024-04-20 22:55:18,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:55:19.238268777Z [2024-04-20 22:55:19,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4359db2-6210-43ed-84f9-6defe763a271] succeeded in 2.944843502999902s: None 2024-04-20T22:55:19.658816731Z [2024-04-20 22:55:19,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[538b0ad1-632c-460c-aa6b-5a24e709b44f] received 2024-04-20T22:55:19.666861405Z [2024-04-20 22:55:19,666: INFO/ForkPoolWorker-15] [538b0ad1-632c-460c-aa6b-5a24e709b44f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:55:19.671056422Z [2024-04-20 22:55:19,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2219cd94-48f2-4b77-84f1-70df69570f7a] received 2024-04-20T22:55:19.681066005Z [2024-04-20 22:55:19,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77b7a6a3-3a7e-4a67-84a1-2f5e78647ba4] received 2024-04-20T22:55:19.682433258Z [2024-04-20 22:55:19,682: INFO/ForkPoolWorker-1] [2219cd94-48f2-4b77-84f1-70df69570f7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:55:19.692283249Z [2024-04-20 22:55:19,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e26a276-1748-4454-9ed6-381579cc7d8b] received 2024-04-20T22:55:19.700296018Z [2024-04-20 22:55:19,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[702cedd1-6fe1-4282-9aa3-3e6c3d5d15e3] received 2024-04-20T22:55:19.701081614Z [2024-04-20 22:55:19,700: INFO/ForkPoolWorker-3] [0e26a276-1748-4454-9ed6-381579cc7d8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:55:19.716435961Z [2024-04-20 22:55:19,716: INFO/ForkPoolWorker-2] [77b7a6a3-3a7e-4a67-84a1-2f5e78647ba4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T22:55:19.717239998Z [2024-04-20 22:55:19,716: INFO/ForkPoolWorker-4] [702cedd1-6fe1-4282-9aa3-3e6c3d5d15e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:55:20.127511942Z [2024-04-20 22:55:20,127: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:55:20.131008970Z [2024-04-20 22:55:20,130: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:20.175267313Z [2024-04-20 22:55:20,175: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:55:20.185268475Z [2024-04-20 22:55:20,185: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:20.185313035Z [2024-04-20 22:55:20,185: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:20.185509704Z [2024-04-20 22:55:20,185: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:20.185680091Z [2024-04-20 22:55:20,185: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:55:20.185948377Z [2024-04-20 22:55:20,185: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:20.186011331Z [2024-04-20 22:55:20,185: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:20.192455535Z [2024-04-20 22:55:20,192: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:20.197452277Z [2024-04-20 22:55:20,192: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:20.201524253Z [2024-04-20 22:55:20,201: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:55:20.224455779Z [2024-04-20 22:55:20,224: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:20.265335618Z [2024-04-20 22:55:20,265: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:55:20.270697874Z [2024-04-20 22:55:20,270: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:20.270712828Z [2024-04-20 22:55:20,270: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:20.270939136Z [2024-04-20 22:55:20,270: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:20.271017085Z [2024-04-20 22:55:20,270: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:55:20.271264618Z [2024-04-20 22:55:20,271: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:20.271308442Z [2024-04-20 22:55:20,271: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:20.275355502Z [2024-04-20 22:55:20,274: ERROR/ForkPoolWorker-16] [8abfb278-050c-4960-bc1b-ffd1d555a045] Failed to execute task Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:20.275367674Z Traceback (most recent call last): 2024-04-20T22:55:20.275371338Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:20.275375084Z args.func(args) 2024-04-20T22:55:20.275378882Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:20.275382498Z return func(*args, **kwargs) 2024-04-20T22:55:20.275389482Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:20.275392774Z return f(*args, **kwargs) 2024-04-20T22:55:20.275395921Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:20.275398982Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:20.275402067Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:20.275417721Z raise AirflowException( 2024-04-20T22:55:20.275424376Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:20.305563170Z [2024-04-20 22:55:20,302: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:20.433639734Z [2024-04-20 22:55:20,433: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8abfb278-050c-4960-bc1b-ffd1d555a045] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8abfb278-050c-4960-bc1b-ffd1d555a045') 2024-04-20T22:55:20.433657103Z Traceback (most recent call last): 2024-04-20T22:55:20.433661112Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:20.433664168Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:20.433667123Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:20.433670155Z return self.run(*args, **kwargs) 2024-04-20T22:55:20.433673680Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:20.433677709Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:20.433680613Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:20.433684013Z raise AirflowException(msg) 2024-04-20T22:55:20.433687445Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8abfb278-050c-4960-bc1b-ffd1d555a045 2024-04-20T22:55:20.492670175Z [2024-04-20 22:55:20,487: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:20.533636886Z [2024-04-20 22:55:20,530: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:20.581683599Z [2024-04-20 22:55:20,537: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:21.005912848Z [2024-04-20 22:55:20,991: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:22.109488448Z [2024-04-20 22:55:22,109: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-20T22:55:22.113361522Z [2024-04-20 22:55:22,112: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.164150589Z [2024-04-20 22:55:22,163: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-20T22:55:22.166091343Z [2024-04-20 22:55:22,165: INFO/ForkPoolWorker-4] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.166103776Z [2024-04-20 22:55:22,166: INFO/ForkPoolWorker-4] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.166292251Z [2024-04-20 22:55:22,166: INFO/ForkPoolWorker-4] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.166361829Z [2024-04-20 22:55:22,166: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-20T22:55:22.166620546Z [2024-04-20 22:55:22,166: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:22.166658586Z [2024-04-20 22:55:22,166: INFO/ForkPoolWorker-4] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.171985435Z [2024-04-20 22:55:22,171: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:55:22.176115720Z [2024-04-20 22:55:22,175: WARNING/ForkPoolWorker-4] Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:22.176710934Z [2024-04-20 22:55:22,176: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.196022138Z [2024-04-20 22:55:22,195: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:22.197395622Z [2024-04-20 22:55:22,197: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-20T22:55:22.201079816Z [2024-04-20 22:55:22,200: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.234572898Z [2024-04-20 22:55:22,234: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:55:22.236283754Z [2024-04-20 22:55:22,236: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.236586575Z [2024-04-20 22:55:22,236: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.236777583Z [2024-04-20 22:55:22,236: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.236971872Z [2024-04-20 22:55:22,236: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:55:22.237291114Z [2024-04-20 22:55:22,237: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:22.237419433Z [2024-04-20 22:55:22,237: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.237781579Z [2024-04-20 22:55:22,237: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-20T22:55:22.241234667Z [2024-04-20 22:55:22,240: INFO/ForkPoolWorker-4] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.241306389Z [2024-04-20 22:55:22,241: INFO/ForkPoolWorker-4] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.241472485Z [2024-04-20 22:55:22,241: INFO/ForkPoolWorker-4] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.241531292Z [2024-04-20 22:55:22,241: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-20T22:55:22.241805418Z [2024-04-20 22:55:22,241: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:22.241985577Z [2024-04-20 22:55:22,241: INFO/ForkPoolWorker-4] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.244166060Z [2024-04-20 22:55:22,243: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:22.245101269Z [2024-04-20 22:55:22,244: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:55:22.245986876Z [2024-04-20 22:55:22,245: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:55:22.245997948Z [2024-04-20 22:55:22,245: ERROR/ForkPoolWorker-4] [702cedd1-6fe1-4282-9aa3-3e6c3d5d15e3] Failed to execute task Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:22.246001929Z Traceback (most recent call last): 2024-04-20T22:55:22.246005552Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:22.246009250Z args.func(args) 2024-04-20T22:55:22.246012698Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:22.246016675Z return func(*args, **kwargs) 2024-04-20T22:55:22.246019621Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:22.246022785Z return f(*args, **kwargs) 2024-04-20T22:55:22.246025794Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:22.246028813Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:22.246032130Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:22.246035048Z raise AirflowException( 2024-04-20T22:55:22.246038540Z airflow.exceptions.AirflowException: Dag 'vim_status_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:22.248638857Z [2024-04-20 22:55:22,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.290712084Z [2024-04-20 22:55:22,290: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:55:22.292940880Z [2024-04-20 22:55:22,292: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.293051047Z [2024-04-20 22:55:22,292: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.293202271Z [2024-04-20 22:55:22,293: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.293276363Z [2024-04-20 22:55:22,293: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:55:22.293524397Z [2024-04-20 22:55:22,293: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:55:22.293600007Z [2024-04-20 22:55:22,293: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.296706596Z [2024-04-20 22:55:22,296: ERROR/ForkPoolWorker-15] [538b0ad1-632c-460c-aa6b-5a24e709b44f] Failed to execute task Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:22.296723538Z Traceback (most recent call last): 2024-04-20T22:55:22.296726872Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:22.296730409Z args.func(args) 2024-04-20T22:55:22.296733642Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:22.296737248Z return func(*args, **kwargs) 2024-04-20T22:55:22.296740157Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:22.296743381Z return f(*args, **kwargs) 2024-04-20T22:55:22.296746894Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:22.296749813Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:22.296766892Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:22.296770512Z raise AirflowException( 2024-04-20T22:55:22.296774261Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:22.338428228Z [2024-04-20 22:55:22,334: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[702cedd1-6fe1-4282-9aa3-3e6c3d5d15e3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 702cedd1-6fe1-4282-9aa3-3e6c3d5d15e3') 2024-04-20T22:55:22.338446269Z Traceback (most recent call last): 2024-04-20T22:55:22.338451615Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:22.338456554Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:22.338461130Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:22.338465616Z return self.run(*args, **kwargs) 2024-04-20T22:55:22.338488518Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:22.338493972Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:22.338498456Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:22.338503434Z raise AirflowException(msg) 2024-04-20T22:55:22.338508426Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 702cedd1-6fe1-4282-9aa3-3e6c3d5d15e3 2024-04-20T22:55:22.371324037Z [2024-04-20 22:55:22,371: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T22:55:22.374775715Z [2024-04-20 22:55:22,374: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.381836630Z [2024-04-20 22:55:22,381: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[538b0ad1-632c-460c-aa6b-5a24e709b44f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 538b0ad1-632c-460c-aa6b-5a24e709b44f') 2024-04-20T22:55:22.381855287Z Traceback (most recent call last): 2024-04-20T22:55:22.381859249Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:22.381862477Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:22.381876998Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:22.381880089Z return self.run(*args, **kwargs) 2024-04-20T22:55:22.381883495Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:22.381886913Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:22.381892293Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:22.381896141Z raise AirflowException(msg) 2024-04-20T22:55:22.381899967Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 538b0ad1-632c-460c-aa6b-5a24e709b44f 2024-04-20T22:55:22.392458112Z [2024-04-20 22:55:22,392: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T22:55:22.393632210Z [2024-04-20 22:55:22,393: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.393643384Z [2024-04-20 22:55:22,393: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.393776243Z [2024-04-20 22:55:22,393: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.393805026Z [2024-04-20 22:55:22,393: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T22:55:22.394046329Z [2024-04-20 22:55:22,393: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:22.394444745Z [2024-04-20 22:55:22,394: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.400451837Z [2024-04-20 22:55:22,400: WARNING/ForkPoolWorker-3] Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:22.401443504Z [2024-04-20 22:55:22,400: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:55:22.402732467Z [2024-04-20 22:55:22,402: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T22:55:22.405706203Z [2024-04-20 22:55:22,405: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.418898293Z [2024-04-20 22:55:22,418: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T22:55:22.419980444Z [2024-04-20 22:55:22,419: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.420087065Z [2024-04-20 22:55:22,419: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.420270079Z [2024-04-20 22:55:22,420: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.420365834Z [2024-04-20 22:55:22,420: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T22:55:22.420804402Z [2024-04-20 22:55:22,420: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:55:22.420815036Z [2024-04-20 22:55:22,420: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.424585033Z [2024-04-20 22:55:22,423: ERROR/ForkPoolWorker-3] [0e26a276-1748-4454-9ed6-381579cc7d8b] Failed to execute task Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:22.424598712Z Traceback (most recent call last): 2024-04-20T22:55:22.424603025Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:22.424606806Z args.func(args) 2024-04-20T22:55:22.424610674Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:22.424614420Z return func(*args, **kwargs) 2024-04-20T22:55:22.424617548Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:22.424620644Z return f(*args, **kwargs) 2024-04-20T22:55:22.424623775Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:22.424627035Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:22.424630654Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:22.424634270Z raise AirflowException( 2024-04-20T22:55:22.424638070Z airflow.exceptions.AirflowException: Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:22.466596776Z [2024-04-20 22:55:22,466: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0e26a276-1748-4454-9ed6-381579cc7d8b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0e26a276-1748-4454-9ed6-381579cc7d8b') 2024-04-20T22:55:22.466611145Z Traceback (most recent call last): 2024-04-20T22:55:22.466615223Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:22.466618404Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:22.466621552Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:22.466625195Z return self.run(*args, **kwargs) 2024-04-20T22:55:22.466628822Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:22.466632408Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:22.466635481Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:22.466639319Z raise AirflowException(msg) 2024-04-20T22:55:22.466643376Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0e26a276-1748-4454-9ed6-381579cc7d8b 2024-04-20T22:55:22.523269225Z [2024-04-20 22:55:22,522: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T22:55:22.526513299Z [2024-04-20 22:55:22,526: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.557330634Z [2024-04-20 22:55:22,557: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:55:22.558589815Z [2024-04-20 22:55:22,558: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.558759370Z [2024-04-20 22:55:22,558: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.558951623Z [2024-04-20 22:55:22,558: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.559004605Z [2024-04-20 22:55:22,558: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T22:55:22.559422532Z [2024-04-20 22:55:22,559: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:22.559537863Z [2024-04-20 22:55:22,559: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.568918988Z [2024-04-20 22:55:22,568: WARNING/ForkPoolWorker-1] Dag 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:22.569911756Z [2024-04-20 22:55:22,569: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:22.570905969Z [2024-04-20 22:55:22,570: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T22:55:22.574266505Z [2024-04-20 22:55:22,573: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.586994269Z [2024-04-20 22:55:22,586: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:55:22.588529873Z [2024-04-20 22:55:22,588: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.588800398Z [2024-04-20 22:55:22,588: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.588869667Z [2024-04-20 22:55:22,588: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.589039751Z [2024-04-20 22:55:22,588: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T22:55:22.589420924Z [2024-04-20 22:55:22,589: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:22.589547727Z [2024-04-20 22:55:22,589: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.592989260Z [2024-04-20 22:55:22,592: ERROR/ForkPoolWorker-1] [2219cd94-48f2-4b77-84f1-70df69570f7a] Failed to execute task Dag 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:22.593001676Z Traceback (most recent call last): 2024-04-20T22:55:22.593005902Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:22.593009362Z args.func(args) 2024-04-20T22:55:22.593012840Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:22.593050263Z return func(*args, **kwargs) 2024-04-20T22:55:22.593054390Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:22.593057562Z return f(*args, **kwargs) 2024-04-20T22:55:22.593060727Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:22.593073733Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:22.593076923Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:22.593079928Z raise AirflowException( 2024-04-20T22:55:22.593083457Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:22.629752782Z [2024-04-20 22:55:22,629: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2219cd94-48f2-4b77-84f1-70df69570f7a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2219cd94-48f2-4b77-84f1-70df69570f7a') 2024-04-20T22:55:22.629823268Z Traceback (most recent call last): 2024-04-20T22:55:22.629831856Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:22.629838849Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:22.629856346Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:22.629863166Z return self.run(*args, **kwargs) 2024-04-20T22:55:22.629870287Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:22.629877200Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:22.629883700Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:22.629891124Z raise AirflowException(msg) 2024-04-20T22:55:22.629898229Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2219cd94-48f2-4b77-84f1-70df69570f7a 2024-04-20T22:55:22.783032264Z [2024-04-20 22:55:22,782: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:55:22.786101339Z [2024-04-20 22:55:22,785: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.809872759Z [2024-04-20 22:55:22,809: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:55:22.814250050Z [2024-04-20 22:55:22,813: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.814432431Z [2024-04-20 22:55:22,814: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.814693279Z [2024-04-20 22:55:22,814: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.814830015Z [2024-04-20 22:55:22,814: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:55:22.815260877Z [2024-04-20 22:55:22,815: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:22.815386769Z [2024-04-20 22:55:22,815: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.835647100Z [2024-04-20 22:55:22,835: WARNING/ForkPoolWorker-2] Dag 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:22.836407679Z [2024-04-20 22:55:22,835: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T22:55:22.837429471Z [2024-04-20 22:55:22,837: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:55:22.841181076Z [2024-04-20 22:55:22,840: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:55:22.867729331Z [2024-04-20 22:55:22,867: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:55:22.869224874Z [2024-04-20 22:55:22,869: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:55:22.869238441Z [2024-04-20 22:55:22,869: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:55:22.869372589Z [2024-04-20 22:55:22,869: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:55:22.869534190Z [2024-04-20 22:55:22,869: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:55:22.869940475Z [2024-04-20 22:55:22,869: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T22:55:22.869973957Z [2024-04-20 22:55:22,869: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:55:22.875073999Z [2024-04-20 22:55:22,874: ERROR/ForkPoolWorker-2] [77b7a6a3-3a7e-4a67-84a1-2f5e78647ba4] Failed to execute task Dag 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:55:22.875085806Z Traceback (most recent call last): 2024-04-20T22:55:22.875089494Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:55:22.875093353Z args.func(args) 2024-04-20T22:55:22.875096397Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:55:22.875099893Z return func(*args, **kwargs) 2024-04-20T22:55:22.875102699Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:55:22.875105677Z return f(*args, **kwargs) 2024-04-20T22:55:22.875108503Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:55:22.875111169Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:55:22.875114295Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:55:22.875117014Z raise AirflowException( 2024-04-20T22:55:22.875120355Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_9ddf6c24-59d7-471b-add2-4d9cb922c5b5' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:55:22.907019699Z [2024-04-20 22:55:22,906: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[77b7a6a3-3a7e-4a67-84a1-2f5e78647ba4] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 77b7a6a3-3a7e-4a67-84a1-2f5e78647ba4') 2024-04-20T22:55:22.907037867Z Traceback (most recent call last): 2024-04-20T22:55:22.907043138Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:55:22.907047730Z R = retval = fun(*args, **kwargs) 2024-04-20T22:55:22.907078504Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:55:22.907082800Z return self.run(*args, **kwargs) 2024-04-20T22:55:22.907087482Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:55:22.907092115Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:55:22.907096149Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:55:22.907100747Z raise AirflowException(msg) 2024-04-20T22:55:22.907105246Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 77b7a6a3-3a7e-4a67-84a1-2f5e78647ba4 2024-04-20T22:56:00.875145632Z [2024-04-20 22:56:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23b14194-578b-4662-8f01-5c15eaf974fe] received 2024-04-20T22:56:00.884885628Z [2024-04-20 22:56:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b57731f-21fd-43e3-95f7-51a6a78745e7] received 2024-04-20T22:56:00.889642330Z [2024-04-20 22:56:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da7549c0-b0ee-4dc5-b1c6-d8ee455011f9] received 2024-04-20T22:56:00.891303069Z [2024-04-20 22:56:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[467387af-164b-4254-9ce4-7262bd44a9d4] received 2024-04-20T22:56:00.892888035Z [2024-04-20 22:56:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0255a24c-1825-4b75-90b5-8da2e9e3c01a] received 2024-04-20T22:56:00.899261117Z [2024-04-20 22:56:00,899: INFO/ForkPoolWorker-2] [467387af-164b-4254-9ce4-7262bd44a9d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:56:00.904474587Z [2024-04-20 22:56:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc0d2a25-9790-42fb-9db3-f9439c11f291] received 2024-04-20T22:56:00.910132042Z [2024-04-20 22:56:00,909: INFO/ForkPoolWorker-16] [0b57731f-21fd-43e3-95f7-51a6a78745e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T22:56:00.913678069Z [2024-04-20 22:56:00,913: INFO/ForkPoolWorker-4] [cc0d2a25-9790-42fb-9db3-f9439c11f291] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:56:00.917777672Z [2024-04-20 22:56:00,914: INFO/ForkPoolWorker-3] [0255a24c-1825-4b75-90b5-8da2e9e3c01a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:56:00.920291686Z [2024-04-20 22:56:00,920: INFO/ForkPoolWorker-1] [da7549c0-b0ee-4dc5-b1c6-d8ee455011f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:56:00.924107049Z [2024-04-20 22:56:00,923: INFO/ForkPoolWorker-15] [23b14194-578b-4662-8f01-5c15eaf974fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:56:01.354608891Z [2024-04-20 22:56:01,350: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T22:56:01.363239267Z [2024-04-20 22:56:01,360: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:56:01.641697215Z [2024-04-20 22:56:01,637: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:56:01.740194740Z [2024-04-20 22:56:01,737: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:56:02.114861454Z [2024-04-20 22:56:02,114: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T22:56:02.122572482Z [2024-04-20 22:56:02,122: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:02.201125099Z [2024-04-20 22:56:02,200: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:56:02.203245897Z [2024-04-20 22:56:02,202: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T22:56:02.203892114Z [2024-04-20 22:56:02,203: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T22:56:02.203989563Z [2024-04-20 22:56:02,203: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T22:56:02.204282466Z [2024-04-20 22:56:02,204: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T22:56:02.282023905Z [2024-04-20 22:56:02,267: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:56:02.366473564Z [2024-04-20 22:56:02,339: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:56:02.477877701Z [2024-04-20 22:56:02,477: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:56:03.308138597Z [2024-04-20 22:56:03,307: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:56:03.363576420Z [2024-04-20 22:56:03,363: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b57731f-21fd-43e3-95f7-51a6a78745e7] succeeded in 2.4719013010001163s: None 2024-04-20T22:56:03.639216937Z [2024-04-20 22:56:03,638: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:56:03.643301157Z [2024-04-20 22:56:03,642: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:03.730588221Z [2024-04-20 22:56:03,730: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T22:56:03.750348686Z [2024-04-20 22:56:03,739: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:03.752244349Z [2024-04-20 22:56:03,752: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:56:03.759175174Z [2024-04-20 22:56:03,758: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:03.759278220Z [2024-04-20 22:56:03,759: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:03.759437310Z [2024-04-20 22:56:03,759: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:03.759556032Z [2024-04-20 22:56:03,759: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:56:03.761842553Z [2024-04-20 22:56:03,759: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:56:03.761857286Z [2024-04-20 22:56:03,759: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:03.868943288Z [2024-04-20 22:56:03,868: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T22:56:03.885122651Z [2024-04-20 22:56:03,884: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:03.885968641Z [2024-04-20 22:56:03,885: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:03.886449916Z [2024-04-20 22:56:03,885: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:03.886698259Z [2024-04-20 22:56:03,886: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T22:56:03.887287971Z [2024-04-20 22:56:03,887: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:56:03.887352514Z [2024-04-20 22:56:03,887: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:03.896521379Z [2024-04-20 22:56:03,896: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:56:03.897335301Z [2024-04-20 22:56:03,896: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:56:03.901967270Z [2024-04-20 22:56:03,901: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T22:56:03.912985786Z [2024-04-20 22:56:03,912: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:03.978214055Z [2024-04-20 22:56:03,978: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T22:56:03.984896859Z [2024-04-20 22:56:03,984: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:03.984915211Z [2024-04-20 22:56:03,984: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:03.985031183Z [2024-04-20 22:56:03,984: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:03.985065890Z [2024-04-20 22:56:03,984: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T22:56:03.985566776Z [2024-04-20 22:56:03,985: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:56:03.985583332Z [2024-04-20 22:56:03,985: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:03.989382712Z [2024-04-20 22:56:03,988: ERROR/ForkPoolWorker-3] [0255a24c-1825-4b75-90b5-8da2e9e3c01a] Failed to execute task Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:56:03.989400721Z Traceback (most recent call last): 2024-04-20T22:56:03.989405968Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:56:03.989424606Z args.func(args) 2024-04-20T22:56:03.989429203Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:56:03.989433930Z return func(*args, **kwargs) 2024-04-20T22:56:03.989437001Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:56:03.989440203Z return f(*args, **kwargs) 2024-04-20T22:56:03.989443199Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:56:03.989446514Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:56:03.989449587Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:56:03.989452466Z raise AirflowException( 2024-04-20T22:56:03.989455767Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:56:03.995754975Z [2024-04-20 22:56:03,993: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:56:04.057101279Z [2024-04-20 22:56:04,055: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0255a24c-1825-4b75-90b5-8da2e9e3c01a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0255a24c-1825-4b75-90b5-8da2e9e3c01a') 2024-04-20T22:56:04.057122449Z Traceback (most recent call last): 2024-04-20T22:56:04.057127261Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:56:04.057131259Z R = retval = fun(*args, **kwargs) 2024-04-20T22:56:04.057134597Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:56:04.057137978Z return self.run(*args, **kwargs) 2024-04-20T22:56:04.057155119Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:56:04.057161139Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:56:04.057164585Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:56:04.057169253Z raise AirflowException(msg) 2024-04-20T22:56:04.057174272Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0255a24c-1825-4b75-90b5-8da2e9e3c01a 2024-04-20T22:56:04.474847057Z [2024-04-20 22:56:04,473: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da7549c0-b0ee-4dc5-b1c6-d8ee455011f9] succeeded in 3.580424027999925s: None 2024-04-20T22:56:04.589631471Z [2024-04-20 22:56:04,589: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-20T22:56:04.593324641Z [2024-04-20 22:56:04,592: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:04.632113556Z [2024-04-20 22:56:04,631: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-20T22:56:04.634692514Z [2024-04-20 22:56:04,634: INFO/ForkPoolWorker-4] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:04.634708163Z [2024-04-20 22:56:04,634: INFO/ForkPoolWorker-4] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:04.634774319Z [2024-04-20 22:56:04,634: INFO/ForkPoolWorker-4] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:04.634924558Z [2024-04-20 22:56:04,634: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-20T22:56:04.635361946Z [2024-04-20 22:56:04,635: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:56:04.635373937Z [2024-04-20 22:56:04,635: INFO/ForkPoolWorker-4] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:04.791741297Z [2024-04-20 22:56:04,791: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:56:05.300716063Z [2024-04-20 22:56:05,300: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:56:05.306358142Z [2024-04-20 22:56:05,305: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:05.346198148Z [2024-04-20 22:56:05,345: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:56:05.349689348Z [2024-04-20 22:56:05,349: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:05.351061472Z [2024-04-20 22:56:05,350: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:05.351472763Z [2024-04-20 22:56:05,351: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:05.351722011Z [2024-04-20 22:56:05,351: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:56:05.352319828Z [2024-04-20 22:56:05,352: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:56:05.352457133Z [2024-04-20 22:56:05,352: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:05.359436043Z [2024-04-20 22:56:05,359: WARNING/ForkPoolWorker-15] Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:56:05.360725824Z [2024-04-20 22:56:05,359: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:56:05.361765327Z [2024-04-20 22:56:05,361: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:56:05.366911474Z [2024-04-20 22:56:05,366: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:05.377398847Z [2024-04-20 22:56:05,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:56:05.378985049Z [2024-04-20 22:56:05,378: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:05.380023380Z [2024-04-20 22:56:05,379: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:05.380276673Z [2024-04-20 22:56:05,379: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:05.380929850Z [2024-04-20 22:56:05,380: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:56:05.381176980Z [2024-04-20 22:56:05,381: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:56:05.381203942Z [2024-04-20 22:56:05,381: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:05.384652353Z [2024-04-20 22:56:05,384: ERROR/ForkPoolWorker-15] [23b14194-578b-4662-8f01-5c15eaf974fe] Failed to execute task Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:56:05.384666560Z Traceback (most recent call last): 2024-04-20T22:56:05.384673723Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:56:05.384678144Z args.func(args) 2024-04-20T22:56:05.384681904Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:56:05.384685945Z return func(*args, **kwargs) 2024-04-20T22:56:05.384689287Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:56:05.384692462Z return f(*args, **kwargs) 2024-04-20T22:56:05.384695683Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:56:05.384711277Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:56:05.384715797Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:56:05.384722991Z raise AirflowException( 2024-04-20T22:56:05.384726948Z airflow.exceptions.AirflowException: Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:56:05.438792475Z [2024-04-20 22:56:05,438: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23b14194-578b-4662-8f01-5c15eaf974fe] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 23b14194-578b-4662-8f01-5c15eaf974fe') 2024-04-20T22:56:05.438805246Z Traceback (most recent call last): 2024-04-20T22:56:05.438809231Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:56:05.438812037Z R = retval = fun(*args, **kwargs) 2024-04-20T22:56:05.438814855Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:56:05.438844572Z return self.run(*args, **kwargs) 2024-04-20T22:56:05.438848281Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:56:05.438851864Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:56:05.438854701Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:56:05.438861889Z raise AirflowException(msg) 2024-04-20T22:56:05.438865574Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 23b14194-578b-4662-8f01-5c15eaf974fe 2024-04-20T22:56:06.386205281Z [2024-04-20 22:56:06,385: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[467387af-164b-4254-9ce4-7262bd44a9d4] succeeded in 5.4923560540000835s: None 2024-04-20T22:56:06.460759925Z [2024-04-20 22:56:06,460: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[cc0d2a25-9790-42fb-9db3-f9439c11f291] succeeded in 5.555021473000124s: None 2024-04-20T22:56:15.122719445Z [2024-04-20 22:56:15,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fafcbb3-6946-4e0a-a590-dfc779182c4e] received 2024-04-20T22:56:15.144470508Z [2024-04-20 22:56:15,144: INFO/ForkPoolWorker-15] [0fafcbb3-6946-4e0a-a590-dfc779182c4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:56:15.435496366Z [2024-04-20 22:56:15,432: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:56:16.577371851Z [2024-04-20 22:56:16,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d2ba5b0-9e72-4b36-9ec2-12e0996664be] received 2024-04-20T22:56:16.597246363Z [2024-04-20 22:56:16,597: INFO/ForkPoolWorker-16] [0d2ba5b0-9e72-4b36-9ec2-12e0996664be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:56:16.745749341Z [2024-04-20 22:56:16,745: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:56:16.748983699Z [2024-04-20 22:56:16,748: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:16.769509628Z [2024-04-20 22:56:16,769: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:56:16.772559090Z [2024-04-20 22:56:16,772: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:16.772584391Z [2024-04-20 22:56:16,772: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:16.772696879Z [2024-04-20 22:56:16,772: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:16.772712552Z [2024-04-20 22:56:16,772: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:56:16.772930301Z [2024-04-20 22:56:16,772: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:56:16.772945815Z [2024-04-20 22:56:16,772: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:16.780555289Z [2024-04-20 22:56:16,780: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:56:16.781305226Z [2024-04-20 22:56:16,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:56:16.782029886Z [2024-04-20 22:56:16,781: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:56:16.784965422Z [2024-04-20 22:56:16,784: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:16.804071951Z [2024-04-20 22:56:16,803: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:56:16.805350972Z [2024-04-20 22:56:16,805: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:16.805384245Z [2024-04-20 22:56:16,805: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:16.805493553Z [2024-04-20 22:56:16,805: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:16.805529409Z [2024-04-20 22:56:16,805: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:56:16.805717086Z [2024-04-20 22:56:16,805: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:56:16.805726510Z [2024-04-20 22:56:16,805: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:16.809253216Z [2024-04-20 22:56:16,808: ERROR/ForkPoolWorker-15] [0fafcbb3-6946-4e0a-a590-dfc779182c4e] Failed to execute task Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:56:16.809260033Z Traceback (most recent call last): 2024-04-20T22:56:16.809263692Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:56:16.809267062Z args.func(args) 2024-04-20T22:56:16.809270243Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:56:16.809273993Z return func(*args, **kwargs) 2024-04-20T22:56:16.809276851Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:56:16.809279778Z return f(*args, **kwargs) 2024-04-20T22:56:16.809282686Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:56:16.809285523Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:56:16.809288592Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:56:16.809295067Z raise AirflowException( 2024-04-20T22:56:16.809300745Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:56:16.853498688Z [2024-04-20 22:56:16,852: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0fafcbb3-6946-4e0a-a590-dfc779182c4e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0fafcbb3-6946-4e0a-a590-dfc779182c4e') 2024-04-20T22:56:16.853519423Z Traceback (most recent call last): 2024-04-20T22:56:16.853523407Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:56:16.853526254Z R = retval = fun(*args, **kwargs) 2024-04-20T22:56:16.853528997Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:56:16.853531811Z return self.run(*args, **kwargs) 2024-04-20T22:56:16.853535076Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:56:16.853538611Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:56:16.853541360Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:56:16.853544714Z raise AirflowException(msg) 2024-04-20T22:56:16.853548057Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0fafcbb3-6946-4e0a-a590-dfc779182c4e 2024-04-20T22:56:16.909217271Z [2024-04-20 22:56:16,906: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:56:18.028399283Z [2024-04-20 22:56:18,027: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:56:18.032145278Z [2024-04-20 22:56:18,031: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:18.052628840Z [2024-04-20 22:56:18,052: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:56:18.053989747Z [2024-04-20 22:56:18,053: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:18.054006958Z [2024-04-20 22:56:18,053: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:18.054130196Z [2024-04-20 22:56:18,053: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:18.054154507Z [2024-04-20 22:56:18,054: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:56:18.054349713Z [2024-04-20 22:56:18,054: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:56:18.054374896Z [2024-04-20 22:56:18,054: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:18.060475861Z [2024-04-20 22:56:18,060: WARNING/ForkPoolWorker-16] Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:56:18.061202197Z [2024-04-20 22:56:18,060: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:56:18.061899086Z [2024-04-20 22:56:18,061: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:56:18.064567028Z [2024-04-20 22:56:18,064: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:56:18.075212284Z [2024-04-20 22:56:18,075: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:56:18.076228269Z [2024-04-20 22:56:18,076: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:56:18.076243859Z [2024-04-20 22:56:18,076: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:56:18.076335440Z [2024-04-20 22:56:18,076: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:56:18.076347596Z [2024-04-20 22:56:18,076: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:56:18.076602677Z [2024-04-20 22:56:18,076: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:56:18.076637627Z [2024-04-20 22:56:18,076: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:56:18.079362738Z [2024-04-20 22:56:18,078: ERROR/ForkPoolWorker-16] [0d2ba5b0-9e72-4b36-9ec2-12e0996664be] Failed to execute task Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse.. 2024-04-20T22:56:18.079375839Z Traceback (most recent call last): 2024-04-20T22:56:18.079382178Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T22:56:18.079387625Z args.func(args) 2024-04-20T22:56:18.079393031Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T22:56:18.079398852Z return func(*args, **kwargs) 2024-04-20T22:56:18.079408637Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T22:56:18.079413562Z return f(*args, **kwargs) 2024-04-20T22:56:18.079418190Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T22:56:18.079423385Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T22:56:18.079428101Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T22:56:18.079432821Z raise AirflowException( 2024-04-20T22:56:18.079438216Z airflow.exceptions.AirflowException: Dag 'vim_status_7e5df66a-64d4-4678-8e20-794872028ce3' could not be found; either it does not exist or it failed to parse. 2024-04-20T22:56:18.111207871Z [2024-04-20 22:56:18,110: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d2ba5b0-9e72-4b36-9ec2-12e0996664be] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0d2ba5b0-9e72-4b36-9ec2-12e0996664be') 2024-04-20T22:56:18.111222678Z Traceback (most recent call last): 2024-04-20T22:56:18.111226248Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T22:56:18.111229053Z R = retval = fun(*args, **kwargs) 2024-04-20T22:56:18.111232216Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T22:56:18.111249688Z return self.run(*args, **kwargs) 2024-04-20T22:56:18.111263323Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T22:56:18.111267019Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T22:56:18.111269922Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T22:56:18.111283764Z raise AirflowException(msg) 2024-04-20T22:56:18.111287061Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0d2ba5b0-9e72-4b36-9ec2-12e0996664be 2024-04-20T22:57:01.107752665Z [2024-04-20 22:57:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5786750a-f914-465e-9eca-3903822690a3] received 2024-04-20T22:57:01.113130519Z [2024-04-20 22:57:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e81f308-814b-42a6-8833-88d9593c03e4] received 2024-04-20T22:57:01.124925079Z [2024-04-20 22:57:01,124: INFO/ForkPoolWorker-15] [5786750a-f914-465e-9eca-3903822690a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T22:57:01.130747079Z [2024-04-20 22:57:01,130: INFO/ForkPoolWorker-16] [7e81f308-814b-42a6-8833-88d9593c03e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:57:01.135024659Z [2024-04-20 22:57:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d22a1bc8-873c-481e-9002-acf21afefd6b] received 2024-04-20T22:57:01.221991337Z [2024-04-20 22:57:01,221: INFO/ForkPoolWorker-1] [d22a1bc8-873c-481e-9002-acf21afefd6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:57:01.805237987Z [2024-04-20 22:57:01,801: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T22:57:01.907493963Z [2024-04-20 22:57:01,903: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:57:02.004849261Z [2024-04-20 22:57:02,004: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-20T22:57:02.010431135Z [2024-04-20 22:57:02,008: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:57:02.038588474Z [2024-04-20 22:57:02,033: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:57:02.046219731Z [2024-04-20 22:57:02,046: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:57:02.052581696Z [2024-04-20 22:57:02,052: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T22:57:02.052757903Z [2024-04-20 22:57:02,052: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T22:57:02.053290959Z [2024-04-20 22:57:02,052: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-20T22:57:02.053837512Z [2024-04-20 22:57:02,053: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T22:57:02.215068584Z [2024-04-20 22:57:02,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:57:03.144569749Z [2024-04-20 22:57:03,144: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5786750a-f914-465e-9eca-3903822690a3] succeeded in 2.0299307479999698s: None 2024-04-20T22:57:03.579704574Z [2024-04-20 22:57:03,579: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T22:57:03.584922474Z [2024-04-20 22:57:03,582: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:57:03.624516000Z [2024-04-20 22:57:03,624: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:57:03.626437350Z [2024-04-20 22:57:03,625: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:57:03.626455123Z [2024-04-20 22:57:03,626: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:57:03.626462121Z [2024-04-20 22:57:03,626: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:57:03.626468449Z [2024-04-20 22:57:03,626: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T22:57:03.626607055Z [2024-04-20 22:57:03,626: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:57:03.626860169Z [2024-04-20 22:57:03,626: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:57:03.709582347Z [2024-04-20 22:57:03,708: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:57:03.713438739Z [2024-04-20 22:57:03,713: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:57:03.715267975Z [2024-04-20 22:57:03,715: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:57:03.743150693Z [2024-04-20 22:57:03,742: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:57:03.744780893Z [2024-04-20 22:57:03,744: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:57:03.744819406Z [2024-04-20 22:57:03,744: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:57:03.745028668Z [2024-04-20 22:57:03,744: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:57:03.745037157Z [2024-04-20 22:57:03,744: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:57:03.746292965Z [2024-04-20 22:57:03,746: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:57:03.758255193Z [2024-04-20 22:57:03,746: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:57:03.920676016Z [2024-04-20 22:57:03,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:57:07.378472533Z [2024-04-20 22:57:07,378: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d22a1bc8-873c-481e-9002-acf21afefd6b] succeeded in 6.220882153000048s: None 2024-04-20T22:57:09.542984899Z [2024-04-20 22:57:09,542: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e81f308-814b-42a6-8833-88d9593c03e4] succeeded in 8.428323373000012s: None 2024-04-20T22:58:01.451616443Z [2024-04-20 22:58:01,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02da27d4-c808-4809-b727-7688405d1b04] received 2024-04-20T22:58:01.463110942Z [2024-04-20 22:58:01,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e78253c4-9fe9-48db-8516-8f80800fadb9] received 2024-04-20T22:58:01.463125933Z [2024-04-20 22:58:01,462: INFO/ForkPoolWorker-15] [02da27d4-c808-4809-b727-7688405d1b04] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T22:58:01.470241730Z [2024-04-20 22:58:01,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ab10df3-7f93-4ca6-bd44-204ed9a18254] received 2024-04-20T22:58:01.472749165Z [2024-04-20 22:58:01,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[339d497a-33f3-4ee4-ba28-44c04c968cea] received 2024-04-20T22:58:01.523781151Z [2024-04-20 22:58:01,519: INFO/ForkPoolWorker-1] [4ab10df3-7f93-4ca6-bd44-204ed9a18254] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:58:01.542201402Z [2024-04-20 22:58:01,540: INFO/ForkPoolWorker-16] [e78253c4-9fe9-48db-8516-8f80800fadb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T22:58:01.543788379Z [2024-04-20 22:58:01,543: INFO/ForkPoolWorker-2] [339d497a-33f3-4ee4-ba28-44c04c968cea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:58:02.327152139Z [2024-04-20 22:58:02,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T22:58:02.815831500Z [2024-04-20 22:58:02,808: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:58:02.820194181Z [2024-04-20 22:58:02,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:58:02.833951420Z [2024-04-20 22:58:02,829: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T22:58:02.898893087Z [2024-04-20 22:58:02,898: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:58:03.403188754Z [2024-04-20 22:58:03,402: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T22:58:03.420330896Z [2024-04-20 22:58:03,419: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:58:03.549452473Z [2024-04-20 22:58:03,549: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:58:03.553859812Z [2024-04-20 22:58:03,552: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T22:58:03.554082895Z [2024-04-20 22:58:03,553: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T22:58:03.554233940Z [2024-04-20 22:58:03,554: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T22:58:03.554542013Z [2024-04-20 22:58:03,554: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T22:58:03.983662165Z [2024-04-20 22:58:03,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:58:04.634839021Z [2024-04-20 22:58:04,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02da27d4-c808-4809-b727-7688405d1b04] succeeded in 3.180897062999975s: None 2024-04-20T22:58:04.926678595Z [2024-04-20 22:58:04,926: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e78253c4-9fe9-48db-8516-8f80800fadb9] succeeded in 3.4392210220000834s: None 2024-04-20T22:58:05.529446119Z [2024-04-20 22:58:05,529: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T22:58:05.534572323Z [2024-04-20 22:58:05,534: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:58:05.592383118Z [2024-04-20 22:58:05,592: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T22:58:05.596850002Z [2024-04-20 22:58:05,596: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:58:05.597436350Z [2024-04-20 22:58:05,596: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:58:05.597674707Z [2024-04-20 22:58:05,597: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:58:05.597736784Z [2024-04-20 22:58:05,597: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T22:58:05.598066915Z [2024-04-20 22:58:05,597: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:58:05.598126130Z [2024-04-20 22:58:05,598: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:58:05.601278699Z [2024-04-20 22:58:05,600: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T22:58:05.605976888Z [2024-04-20 22:58:05,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:58:05.622329059Z [2024-04-20 22:58:05,622: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:58:05.624228187Z [2024-04-20 22:58:05,623: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:58:05.624241031Z [2024-04-20 22:58:05,623: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:58:05.624245195Z [2024-04-20 22:58:05,623: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:58:05.624258312Z [2024-04-20 22:58:05,624: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T22:58:05.624367371Z [2024-04-20 22:58:05,624: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:58:05.624681568Z [2024-04-20 22:58:05,624: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:58:05.702886824Z [2024-04-20 22:58:05,702: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:58:05.748968669Z [2024-04-20 22:58:05,748: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:58:07.678501490Z [2024-04-20 22:58:07,678: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[339d497a-33f3-4ee4-ba28-44c04c968cea] succeeded in 6.180717371000128s: None 2024-04-20T22:58:07.957574541Z [2024-04-20 22:58:07,957: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ab10df3-7f93-4ca6-bd44-204ed9a18254] succeeded in 6.486477286000081s: None 2024-04-20T22:59:00.566300699Z [2024-04-20 22:59:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f51cf1d-b0d2-4513-91d3-4e9bfc958a3d] received 2024-04-20T22:59:00.577459825Z [2024-04-20 22:59:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[869ca770-0cbd-4d06-95f1-28af50731f1e] received 2024-04-20T22:59:00.582920316Z [2024-04-20 22:59:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d6361a6-8e20-45c9-9d47-0373a1127218] received 2024-04-20T22:59:00.584770079Z [2024-04-20 22:59:00,584: INFO/ForkPoolWorker-15] [1f51cf1d-b0d2-4513-91d3-4e9bfc958a3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T22:59:00.588343591Z [2024-04-20 22:59:00,588: INFO/ForkPoolWorker-16] [869ca770-0cbd-4d06-95f1-28af50731f1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T22:59:00.592339291Z [2024-04-20 22:59:00,592: INFO/ForkPoolWorker-1] [7d6361a6-8e20-45c9-9d47-0373a1127218] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T22:59:01.099867315Z [2024-04-20 22:59:01,092: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T22:59:01.181037164Z [2024-04-20 22:59:01,177: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T22:59:01.312010632Z [2024-04-20 22:59:01,307: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T22:59:01.558735300Z [2024-04-20 22:59:01,557: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T22:59:01.572302415Z [2024-04-20 22:59:01,571: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:59:01.667743464Z [2024-04-20 22:59:01,667: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T22:59:01.669040587Z [2024-04-20 22:59:01,668: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T22:59:01.669071217Z [2024-04-20 22:59:01,668: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T22:59:01.669140261Z [2024-04-20 22:59:01,669: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T22:59:01.669409999Z [2024-04-20 22:59:01,669: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T22:59:01.930875280Z [2024-04-20 22:59:01,930: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:59:03.354817213Z [2024-04-20 22:59:03,354: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7d6361a6-8e20-45c9-9d47-0373a1127218] succeeded in 2.769760880999911s: None 2024-04-20T22:59:03.393848605Z [2024-04-20 22:59:03,393: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T22:59:03.398188596Z [2024-04-20 22:59:03,397: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:59:03.469969419Z [2024-04-20 22:59:03,469: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T22:59:03.475513252Z [2024-04-20 22:59:03,475: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:59:03.475716126Z [2024-04-20 22:59:03,475: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:59:03.475950194Z [2024-04-20 22:59:03,475: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:59:03.476116880Z [2024-04-20 22:59:03,475: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T22:59:03.476456975Z [2024-04-20 22:59:03,476: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T22:59:03.476716515Z [2024-04-20 22:59:03,476: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:59:03.592664892Z [2024-04-20 22:59:03,592: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:59:03.707066503Z [2024-04-20 22:59:03,706: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T22:59:03.737046215Z [2024-04-20 22:59:03,719: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T22:59:03.817967682Z [2024-04-20 22:59:03,817: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T22:59:03.827190677Z [2024-04-20 22:59:03,825: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T22:59:03.827267660Z [2024-04-20 22:59:03,827: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T22:59:03.827400969Z [2024-04-20 22:59:03,827: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T22:59:03.827447919Z [2024-04-20 22:59:03,827: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T22:59:03.827760297Z [2024-04-20 22:59:03,827: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T22:59:03.827775025Z [2024-04-20 22:59:03,827: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T22:59:04.055390315Z [2024-04-20 22:59:04,055: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T22:59:06.149340760Z [2024-04-20 22:59:06,148: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f51cf1d-b0d2-4513-91d3-4e9bfc958a3d] succeeded in 5.580024014999935s: None 2024-04-20T22:59:06.158375832Z [2024-04-20 22:59:06,157: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[869ca770-0cbd-4d06-95f1-28af50731f1e] succeeded in 5.578524574999847s: None 2024-04-20T23:00:00.368912727Z [2024-04-20 23:00:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c398c1bc-47c4-44ec-ac5e-01daf70b7f8e] received 2024-04-20T23:00:00.371102531Z [2024-04-20 23:00:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfd746db-891a-4c38-ad66-db2aa508510e] received 2024-04-20T23:00:00.381866562Z [2024-04-20 23:00:00,381: INFO/ForkPoolWorker-15] [c398c1bc-47c4-44ec-ac5e-01daf70b7f8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:00:00.384242741Z [2024-04-20 23:00:00,383: INFO/ForkPoolWorker-16] [dfd746db-891a-4c38-ad66-db2aa508510e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:00:00.386640414Z [2024-04-20 23:00:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2701c62a-a8b3-4244-af84-60ad82fa5c62] received 2024-04-20T23:00:00.400457062Z [2024-04-20 23:00:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2fd9b8a-f7dd-4b22-b2b2-a3a0bdb62d0d] received 2024-04-20T23:00:00.403869299Z [2024-04-20 23:00:00,403: INFO/ForkPoolWorker-1] [2701c62a-a8b3-4244-af84-60ad82fa5c62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:00:00.409254600Z [2024-04-20 23:00:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[559de4e8-8573-4c0a-94a5-b6d505e44571] received 2024-04-20T23:00:00.428072014Z [2024-04-20 23:00:00,427: INFO/ForkPoolWorker-3] [559de4e8-8573-4c0a-94a5-b6d505e44571] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:00:00.436980602Z [2024-04-20 23:00:00,436: INFO/ForkPoolWorker-2] [c2fd9b8a-f7dd-4b22-b2b2-a3a0bdb62d0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:00:00.843364420Z [2024-04-20 23:00:00,840: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:00:00.895708117Z [2024-04-20 23:00:00,892: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:00:00.984215080Z [2024-04-20 23:00:00,979: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:00:01.039967085Z [2024-04-20 23:00:01,036: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:00:01.152410916Z [2024-04-20 23:00:01,142: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:00:01.155135832Z [2024-04-20 23:00:01,154: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:00:01.166184606Z [2024-04-20 23:00:01,165: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:00:01.237411774Z [2024-04-20 23:00:01,237: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:00:01.244397340Z [2024-04-20 23:00:01,244: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:00:01.244459540Z [2024-04-20 23:00:01,244: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:00:01.244540304Z [2024-04-20 23:00:01,244: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:00:01.244788453Z [2024-04-20 23:00:01,244: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:00:01.389640251Z [2024-04-20 23:00:01,389: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:00:01.692104290Z [2024-04-20 23:00:01,691: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:00:02.340792603Z [2024-04-20 23:00:02,340: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c2fd9b8a-f7dd-4b22-b2b2-a3a0bdb62d0d] succeeded in 1.9350339539998913s: None 2024-04-20T23:00:02.637921799Z [2024-04-20 23:00:02,637: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfd746db-891a-4c38-ad66-db2aa508510e] succeeded in 2.2652113189999454s: None 2024-04-20T23:00:03.013990049Z [2024-04-20 23:00:03,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:00:03.017566201Z [2024-04-20 23:00:03,017: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:00:03.029913021Z [2024-04-20 23:00:03,029: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:00:03.041027106Z [2024-04-20 23:00:03,040: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:00:03.041402438Z [2024-04-20 23:00:03,040: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:00:03.042345303Z [2024-04-20 23:00:03,042: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:00:03.042520742Z [2024-04-20 23:00:03,042: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:00:03.042719895Z [2024-04-20 23:00:03,042: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:00:03.042861937Z [2024-04-20 23:00:03,042: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:00:03.043147743Z [2024-04-20 23:00:03,043: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:00:03.043651172Z [2024-04-20 23:00:03,043: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:00:03.088629148Z [2024-04-20 23:00:03,088: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:00:03.089800676Z [2024-04-20 23:00:03,089: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:00:03.089812350Z [2024-04-20 23:00:03,089: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:00:03.090844494Z [2024-04-20 23:00:03,090: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:00:03.090855945Z [2024-04-20 23:00:03,090: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:00:03.091164497Z [2024-04-20 23:00:03,091: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:00:03.091174097Z [2024-04-20 23:00:03,091: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:00:03.142359084Z [2024-04-20 23:00:03,142: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:00:03.210480407Z [2024-04-20 23:00:03,210: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:00:03.332728857Z [2024-04-20 23:00:03,332: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T23:00:03.338624384Z [2024-04-20 23:00:03,338: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:00:03.386585078Z [2024-04-20 23:00:03,386: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:00:03.388763018Z [2024-04-20 23:00:03,388: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:00:03.388795787Z [2024-04-20 23:00:03,388: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:00:03.388952813Z [2024-04-20 23:00:03,388: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:00:03.388962556Z [2024-04-20 23:00:03,388: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T23:00:03.389207966Z [2024-04-20 23:00:03,389: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:00:03.389218079Z [2024-04-20 23:00:03,389: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:00:03.559755116Z [2024-04-20 23:00:03,559: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:00:04.136554957Z [2024-04-20 23:00:04,136: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c398c1bc-47c4-44ec-ac5e-01daf70b7f8e] succeeded in 3.763855119000027s: None 2024-04-20T23:00:04.206916047Z [2024-04-20 23:00:04,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a59f690-a5a6-43d2-85e0-9efadc5df933] received 2024-04-20T23:00:04.223444119Z [2024-04-20 23:00:04,222: INFO/ForkPoolWorker-15] [9a59f690-a5a6-43d2-85e0-9efadc5df933] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:00:04.738605420Z [2024-04-20 23:00:04,731: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:00:04.891390211Z [2024-04-20 23:00:04,891: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2701c62a-a8b3-4244-af84-60ad82fa5c62] succeeded in 4.5011928599999464s: None 2024-04-20T23:00:05.738724472Z [2024-04-20 23:00:05,738: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[559de4e8-8573-4c0a-94a5-b6d505e44571] succeeded in 5.325287869000022s: None 2024-04-20T23:00:05.988801530Z [2024-04-20 23:00:05,988: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:00:05.992383889Z [2024-04-20 23:00:05,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:00:06.019808441Z [2024-04-20 23:00:06,019: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:00:06.021306895Z [2024-04-20 23:00:06,021: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:00:06.021538400Z [2024-04-20 23:00:06,021: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:00:06.021810738Z [2024-04-20 23:00:06,021: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:00:06.022014040Z [2024-04-20 23:00:06,021: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:00:06.022371783Z [2024-04-20 23:00:06,022: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:00:06.022515103Z [2024-04-20 23:00:06,022: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:00:06.126865529Z [2024-04-20 23:00:06,126: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:00:06.869508471Z [2024-04-20 23:00:06,868: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a59f690-a5a6-43d2-85e0-9efadc5df933] succeeded in 2.6609504190000735s: None 2024-04-20T23:00:07.875436915Z [2024-04-20 23:00:07,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8c511fb-7236-40e1-81f0-78a17b5baeb7] received 2024-04-20T23:00:07.916456075Z [2024-04-20 23:00:07,916: INFO/ForkPoolWorker-15] [a8c511fb-7236-40e1-81f0-78a17b5baeb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:00:08.345395989Z [2024-04-20 23:00:08,342: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:00:09.698468802Z [2024-04-20 23:00:09,696: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:00:09.702106344Z [2024-04-20 23:00:09,701: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:00:09.735453584Z [2024-04-20 23:00:09,735: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:00:09.740482036Z [2024-04-20 23:00:09,740: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:00:09.740522771Z [2024-04-20 23:00:09,740: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:00:09.740615386Z [2024-04-20 23:00:09,740: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:00:09.740737453Z [2024-04-20 23:00:09,740: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:00:09.740956979Z [2024-04-20 23:00:09,740: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:00:09.740992311Z [2024-04-20 23:00:09,740: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:00:09.835052691Z [2024-04-20 23:00:09,834: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:00:10.414013822Z [2024-04-20 23:00:10,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8c511fb-7236-40e1-81f0-78a17b5baeb7] succeeded in 2.5321429069999795s: None 2024-04-20T23:00:10.553695008Z [2024-04-20 23:00:10,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa9ccb55-2bc0-4dcc-9446-36ffe5c113c7] received 2024-04-20T23:00:10.568611031Z [2024-04-20 23:00:10,568: INFO/ForkPoolWorker-15] [aa9ccb55-2bc0-4dcc-9446-36ffe5c113c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:00:10.892687848Z [2024-04-20 23:00:10,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:00:12.119775348Z [2024-04-20 23:00:12,119: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:00:12.126547883Z [2024-04-20 23:00:12,125: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:00:12.148985837Z [2024-04-20 23:00:12,148: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:00:12.150150271Z [2024-04-20 23:00:12,149: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:00:12.150174107Z [2024-04-20 23:00:12,150: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:00:12.150326144Z [2024-04-20 23:00:12,150: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:00:12.150380244Z [2024-04-20 23:00:12,150: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:00:12.150655695Z [2024-04-20 23:00:12,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:00:12.150703729Z [2024-04-20 23:00:12,150: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:00:12.220352142Z [2024-04-20 23:00:12,220: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:00:12.821230188Z [2024-04-20 23:00:12,820: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa9ccb55-2bc0-4dcc-9446-36ffe5c113c7] succeeded in 2.261704555000051s: None 2024-04-20T23:01:00.421157537Z [2024-04-20 23:01:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51f12144-7ea6-48e1-90e1-55dde0ce9042] received 2024-04-20T23:01:00.423468694Z [2024-04-20 23:01:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ff631fa-3ffe-4198-b689-26be12d312cf] received 2024-04-20T23:01:00.435180279Z [2024-04-20 23:01:00,434: INFO/ForkPoolWorker-16] [4ff631fa-3ffe-4198-b689-26be12d312cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:01:00.435442666Z [2024-04-20 23:01:00,434: INFO/ForkPoolWorker-15] [51f12144-7ea6-48e1-90e1-55dde0ce9042] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:01:00.447165972Z [2024-04-20 23:01:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2761c420-43bd-4c9b-a4ce-f40fc4ef5ad7] received 2024-04-20T23:01:00.466471308Z [2024-04-20 23:01:00,466: INFO/ForkPoolWorker-1] [2761c420-43bd-4c9b-a4ce-f40fc4ef5ad7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:01:00.786453207Z [2024-04-20 23:01:00,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:01:00.876051222Z [2024-04-20 23:01:00,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:01:00.911841307Z [2024-04-20 23:01:00,908: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:01:01.103497842Z [2024-04-20 23:01:01,099: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:01:01.107209593Z [2024-04-20 23:01:01,103: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:01:01.147807253Z [2024-04-20 23:01:01,147: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:01:01.150913108Z [2024-04-20 23:01:01,150: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:01:01.150967319Z [2024-04-20 23:01:01,150: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:01:01.151004514Z [2024-04-20 23:01:01,150: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:01:01.151175546Z [2024-04-20 23:01:01,151: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:01:01.264401230Z [2024-04-20 23:01:01,264: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:01:02.137367867Z [2024-04-20 23:01:02,136: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2761c420-43bd-4c9b-a4ce-f40fc4ef5ad7] succeeded in 1.687537925000015s: None 2024-04-20T23:01:02.366979906Z [2024-04-20 23:01:02,366: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:01:02.371799694Z [2024-04-20 23:01:02,371: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:01:02.411755022Z [2024-04-20 23:01:02,411: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:01:02.413252208Z [2024-04-20 23:01:02,413: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:01:02.413318337Z [2024-04-20 23:01:02,413: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:01:02.413491346Z [2024-04-20 23:01:02,413: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:01:02.413566599Z [2024-04-20 23:01:02,413: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:01:02.413816759Z [2024-04-20 23:01:02,413: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:01:02.413891749Z [2024-04-20 23:01:02,413: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:01:02.516948104Z [2024-04-20 23:01:02,516: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:01:02.548798344Z [2024-04-20 23:01:02,548: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:01:02.553234900Z [2024-04-20 23:01:02,552: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:01:02.581798963Z [2024-04-20 23:01:02,581: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:01:02.583409086Z [2024-04-20 23:01:02,583: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:01:02.583626303Z [2024-04-20 23:01:02,583: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:01:02.584000500Z [2024-04-20 23:01:02,583: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:01:02.584169843Z [2024-04-20 23:01:02,584: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:01:02.584539968Z [2024-04-20 23:01:02,584: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:01:02.585023899Z [2024-04-20 23:01:02,584: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:01:02.691374147Z [2024-04-20 23:01:02,691: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:01:04.341237867Z [2024-04-20 23:01:04,339: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51f12144-7ea6-48e1-90e1-55dde0ce9042] succeeded in 3.916403616000025s: None 2024-04-20T23:01:05.010357200Z [2024-04-20 23:01:05,009: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ff631fa-3ffe-4198-b689-26be12d312cf] succeeded in 4.584678094000083s: None 2024-04-20T23:02:00.859818109Z [2024-04-20 23:02:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bc92e9d-05c2-4439-a6ae-84869341f1c2] received 2024-04-20T23:02:00.862316226Z [2024-04-20 23:02:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6eec8ce-9817-486f-a72c-ab1203cc5cde] received 2024-04-20T23:02:00.863924002Z [2024-04-20 23:02:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f6ae81e-a92c-4a62-b24b-6742650b9ad0] received 2024-04-20T23:02:00.879179877Z [2024-04-20 23:02:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a83846c-9636-4c51-a052-3f4763c75ce8] received 2024-04-20T23:02:00.887971185Z [2024-04-20 23:02:00,887: INFO/ForkPoolWorker-15] [2bc92e9d-05c2-4439-a6ae-84869341f1c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:02:00.888920230Z [2024-04-20 23:02:00,888: INFO/ForkPoolWorker-1] [6f6ae81e-a92c-4a62-b24b-6742650b9ad0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:02:00.898224753Z [2024-04-20 23:02:00,897: INFO/ForkPoolWorker-16] [a6eec8ce-9817-486f-a72c-ab1203cc5cde] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:02:00.906350116Z [2024-04-20 23:02:00,906: INFO/ForkPoolWorker-2] [8a83846c-9636-4c51-a052-3f4763c75ce8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:02:01.849722674Z [2024-04-20 23:02:01,829: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:02:02.064526302Z [2024-04-20 23:02:02,050: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:02:02.081963531Z [2024-04-20 23:02:02,062: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:02:02.888250080Z [2024-04-20 23:02:02,872: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:02:02.899782409Z [2024-04-20 23:02:02,899: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:02:02.977690525Z [2024-04-20 23:02:02,964: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:02:03.548670459Z [2024-04-20 23:02:03,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:02:03.628292849Z [2024-04-20 23:02:03,622: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:02:03.631484544Z [2024-04-20 23:02:03,628: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:02:03.632425402Z [2024-04-20 23:02:03,631: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:02:03.653287710Z [2024-04-20 23:02:03,633: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:02:03.951847639Z [2024-04-20 23:02:03,947: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:02:04.875533864Z [2024-04-20 23:02:04,874: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:02:05.970075777Z [2024-04-20 23:02:05,969: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6eec8ce-9817-486f-a72c-ab1203cc5cde] succeeded in 5.099653042999989s: None 2024-04-20T23:02:06.241767617Z [2024-04-20 23:02:06,233: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2bc92e9d-05c2-4439-a6ae-84869341f1c2] succeeded in 5.371437713999967s: None 2024-04-20T23:02:07.645283310Z [2024-04-20 23:02:07,644: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:02:07.649502723Z [2024-04-20 23:02:07,649: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:02:07.770832279Z [2024-04-20 23:02:07,770: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:02:07.793284631Z [2024-04-20 23:02:07,791: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:02:07.793435650Z [2024-04-20 23:02:07,793: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:02:07.799257048Z [2024-04-20 23:02:07,796: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:02:07.801442598Z [2024-04-20 23:02:07,799: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:02:07.801458998Z [2024-04-20 23:02:07,800: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:02:07.801466256Z [2024-04-20 23:02:07,800: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:02:08.051514184Z [2024-04-20 23:02:08,049: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:02:08.167077260Z [2024-04-20 23:02:08,166: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:02:08.171845778Z [2024-04-20 23:02:08,171: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:02:08.245746924Z [2024-04-20 23:02:08,245: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:02:08.252785456Z [2024-04-20 23:02:08,252: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:02:08.253046922Z [2024-04-20 23:02:08,252: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:02:08.253363437Z [2024-04-20 23:02:08,253: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:02:08.253468002Z [2024-04-20 23:02:08,253: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:02:08.253839745Z [2024-04-20 23:02:08,253: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:02:08.253950479Z [2024-04-20 23:02:08,253: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:02:08.442857420Z [2024-04-20 23:02:08,442: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:02:10.180979306Z [2024-04-20 23:02:10,180: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8a83846c-9636-4c51-a052-3f4763c75ce8] succeeded in 9.299486716000047s: None 2024-04-20T23:02:10.673803932Z [2024-04-20 23:02:10,673: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f6ae81e-a92c-4a62-b24b-6742650b9ad0] succeeded in 9.807498978000012s: None 2024-04-20T23:03:01.136173160Z [2024-04-20 23:03:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69929228-4bab-4d99-9351-cb07de194932] received 2024-04-20T23:03:01.206399732Z [2024-04-20 23:03:01,206: INFO/ForkPoolWorker-15] [69929228-4bab-4d99-9351-cb07de194932] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:03:01.233639184Z [2024-04-20 23:03:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86f0a181-396d-47e1-b65b-a25399f87430] received 2024-04-20T23:03:01.254768932Z [2024-04-20 23:03:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fbc7007-95ce-4c9b-a404-c3ddf209e82d] received 2024-04-20T23:03:01.272753687Z [2024-04-20 23:03:01,272: INFO/ForkPoolWorker-16] [86f0a181-396d-47e1-b65b-a25399f87430] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:03:01.276647720Z [2024-04-20 23:03:01,274: INFO/ForkPoolWorker-1] [7fbc7007-95ce-4c9b-a404-c3ddf209e82d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:03:01.833595049Z [2024-04-20 23:03:01,830: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:03:01.853351409Z [2024-04-20 23:03:01,850: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:03:02.046842216Z [2024-04-20 23:03:02,042: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:03:02.065508277Z [2024-04-20 23:03:02,065: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:03:02.069641445Z [2024-04-20 23:03:02,069: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:03:02.112094527Z [2024-04-20 23:03:02,111: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:03:02.115551921Z [2024-04-20 23:03:02,115: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:03:02.117570597Z [2024-04-20 23:03:02,115: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:03:02.117732307Z [2024-04-20 23:03:02,117: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:03:02.118809209Z [2024-04-20 23:03:02,118: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:03:02.261923257Z [2024-04-20 23:03:02,261: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:03:03.530741229Z [2024-04-20 23:03:03,530: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86f0a181-396d-47e1-b65b-a25399f87430] succeeded in 2.282348711000168s: None 2024-04-20T23:03:04.538762433Z [2024-04-20 23:03:04,535: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:03:04.540966677Z [2024-04-20 23:03:04,540: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:03:04.591648306Z [2024-04-20 23:03:04,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:03:04.593120982Z [2024-04-20 23:03:04,592: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:03:04.593217915Z [2024-04-20 23:03:04,593: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:03:04.593473552Z [2024-04-20 23:03:04,593: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:03:04.593602527Z [2024-04-20 23:03:04,593: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:03:04.593997430Z [2024-04-20 23:03:04,593: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:03:04.594124534Z [2024-04-20 23:03:04,594: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:03:04.688659026Z [2024-04-20 23:03:04,686: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:03:04.697031465Z [2024-04-20 23:03:04,696: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:03:04.755473535Z [2024-04-20 23:03:04,755: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:03:04.756747666Z [2024-04-20 23:03:04,756: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:03:04.756832281Z [2024-04-20 23:03:04,756: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:03:04.756980754Z [2024-04-20 23:03:04,756: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:03:04.757058370Z [2024-04-20 23:03:04,756: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:03:04.757319843Z [2024-04-20 23:03:04,757: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:03:04.757388892Z [2024-04-20 23:03:04,757: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:03:04.766589107Z [2024-04-20 23:03:04,766: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:03:04.898756160Z [2024-04-20 23:03:04,898: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:03:06.541673548Z [2024-04-20 23:03:06,541: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[69929228-4bab-4d99-9351-cb07de194932] succeeded in 5.3848142439999265s: None 2024-04-20T23:03:08.398628618Z [2024-04-20 23:03:08,398: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7fbc7007-95ce-4c9b-a404-c3ddf209e82d] succeeded in 7.138949455000102s: None 2024-04-20T23:04:01.201967875Z [2024-04-20 23:04:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38daaa02-7ff9-4c7e-8ed1-ed1b9ad7c768] received 2024-04-20T23:04:01.208797747Z [2024-04-20 23:04:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25dc11ae-7a7e-4aa2-8cb5-40c18f0e0506] received 2024-04-20T23:04:01.215623559Z [2024-04-20 23:04:01,215: INFO/ForkPoolWorker-15] [38daaa02-7ff9-4c7e-8ed1-ed1b9ad7c768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:04:01.219645591Z [2024-04-20 23:04:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10fe991b-5d68-4d68-9ee3-72522e917086] received 2024-04-20T23:04:01.222190391Z [2024-04-20 23:04:01,221: INFO/ForkPoolWorker-16] [25dc11ae-7a7e-4aa2-8cb5-40c18f0e0506] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:04:01.227230239Z [2024-04-20 23:04:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7979b0af-281b-453f-9d4d-99c7255a9358] received 2024-04-20T23:04:01.239897047Z [2024-04-20 23:04:01,239: INFO/ForkPoolWorker-2] [7979b0af-281b-453f-9d4d-99c7255a9358] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:04:01.244088883Z [2024-04-20 23:04:01,241: INFO/ForkPoolWorker-1] [10fe991b-5d68-4d68-9ee3-72522e917086] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:04:01.681146155Z [2024-04-20 23:04:01,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:04:01.823342280Z [2024-04-20 23:04:01,810: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:04:01.892689836Z [2024-04-20 23:04:01,883: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:04:02.066375948Z [2024-04-20 23:04:02,062: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:04:02.123465213Z [2024-04-20 23:04:02,123: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:04:02.127739333Z [2024-04-20 23:04:02,127: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:04:02.169570845Z [2024-04-20 23:04:02,169: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:04:02.172956666Z [2024-04-20 23:04:02,172: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:04:02.173133013Z [2024-04-20 23:04:02,172: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:04:02.173248470Z [2024-04-20 23:04:02,173: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:04:02.173518403Z [2024-04-20 23:04:02,173: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:04:02.374546883Z [2024-04-20 23:04:02,374: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:04:02.582238452Z [2024-04-20 23:04:02,581: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:04:03.464328750Z [2024-04-20 23:04:03,463: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25dc11ae-7a7e-4aa2-8cb5-40c18f0e0506] succeeded in 2.2526060340001095s: None 2024-04-20T23:04:03.766024940Z [2024-04-20 23:04:03,765: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[10fe991b-5d68-4d68-9ee3-72522e917086] succeeded in 2.5369845469999746s: None 2024-04-20T23:04:04.252688783Z [2024-04-20 23:04:04,252: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:04:04.257344096Z [2024-04-20 23:04:04,256: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:04:04.279777721Z [2024-04-20 23:04:04,279: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:04:04.282640502Z [2024-04-20 23:04:04,282: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:04:04.282677291Z [2024-04-20 23:04:04,282: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:04:04.282870154Z [2024-04-20 23:04:04,282: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:04:04.282911307Z [2024-04-20 23:04:04,282: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:04:04.283098710Z [2024-04-20 23:04:04,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:04:04.283150251Z [2024-04-20 23:04:04,283: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:04:04.382915354Z [2024-04-20 23:04:04,382: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:04:04.486618390Z [2024-04-20 23:04:04,486: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:04:04.492899516Z [2024-04-20 23:04:04,492: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:04:04.533373532Z [2024-04-20 23:04:04,533: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:04:04.547451884Z [2024-04-20 23:04:04,547: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:04:04.547494722Z [2024-04-20 23:04:04,547: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:04:04.547730856Z [2024-04-20 23:04:04,547: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:04:04.547865700Z [2024-04-20 23:04:04,547: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:04:04.548319655Z [2024-04-20 23:04:04,548: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:04:04.548333505Z [2024-04-20 23:04:04,548: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:04:04.789520782Z [2024-04-20 23:04:04,789: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:04:06.574679298Z [2024-04-20 23:04:06,573: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7979b0af-281b-453f-9d4d-99c7255a9358] succeeded in 5.340350347999902s: None 2024-04-20T23:04:06.659189112Z [2024-04-20 23:04:06,658: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38daaa02-7ff9-4c7e-8ed1-ed1b9ad7c768] succeeded in 5.452874123000129s: None 2024-04-20T23:05:01.264322699Z [2024-04-20 23:05:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[614cb7eb-63cc-4129-829a-309262b6c095] received 2024-04-20T23:05:01.268072685Z [2024-04-20 23:05:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c581228b-6d2b-4f92-a660-269b3982231c] received 2024-04-20T23:05:01.269439669Z [2024-04-20 23:05:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dfc4d44-a995-4437-8b7b-1d46b545df2f] received 2024-04-20T23:05:01.278045229Z [2024-04-20 23:05:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a72e3066-1478-451e-be8b-f94f1301e4bc] received 2024-04-20T23:05:01.281494548Z [2024-04-20 23:05:01,281: INFO/ForkPoolWorker-16] [c581228b-6d2b-4f92-a660-269b3982231c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:05:01.285641295Z [2024-04-20 23:05:01,285: INFO/ForkPoolWorker-15] [614cb7eb-63cc-4129-829a-309262b6c095] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:05:01.292616450Z [2024-04-20 23:05:01,292: INFO/ForkPoolWorker-2] [a72e3066-1478-451e-be8b-f94f1301e4bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:05:01.293287776Z [2024-04-20 23:05:01,293: INFO/ForkPoolWorker-1] [2dfc4d44-a995-4437-8b7b-1d46b545df2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:05:01.745175567Z [2024-04-20 23:05:01,741: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:05:01.890978367Z [2024-04-20 23:05:01,886: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:05:01.959012237Z [2024-04-20 23:05:01,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:05:02.056245185Z [2024-04-20 23:05:02,055: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:05:02.060486818Z [2024-04-20 23:05:02,060: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:02.081452604Z [2024-04-20 23:05:02,081: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:05:02.082352942Z [2024-04-20 23:05:02,082: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:05:02.082509531Z [2024-04-20 23:05:02,082: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:05:02.082625594Z [2024-04-20 23:05:02,082: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:05:02.082828798Z [2024-04-20 23:05:02,082: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:05:02.085830228Z [2024-04-20 23:05:02,078: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:05:02.246219986Z [2024-04-20 23:05:02,245: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:03.242906873Z [2024-04-20 23:05:03,242: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c581228b-6d2b-4f92-a660-269b3982231c] succeeded in 1.9720519509999122s: None 2024-04-20T23:05:03.756784612Z [2024-04-20 23:05:03,755: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:05:03.766820974Z [2024-04-20 23:05:03,766: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:03.826412529Z [2024-04-20 23:05:03,826: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:05:03.832737262Z [2024-04-20 23:05:03,832: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:03.833211145Z [2024-04-20 23:05:03,832: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:03.833548519Z [2024-04-20 23:05:03,832: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:05:03.835636472Z [2024-04-20 23:05:03,833: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:05:03.835648754Z [2024-04-20 23:05:03,833: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:05:03.835652379Z [2024-04-20 23:05:03,833: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:03.950866603Z [2024-04-20 23:05:03,950: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:04.236355322Z [2024-04-20 23:05:04,232: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:05:04.242714852Z [2024-04-20 23:05:04,242: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:04.298982544Z [2024-04-20 23:05:04,298: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:05:04.305112906Z [2024-04-20 23:05:04,304: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:04.306520172Z [2024-04-20 23:05:04,306: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:04.306713644Z [2024-04-20 23:05:04,306: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:05:04.306868042Z [2024-04-20 23:05:04,306: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:05:04.307690592Z [2024-04-20 23:05:04,307: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:05:04.307798263Z [2024-04-20 23:05:04,307: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:04.376422523Z [2024-04-20 23:05:04,376: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:05:04.387121296Z [2024-04-20 23:05:04,386: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:04.476260178Z [2024-04-20 23:05:04,476: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:05:04.482458974Z [2024-04-20 23:05:04,482: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:04.482477919Z [2024-04-20 23:05:04,482: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:04.482664045Z [2024-04-20 23:05:04,482: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:05:04.482698664Z [2024-04-20 23:05:04,482: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:05:04.482915031Z [2024-04-20 23:05:04,482: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:05:04.482929546Z [2024-04-20 23:05:04,482: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:04.485920447Z [2024-04-20 23:05:04,485: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:04.707401463Z [2024-04-20 23:05:04,707: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:05.636705999Z [2024-04-20 23:05:05,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[614cb7eb-63cc-4129-829a-309262b6c095] succeeded in 4.36623514300004s: None 2024-04-20T23:05:06.210535331Z [2024-04-20 23:05:06,210: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a72e3066-1478-451e-be8b-f94f1301e4bc] succeeded in 4.930682754000145s: None 2024-04-20T23:05:06.340100158Z [2024-04-20 23:05:06,336: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2dfc4d44-a995-4437-8b7b-1d46b545df2f] succeeded in 5.059497242000134s: None 2024-04-20T23:05:06.423185608Z [2024-04-20 23:05:06,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[feb47882-3005-4d79-9393-6b93835b717d] received 2024-04-20T23:05:06.438717834Z [2024-04-20 23:05:06,438: INFO/ForkPoolWorker-15] [feb47882-3005-4d79-9393-6b93835b717d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:05:06.762739052Z [2024-04-20 23:05:06,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:05:07.939355923Z [2024-04-20 23:05:07,938: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:05:07.943065275Z [2024-04-20 23:05:07,942: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:07.964666212Z [2024-04-20 23:05:07,964: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:05:07.965686816Z [2024-04-20 23:05:07,965: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:07.965703874Z [2024-04-20 23:05:07,965: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:07.965790697Z [2024-04-20 23:05:07,965: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:05:07.965798836Z [2024-04-20 23:05:07,965: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:05:07.966056955Z [2024-04-20 23:05:07,965: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:05:07.966111534Z [2024-04-20 23:05:07,965: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:08.070402946Z [2024-04-20 23:05:08,069: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:08.723385100Z [2024-04-20 23:05:08,722: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[feb47882-3005-4d79-9393-6b93835b717d] succeeded in 2.298177709999891s: None 2024-04-20T23:05:08.828031957Z [2024-04-20 23:05:08,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2885aa5-f7d4-42d0-861b-bedbb9e12252] received 2024-04-20T23:05:08.834819384Z [2024-04-20 23:05:08,834: INFO/ForkPoolWorker-15] [b2885aa5-f7d4-42d0-861b-bedbb9e12252] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:05:09.115041221Z [2024-04-20 23:05:09,111: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:05:10.438434159Z [2024-04-20 23:05:10,438: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:05:10.444660060Z [2024-04-20 23:05:10,444: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:10.465835883Z [2024-04-20 23:05:10,465: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:05:10.467157317Z [2024-04-20 23:05:10,466: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:10.467404754Z [2024-04-20 23:05:10,467: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:10.467926052Z [2024-04-20 23:05:10,467: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:05:10.468143496Z [2024-04-20 23:05:10,468: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:05:10.468661432Z [2024-04-20 23:05:10,468: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:05:10.468903513Z [2024-04-20 23:05:10,468: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:10.564252709Z [2024-04-20 23:05:10,563: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:11.159191436Z [2024-04-20 23:05:11,158: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2885aa5-f7d4-42d0-861b-bedbb9e12252] succeeded in 2.3288472720000755s: None 2024-04-20T23:05:11.431307209Z [2024-04-20 23:05:11,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[461c3cb7-f4a5-46e8-9342-84f304135d6d] received 2024-04-20T23:05:11.438920109Z [2024-04-20 23:05:11,438: INFO/ForkPoolWorker-15] [461c3cb7-f4a5-46e8-9342-84f304135d6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:05:11.798390649Z [2024-04-20 23:05:11,794: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:05:13.024899086Z [2024-04-20 23:05:13,024: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:05:13.028301511Z [2024-04-20 23:05:13,027: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:13.055887116Z [2024-04-20 23:05:13,055: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:05:13.056981622Z [2024-04-20 23:05:13,056: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:13.057001660Z [2024-04-20 23:05:13,056: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:13.057127810Z [2024-04-20 23:05:13,056: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:05:13.057142079Z [2024-04-20 23:05:13,057: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:05:13.057357683Z [2024-04-20 23:05:13,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:05:13.057363487Z [2024-04-20 23:05:13,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:13.151040883Z [2024-04-20 23:05:13,150: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:13.710099995Z [2024-04-20 23:05:13,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[461c3cb7-f4a5-46e8-9342-84f304135d6d] succeeded in 2.2763735900000484s: None 2024-04-20T23:05:50.204984247Z [2024-04-20 23:05:50,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66e0e32c-db1e-42a8-8a2d-49a22b34b077] received 2024-04-20T23:05:50.239370366Z [2024-04-20 23:05:50,239: INFO/ForkPoolWorker-15] [66e0e32c-db1e-42a8-8a2d-49a22b34b077] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:05:50.529278207Z [2024-04-20 23:05:50,525: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:05:51.947535267Z [2024-04-20 23:05:51,947: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:05:51.951805863Z [2024-04-20 23:05:51,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:51.979763998Z [2024-04-20 23:05:51,979: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:05:51.981379308Z [2024-04-20 23:05:51,981: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:51.981465423Z [2024-04-20 23:05:51,981: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:51.981543734Z [2024-04-20 23:05:51,981: INFO/ForkPoolWorker-15] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:05:51.981752873Z [2024-04-20 23:05:51,981: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:05:51.981825317Z [2024-04-20 23:05:51,981: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:05:51.982385887Z [2024-04-20 23:05:51,982: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:05:51.982496340Z [2024-04-20 23:05:51,982: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:51.990386961Z [2024-04-20 23:05:51,990: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:05:52.092444138Z [2024-04-20 23:05:52,092: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:52.769375031Z [2024-04-20 23:05:52,768: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66e0e32c-db1e-42a8-8a2d-49a22b34b077] succeeded in 2.5551328650001324s: None 2024-04-20T23:05:53.289492180Z [2024-04-20 23:05:53,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f7e9ae1-aafe-4db5-8d91-a43f1c33dcd1] received 2024-04-20T23:05:53.300452108Z [2024-04-20 23:05:53,300: INFO/ForkPoolWorker-15] [5f7e9ae1-aafe-4db5-8d91-a43f1c33dcd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'split_metrics', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:05:53.606415630Z [2024-04-20 23:05:53,603: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:05:54.867590060Z [2024-04-20 23:05:54,867: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:05:54.871706874Z [2024-04-20 23:05:54,871: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:54.900811124Z [2024-04-20 23:05:54,899: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:05:54.904383021Z [2024-04-20 23:05:54,904: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:54.904749272Z [2024-04-20 23:05:54,904: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:54.905231154Z [2024-04-20 23:05:54,904: INFO/ForkPoolWorker-15] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:05:54.905589892Z [2024-04-20 23:05:54,904: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:05:54.905724729Z [2024-04-20 23:05:54,905: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:05:54.906172634Z [2024-04-20 23:05:54,905: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:05:54.906191659Z [2024-04-20 23:05:54,905: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:54.913572216Z [2024-04-20 23:05:54,913: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:05:55.001966667Z [2024-04-20 23:05:55,001: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:55.590826922Z [2024-04-20 23:05:55,590: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f7e9ae1-aafe-4db5-8d91-a43f1c33dcd1] succeeded in 2.298214185000006s: None 2024-04-20T23:05:56.129404535Z [2024-04-20 23:05:56,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c1927ae-2362-4d62-a914-9eb4ebf32988] received 2024-04-20T23:05:56.141511570Z [2024-04-20 23:05:56,141: INFO/ForkPoolWorker-15] [4c1927ae-2362-4d62-a914-9eb4ebf32988] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'collect_metrics', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:05:56.480162540Z [2024-04-20 23:05:56,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:05:57.531445529Z [2024-04-20 23:05:57,531: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:05:57.534822129Z [2024-04-20 23:05:57,534: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:05:57.562993551Z [2024-04-20 23:05:57,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:05:57.565410099Z [2024-04-20 23:05:57,564: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:05:57.567628370Z [2024-04-20 23:05:57,566: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:05:57.567752844Z [2024-04-20 23:05:57,567: INFO/ForkPoolWorker-15] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:05:57.567898921Z [2024-04-20 23:05:57,567: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:05:57.567973451Z [2024-04-20 23:05:57,567: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:05:57.568186266Z [2024-04-20 23:05:57,568: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:05:57.568197588Z [2024-04-20 23:05:57,568: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:05:57.576904500Z [2024-04-20 23:05:57,575: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:05:57.657543875Z [2024-04-20 23:05:57,657: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:05:58.209306697Z [2024-04-20 23:05:58,208: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c1927ae-2362-4d62-a914-9eb4ebf32988] succeeded in 2.0769075169998814s: None 2024-04-20T23:05:58.477022026Z [2024-04-20 23:05:58,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71c21e27-c24b-4e2b-a8dd-98947e1952c9] received 2024-04-20T23:05:58.482859499Z [2024-04-20 23:05:58,482: INFO/ForkPoolWorker-15] [71c21e27-c24b-4e2b-a8dd-98947e1952c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'send_prometheus', 'scheduled__2024-04-20T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:05:58.817672859Z [2024-04-20 23:05:58,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:06:00.058068958Z [2024-04-20 23:06:00,057: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:06:00.061849789Z [2024-04-20 23:06:00,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:06:00.087076580Z [2024-04-20 23:06:00,086: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:06:00.088841173Z [2024-04-20 23:06:00,088: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:06:00.088979592Z [2024-04-20 23:06:00,088: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:06:00.089156709Z [2024-04-20 23:06:00,088: INFO/ForkPoolWorker-15] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:06:00.089344114Z [2024-04-20 23:06:00,089: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:06:00.089363698Z [2024-04-20 23:06:00,089: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:06:00.089667225Z [2024-04-20 23:06:00,089: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:06:00.089680313Z [2024-04-20 23:06:00,089: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:06:00.096184337Z [2024-04-20 23:06:00,095: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:06:00.169791832Z [2024-04-20 23:06:00,169: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:06:00.588319485Z [2024-04-20 23:06:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6204cff-8fa6-4302-9868-4aaaa60626ca] received 2024-04-20T23:06:00.600463122Z [2024-04-20 23:06:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67b9c46f-b2fc-4957-a2f7-ae4d2fcdf90d] received 2024-04-20T23:06:00.609845190Z [2024-04-20 23:06:00,609: INFO/ForkPoolWorker-1] [67b9c46f-b2fc-4957-a2f7-ae4d2fcdf90d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:06:00.615986627Z [2024-04-20 23:06:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b581888-f8b8-43de-8316-552dacee9887] received 2024-04-20T23:06:00.617455481Z [2024-04-20 23:06:00,617: INFO/ForkPoolWorker-16] [e6204cff-8fa6-4302-9868-4aaaa60626ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:06:00.625923345Z [2024-04-20 23:06:00,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03850383-53b6-4002-b40e-599486432e92] received 2024-04-20T23:06:00.640105788Z [2024-04-20 23:06:00,639: INFO/ForkPoolWorker-2] [1b581888-f8b8-43de-8316-552dacee9887] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:06:00.656749538Z [2024-04-20 23:06:00,656: INFO/ForkPoolWorker-3] [03850383-53b6-4002-b40e-599486432e92] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:06:00.875420276Z [2024-04-20 23:06:00,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71c21e27-c24b-4e2b-a8dd-98947e1952c9] succeeded in 2.397092724999993s: None 2024-04-20T23:06:01.025263220Z [2024-04-20 23:06:01,021: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:06:01.178577763Z [2024-04-20 23:06:01,175: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:06:01.576603313Z [2024-04-20 23:06:01,557: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:06:01.702751242Z [2024-04-20 23:06:01,685: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:06:01.788843189Z [2024-04-20 23:06:01,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:06:02.152742543Z [2024-04-20 23:06:02,152: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-20T23:06:02.157020079Z [2024-04-20 23:06:02,156: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:06:02.252752063Z [2024-04-20 23:06:02,252: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:06:02.254271533Z [2024-04-20 23:06:02,254: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:06:02.254409682Z [2024-04-20 23:06:02,254: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:06:02.255427523Z [2024-04-20 23:06:02,255: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-20T23:06:02.255684626Z [2024-04-20 23:06:02,255: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:06:02.610344920Z [2024-04-20 23:06:02,609: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:06:03.044729139Z [2024-04-20 23:06:03,044: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6204cff-8fa6-4302-9868-4aaaa60626ca] succeeded in 2.446977486999913s: None 2024-04-20T23:06:04.040906267Z [2024-04-20 23:06:04,040: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[03850383-53b6-4002-b40e-599486432e92] succeeded in 3.408083996999949s: None 2024-04-20T23:06:04.238282735Z [2024-04-20 23:06:04,237: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:06:04.242457210Z [2024-04-20 23:06:04,242: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:06:04.266447101Z [2024-04-20 23:06:04,266: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:06:04.267456437Z [2024-04-20 23:06:04,267: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:06:04.267476824Z [2024-04-20 23:06:04,267: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:06:04.267490890Z [2024-04-20 23:06:04,267: INFO/ForkPoolWorker-2] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:06:04.267628697Z [2024-04-20 23:06:04,267: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:06:04.267640215Z [2024-04-20 23:06:04,267: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:06:04.267953856Z [2024-04-20 23:06:04,267: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:06:04.267970396Z [2024-04-20 23:06:04,267: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:06:04.272183644Z [2024-04-20 23:06:04,271: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:06:04.351215988Z [2024-04-20 23:06:04,350: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:06:04.504479616Z [2024-04-20 23:06:04,504: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:06:04.507692620Z [2024-04-20 23:06:04,507: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:06:04.526696959Z [2024-04-20 23:06:04,526: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:06:04.528038759Z [2024-04-20 23:06:04,527: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:06:04.528150692Z [2024-04-20 23:06:04,527: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:06:04.528259204Z [2024-04-20 23:06:04,528: INFO/ForkPoolWorker-1] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:06:04.528450916Z [2024-04-20 23:06:04,528: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:06:04.528524008Z [2024-04-20 23:06:04,528: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:06:04.528784030Z [2024-04-20 23:06:04,528: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:06:04.528896070Z [2024-04-20 23:06:04,528: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:06:04.533126914Z [2024-04-20 23:06:04,532: INFO/ForkPoolWorker-1] Creating DAG vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:06:04.618778420Z [2024-04-20 23:06:04,618: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:06:05.013060488Z [2024-04-20 23:06:05,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaa503f5-def3-4815-ac1b-dfb1ac671409] received 2024-04-20T23:06:05.014991752Z [2024-04-20 23:06:05,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1277b589-d652-43a8-bd38-2bf37ec7aa97] received 2024-04-20T23:06:05.031900807Z [2024-04-20 23:06:05,031: INFO/ForkPoolWorker-16] [1277b589-d652-43a8-bd38-2bf37ec7aa97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:06:05.032194630Z [2024-04-20 23:06:05,032: INFO/ForkPoolWorker-15] [aaa503f5-def3-4815-ac1b-dfb1ac671409] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:06:05.390858667Z [2024-04-20 23:06:05,387: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:06:05.445295019Z [2024-04-20 23:06:05,441: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:06:06.497005727Z [2024-04-20 23:06:06,495: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1b581888-f8b8-43de-8316-552dacee9887] succeeded in 5.877260585000158s: None 2024-04-20T23:06:06.576832756Z [2024-04-20 23:06:06,576: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67b9c46f-b2fc-4957-a2f7-ae4d2fcdf90d] succeeded in 5.9741764550001335s: None 2024-04-20T23:06:06.856840024Z [2024-04-20 23:06:06,856: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:06:06.860143184Z [2024-04-20 23:06:06,859: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:06:06.885195618Z [2024-04-20 23:06:06,884: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:06:06.886455688Z [2024-04-20 23:06:06,886: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:06:06.886571039Z [2024-04-20 23:06:06,886: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:06:06.886705028Z [2024-04-20 23:06:06,886: INFO/ForkPoolWorker-15] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:06:06.886905065Z [2024-04-20 23:06:06,886: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:06:06.887029589Z [2024-04-20 23:06:06,886: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:06:06.887297105Z [2024-04-20 23:06:06,887: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:06:06.887398899Z [2024-04-20 23:06:06,887: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:06:06.892349982Z [2024-04-20 23:06:06,891: INFO/ForkPoolWorker-15] Creating DAG vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:06:06.913754265Z [2024-04-20 23:06:06,913: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:06:06.919144299Z [2024-04-20 23:06:06,918: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:06:06.943393874Z [2024-04-20 23:06:06,943: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:06:06.944634545Z [2024-04-20 23:06:06,944: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:06:06.944648406Z [2024-04-20 23:06:06,944: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:06:06.944768256Z [2024-04-20 23:06:06,944: INFO/ForkPoolWorker-16] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:06:06.944904365Z [2024-04-20 23:06:06,944: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:06:06.944915715Z [2024-04-20 23:06:06,944: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:06:06.945124070Z [2024-04-20 23:06:06,945: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:06:06.945150850Z [2024-04-20 23:06:06,945: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:06:06.949615259Z [2024-04-20 23:06:06,949: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:06:06.986777312Z [2024-04-20 23:06:06,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:06:07.047376257Z [2024-04-20 23:06:07,047: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:06:08.456119596Z [2024-04-20 23:06:08,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aaa503f5-def3-4815-ac1b-dfb1ac671409] succeeded in 3.440404676999833s: None 2024-04-20T23:06:08.967130212Z [2024-04-20 23:06:08,966: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1277b589-d652-43a8-bd38-2bf37ec7aa97] succeeded in 3.950684600999921s: None 2024-04-20T23:07:00.901524734Z [2024-04-20 23:07:00,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ad91603-0c53-4345-ab4a-d075c2d5bed3] received 2024-04-20T23:07:00.911399172Z [2024-04-20 23:07:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bc7ec0e-e2a0-46e7-8724-b0cddc2f260f] received 2024-04-20T23:07:00.912170836Z [2024-04-20 23:07:00,911: INFO/ForkPoolWorker-15] [9ad91603-0c53-4345-ab4a-d075c2d5bed3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:07:00.916718557Z [2024-04-20 23:07:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d596cde-f669-41c8-a70f-f863e3a3d917] received 2024-04-20T23:07:00.930426013Z [2024-04-20 23:07:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94959afd-0942-43cf-9b92-bc0e036530ee] received 2024-04-20T23:07:00.931366380Z [2024-04-20 23:07:00,930: INFO/ForkPoolWorker-16] [9bc7ec0e-e2a0-46e7-8724-b0cddc2f260f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:07:00.932082987Z [2024-04-20 23:07:00,931: INFO/ForkPoolWorker-1] [3d596cde-f669-41c8-a70f-f863e3a3d917] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:07:00.945561555Z [2024-04-20 23:07:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c1d685e-a201-4167-afc2-a4252dadbc89] received 2024-04-20T23:07:00.946579799Z [2024-04-20 23:07:00,946: INFO/ForkPoolWorker-2] [94959afd-0942-43cf-9b92-bc0e036530ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:07:00.971862120Z [2024-04-20 23:07:00,971: INFO/ForkPoolWorker-3] [7c1d685e-a201-4167-afc2-a4252dadbc89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:07:01.404539339Z [2024-04-20 23:07:01,400: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:07:01.424000045Z [2024-04-20 23:07:01,420: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:07:01.725613807Z [2024-04-20 23:07:01,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:07:01.804503758Z [2024-04-20 23:07:01,793: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:07:01.882787729Z [2024-04-20 23:07:01,878: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:07:02.237064990Z [2024-04-20 23:07:02,236: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:07:02.250600566Z [2024-04-20 23:07:02,250: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:07:02.351005912Z [2024-04-20 23:07:02,350: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:07:02.352096169Z [2024-04-20 23:07:02,351: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:07:02.357618836Z [2024-04-20 23:07:02,352: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:07:02.357732560Z [2024-04-20 23:07:02,357: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:07:02.358926030Z [2024-04-20 23:07:02,358: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:07:02.587337683Z [2024-04-20 23:07:02,587: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:07:03.562103917Z [2024-04-20 23:07:03,560: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d596cde-f669-41c8-a70f-f863e3a3d917] succeeded in 2.6421004479998373s: None 2024-04-20T23:07:03.700130897Z [2024-04-20 23:07:03,692: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T23:07:03.700155019Z [2024-04-20 23:07:03,697: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:07:03.823835278Z [2024-04-20 23:07:03,822: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:07:03.827506043Z [2024-04-20 23:07:03,825: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:07:03.827524282Z [2024-04-20 23:07:03,825: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:07:03.827529522Z [2024-04-20 23:07:03,826: INFO/ForkPoolWorker-3] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:07:03.827534465Z [2024-04-20 23:07:03,826: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:07:03.857761985Z [2024-04-20 23:07:03,826: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T23:07:03.857798793Z [2024-04-20 23:07:03,853: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:07:03.857802861Z [2024-04-20 23:07:03,853: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:07:03.907625098Z [2024-04-20 23:07:03,902: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:07:03.943302711Z [2024-04-20 23:07:03,942: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:07:03.951777934Z [2024-04-20 23:07:03,945: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:07:04.012228217Z [2024-04-20 23:07:04,012: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:07:04.014902337Z [2024-04-20 23:07:04,014: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:07:04.014983578Z [2024-04-20 23:07:04,014: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:07:04.015081483Z [2024-04-20 23:07:04,014: INFO/ForkPoolWorker-2] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:07:04.015190641Z [2024-04-20 23:07:04,015: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:07:04.015237157Z [2024-04-20 23:07:04,015: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:07:04.015446246Z [2024-04-20 23:07:04,015: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:07:04.015494157Z [2024-04-20 23:07:04,015: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:07:04.020330328Z [2024-04-20 23:07:04,020: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:07:04.156656748Z [2024-04-20 23:07:04,156: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:07:04.186602856Z [2024-04-20 23:07:04,186: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:07:04.259177832Z [2024-04-20 23:07:04,258: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:07:04.270351494Z [2024-04-20 23:07:04,267: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:07:04.324683447Z [2024-04-20 23:07:04,324: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:07:04.332074178Z [2024-04-20 23:07:04,331: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:07:04.332657275Z [2024-04-20 23:07:04,332: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:07:04.332738614Z [2024-04-20 23:07:04,332: INFO/ForkPoolWorker-16] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:07:04.332905910Z [2024-04-20 23:07:04,332: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:07:04.333161826Z [2024-04-20 23:07:04,333: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:07:04.333439495Z [2024-04-20 23:07:04,333: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:07:04.334044836Z [2024-04-20 23:07:04,333: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:07:04.340827017Z [2024-04-20 23:07:04,340: INFO/ForkPoolWorker-16] Creating DAG vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:07:04.501409734Z [2024-04-20 23:07:04,501: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:07:04.770119623Z [2024-04-20 23:07:04,769: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:07:04.776813823Z [2024-04-20 23:07:04,775: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:07:04.821912575Z [2024-04-20 23:07:04,821: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:07:04.829516586Z [2024-04-20 23:07:04,829: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:07:04.848454206Z [2024-04-20 23:07:04,829: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:07:04.857786184Z [2024-04-20 23:07:04,848: INFO/ForkPoolWorker-15] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:07:04.858004643Z [2024-04-20 23:07:04,857: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:07:04.858314321Z [2024-04-20 23:07:04,857: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:07:04.858921791Z [2024-04-20 23:07:04,858: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:07:04.858935003Z [2024-04-20 23:07:04,858: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:07:04.864774897Z [2024-04-20 23:07:04,863: INFO/ForkPoolWorker-15] Creating DAG vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:07:04.974477667Z [2024-04-20 23:07:04,974: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:07:06.515796815Z [2024-04-20 23:07:06,515: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7c1d685e-a201-4167-afc2-a4252dadbc89] succeeded in 5.558084898999823s: None 2024-04-20T23:07:06.619862814Z [2024-04-20 23:07:06,619: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[94959afd-0942-43cf-9b92-bc0e036530ee] succeeded in 5.681618192000315s: None 2024-04-20T23:07:06.621873197Z [2024-04-20 23:07:06,621: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ad91603-0c53-4345-ab4a-d075c2d5bed3] succeeded in 5.718198886999744s: None 2024-04-20T23:07:06.623305783Z [2024-04-20 23:07:06,622: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9bc7ec0e-e2a0-46e7-8724-b0cddc2f260f] succeeded in 5.705114399000195s: None 2024-04-20T23:08:01.250118428Z [2024-04-20 23:08:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[492e1262-1078-4f51-92b9-f23a1b600f0b] received 2024-04-20T23:08:01.254560888Z [2024-04-20 23:08:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7ebcade-6fa3-4f06-9d71-cc8a67906329] received 2024-04-20T23:08:01.261592248Z [2024-04-20 23:08:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67cfb099-f2b7-4f65-adcf-6a99925ca383] received 2024-04-20T23:08:01.262793670Z [2024-04-20 23:08:01,262: INFO/ForkPoolWorker-15] [492e1262-1078-4f51-92b9-f23a1b600f0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:08:01.266925548Z [2024-04-20 23:08:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb345e56-5d89-4157-9ba2-ece0aa5a4544] received 2024-04-20T23:08:01.268963010Z [2024-04-20 23:08:01,268: INFO/ForkPoolWorker-16] [e7ebcade-6fa3-4f06-9d71-cc8a67906329] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:08:01.271420833Z [2024-04-20 23:08:01,271: INFO/ForkPoolWorker-1] [67cfb099-f2b7-4f65-adcf-6a99925ca383] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:08:01.280656554Z [2024-04-20 23:08:01,280: INFO/ForkPoolWorker-2] [eb345e56-5d89-4157-9ba2-ece0aa5a4544] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:08:01.282878811Z [2024-04-20 23:08:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02cfb826-9737-4688-ba06-17835a5778a0] received 2024-04-20T23:08:01.288379317Z [2024-04-20 23:08:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c27958a3-af82-48c5-a197-4772a246c9c2] received 2024-04-20T23:08:01.313114613Z [2024-04-20 23:08:01,312: INFO/ForkPoolWorker-3] [02cfb826-9737-4688-ba06-17835a5778a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:08:01.327313556Z [2024-04-20 23:08:01,326: INFO/ForkPoolWorker-4] [c27958a3-af82-48c5-a197-4772a246c9c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:08:01.831289350Z [2024-04-20 23:08:01,827: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:08:01.937529099Z [2024-04-20 23:08:01,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:08:02.000419949Z [2024-04-20 23:08:01,996: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:08:02.424822473Z [2024-04-20 23:08:02,420: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:08:02.499408865Z [2024-04-20 23:08:02,496: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:08:02.635796043Z [2024-04-20 23:08:02,624: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:08:02.644805598Z [2024-04-20 23:08:02,644: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:08:02.648782868Z [2024-04-20 23:08:02,648: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:08:02.673338527Z [2024-04-20 23:08:02,673: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:08:02.674590318Z [2024-04-20 23:08:02,674: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:08:02.674742604Z [2024-04-20 23:08:02,674: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:08:02.674839053Z [2024-04-20 23:08:02,674: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:08:02.675074183Z [2024-04-20 23:08:02,674: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:08:02.846567724Z [2024-04-20 23:08:02,846: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:08:03.013817742Z [2024-04-20 23:08:03,013: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:08:04.117066483Z [2024-04-20 23:08:04,116: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eb345e56-5d89-4157-9ba2-ece0aa5a4544] succeeded in 2.8442676119998396s: None 2024-04-20T23:08:04.345505879Z [2024-04-20 23:08:04,345: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-20T23:08:04.348595336Z [2024-04-20 23:08:04,348: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:08:04.396218133Z [2024-04-20 23:08:04,395: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-20T23:08:04.400708892Z [2024-04-20 23:08:04,400: INFO/ForkPoolWorker-4] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:08:04.400723003Z [2024-04-20 23:08:04,400: INFO/ForkPoolWorker-4] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:08:04.400732421Z [2024-04-20 23:08:04,400: INFO/ForkPoolWorker-4] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:08:04.400892164Z [2024-04-20 23:08:04,400: INFO/ForkPoolWorker-4] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:08:04.400922235Z [2024-04-20 23:08:04,400: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-20T23:08:04.401262474Z [2024-04-20 23:08:04,401: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:08:04.401278152Z [2024-04-20 23:08:04,401: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:08:04.405937794Z [2024-04-20 23:08:04,405: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:08:04.423297245Z [2024-04-20 23:08:04,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[492e1262-1078-4f51-92b9-f23a1b600f0b] succeeded in 3.1694062999999915s: None 2024-04-20T23:08:04.501199839Z [2024-04-20 23:08:04,500: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:08:04.659279457Z [2024-04-20 23:08:04,658: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T23:08:04.662804242Z [2024-04-20 23:08:04,662: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:08:04.702567347Z [2024-04-20 23:08:04,702: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:08:04.707025100Z [2024-04-20 23:08:04,706: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:08:04.707038103Z [2024-04-20 23:08:04,706: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:08:04.707133662Z [2024-04-20 23:08:04,706: INFO/ForkPoolWorker-3] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:08:04.707291526Z [2024-04-20 23:08:04,707: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:08:04.707358239Z [2024-04-20 23:08:04,707: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T23:08:04.707715940Z [2024-04-20 23:08:04,707: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:08:04.707720089Z [2024-04-20 23:08:04,707: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:08:04.712259907Z [2024-04-20 23:08:04,712: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:08:04.892851016Z [2024-04-20 23:08:04,892: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:08:05.193966095Z [2024-04-20 23:08:05,193: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:08:05.197791839Z [2024-04-20 23:08:05,197: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:08:05.236945252Z [2024-04-20 23:08:05,236: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:08:05.243212661Z [2024-04-20 23:08:05,240: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:08:05.243261285Z [2024-04-20 23:08:05,243: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:08:05.243289958Z [2024-04-20 23:08:05,243: INFO/ForkPoolWorker-16] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:08:05.243409357Z [2024-04-20 23:08:05,243: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:08:05.243661221Z [2024-04-20 23:08:05,243: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:08:05.244275421Z [2024-04-20 23:08:05,244: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:08:05.244993908Z [2024-04-20 23:08:05,244: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:08:05.249654836Z [2024-04-20 23:08:05,249: INFO/ForkPoolWorker-16] Creating DAG vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:08:05.370413117Z [2024-04-20 23:08:05,370: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:08:05.597109141Z [2024-04-20 23:08:05,596: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:08:05.601362396Z [2024-04-20 23:08:05,600: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:08:05.630431475Z [2024-04-20 23:08:05,630: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:08:05.632128443Z [2024-04-20 23:08:05,631: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:08:05.632142807Z [2024-04-20 23:08:05,631: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:08:05.632157133Z [2024-04-20 23:08:05,632: INFO/ForkPoolWorker-1] Read VIM 0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 (basic_08_vim_test) 2024-04-20T23:08:05.632291320Z [2024-04-20 23:08:05,632: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-20T23:08:05.636233764Z [2024-04-20 23:08:05,636: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:08:05.636432668Z [2024-04-20 23:08:05,636: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:08:05.636471661Z [2024-04-20 23:08:05,636: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:08:05.660410829Z [2024-04-20 23:08:05,660: INFO/ForkPoolWorker-1] Creating DAG vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42 2024-04-20T23:08:05.759400405Z [2024-04-20 23:08:05,759: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:08:06.660533992Z [2024-04-20 23:08:06,660: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[c27958a3-af82-48c5-a197-4772a246c9c2] succeeded in 5.363940287999867s: None 2024-04-20T23:08:07.033769276Z [2024-04-20 23:08:07,033: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[02cfb826-9737-4688-ba06-17835a5778a0] succeeded in 5.746624839000106s: None 2024-04-20T23:08:07.046971699Z [2024-04-20 23:08:07,046: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7ebcade-6fa3-4f06-9d71-cc8a67906329] succeeded in 5.788182638999842s: None 2024-04-20T23:08:07.448627190Z [2024-04-20 23:08:07,448: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67cfb099-f2b7-4f65-adcf-6a99925ca383] succeeded in 6.184977509999953s: None 2024-04-20T23:09:00.273420351Z [2024-04-20 23:09:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[211e7276-33ec-42ab-b8a4-dec56ba1e7df] received 2024-04-20T23:09:00.280863318Z [2024-04-20 23:09:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4b748bd-4d4a-4946-be95-480ae8881bdb] received 2024-04-20T23:09:00.285744388Z [2024-04-20 23:09:00,285: INFO/ForkPoolWorker-15] [211e7276-33ec-42ab-b8a4-dec56ba1e7df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:09:00.287641908Z [2024-04-20 23:09:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59e10530-c072-4ef1-a66c-dfeeefb4aa9c] received 2024-04-20T23:09:00.292921363Z [2024-04-20 23:09:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39d7f9fc-ea54-4e7d-b843-b7a700e60227] received 2024-04-20T23:09:00.294293786Z [2024-04-20 23:09:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6f54a3e-dca8-4e79-bf68-776614d3fd4a] received 2024-04-20T23:09:00.296824840Z [2024-04-20 23:09:00,296: INFO/ForkPoolWorker-16] [a4b748bd-4d4a-4946-be95-480ae8881bdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:09:00.304382338Z [2024-04-20 23:09:00,304: INFO/ForkPoolWorker-3] [b6f54a3e-dca8-4e79-bf68-776614d3fd4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:09:00.305678941Z [2024-04-20 23:09:00,305: INFO/ForkPoolWorker-1] [59e10530-c072-4ef1-a66c-dfeeefb4aa9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:09:00.306017756Z [2024-04-20 23:09:00,305: INFO/ForkPoolWorker-2] [39d7f9fc-ea54-4e7d-b843-b7a700e60227] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:09:00.619791237Z [2024-04-20 23:09:00,614: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:09:00.642116841Z [2024-04-20 23:09:00,638: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:09:00.704525014Z [2024-04-20 23:09:00,701: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:09:00.753289901Z [2024-04-20 23:09:00,749: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:09:00.762673346Z [2024-04-20 23:09:00,755: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:09:00.823804289Z [2024-04-20 23:09:00,823: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:09:00.827875655Z [2024-04-20 23:09:00,827: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:00.860366490Z [2024-04-20 23:09:00,860: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:09:00.864646930Z [2024-04-20 23:09:00,864: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:09:00.865082624Z [2024-04-20 23:09:00,864: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:09:00.865155816Z [2024-04-20 23:09:00,865: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:09:00.865433747Z [2024-04-20 23:09:00,865: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:09:00.991501187Z [2024-04-20 23:09:00,991: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:09:01.853227712Z [2024-04-20 23:09:01,852: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59e10530-c072-4ef1-a66c-dfeeefb4aa9c] succeeded in 1.5620877110000038s: None 2024-04-20T23:09:02.149987065Z [2024-04-20 23:09:02,149: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:09:02.153335955Z [2024-04-20 23:09:02,152: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:02.166239278Z [2024-04-20 23:09:02,165: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T23:09:02.170229492Z [2024-04-20 23:09:02,169: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:02.188776763Z [2024-04-20 23:09:02,188: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:09:02.190333540Z [2024-04-20 23:09:02,190: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:02.190351011Z [2024-04-20 23:09:02,190: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:02.190604296Z [2024-04-20 23:09:02,190: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:02.190658882Z [2024-04-20 23:09:02,190: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:09:02.190886730Z [2024-04-20 23:09:02,190: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:09:02.190961001Z [2024-04-20 23:09:02,190: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:02.210414463Z [2024-04-20 23:09:02,210: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:09:02.212266716Z [2024-04-20 23:09:02,211: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:02.212442630Z [2024-04-20 23:09:02,212: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:02.212622643Z [2024-04-20 23:09:02,212: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:02.212742228Z [2024-04-20 23:09:02,212: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T23:09:02.213263192Z [2024-04-20 23:09:02,213: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:09:02.213470076Z [2024-04-20 23:09:02,213: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:02.292588732Z [2024-04-20 23:09:02,292: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:09:02.301651398Z [2024-04-20 23:09:02,301: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:09:02.603161432Z [2024-04-20 23:09:02,602: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:09:02.606710774Z [2024-04-20 23:09:02,606: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:02.637189815Z [2024-04-20 23:09:02,636: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:09:02.645019334Z [2024-04-20 23:09:02,644: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:02.645120772Z [2024-04-20 23:09:02,644: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:02.645390135Z [2024-04-20 23:09:02,645: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:02.645550125Z [2024-04-20 23:09:02,645: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:09:02.645948324Z [2024-04-20 23:09:02,645: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:09:02.646116882Z [2024-04-20 23:09:02,645: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:02.655207702Z [2024-04-20 23:09:02,654: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:09:02.656406754Z [2024-04-20 23:09:02,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:09:02.657544758Z [2024-04-20 23:09:02,657: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:09:02.661404848Z [2024-04-20 23:09:02,661: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:02.681269579Z [2024-04-20 23:09:02,681: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:09:02.690255898Z [2024-04-20 23:09:02,690: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:02.690288296Z [2024-04-20 23:09:02,690: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:02.690501859Z [2024-04-20 23:09:02,690: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:02.690588880Z [2024-04-20 23:09:02,690: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:09:02.691052981Z [2024-04-20 23:09:02,690: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:09:02.691233930Z [2024-04-20 23:09:02,691: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:02.694429702Z [2024-04-20 23:09:02,693: ERROR/ForkPoolWorker-16] [a4b748bd-4d4a-4946-be95-480ae8881bdb] Failed to execute task Dag 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' could not be found; either it does not exist or it failed to parse.. 2024-04-20T23:09:02.694443947Z Traceback (most recent call last): 2024-04-20T23:09:02.694447519Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T23:09:02.694450975Z args.func(args) 2024-04-20T23:09:02.694454350Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T23:09:02.694473902Z return func(*args, **kwargs) 2024-04-20T23:09:02.694477300Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T23:09:02.694480799Z return f(*args, **kwargs) 2024-04-20T23:09:02.694483899Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T23:09:02.694487637Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T23:09:02.694490652Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T23:09:02.694493608Z raise AirflowException( 2024-04-20T23:09:02.694497575Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' could not be found; either it does not exist or it failed to parse. 2024-04-20T23:09:02.740177940Z [2024-04-20 23:09:02,739: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4b748bd-4d4a-4946-be95-480ae8881bdb] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a4b748bd-4d4a-4946-be95-480ae8881bdb') 2024-04-20T23:09:02.740195168Z Traceback (most recent call last): 2024-04-20T23:09:02.740199461Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T23:09:02.740202620Z R = retval = fun(*args, **kwargs) 2024-04-20T23:09:02.740205998Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T23:09:02.740209142Z return self.run(*args, **kwargs) 2024-04-20T23:09:02.740212898Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T23:09:02.740216528Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T23:09:02.740229842Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T23:09:02.740233759Z raise AirflowException(msg) 2024-04-20T23:09:02.740237266Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a4b748bd-4d4a-4946-be95-480ae8881bdb 2024-04-20T23:09:02.764609381Z [2024-04-20 23:09:02,764: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:09:02.789163652Z [2024-04-20 23:09:02,788: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:02.848295101Z [2024-04-20 23:09:02,848: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:09:02.849498990Z [2024-04-20 23:09:02,849: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:02.849548387Z [2024-04-20 23:09:02,849: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:02.849665688Z [2024-04-20 23:09:02,849: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:02.849685952Z [2024-04-20 23:09:02,849: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:09:02.849884531Z [2024-04-20 23:09:02,849: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:09:02.849896923Z [2024-04-20 23:09:02,849: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:02.856878407Z [2024-04-20 23:09:02,856: WARNING/ForkPoolWorker-2] Dag 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:09:02.857788992Z [2024-04-20 23:09:02,856: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:09:02.858543331Z [2024-04-20 23:09:02,858: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:09:02.861298095Z [2024-04-20 23:09:02,861: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:02.887475324Z [2024-04-20 23:09:02,887: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:09:02.889456577Z [2024-04-20 23:09:02,889: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:02.889509852Z [2024-04-20 23:09:02,889: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:02.889720561Z [2024-04-20 23:09:02,889: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:02.889847654Z [2024-04-20 23:09:02,889: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:09:02.890187116Z [2024-04-20 23:09:02,889: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:09:02.890288658Z [2024-04-20 23:09:02,890: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:02.895246945Z [2024-04-20 23:09:02,894: ERROR/ForkPoolWorker-2] [39d7f9fc-ea54-4e7d-b843-b7a700e60227] Failed to execute task Dag 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' could not be found; either it does not exist or it failed to parse.. 2024-04-20T23:09:02.895261939Z Traceback (most recent call last): 2024-04-20T23:09:02.895266161Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T23:09:02.895269668Z args.func(args) 2024-04-20T23:09:02.895273356Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T23:09:02.895276824Z return func(*args, **kwargs) 2024-04-20T23:09:02.895280725Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T23:09:02.895283790Z return f(*args, **kwargs) 2024-04-20T23:09:02.895286870Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T23:09:02.895301311Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T23:09:02.895304664Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T23:09:02.895307638Z raise AirflowException( 2024-04-20T23:09:02.895313703Z airflow.exceptions.AirflowException: Dag 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' could not be found; either it does not exist or it failed to parse. 2024-04-20T23:09:02.923404050Z [2024-04-20 23:09:02,922: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39d7f9fc-ea54-4e7d-b843-b7a700e60227] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 39d7f9fc-ea54-4e7d-b843-b7a700e60227') 2024-04-20T23:09:02.923419477Z Traceback (most recent call last): 2024-04-20T23:09:02.923423560Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T23:09:02.923426732Z R = retval = fun(*args, **kwargs) 2024-04-20T23:09:02.923429805Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T23:09:02.923432963Z return self.run(*args, **kwargs) 2024-04-20T23:09:02.923449511Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T23:09:02.923453784Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T23:09:02.923456965Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T23:09:02.923460816Z raise AirflowException(msg) 2024-04-20T23:09:02.923464498Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 39d7f9fc-ea54-4e7d-b843-b7a700e60227 2024-04-20T23:09:04.531831822Z [2024-04-20 23:09:04,531: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b6f54a3e-dca8-4e79-bf68-776614d3fd4a] succeeded in 4.234976122999797s: None 2024-04-20T23:09:04.973565475Z [2024-04-20 23:09:04,973: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[211e7276-33ec-42ab-b8a4-dec56ba1e7df] succeeded in 4.697921400999803s: None 2024-04-20T23:09:14.170068454Z [2024-04-20 23:09:14,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfdf3546-51cd-47c2-a970-eea8ca9ec44c] received 2024-04-20T23:09:14.177190365Z [2024-04-20 23:09:14,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53470aaa-10e9-471b-9461-9af63caf5acc] received 2024-04-20T23:09:14.187206729Z [2024-04-20 23:09:14,186: INFO/ForkPoolWorker-15] [cfdf3546-51cd-47c2-a970-eea8ca9ec44c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:09:14.187553930Z [2024-04-20 23:09:14,187: INFO/ForkPoolWorker-16] [53470aaa-10e9-471b-9461-9af63caf5acc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:09:14.473945861Z [2024-04-20 23:09:14,469: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:09:14.610508857Z [2024-04-20 23:09:14,606: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:09:15.700063683Z [2024-04-20 23:09:15,699: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:09:15.703109015Z [2024-04-20 23:09:15,702: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:15.726350506Z [2024-04-20 23:09:15,726: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:09:15.727762071Z [2024-04-20 23:09:15,727: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:15.727864544Z [2024-04-20 23:09:15,727: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:15.728024000Z [2024-04-20 23:09:15,727: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:15.728080407Z [2024-04-20 23:09:15,727: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:09:15.728345119Z [2024-04-20 23:09:15,728: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:09:15.728359947Z [2024-04-20 23:09:15,728: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:15.738935355Z [2024-04-20 23:09:15,738: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:09:15.739751928Z [2024-04-20 23:09:15,739: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:09:15.740534228Z [2024-04-20 23:09:15,740: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:09:15.743101017Z [2024-04-20 23:09:15,742: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:15.747554849Z [2024-04-20 23:09:15,747: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:09:15.751251713Z [2024-04-20 23:09:15,750: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:15.752184594Z [2024-04-20 23:09:15,752: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:09:15.753472284Z [2024-04-20 23:09:15,753: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:15.753482831Z [2024-04-20 23:09:15,753: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:15.753605473Z [2024-04-20 23:09:15,753: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:15.753611353Z [2024-04-20 23:09:15,753: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:09:15.753790440Z [2024-04-20 23:09:15,753: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:09:15.753795969Z [2024-04-20 23:09:15,753: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:15.757012692Z [2024-04-20 23:09:15,756: ERROR/ForkPoolWorker-16] [53470aaa-10e9-471b-9461-9af63caf5acc] Failed to execute task Dag 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' could not be found; either it does not exist or it failed to parse.. 2024-04-20T23:09:15.757031912Z Traceback (most recent call last): 2024-04-20T23:09:15.757035852Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T23:09:15.757039449Z args.func(args) 2024-04-20T23:09:15.757042777Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T23:09:15.757046364Z return func(*args, **kwargs) 2024-04-20T23:09:15.757049388Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T23:09:15.757052487Z return f(*args, **kwargs) 2024-04-20T23:09:15.757056296Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T23:09:15.757060666Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T23:09:15.757070466Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T23:09:15.757075070Z raise AirflowException( 2024-04-20T23:09:15.757079908Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' could not be found; either it does not exist or it failed to parse. 2024-04-20T23:09:15.789564878Z [2024-04-20 23:09:15,789: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53470aaa-10e9-471b-9461-9af63caf5acc] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 53470aaa-10e9-471b-9461-9af63caf5acc') 2024-04-20T23:09:15.789578757Z Traceback (most recent call last): 2024-04-20T23:09:15.789582439Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T23:09:15.789585914Z R = retval = fun(*args, **kwargs) 2024-04-20T23:09:15.789599954Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T23:09:15.789603220Z return self.run(*args, **kwargs) 2024-04-20T23:09:15.789612186Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T23:09:15.789615413Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T23:09:15.789628001Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T23:09:15.789631179Z raise AirflowException(msg) 2024-04-20T23:09:15.789635233Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 53470aaa-10e9-471b-9461-9af63caf5acc 2024-04-20T23:09:15.791845968Z [2024-04-20 23:09:15,791: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:09:15.793114844Z [2024-04-20 23:09:15,792: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:15.793216396Z [2024-04-20 23:09:15,793: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:15.793404264Z [2024-04-20 23:09:15,793: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:15.793503133Z [2024-04-20 23:09:15,793: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:09:15.793805518Z [2024-04-20 23:09:15,793: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:09:15.793872495Z [2024-04-20 23:09:15,793: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:15.799662547Z [2024-04-20 23:09:15,799: WARNING/ForkPoolWorker-15] Dag 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:09:15.800570976Z [2024-04-20 23:09:15,799: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:09:15.801459834Z [2024-04-20 23:09:15,801: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:09:15.804203604Z [2024-04-20 23:09:15,803: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:09:15.815492837Z [2024-04-20 23:09:15,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:09:15.816933276Z [2024-04-20 23:09:15,816: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:09:15.816982546Z [2024-04-20 23:09:15,816: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:09:15.817177065Z [2024-04-20 23:09:15,816: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:09:15.817224813Z [2024-04-20 23:09:15,817: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:09:15.817506379Z [2024-04-20 23:09:15,817: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:09:15.817581788Z [2024-04-20 23:09:15,817: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:09:15.820632195Z [2024-04-20 23:09:15,820: ERROR/ForkPoolWorker-15] [cfdf3546-51cd-47c2-a970-eea8ca9ec44c] Failed to execute task Dag 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' could not be found; either it does not exist or it failed to parse.. 2024-04-20T23:09:15.820668303Z Traceback (most recent call last): 2024-04-20T23:09:15.820708211Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-20T23:09:15.820722033Z args.func(args) 2024-04-20T23:09:15.820735341Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-20T23:09:15.820748088Z return func(*args, **kwargs) 2024-04-20T23:09:15.820760283Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-20T23:09:15.820772663Z return f(*args, **kwargs) 2024-04-20T23:09:15.820785077Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-20T23:09:15.820796371Z dag = get_dag(args.subdir, args.dag_id) 2024-04-20T23:09:15.820805999Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-20T23:09:15.820813955Z raise AirflowException( 2024-04-20T23:09:15.820822463Z airflow.exceptions.AirflowException: Dag 'vim_status_0428e1e9-20bf-4d8f-b5b8-6c6cdbbc6c42' could not be found; either it does not exist or it failed to parse. 2024-04-20T23:09:15.855138757Z [2024-04-20 23:09:15,853: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfdf3546-51cd-47c2-a970-eea8ca9ec44c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cfdf3546-51cd-47c2-a970-eea8ca9ec44c') 2024-04-20T23:09:15.855177348Z Traceback (most recent call last): 2024-04-20T23:09:15.855192076Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-20T23:09:15.855204382Z R = retval = fun(*args, **kwargs) 2024-04-20T23:09:15.855216303Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-20T23:09:15.855228296Z return self.run(*args, **kwargs) 2024-04-20T23:09:15.855241284Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-20T23:09:15.855254757Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-20T23:09:15.855266604Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-20T23:09:15.855279371Z raise AirflowException(msg) 2024-04-20T23:09:15.855292065Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cfdf3546-51cd-47c2-a970-eea8ca9ec44c 2024-04-20T23:10:00.375471426Z [2024-04-20 23:10:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1460440f-7ebd-4d3f-931e-932b327b8d15] received 2024-04-20T23:10:00.377330420Z [2024-04-20 23:10:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67d3595a-9f2a-4d55-8586-376c80958b78] received 2024-04-20T23:10:00.383384961Z [2024-04-20 23:10:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[858269ae-8d1c-4e16-941a-cc7181034165] received 2024-04-20T23:10:00.384623499Z [2024-04-20 23:10:00,384: INFO/ForkPoolWorker-15] [1460440f-7ebd-4d3f-931e-932b327b8d15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:10:00.388224803Z [2024-04-20 23:10:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d03c4dc-66d5-4527-9b47-04142a2e9d9d] received 2024-04-20T23:10:00.389913478Z [2024-04-20 23:10:00,389: INFO/ForkPoolWorker-16] [67d3595a-9f2a-4d55-8586-376c80958b78] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:10:00.395290265Z [2024-04-20 23:10:00,395: INFO/ForkPoolWorker-1] [858269ae-8d1c-4e16-941a-cc7181034165] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:10:00.397481967Z [2024-04-20 23:10:00,397: INFO/ForkPoolWorker-2] [3d03c4dc-66d5-4527-9b47-04142a2e9d9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:10:00.409786242Z [2024-04-20 23:10:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3990efbc-9e76-44b4-b1e2-7d8933bf0aeb] received 2024-04-20T23:10:00.416529314Z [2024-04-20 23:10:00,416: INFO/ForkPoolWorker-3] [3990efbc-9e76-44b4-b1e2-7d8933bf0aeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:10:00.826199359Z [2024-04-20 23:10:00,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:10:00.865100712Z [2024-04-20 23:10:00,861: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:10:00.899797215Z [2024-04-20 23:10:00,896: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:10:01.027968643Z [2024-04-20 23:10:01,024: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:10:01.219452643Z [2024-04-20 23:10:01,215: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:10:01.237488307Z [2024-04-20 23:10:01,237: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:10:01.258853332Z [2024-04-20 23:10:01,243: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:10:01.326634387Z [2024-04-20 23:10:01,325: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:10:01.327351368Z [2024-04-20 23:10:01,327: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:10:01.327470399Z [2024-04-20 23:10:01,327: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:10:01.328164974Z [2024-04-20 23:10:01,327: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:10:01.328176551Z [2024-04-20 23:10:01,327: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:10:01.476504123Z [2024-04-20 23:10:01,476: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:10:01.682104457Z [2024-04-20 23:10:01,681: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:10:02.537512485Z [2024-04-20 23:10:02,537: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[67d3595a-9f2a-4d55-8586-376c80958b78] succeeded in 2.1569791570000234s: None 2024-04-20T23:10:02.580854911Z [2024-04-20 23:10:02,580: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d03c4dc-66d5-4527-9b47-04142a2e9d9d] succeeded in 2.1900823070000115s: None 2024-04-20T23:10:02.740637566Z [2024-04-20 23:10:02,739: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T23:10:02.744423353Z [2024-04-20 23:10:02,743: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:10:02.796641151Z [2024-04-20 23:10:02,796: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:10:02.798970891Z [2024-04-20 23:10:02,798: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:10:02.798984523Z [2024-04-20 23:10:02,798: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:10:02.799072565Z [2024-04-20 23:10:02,798: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:10:02.799098257Z [2024-04-20 23:10:02,799: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T23:10:02.799314215Z [2024-04-20 23:10:02,799: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:10:02.799340602Z [2024-04-20 23:10:02,799: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:10:02.900156454Z [2024-04-20 23:10:02,899: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:10:03.027548698Z [2024-04-20 23:10:03,027: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:10:03.031007515Z [2024-04-20 23:10:03,030: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:10:03.084728342Z [2024-04-20 23:10:03,084: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:10:03.088872446Z [2024-04-20 23:10:03,088: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:10:03.089160662Z [2024-04-20 23:10:03,089: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:10:03.089407973Z [2024-04-20 23:10:03,089: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:10:03.089653219Z [2024-04-20 23:10:03,089: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:10:03.090023221Z [2024-04-20 23:10:03,089: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:10:03.090257235Z [2024-04-20 23:10:03,090: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:10:03.239094702Z [2024-04-20 23:10:03,238: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:10:03.252256819Z [2024-04-20 23:10:03,251: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:10:03.255479000Z [2024-04-20 23:10:03,255: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:10:03.320524307Z [2024-04-20 23:10:03,320: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:10:03.328131589Z [2024-04-20 23:10:03,327: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:10:03.328172745Z [2024-04-20 23:10:03,328: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:10:03.328382841Z [2024-04-20 23:10:03,328: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:10:03.328453252Z [2024-04-20 23:10:03,328: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:10:03.328762315Z [2024-04-20 23:10:03,328: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:10:03.328887913Z [2024-04-20 23:10:03,328: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:10:03.444173541Z [2024-04-20 23:10:03,443: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:10:03.927797679Z [2024-04-20 23:10:03,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1460440f-7ebd-4d3f-931e-932b327b8d15] succeeded in 3.547328509000181s: None 2024-04-20T23:10:04.762683450Z [2024-04-20 23:10:04,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[184e509b-e72c-4cd0-88fd-08f19a753999] received 2024-04-20T23:10:04.769242610Z [2024-04-20 23:10:04,768: INFO/ForkPoolWorker-15] [184e509b-e72c-4cd0-88fd-08f19a753999] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:10:04.882044611Z [2024-04-20 23:10:04,881: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3990efbc-9e76-44b4-b1e2-7d8933bf0aeb] succeeded in 4.470643487999951s: None 2024-04-20T23:10:04.988238341Z [2024-04-20 23:10:04,987: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[858269ae-8d1c-4e16-941a-cc7181034165] succeeded in 4.598791295999945s: None 2024-04-20T23:10:05.078731519Z [2024-04-20 23:10:05,075: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:10:06.168192942Z [2024-04-20 23:10:06,167: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:10:06.171585574Z [2024-04-20 23:10:06,170: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:10:06.200637501Z [2024-04-20 23:10:06,197: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:10:06.200648429Z [2024-04-20 23:10:06,199: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:10:06.200652173Z [2024-04-20 23:10:06,199: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:10:06.200655908Z [2024-04-20 23:10:06,200: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:10:06.200659514Z [2024-04-20 23:10:06,200: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:10:06.200662766Z [2024-04-20 23:10:06,200: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:10:06.200813758Z [2024-04-20 23:10:06,200: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:10:06.306038046Z [2024-04-20 23:10:06,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:10:07.031486918Z [2024-04-20 23:10:07,030: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[184e509b-e72c-4cd0-88fd-08f19a753999] succeeded in 2.2664087000002837s: None 2024-04-20T23:10:07.134546143Z [2024-04-20 23:10:07,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6141680d-9a5f-4991-b870-ce87e8adfd84] received 2024-04-20T23:10:07.158612249Z [2024-04-20 23:10:07,158: INFO/ForkPoolWorker-15] [6141680d-9a5f-4991-b870-ce87e8adfd84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:10:07.420008735Z [2024-04-20 23:10:07,416: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:10:08.534881067Z [2024-04-20 23:10:08,534: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:10:08.538026008Z [2024-04-20 23:10:08,537: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:10:08.559979591Z [2024-04-20 23:10:08,559: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:10:08.561455645Z [2024-04-20 23:10:08,561: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:10:08.561476577Z [2024-04-20 23:10:08,561: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:10:08.561604177Z [2024-04-20 23:10:08,561: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:10:08.561616272Z [2024-04-20 23:10:08,561: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:10:08.561922661Z [2024-04-20 23:10:08,561: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:10:08.562028758Z [2024-04-20 23:10:08,561: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:10:08.660890902Z [2024-04-20 23:10:08,660: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:10:11.025345530Z [2024-04-20 23:10:11,024: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6141680d-9a5f-4991-b870-ce87e8adfd84] succeeded in 3.886624451999978s: None 2024-04-20T23:10:11.164865022Z [2024-04-20 23:10:11,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abc0cb23-4d0a-49ce-9a97-59523ff0d297] received 2024-04-20T23:10:11.177913485Z [2024-04-20 23:10:11,177: INFO/ForkPoolWorker-15] [abc0cb23-4d0a-49ce-9a97-59523ff0d297] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:10:11.554964048Z [2024-04-20 23:10:11,551: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:10:12.732971307Z [2024-04-20 23:10:12,732: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:10:12.736286643Z [2024-04-20 23:10:12,735: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:10:12.764790593Z [2024-04-20 23:10:12,764: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:10:12.767340389Z [2024-04-20 23:10:12,767: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:10:12.767594668Z [2024-04-20 23:10:12,767: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:10:12.768032543Z [2024-04-20 23:10:12,767: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:10:12.768297071Z [2024-04-20 23:10:12,768: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:10:12.768676621Z [2024-04-20 23:10:12,768: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:10:12.769247861Z [2024-04-20 23:10:12,769: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:10:12.881747622Z [2024-04-20 23:10:12,881: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:10:13.600849413Z [2024-04-20 23:10:13,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abc0cb23-4d0a-49ce-9a97-59523ff0d297] succeeded in 2.433465004000027s: None 2024-04-20T23:11:00.900167818Z [2024-04-20 23:11:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f57e46ba-cf4e-4254-8c5c-8529df9a34e0] received 2024-04-20T23:11:00.902495016Z [2024-04-20 23:11:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4955f3a0-e2b4-4422-83cc-3d3625e43c3a] received 2024-04-20T23:11:00.905964489Z [2024-04-20 23:11:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d668cfc-938d-4fbc-a79f-7f3a2157d24a] received 2024-04-20T23:11:00.915879205Z [2024-04-20 23:11:00,915: INFO/ForkPoolWorker-1] [5d668cfc-938d-4fbc-a79f-7f3a2157d24a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:11:00.921241061Z [2024-04-20 23:11:00,920: INFO/ForkPoolWorker-16] [4955f3a0-e2b4-4422-83cc-3d3625e43c3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:11:00.925412072Z [2024-04-20 23:11:00,925: INFO/ForkPoolWorker-15] [f57e46ba-cf4e-4254-8c5c-8529df9a34e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:11:01.240713244Z [2024-04-20 23:11:01,236: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:11:01.263654704Z [2024-04-20 23:11:01,259: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:11:01.264224555Z [2024-04-20 23:11:01,260: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:11:01.434982164Z [2024-04-20 23:11:01,434: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-20T23:11:01.439203361Z [2024-04-20 23:11:01,438: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:11:01.482842297Z [2024-04-20 23:11:01,482: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:11:01.485562913Z [2024-04-20 23:11:01,484: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:11:01.485576379Z [2024-04-20 23:11:01,484: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:11:01.485580442Z [2024-04-20 23:11:01,485: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-20T23:11:01.485583425Z [2024-04-20 23:11:01,485: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:11:01.639768147Z [2024-04-20 23:11:01,639: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:11:02.275703928Z [2024-04-20 23:11:02,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f57e46ba-cf4e-4254-8c5c-8529df9a34e0] succeeded in 1.3687404540000898s: None 2024-04-20T23:11:02.497190315Z [2024-04-20 23:11:02,496: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:11:02.500346062Z [2024-04-20 23:11:02,499: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:11:02.523914661Z [2024-04-20 23:11:02,523: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:11:02.525124052Z [2024-04-20 23:11:02,524: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:11:02.525203717Z [2024-04-20 23:11:02,525: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:11:02.525311544Z [2024-04-20 23:11:02,525: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:11:02.525385605Z [2024-04-20 23:11:02,525: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:11:02.525577471Z [2024-04-20 23:11:02,525: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:11:02.525642984Z [2024-04-20 23:11:02,525: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:11:02.646337472Z [2024-04-20 23:11:02,646: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:11:02.705468858Z [2024-04-20 23:11:02,705: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:11:02.708634792Z [2024-04-20 23:11:02,708: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:11:02.733040521Z [2024-04-20 23:11:02,732: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:11:02.734224598Z [2024-04-20 23:11:02,734: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:11:02.734282372Z [2024-04-20 23:11:02,734: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:11:02.734391309Z [2024-04-20 23:11:02,734: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:11:02.734435994Z [2024-04-20 23:11:02,734: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:11:02.734758331Z [2024-04-20 23:11:02,734: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:11:02.734765426Z [2024-04-20 23:11:02,734: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:11:02.843367671Z [2024-04-20 23:11:02,843: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:11:04.582506741Z [2024-04-20 23:11:04,581: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4955f3a0-e2b4-4422-83cc-3d3625e43c3a] succeeded in 3.676936602999831s: None 2024-04-20T23:11:04.820771855Z [2024-04-20 23:11:04,820: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5d668cfc-938d-4fbc-a79f-7f3a2157d24a] succeeded in 3.9122155210002347s: None 2024-04-20T23:12:01.309051640Z [2024-04-20 23:12:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cce148d-c85a-445b-9c8d-09b30b02e42b] received 2024-04-20T23:12:01.314122549Z [2024-04-20 23:12:01,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce79ba34-e329-4539-a00d-238fbd40c7c7] received 2024-04-20T23:12:01.330589643Z [2024-04-20 23:12:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49321fff-4327-43ca-aa98-c1c7d34ccb40] received 2024-04-20T23:12:01.331740520Z [2024-04-20 23:12:01,331: INFO/ForkPoolWorker-16] [ce79ba34-e329-4539-a00d-238fbd40c7c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:12:01.333710718Z [2024-04-20 23:12:01,333: INFO/ForkPoolWorker-15] [2cce148d-c85a-445b-9c8d-09b30b02e42b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:12:01.337290036Z [2024-04-20 23:12:01,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d95ca4b3-6489-4338-b376-6317dc8b870c] received 2024-04-20T23:12:01.347868425Z [2024-04-20 23:12:01,347: INFO/ForkPoolWorker-1] [49321fff-4327-43ca-aa98-c1c7d34ccb40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:12:01.358936737Z [2024-04-20 23:12:01,358: INFO/ForkPoolWorker-2] [d95ca4b3-6489-4338-b376-6317dc8b870c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:12:01.743213153Z [2024-04-20 23:12:01,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:12:01.790309930Z [2024-04-20 23:12:01,785: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:12:01.857942695Z [2024-04-20 23:12:01,848: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:12:01.881159706Z [2024-04-20 23:12:01,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:12:02.294873782Z [2024-04-20 23:12:02,294: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:12:02.295249326Z [2024-04-20 23:12:02,295: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:12:02.308607369Z [2024-04-20 23:12:02,308: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:12:02.362135904Z [2024-04-20 23:12:02,361: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:12:02.366264123Z [2024-04-20 23:12:02,366: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:12:02.366357055Z [2024-04-20 23:12:02,366: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:12:02.366918988Z [2024-04-20 23:12:02,366: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:12:02.367124318Z [2024-04-20 23:12:02,366: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:12:02.505856245Z [2024-04-20 23:12:02,505: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:12:03.194813546Z [2024-04-20 23:12:03,194: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cce148d-c85a-445b-9c8d-09b30b02e42b] succeeded in 1.8820057460002317s: None 2024-04-20T23:12:03.351797511Z [2024-04-20 23:12:03,351: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d95ca4b3-6489-4338-b376-6317dc8b870c] succeeded in 2.011993982000149s: None 2024-04-20T23:12:03.491265587Z [2024-04-20 23:12:03,490: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:12:03.494683924Z [2024-04-20 23:12:03,494: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:12:03.506674660Z [2024-04-20 23:12:03,506: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:12:03.510807423Z [2024-04-20 23:12:03,510: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:12:03.519488695Z [2024-04-20 23:12:03,519: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:12:03.520880653Z [2024-04-20 23:12:03,520: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:12:03.521084426Z [2024-04-20 23:12:03,520: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:12:03.521280435Z [2024-04-20 23:12:03,521: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:12:03.521501093Z [2024-04-20 23:12:03,521: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:12:03.522110439Z [2024-04-20 23:12:03,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:12:03.522173038Z [2024-04-20 23:12:03,522: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:12:03.552184209Z [2024-04-20 23:12:03,551: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:12:03.555259609Z [2024-04-20 23:12:03,555: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:12:03.555366083Z [2024-04-20 23:12:03,555: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:12:03.555567053Z [2024-04-20 23:12:03,555: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:12:03.555858818Z [2024-04-20 23:12:03,555: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:12:03.556201714Z [2024-04-20 23:12:03,556: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:12:03.556222639Z [2024-04-20 23:12:03,556: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:12:03.603354209Z [2024-04-20 23:12:03,603: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:12:03.698632632Z [2024-04-20 23:12:03,698: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:12:05.612940754Z [2024-04-20 23:12:05,612: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49321fff-4327-43ca-aa98-c1c7d34ccb40] succeeded in 4.2719603870000356s: None 2024-04-20T23:12:05.664764808Z [2024-04-20 23:12:05,664: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ce79ba34-e329-4539-a00d-238fbd40c7c7] succeeded in 4.3433598749998055s: None 2024-04-20T23:13:01.167834565Z [2024-04-20 23:13:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ceae493-9764-4078-9cb0-cfefd82f04c3] received 2024-04-20T23:13:01.169395370Z [2024-04-20 23:13:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b95eb8c5-7eac-4a87-886d-fc08599e71a7] received 2024-04-20T23:13:01.171304788Z [2024-04-20 23:13:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c799f21-08d5-40e7-a673-e9d762c93ff9] received 2024-04-20T23:13:01.187277926Z [2024-04-20 23:13:01,186: INFO/ForkPoolWorker-16] [b95eb8c5-7eac-4a87-886d-fc08599e71a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:13:01.194671268Z [2024-04-20 23:13:01,194: INFO/ForkPoolWorker-1] [4c799f21-08d5-40e7-a673-e9d762c93ff9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:13:01.219282533Z [2024-04-20 23:13:01,218: INFO/ForkPoolWorker-15] [9ceae493-9764-4078-9cb0-cfefd82f04c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:13:01.592218584Z [2024-04-20 23:13:01,588: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:13:01.609110664Z [2024-04-20 23:13:01,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:13:01.614570161Z [2024-04-20 23:13:01,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:13:01.800053627Z [2024-04-20 23:13:01,799: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:13:01.804737143Z [2024-04-20 23:13:01,804: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:13:01.837701583Z [2024-04-20 23:13:01,837: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:13:01.838916625Z [2024-04-20 23:13:01,838: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:13:01.839543308Z [2024-04-20 23:13:01,839: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:13:01.840233597Z [2024-04-20 23:13:01,839: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:13:01.840616814Z [2024-04-20 23:13:01,840: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:13:01.952861777Z [2024-04-20 23:13:01,952: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:13:02.563412460Z [2024-04-20 23:13:02,563: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c799f21-08d5-40e7-a673-e9d762c93ff9] succeeded in 1.388056852000318s: None 2024-04-20T23:13:02.858541628Z [2024-04-20 23:13:02,858: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:13:02.861903504Z [2024-04-20 23:13:02,861: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:13:02.864438681Z [2024-04-20 23:13:02,863: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:13:02.867804034Z [2024-04-20 23:13:02,867: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:13:02.888144386Z [2024-04-20 23:13:02,887: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:13:02.889719196Z [2024-04-20 23:13:02,889: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:13:02.889861796Z [2024-04-20 23:13:02,889: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:13:02.889920233Z [2024-04-20 23:13:02,889: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:13:02.890122094Z [2024-04-20 23:13:02,889: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:13:02.890136999Z [2024-04-20 23:13:02,890: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:13:02.890470260Z [2024-04-20 23:13:02,890: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:13:02.890524077Z [2024-04-20 23:13:02,890: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:13:02.892670749Z [2024-04-20 23:13:02,892: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:13:02.892747132Z [2024-04-20 23:13:02,892: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:13:02.892950139Z [2024-04-20 23:13:02,892: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:13:02.893008802Z [2024-04-20 23:13:02,892: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:13:02.893347618Z [2024-04-20 23:13:02,893: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:13:02.893406555Z [2024-04-20 23:13:02,893: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:13:02.966165872Z [2024-04-20 23:13:02,965: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:13:02.975873928Z [2024-04-20 23:13:02,975: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:13:04.649698253Z [2024-04-20 23:13:04,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ceae493-9764-4078-9cb0-cfefd82f04c3] succeeded in 3.4767285970001467s: None 2024-04-20T23:13:05.123329838Z [2024-04-20 23:13:05,122: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b95eb8c5-7eac-4a87-886d-fc08599e71a7] succeeded in 3.950004836000062s: None 2024-04-20T23:14:01.042364459Z [2024-04-20 23:14:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5876847a-f4f2-4b88-996f-080d47486d65] received 2024-04-20T23:14:01.044151922Z [2024-04-20 23:14:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eacc67ff-7fda-4aa8-b988-b0ddf525a7e4] received 2024-04-20T23:14:01.061203212Z [2024-04-20 23:14:01,060: INFO/ForkPoolWorker-15] [5876847a-f4f2-4b88-996f-080d47486d65] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:14:01.074278007Z [2024-04-20 23:14:01,073: INFO/ForkPoolWorker-16] [eacc67ff-7fda-4aa8-b988-b0ddf525a7e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:14:01.091974526Z [2024-04-20 23:14:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36c25353-da8d-44db-9a2d-ed3ff6ad4f37] received 2024-04-20T23:14:01.094298716Z [2024-04-20 23:14:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dd1ded6-8bf7-46d5-898f-364c82ee47e7] received 2024-04-20T23:14:01.127665744Z [2024-04-20 23:14:01,126: INFO/ForkPoolWorker-1] [36c25353-da8d-44db-9a2d-ed3ff6ad4f37] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:14:01.130151733Z [2024-04-20 23:14:01,129: INFO/ForkPoolWorker-2] [2dd1ded6-8bf7-46d5-898f-364c82ee47e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:14:01.670946376Z [2024-04-20 23:14:01,662: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:14:01.751814776Z [2024-04-20 23:14:01,744: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:14:02.039158446Z [2024-04-20 23:14:01,993: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:14:02.115600053Z [2024-04-20 23:14:02,107: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:14:02.455528243Z [2024-04-20 23:14:02,454: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:14:02.468053353Z [2024-04-20 23:14:02,467: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:14:02.485614771Z [2024-04-20 23:14:02,485: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:14:02.538693694Z [2024-04-20 23:14:02,538: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:14:02.539864597Z [2024-04-20 23:14:02,539: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:14:02.540326798Z [2024-04-20 23:14:02,540: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:14:02.540341148Z [2024-04-20 23:14:02,540: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:14:02.541366162Z [2024-04-20 23:14:02,541: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:14:02.727325639Z [2024-04-20 23:14:02,726: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:14:03.105181528Z [2024-04-20 23:14:03,104: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5876847a-f4f2-4b88-996f-080d47486d65] succeeded in 2.0596386020001773s: None 2024-04-20T23:14:03.176706875Z [2024-04-20 23:14:03,176: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:14:03.193558598Z [2024-04-20 23:14:03,193: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:14:03.276206621Z [2024-04-20 23:14:03,275: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:14:03.280806936Z [2024-04-20 23:14:03,280: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:14:03.281027335Z [2024-04-20 23:14:03,280: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:14:03.281246916Z [2024-04-20 23:14:03,281: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:14:03.281412000Z [2024-04-20 23:14:03,281: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:14:03.281770672Z [2024-04-20 23:14:03,281: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:14:03.281931484Z [2024-04-20 23:14:03,281: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:14:03.377952482Z [2024-04-20 23:14:03,377: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:14:03.498556662Z [2024-04-20 23:14:03,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[36c25353-da8d-44db-9a2d-ed3ff6ad4f37] succeeded in 2.4027485310002703s: None 2024-04-20T23:14:03.708969243Z [2024-04-20 23:14:03,703: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:14:03.708987433Z [2024-04-20 23:14:03,706: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:14:03.751552741Z [2024-04-20 23:14:03,751: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:14:03.758979938Z [2024-04-20 23:14:03,758: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:14:03.759101202Z [2024-04-20 23:14:03,758: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:14:03.759369979Z [2024-04-20 23:14:03,759: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:14:03.759500742Z [2024-04-20 23:14:03,759: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:14:03.760321329Z [2024-04-20 23:14:03,760: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:14:03.760415322Z [2024-04-20 23:14:03,760: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:14:03.905438206Z [2024-04-20 23:14:03,905: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:14:05.379299429Z [2024-04-20 23:14:05,378: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2dd1ded6-8bf7-46d5-898f-364c82ee47e7] succeeded in 4.26187659299967s: None 2024-04-20T23:14:05.513169586Z [2024-04-20 23:14:05,512: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eacc67ff-7fda-4aa8-b988-b0ddf525a7e4] succeeded in 4.45049614699974s: None 2024-04-20T23:15:00.329011042Z [2024-04-20 23:15:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84333c5a-61d1-46c2-bec7-c386b46753d6] received 2024-04-20T23:15:00.333594088Z [2024-04-20 23:15:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f78d6816-6181-4bb4-9a9e-344682cebb8e] received 2024-04-20T23:15:00.341158718Z [2024-04-20 23:15:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0690832-0c5c-4143-ae4a-558db67ca2dd] received 2024-04-20T23:15:00.343445530Z [2024-04-20 23:15:00,343: INFO/ForkPoolWorker-16] [f78d6816-6181-4bb4-9a9e-344682cebb8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:15:00.343921030Z [2024-04-20 23:15:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b509defc-2873-4829-8486-3a389e325e96] received 2024-04-20T23:15:00.351604512Z [2024-04-20 23:15:00,350: INFO/ForkPoolWorker-15] [84333c5a-61d1-46c2-bec7-c386b46753d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:15:00.352075566Z [2024-04-20 23:15:00,351: INFO/ForkPoolWorker-2] [b509defc-2873-4829-8486-3a389e325e96] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:15:00.352629398Z [2024-04-20 23:15:00,352: INFO/ForkPoolWorker-1] [c0690832-0c5c-4143-ae4a-558db67ca2dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:15:00.644728098Z [2024-04-20 23:15:00,640: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:15:00.706099723Z [2024-04-20 23:15:00,702: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:15:00.756107782Z [2024-04-20 23:15:00,751: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:15:00.761492551Z [2024-04-20 23:15:00,758: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:15:00.915956391Z [2024-04-20 23:15:00,915: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:15:00.920564717Z [2024-04-20 23:15:00,919: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:15:00.942471623Z [2024-04-20 23:15:00,942: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:15:00.943796305Z [2024-04-20 23:15:00,943: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:15:00.943925703Z [2024-04-20 23:15:00,943: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:15:00.944020749Z [2024-04-20 23:15:00,943: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:15:00.944280150Z [2024-04-20 23:15:00,944: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:15:01.024212865Z [2024-04-20 23:15:01,023: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:15:01.683846461Z [2024-04-20 23:15:01,683: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b509defc-2873-4829-8486-3a389e325e96] succeeded in 1.3377900730001784s: None 2024-04-20T23:15:02.114976288Z [2024-04-20 23:15:02,114: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:15:02.118655895Z [2024-04-20 23:15:02,118: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:15:02.126637984Z [2024-04-20 23:15:02,126: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:15:02.127296888Z [2024-04-20 23:15:02,126: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:15:02.131058513Z [2024-04-20 23:15:02,130: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:15:02.131479096Z [2024-04-20 23:15:02,130: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:15:02.137746814Z [2024-04-20 23:15:02,137: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:15:02.139166514Z [2024-04-20 23:15:02,138: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:15:02.139307348Z [2024-04-20 23:15:02,139: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:15:02.139466550Z [2024-04-20 23:15:02,139: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:15:02.139502412Z [2024-04-20 23:15:02,139: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:15:02.139839349Z [2024-04-20 23:15:02,139: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:15:02.139959673Z [2024-04-20 23:15:02,139: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:15:02.152213546Z [2024-04-20 23:15:02,152: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:15:02.156910911Z [2024-04-20 23:15:02,156: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:15:02.157073856Z [2024-04-20 23:15:02,156: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:15:02.157237654Z [2024-04-20 23:15:02,157: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:15:02.157558161Z [2024-04-20 23:15:02,157: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:15:02.158328272Z [2024-04-20 23:15:02,157: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:15:02.158587904Z [2024-04-20 23:15:02,158: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:15:02.161278144Z [2024-04-20 23:15:02,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:15:02.162831630Z [2024-04-20 23:15:02,162: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:15:02.162843478Z [2024-04-20 23:15:02,162: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:15:02.162848229Z [2024-04-20 23:15:02,162: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:15:02.162852044Z [2024-04-20 23:15:02,162: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:15:02.163076268Z [2024-04-20 23:15:02,162: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:15:02.163149208Z [2024-04-20 23:15:02,163: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:15:02.252704769Z [2024-04-20 23:15:02,252: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:15:02.256834913Z [2024-04-20 23:15:02,256: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:15:02.271616332Z [2024-04-20 23:15:02,271: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:15:02.989711753Z [2024-04-20 23:15:02,988: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84333c5a-61d1-46c2-bec7-c386b46753d6] succeeded in 2.6561469069997656s: None 2024-04-20T23:15:03.777052191Z [2024-04-20 23:15:03,776: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f78d6816-6181-4bb4-9a9e-344682cebb8e] succeeded in 3.4404689670000153s: None 2024-04-20T23:15:04.032409778Z [2024-04-20 23:15:04,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2feab7eb-194a-4bdf-a6c2-1dbfa3476407] received 2024-04-20T23:15:04.053559234Z [2024-04-20 23:15:04,053: INFO/ForkPoolWorker-15] [2feab7eb-194a-4bdf-a6c2-1dbfa3476407] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:15:04.198282487Z [2024-04-20 23:15:04,197: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c0690832-0c5c-4143-ae4a-558db67ca2dd] succeeded in 3.852780204999817s: None 2024-04-20T23:15:04.460103813Z [2024-04-20 23:15:04,457: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:15:05.600935926Z [2024-04-20 23:15:05,600: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:15:05.604486572Z [2024-04-20 23:15:05,603: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:15:05.629829415Z [2024-04-20 23:15:05,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:15:05.631280088Z [2024-04-20 23:15:05,631: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:15:05.631384391Z [2024-04-20 23:15:05,631: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:15:05.631563741Z [2024-04-20 23:15:05,631: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:15:05.631644596Z [2024-04-20 23:15:05,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:15:05.632043699Z [2024-04-20 23:15:05,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:15:05.632147518Z [2024-04-20 23:15:05,632: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:15:05.715137467Z [2024-04-20 23:15:05,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:15:06.329665472Z [2024-04-20 23:15:06,329: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2feab7eb-194a-4bdf-a6c2-1dbfa3476407] succeeded in 2.2929767569999058s: None 2024-04-20T23:15:06.979830543Z [2024-04-20 23:15:06,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e732bf43-afa7-4a9f-b9ff-9635848b8400] received 2024-04-20T23:15:06.992438212Z [2024-04-20 23:15:06,992: INFO/ForkPoolWorker-15] [e732bf43-afa7-4a9f-b9ff-9635848b8400] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:15:07.247236114Z [2024-04-20 23:15:07,244: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:15:08.304765048Z [2024-04-20 23:15:08,304: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:15:08.308085086Z [2024-04-20 23:15:08,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:15:08.329292969Z [2024-04-20 23:15:08,329: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:15:08.330835262Z [2024-04-20 23:15:08,330: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:15:08.330860534Z [2024-04-20 23:15:08,330: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:15:08.330983162Z [2024-04-20 23:15:08,330: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:15:08.331099086Z [2024-04-20 23:15:08,330: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:15:08.331316127Z [2024-04-20 23:15:08,331: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:15:08.331342513Z [2024-04-20 23:15:08,331: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:15:08.430151358Z [2024-04-20 23:15:08,429: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:15:09.080444971Z [2024-04-20 23:15:09,080: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e732bf43-afa7-4a9f-b9ff-9635848b8400] succeeded in 2.098239993000334s: None 2024-04-20T23:15:09.164139082Z [2024-04-20 23:15:09,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e868b24-81f1-4cba-975d-b958081303cf] received 2024-04-20T23:15:09.177416048Z [2024-04-20 23:15:09,176: INFO/ForkPoolWorker-15] [9e868b24-81f1-4cba-975d-b958081303cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:15:09.468106694Z [2024-04-20 23:15:09,464: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:15:10.560701201Z [2024-04-20 23:15:10,560: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:15:10.563940702Z [2024-04-20 23:15:10,563: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:15:10.586374346Z [2024-04-20 23:15:10,586: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:15:10.587453956Z [2024-04-20 23:15:10,587: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:15:10.587465605Z [2024-04-20 23:15:10,587: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:15:10.587764283Z [2024-04-20 23:15:10,587: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:15:10.587810269Z [2024-04-20 23:15:10,587: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:15:10.588172275Z [2024-04-20 23:15:10,587: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:15:10.588228043Z [2024-04-20 23:15:10,588: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:15:10.693478226Z [2024-04-20 23:15:10,693: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:15:11.359835133Z [2024-04-20 23:15:11,358: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e868b24-81f1-4cba-975d-b958081303cf] succeeded in 2.191336255999886s: None 2024-04-20T23:16:00.771170042Z [2024-04-20 23:16:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1bbdb8c-2d29-4dd4-b7d7-b2be90482c0b] received 2024-04-20T23:16:00.781534862Z [2024-04-20 23:16:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0c4d2a6-11cc-43d0-bd6b-cb03059a94a5] received 2024-04-20T23:16:00.790840254Z [2024-04-20 23:16:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b413a556-732a-4957-8c88-625073ee5250] received 2024-04-20T23:16:00.792729627Z [2024-04-20 23:16:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15a3e3ac-afc2-4897-b547-28aa7b852581] received 2024-04-20T23:16:00.793522249Z [2024-04-20 23:16:00,793: INFO/ForkPoolWorker-16] [d0c4d2a6-11cc-43d0-bd6b-cb03059a94a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:16:00.794157145Z [2024-04-20 23:16:00,793: INFO/ForkPoolWorker-15] [c1bbdb8c-2d29-4dd4-b7d7-b2be90482c0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:16:00.813064664Z [2024-04-20 23:16:00,812: INFO/ForkPoolWorker-2] [15a3e3ac-afc2-4897-b547-28aa7b852581] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:16:00.814207803Z [2024-04-20 23:16:00,813: INFO/ForkPoolWorker-1] [b413a556-732a-4957-8c88-625073ee5250] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:16:01.150518138Z [2024-04-20 23:16:01,140: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:16:01.242516841Z [2024-04-20 23:16:01,237: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:16:01.307844641Z [2024-04-20 23:16:01,304: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:16:01.312334134Z [2024-04-20 23:16:01,307: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:16:01.512769141Z [2024-04-20 23:16:01,512: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:16:01.522688553Z [2024-04-20 23:16:01,516: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:16:01.567323451Z [2024-04-20 23:16:01,567: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:16:01.570380714Z [2024-04-20 23:16:01,570: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:16:01.570427548Z [2024-04-20 23:16:01,570: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:16:01.570484501Z [2024-04-20 23:16:01,570: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:16:01.570791370Z [2024-04-20 23:16:01,570: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:16:01.593821774Z [2024-04-20 23:16:01,593: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:16:01.706701167Z [2024-04-20 23:16:01,706: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:16:02.263335285Z [2024-04-20 23:16:02,262: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1bbdb8c-2d29-4dd4-b7d7-b2be90482c0b] succeeded in 1.4896748240003035s: None 2024-04-20T23:16:02.395947900Z [2024-04-20 23:16:02,395: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b413a556-732a-4957-8c88-625073ee5250] succeeded in 1.5994802290001644s: None 2024-04-20T23:16:02.597053251Z [2024-04-20 23:16:02,596: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:16:02.600388164Z [2024-04-20 23:16:02,599: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:16:02.621102969Z [2024-04-20 23:16:02,620: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:16:02.622213013Z [2024-04-20 23:16:02,622: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:16:02.622351919Z [2024-04-20 23:16:02,622: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:16:02.622538732Z [2024-04-20 23:16:02,622: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:16:02.622658953Z [2024-04-20 23:16:02,622: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:16:02.622913997Z [2024-04-20 23:16:02,622: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:16:02.623037051Z [2024-04-20 23:16:02,622: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:16:02.708470237Z [2024-04-20 23:16:02,708: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:16:02.810122309Z [2024-04-20 23:16:02,809: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:16:02.813088379Z [2024-04-20 23:16:02,812: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:16:02.840533076Z [2024-04-20 23:16:02,840: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:16:02.843296837Z [2024-04-20 23:16:02,843: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:16:02.843307862Z [2024-04-20 23:16:02,843: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:16:02.843400219Z [2024-04-20 23:16:02,843: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:16:02.843428353Z [2024-04-20 23:16:02,843: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:16:02.843610675Z [2024-04-20 23:16:02,843: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:16:02.843641281Z [2024-04-20 23:16:02,843: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:16:02.939456817Z [2024-04-20 23:16:02,939: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:16:04.283914713Z [2024-04-20 23:16:04,283: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0c4d2a6-11cc-43d0-bd6b-cb03059a94a5] succeeded in 3.498802140999942s: None 2024-04-20T23:16:05.882641174Z [2024-04-20 23:16:05,882: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[15a3e3ac-afc2-4897-b547-28aa7b852581] succeeded in 5.086308835000182s: None 2024-04-20T23:17:01.294235257Z [2024-04-20 23:17:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6a80ef5-2961-4eae-ae32-8550c2990cb0] received 2024-04-20T23:17:01.302327314Z [2024-04-20 23:17:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e66958b-af12-416e-ab74-55b40a4fb6ca] received 2024-04-20T23:17:01.341620378Z [2024-04-20 23:17:01,341: INFO/ForkPoolWorker-16] [5e66958b-af12-416e-ab74-55b40a4fb6ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:17:01.381231242Z [2024-04-20 23:17:01,380: INFO/ForkPoolWorker-15] [e6a80ef5-2961-4eae-ae32-8550c2990cb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:17:01.399065284Z [2024-04-20 23:17:01,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a1b76d5-b28f-4c70-bdde-17bbe0b6f857] received 2024-04-20T23:17:01.578559897Z [2024-04-20 23:17:01,578: INFO/ForkPoolWorker-1] [1a1b76d5-b28f-4c70-bdde-17bbe0b6f857] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:17:02.537975348Z [2024-04-20 23:17:02,534: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:17:02.571605312Z [2024-04-20 23:17:02,568: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:17:02.590704539Z [2024-04-20 23:17:02,587: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:17:03.030611092Z [2024-04-20 23:17:03,018: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-20T23:17:03.038235184Z [2024-04-20 23:17:03,037: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:17:03.177312052Z [2024-04-20 23:17:03,177: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:17:03.204327339Z [2024-04-20 23:17:03,204: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:17:03.207952697Z [2024-04-20 23:17:03,204: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:17:03.208092881Z [2024-04-20 23:17:03,207: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-20T23:17:03.208395027Z [2024-04-20 23:17:03,208: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:17:03.373797990Z [2024-04-20 23:17:03,373: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:17:04.280646017Z [2024-04-20 23:17:04,280: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6a80ef5-2961-4eae-ae32-8550c2990cb0] succeeded in 2.9723422329998357s: None 2024-04-20T23:17:05.124406413Z [2024-04-20 23:17:05,124: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:17:05.128243176Z [2024-04-20 23:17:05,127: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:17:05.189258702Z [2024-04-20 23:17:05,189: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:17:05.194620619Z [2024-04-20 23:17:05,192: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:17:05.194629084Z [2024-04-20 23:17:05,192: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:17:05.194633130Z [2024-04-20 23:17:05,192: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:17:05.194637223Z [2024-04-20 23:17:05,192: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:17:05.194640224Z [2024-04-20 23:17:05,193: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:17:05.194643160Z [2024-04-20 23:17:05,193: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:17:05.342899892Z [2024-04-20 23:17:05,342: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:17:05.689576641Z [2024-04-20 23:17:05,689: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:17:05.693359863Z [2024-04-20 23:17:05,692: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:17:05.731669028Z [2024-04-20 23:17:05,731: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:17:05.734843287Z [2024-04-20 23:17:05,734: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:17:05.735368574Z [2024-04-20 23:17:05,734: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:17:05.735884001Z [2024-04-20 23:17:05,735: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:17:05.736352746Z [2024-04-20 23:17:05,736: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:17:05.736938822Z [2024-04-20 23:17:05,736: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:17:05.737170433Z [2024-04-20 23:17:05,737: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:17:05.950392912Z [2024-04-20 23:17:05,948: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:17:07.712888384Z [2024-04-20 23:17:07,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e66958b-af12-416e-ab74-55b40a4fb6ca] succeeded in 6.399505452000085s: None 2024-04-20T23:17:08.610405188Z [2024-04-20 23:17:08,609: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a1b76d5-b28f-4c70-bdde-17bbe0b6f857] succeeded in 7.201130842000111s: None 2024-04-20T23:18:00.617438755Z [2024-04-20 23:18:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[699f842e-6dda-41c5-a405-fae445a973fb] received 2024-04-20T23:18:00.622380728Z [2024-04-20 23:18:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfb949b3-c639-490c-814b-9a776aa05f17] received 2024-04-20T23:18:00.641498639Z [2024-04-20 23:18:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dedf97d3-442e-4d64-9e29-1aa32c1baa48] received 2024-04-20T23:18:00.647556309Z [2024-04-20 23:18:00,647: INFO/ForkPoolWorker-15] [699f842e-6dda-41c5-a405-fae445a973fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:18:00.650876765Z [2024-04-20 23:18:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4192133-ccfb-448f-9b14-3de63d4c1753] received 2024-04-20T23:18:00.683806244Z [2024-04-20 23:18:00,683: INFO/ForkPoolWorker-2] [c4192133-ccfb-448f-9b14-3de63d4c1753] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:18:00.687982280Z [2024-04-20 23:18:00,687: INFO/ForkPoolWorker-1] [dedf97d3-442e-4d64-9e29-1aa32c1baa48] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:18:00.694713666Z [2024-04-20 23:18:00,689: INFO/ForkPoolWorker-16] [dfb949b3-c639-490c-814b-9a776aa05f17] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:18:01.138978509Z [2024-04-20 23:18:01,127: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:18:01.855518970Z [2024-04-20 23:18:01,800: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:18:01.927838130Z [2024-04-20 23:18:01,920: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:18:02.022401920Z [2024-04-20 23:18:01,996: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:18:02.255537428Z [2024-04-20 23:18:02,255: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:18:02.260432116Z [2024-04-20 23:18:02,259: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:18:02.296481240Z [2024-04-20 23:18:02,296: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:18:02.297959961Z [2024-04-20 23:18:02,297: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:18:02.298215616Z [2024-04-20 23:18:02,297: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:18:02.298427166Z [2024-04-20 23:18:02,298: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:18:02.298967691Z [2024-04-20 23:18:02,298: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:18:02.423300453Z [2024-04-20 23:18:02,423: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:18:02.501817832Z [2024-04-20 23:18:02,501: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:18:03.363487778Z [2024-04-20 23:18:03,363: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfb949b3-c639-490c-814b-9a776aa05f17] succeeded in 2.722487547000128s: None 2024-04-20T23:18:03.407598510Z [2024-04-20 23:18:03,407: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:18:03.411757826Z [2024-04-20 23:18:03,411: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:18:03.448431005Z [2024-04-20 23:18:03,448: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:18:03.450884246Z [2024-04-20 23:18:03,450: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:18:03.450929630Z [2024-04-20 23:18:03,450: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:18:03.451095597Z [2024-04-20 23:18:03,450: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:18:03.451139823Z [2024-04-20 23:18:03,451: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:18:03.451313921Z [2024-04-20 23:18:03,451: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:18:03.451555820Z [2024-04-20 23:18:03,451: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:18:03.489165889Z [2024-04-20 23:18:03,488: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dedf97d3-442e-4d64-9e29-1aa32c1baa48] succeeded in 2.84132121499988s: None 2024-04-20T23:18:03.537381800Z [2024-04-20 23:18:03,536: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:18:03.999724819Z [2024-04-20 23:18:03,999: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:18:04.003182170Z [2024-04-20 23:18:04,002: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:18:04.037306983Z [2024-04-20 23:18:04,036: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:18:04.040675722Z [2024-04-20 23:18:04,040: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:18:04.041011555Z [2024-04-20 23:18:04,040: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:18:04.041250278Z [2024-04-20 23:18:04,040: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:18:04.041453420Z [2024-04-20 23:18:04,041: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:18:04.042094707Z [2024-04-20 23:18:04,041: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:18:04.042314697Z [2024-04-20 23:18:04,042: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:18:04.158632277Z [2024-04-20 23:18:04,158: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:18:05.876816493Z [2024-04-20 23:18:05,876: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c4192133-ccfb-448f-9b14-3de63d4c1753] succeeded in 5.219679840000026s: None 2024-04-20T23:18:06.075191469Z [2024-04-20 23:18:06,074: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[699f842e-6dda-41c5-a405-fae445a973fb] succeeded in 5.449152609000066s: None 2024-04-20T23:19:00.529187890Z [2024-04-20 23:19:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ff367fb-2a49-40b5-895b-e63eb94da3e4] received 2024-04-20T23:19:00.537327241Z [2024-04-20 23:19:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1ba5537-c848-45bd-b938-1810af31a2ba] received 2024-04-20T23:19:00.538988612Z [2024-04-20 23:19:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5702d11a-d9f5-447d-bf95-52bf7792c88a] received 2024-04-20T23:19:00.559029676Z [2024-04-20 23:19:00,558: INFO/ForkPoolWorker-16] [c1ba5537-c848-45bd-b938-1810af31a2ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:19:00.562087443Z [2024-04-20 23:19:00,561: INFO/ForkPoolWorker-1] [5702d11a-d9f5-447d-bf95-52bf7792c88a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:19:00.566199812Z [2024-04-20 23:19:00,565: INFO/ForkPoolWorker-15] [7ff367fb-2a49-40b5-895b-e63eb94da3e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:19:00.867482877Z [2024-04-20 23:19:00,863: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:19:00.887327848Z [2024-04-20 23:19:00,883: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:19:00.966167701Z [2024-04-20 23:19:00,962: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:19:01.023341038Z [2024-04-20 23:19:01,022: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:19:01.027211910Z [2024-04-20 23:19:01,026: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:19:01.047451210Z [2024-04-20 23:19:01,047: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:19:01.048399292Z [2024-04-20 23:19:01,048: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:19:01.048487764Z [2024-04-20 23:19:01,048: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:19:01.048536276Z [2024-04-20 23:19:01,048: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:19:01.048780042Z [2024-04-20 23:19:01,048: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:19:01.178138078Z [2024-04-20 23:19:01,177: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:19:01.977951052Z [2024-04-20 23:19:01,977: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1ba5537-c848-45bd-b938-1810af31a2ba] succeeded in 1.4287421349999931s: None 2024-04-20T23:19:02.779041650Z [2024-04-20 23:19:02,778: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:19:02.784842650Z [2024-04-20 23:19:02,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:19:02.813334893Z [2024-04-20 23:19:02,813: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:19:02.814959110Z [2024-04-20 23:19:02,814: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:19:02.815010153Z [2024-04-20 23:19:02,814: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:19:02.815223607Z [2024-04-20 23:19:02,814: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:19:02.815295236Z [2024-04-20 23:19:02,815: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:19:02.815789594Z [2024-04-20 23:19:02,815: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:19:02.815975412Z [2024-04-20 23:19:02,815: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:19:02.822344140Z [2024-04-20 23:19:02,821: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:19:02.826898716Z [2024-04-20 23:19:02,826: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:19:02.881609213Z [2024-04-20 23:19:02,881: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:19:02.882707621Z [2024-04-20 23:19:02,882: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:19:02.882746499Z [2024-04-20 23:19:02,882: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:19:02.882892476Z [2024-04-20 23:19:02,882: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:19:02.882945787Z [2024-04-20 23:19:02,882: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:19:02.884107395Z [2024-04-20 23:19:02,883: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:19:02.884147330Z [2024-04-20 23:19:02,884: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:19:02.931955208Z [2024-04-20 23:19:02,931: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:19:03.021845891Z [2024-04-20 23:19:03,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:19:05.301924495Z [2024-04-20 23:19:05,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ff367fb-2a49-40b5-895b-e63eb94da3e4] succeeded in 4.768766555000184s: None 2024-04-20T23:19:05.631472113Z [2024-04-20 23:19:05,630: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5702d11a-d9f5-447d-bf95-52bf7792c88a] succeeded in 5.089392486000179s: None 2024-04-20T23:20:01.270682179Z [2024-04-20 23:20:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53111207-620b-47b1-a4b8-6b0753f69572] received 2024-04-20T23:20:01.274002230Z [2024-04-20 23:20:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfbad503-5f2a-486d-a3be-488e4afe1654] received 2024-04-20T23:20:01.279040874Z [2024-04-20 23:20:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f92628f-216c-48f2-adb0-ff3d8e14f650] received 2024-04-20T23:20:01.288347800Z [2024-04-20 23:20:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[628a93f4-53dc-4d02-b1a4-52453b6a7895] received 2024-04-20T23:20:01.295276921Z [2024-04-20 23:20:01,294: INFO/ForkPoolWorker-1] [5f92628f-216c-48f2-adb0-ff3d8e14f650] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:20:01.321259999Z [2024-04-20 23:20:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3acfe8a-9fea-42ed-8ead-a4b88cf938f6] received 2024-04-20T23:20:01.326621339Z [2024-04-20 23:20:01,326: INFO/ForkPoolWorker-16] [bfbad503-5f2a-486d-a3be-488e4afe1654] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:20:01.335205945Z [2024-04-20 23:20:01,334: INFO/ForkPoolWorker-15] [53111207-620b-47b1-a4b8-6b0753f69572] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:20:01.339574939Z [2024-04-20 23:20:01,338: INFO/ForkPoolWorker-3] [d3acfe8a-9fea-42ed-8ead-a4b88cf938f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:20:01.347147790Z [2024-04-20 23:20:01,346: INFO/ForkPoolWorker-2] [628a93f4-53dc-4d02-b1a4-52453b6a7895] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:20:01.682002011Z [2024-04-20 23:20:01,677: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:20:01.704035199Z [2024-04-20 23:20:01,699: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:20:01.812713431Z [2024-04-20 23:20:01,809: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:20:01.869027004Z [2024-04-20 23:20:01,868: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:20:01.873573516Z [2024-04-20 23:20:01,873: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:20:01.899171384Z [2024-04-20 23:20:01,898: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:20:01.901895686Z [2024-04-20 23:20:01,901: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:20:01.902043605Z [2024-04-20 23:20:01,901: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:20:01.902180029Z [2024-04-20 23:20:01,902: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:20:01.902474294Z [2024-04-20 23:20:01,902: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:20:01.986378195Z [2024-04-20 23:20:01,986: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:20:02.297578943Z [2024-04-20 23:20:02,294: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:20:02.410948213Z [2024-04-20 23:20:02,404: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:20:02.650488758Z [2024-04-20 23:20:02,649: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[628a93f4-53dc-4d02-b1a4-52453b6a7895] succeeded in 1.3535885960000087s: None 2024-04-20T23:20:02.820188203Z [2024-04-20 23:20:02,819: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:20:03.423223196Z [2024-04-20 23:20:03,422: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f92628f-216c-48f2-adb0-ff3d8e14f650] succeeded in 2.1405388459997994s: None 2024-04-20T23:20:03.460723672Z [2024-04-20 23:20:03,460: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:20:03.464563164Z [2024-04-20 23:20:03,464: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:20:03.485180735Z [2024-04-20 23:20:03,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:20:03.486626135Z [2024-04-20 23:20:03,486: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:20:03.486643409Z [2024-04-20 23:20:03,486: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:20:03.486805685Z [2024-04-20 23:20:03,486: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:20:03.486835971Z [2024-04-20 23:20:03,486: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:20:03.487071363Z [2024-04-20 23:20:03,486: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:20:03.487110413Z [2024-04-20 23:20:03,487: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:20:03.544960402Z [2024-04-20 23:20:03,544: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T23:20:03.552473545Z [2024-04-20 23:20:03,551: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:20:03.606218123Z [2024-04-20 23:20:03,605: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:20:03.618020606Z [2024-04-20 23:20:03,617: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:20:03.625415189Z [2024-04-20 23:20:03,625: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:20:03.625464987Z [2024-04-20 23:20:03,625: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:20:03.625736195Z [2024-04-20 23:20:03,625: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:20:03.625761226Z [2024-04-20 23:20:03,625: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T23:20:03.626116484Z [2024-04-20 23:20:03,625: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:20:03.626170324Z [2024-04-20 23:20:03,626: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:20:03.757067915Z [2024-04-20 23:20:03,756: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:20:04.319236022Z [2024-04-20 23:20:04,318: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:20:04.322646100Z [2024-04-20 23:20:04,322: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:20:04.368339747Z [2024-04-20 23:20:04,368: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:20:04.371178754Z [2024-04-20 23:20:04,370: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:20:04.371398961Z [2024-04-20 23:20:04,371: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:20:04.371664426Z [2024-04-20 23:20:04,371: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:20:04.372316172Z [2024-04-20 23:20:04,371: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:20:04.372726634Z [2024-04-20 23:20:04,372: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:20:04.372737674Z [2024-04-20 23:20:04,372: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:20:04.493359359Z [2024-04-20 23:20:04,493: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:20:05.130773008Z [2024-04-20 23:20:05,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53111207-620b-47b1-a4b8-6b0753f69572] succeeded in 3.855406012000003s: None 2024-04-20T23:20:05.605743234Z [2024-04-20 23:20:05,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be5fde6c-a00a-4c08-a674-23b25000ed45] received 2024-04-20T23:20:05.616160390Z [2024-04-20 23:20:05,615: INFO/ForkPoolWorker-15] [be5fde6c-a00a-4c08-a674-23b25000ed45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:20:05.878692437Z [2024-04-20 23:20:05,878: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfbad503-5f2a-486d-a3be-488e4afe1654] succeeded in 4.600014635000207s: None 2024-04-20T23:20:05.978945054Z [2024-04-20 23:20:05,975: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:20:06.274009800Z [2024-04-20 23:20:06,273: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d3acfe8a-9fea-42ed-8ead-a4b88cf938f6] succeeded in 4.945125727000232s: None 2024-04-20T23:20:07.242935658Z [2024-04-20 23:20:07,242: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:20:07.246583852Z [2024-04-20 23:20:07,246: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:20:07.266564627Z [2024-04-20 23:20:07,266: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:20:07.267726233Z [2024-04-20 23:20:07,267: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:20:07.267740252Z [2024-04-20 23:20:07,267: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:20:07.267950039Z [2024-04-20 23:20:07,267: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:20:07.267956326Z [2024-04-20 23:20:07,267: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:20:07.268233886Z [2024-04-20 23:20:07,268: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:20:07.268239360Z [2024-04-20 23:20:07,268: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:20:07.380216786Z [2024-04-20 23:20:07,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:20:08.101562743Z [2024-04-20 23:20:08,100: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be5fde6c-a00a-4c08-a674-23b25000ed45] succeeded in 2.4938107170000876s: None 2024-04-20T23:20:08.108695144Z [2024-04-20 23:20:08,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc9c950f-ac90-4d93-aeff-db04d738aa94] received 2024-04-20T23:20:08.129002393Z [2024-04-20 23:20:08,116: INFO/ForkPoolWorker-15] [fc9c950f-ac90-4d93-aeff-db04d738aa94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:20:08.396734381Z [2024-04-20 23:20:08,393: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:20:09.569698722Z [2024-04-20 23:20:09,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:20:09.575785482Z [2024-04-20 23:20:09,575: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:20:09.651254944Z [2024-04-20 23:20:09,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:20:09.652572397Z [2024-04-20 23:20:09,652: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:20:09.652630325Z [2024-04-20 23:20:09,652: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:20:09.652730629Z [2024-04-20 23:20:09,652: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:20:09.652772611Z [2024-04-20 23:20:09,652: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:20:09.653060737Z [2024-04-20 23:20:09,652: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:20:09.653150815Z [2024-04-20 23:20:09,653: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:20:09.743843209Z [2024-04-20 23:20:09,743: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:20:10.314616581Z [2024-04-20 23:20:10,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc9c950f-ac90-4d93-aeff-db04d738aa94] succeeded in 2.202975739000067s: None 2024-04-20T23:20:10.441371727Z [2024-04-20 23:20:10,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2cf4f4d-20df-4f23-bf0e-af53df9dd580] received 2024-04-20T23:20:10.454231179Z [2024-04-20 23:20:10,453: INFO/ForkPoolWorker-15] [f2cf4f4d-20df-4f23-bf0e-af53df9dd580] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:20:10.756528541Z [2024-04-20 23:20:10,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:20:11.888505200Z [2024-04-20 23:20:11,888: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:20:11.891763745Z [2024-04-20 23:20:11,891: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:20:11.922315783Z [2024-04-20 23:20:11,922: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:20:11.923655727Z [2024-04-20 23:20:11,923: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:20:11.923720697Z [2024-04-20 23:20:11,923: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:20:11.923993237Z [2024-04-20 23:20:11,923: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:20:11.924046321Z [2024-04-20 23:20:11,923: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:20:11.924499832Z [2024-04-20 23:20:11,924: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:20:11.924563201Z [2024-04-20 23:20:11,924: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:20:12.050808953Z [2024-04-20 23:20:12,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:20:12.727106615Z [2024-04-20 23:20:12,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2cf4f4d-20df-4f23-bf0e-af53df9dd580] succeeded in 2.281396253999901s: None 2024-04-20T23:21:01.176459253Z [2024-04-20 23:21:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06fe76f6-7492-47d2-a0f5-76a4ead74e9b] received 2024-04-20T23:21:01.184558497Z [2024-04-20 23:21:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f90e8ef-9e1a-427a-bf1d-c03073129e45] received 2024-04-20T23:21:01.195893297Z [2024-04-20 23:21:01,195: INFO/ForkPoolWorker-15] [06fe76f6-7492-47d2-a0f5-76a4ead74e9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:21:01.198177042Z [2024-04-20 23:21:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d5cb235-e40c-423c-ab56-30370ed490a2] received 2024-04-20T23:21:01.201890966Z [2024-04-20 23:21:01,201: INFO/ForkPoolWorker-16] [1f90e8ef-9e1a-427a-bf1d-c03073129e45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:21:01.224518247Z [2024-04-20 23:21:01,224: INFO/ForkPoolWorker-1] [9d5cb235-e40c-423c-ab56-30370ed490a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:21:01.587563019Z [2024-04-20 23:21:01,583: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:21:01.758873961Z [2024-04-20 23:21:01,753: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:21:01.823178176Z [2024-04-20 23:21:01,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:21:01.929679516Z [2024-04-20 23:21:01,929: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:21:01.934296369Z [2024-04-20 23:21:01,933: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:21:01.981736339Z [2024-04-20 23:21:01,981: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:21:01.986856124Z [2024-04-20 23:21:01,986: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:21:01.987193665Z [2024-04-20 23:21:01,986: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:21:01.987352796Z [2024-04-20 23:21:01,987: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:21:01.987775754Z [2024-04-20 23:21:01,987: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:21:02.147090768Z [2024-04-20 23:21:02,146: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:21:02.803046155Z [2024-04-20 23:21:02,802: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9d5cb235-e40c-423c-ab56-30370ed490a2] succeeded in 1.601701778000006s: None 2024-04-20T23:21:03.030776186Z [2024-04-20 23:21:03,030: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:21:03.034418930Z [2024-04-20 23:21:03,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:21:03.053633960Z [2024-04-20 23:21:03,053: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:21:03.055294476Z [2024-04-20 23:21:03,055: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:21:03.055306659Z [2024-04-20 23:21:03,055: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:21:03.055392007Z [2024-04-20 23:21:03,055: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:21:03.055446703Z [2024-04-20 23:21:03,055: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:21:03.055698381Z [2024-04-20 23:21:03,055: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:21:03.055800993Z [2024-04-20 23:21:03,055: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:21:03.142406923Z [2024-04-20 23:21:03,142: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:21:03.375192205Z [2024-04-20 23:21:03,373: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:21:03.378669224Z [2024-04-20 23:21:03,378: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:21:03.406899020Z [2024-04-20 23:21:03,406: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:21:03.408702366Z [2024-04-20 23:21:03,408: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:21:03.409946811Z [2024-04-20 23:21:03,409: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:21:03.410238622Z [2024-04-20 23:21:03,410: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:21:03.410424179Z [2024-04-20 23:21:03,410: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:21:03.410859991Z [2024-04-20 23:21:03,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:21:03.411047755Z [2024-04-20 23:21:03,410: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:21:03.495271398Z [2024-04-20 23:21:03,495: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:21:05.145019878Z [2024-04-20 23:21:05,144: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06fe76f6-7492-47d2-a0f5-76a4ead74e9b] succeeded in 3.966439304999767s: None 2024-04-20T23:21:06.093513128Z [2024-04-20 23:21:06,092: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f90e8ef-9e1a-427a-bf1d-c03073129e45] succeeded in 4.905371391999779s: None 2024-04-20T23:22:00.968729840Z [2024-04-20 23:22:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d24ec9d2-ddd5-42d9-b7bc-b81b3a03d064] received 2024-04-20T23:22:00.972849828Z [2024-04-20 23:22:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[337fc3b0-2b09-4c34-a562-79dca819f186] received 2024-04-20T23:22:00.975971570Z [2024-04-20 23:22:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[827bccf7-e19d-4a21-aeb7-3eef95ce8e91] received 2024-04-20T23:22:00.978431124Z [2024-04-20 23:22:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b09d37f4-ddc3-4955-a2af-d6a7ba2ff81f] received 2024-04-20T23:22:01.006841086Z [2024-04-20 23:22:01,006: INFO/ForkPoolWorker-2] [b09d37f4-ddc3-4955-a2af-d6a7ba2ff81f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:22:01.006875881Z [2024-04-20 23:22:01,006: INFO/ForkPoolWorker-16] [337fc3b0-2b09-4c34-a562-79dca819f186] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:22:01.007566277Z [2024-04-20 23:22:01,007: INFO/ForkPoolWorker-15] [d24ec9d2-ddd5-42d9-b7bc-b81b3a03d064] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:22:01.011098002Z [2024-04-20 23:22:01,010: INFO/ForkPoolWorker-1] [827bccf7-e19d-4a21-aeb7-3eef95ce8e91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:22:01.368415329Z [2024-04-20 23:22:01,359: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:22:01.385850092Z [2024-04-20 23:22:01,382: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:22:01.550566642Z [2024-04-20 23:22:01,550: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:22:01.554949286Z [2024-04-20 23:22:01,554: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:22:01.608538929Z [2024-04-20 23:22:01,608: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:22:01.609662466Z [2024-04-20 23:22:01,606: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:22:01.612885930Z [2024-04-20 23:22:01,612: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:22:01.613006672Z [2024-04-20 23:22:01,612: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:22:01.613085664Z [2024-04-20 23:22:01,613: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:22:01.613303079Z [2024-04-20 23:22:01,613: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:22:01.685363016Z [2024-04-20 23:22:01,670: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:22:01.742038545Z [2024-04-20 23:22:01,741: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:22:01.924887844Z [2024-04-20 23:22:01,924: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:22:02.483354736Z [2024-04-20 23:22:02,482: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b09d37f4-ddc3-4955-a2af-d6a7ba2ff81f] succeeded in 1.4924162239999532s: None 2024-04-20T23:22:02.771926824Z [2024-04-20 23:22:02,771: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d24ec9d2-ddd5-42d9-b7bc-b81b3a03d064] succeeded in 1.79654301499977s: None 2024-04-20T23:22:03.030788540Z [2024-04-20 23:22:03,030: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:22:03.034027556Z [2024-04-20 23:22:03,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:22:03.048566764Z [2024-04-20 23:22:03,048: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:22:03.055933136Z [2024-04-20 23:22:03,055: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:22:03.076430330Z [2024-04-20 23:22:03,076: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:22:03.077427784Z [2024-04-20 23:22:03,077: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:22:03.077443759Z [2024-04-20 23:22:03,077: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:22:03.077530434Z [2024-04-20 23:22:03,077: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:22:03.077643087Z [2024-04-20 23:22:03,077: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:22:03.077656422Z [2024-04-20 23:22:03,077: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:22:03.078192440Z [2024-04-20 23:22:03,078: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:22:03.078284497Z [2024-04-20 23:22:03,078: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:22:03.079072638Z [2024-04-20 23:22:03,078: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:22:03.079180865Z [2024-04-20 23:22:03,079: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:22:03.079398248Z [2024-04-20 23:22:03,079: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:22:03.079587968Z [2024-04-20 23:22:03,079: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:22:03.080019696Z [2024-04-20 23:22:03,079: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:22:03.080206097Z [2024-04-20 23:22:03,080: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:22:03.167807704Z [2024-04-20 23:22:03,167: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:22:03.169998077Z [2024-04-20 23:22:03,169: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:22:05.243693613Z [2024-04-20 23:22:05,243: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[337fc3b0-2b09-4c34-a562-79dca819f186] succeeded in 4.261177126000348s: None 2024-04-20T23:22:05.549619907Z [2024-04-20 23:22:05,549: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[827bccf7-e19d-4a21-aeb7-3eef95ce8e91] succeeded in 4.560414108999794s: None 2024-04-20T23:23:01.021814845Z [2024-04-20 23:23:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d6a7d49-4bfc-4918-a155-56e28f614ded] received 2024-04-20T23:23:01.026115665Z [2024-04-20 23:23:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc76fdd0-3100-4aee-90df-80ae1b74d514] received 2024-04-20T23:23:01.045689469Z [2024-04-20 23:23:01,039: INFO/ForkPoolWorker-15] [5d6a7d49-4bfc-4918-a155-56e28f614ded] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:23:01.049650674Z [2024-04-20 23:23:01,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[108b5300-c254-48d8-9013-70995f91228d] received 2024-04-20T23:23:01.055808381Z [2024-04-20 23:23:01,055: INFO/ForkPoolWorker-1] [108b5300-c254-48d8-9013-70995f91228d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:23:01.066737202Z [2024-04-20 23:23:01,064: INFO/ForkPoolWorker-16] [fc76fdd0-3100-4aee-90df-80ae1b74d514] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:23:01.353351168Z [2024-04-20 23:23:01,349: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:23:01.470676945Z [2024-04-20 23:23:01,466: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:23:01.481794835Z [2024-04-20 23:23:01,477: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:23:01.585250512Z [2024-04-20 23:23:01,584: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-20T23:23:01.588990835Z [2024-04-20 23:23:01,588: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:23:01.625600820Z [2024-04-20 23:23:01,625: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:23:01.628225228Z [2024-04-20 23:23:01,627: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:23:01.628370355Z [2024-04-20 23:23:01,628: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:23:01.628515786Z [2024-04-20 23:23:01,628: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-20T23:23:01.628975323Z [2024-04-20 23:23:01,628: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:23:01.718306697Z [2024-04-20 23:23:01,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:23:02.530629324Z [2024-04-20 23:23:02,530: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d6a7d49-4bfc-4918-a155-56e28f614ded] succeeded in 1.5007450119996975s: None 2024-04-20T23:23:02.722258816Z [2024-04-20 23:23:02,721: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:23:02.726262928Z [2024-04-20 23:23:02,725: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:23:02.771337640Z [2024-04-20 23:23:02,770: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:23:02.772627094Z [2024-04-20 23:23:02,772: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:23:02.774106305Z [2024-04-20 23:23:02,773: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:23:02.774314441Z [2024-04-20 23:23:02,774: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:23:02.774323205Z [2024-04-20 23:23:02,774: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:23:02.774575009Z [2024-04-20 23:23:02,774: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:23:02.774748409Z [2024-04-20 23:23:02,774: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:23:02.775140174Z [2024-04-20 23:23:02,774: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:23:02.775271008Z [2024-04-20 23:23:02,775: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:23:02.801014820Z [2024-04-20 23:23:02,800: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:23:02.802173790Z [2024-04-20 23:23:02,801: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:23:02.802185639Z [2024-04-20 23:23:02,802: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:23:02.802293344Z [2024-04-20 23:23:02,802: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:23:02.802299373Z [2024-04-20 23:23:02,802: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:23:02.802525539Z [2024-04-20 23:23:02,802: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:23:02.802532329Z [2024-04-20 23:23:02,802: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:23:02.875090221Z [2024-04-20 23:23:02,874: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:23:02.894084373Z [2024-04-20 23:23:02,893: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:23:05.045148861Z [2024-04-20 23:23:05,044: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc76fdd0-3100-4aee-90df-80ae1b74d514] succeeded in 3.9996783310002684s: None 2024-04-20T23:23:05.537658168Z [2024-04-20 23:23:05,536: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[108b5300-c254-48d8-9013-70995f91228d] succeeded in 4.486157576000096s: None 2024-04-20T23:24:00.861256215Z [2024-04-20 23:24:00,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39d57070-41a3-42c8-846f-864e7efdbd4b] received 2024-04-20T23:24:00.864333404Z [2024-04-20 23:24:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b37d2f8d-0015-4e2b-becc-da655de72ba7] received 2024-04-20T23:24:00.868083865Z [2024-04-20 23:24:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd00af82-2961-4d7f-9640-179f7512173a] received 2024-04-20T23:24:00.873310407Z [2024-04-20 23:24:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0242eea5-0f2b-4790-842b-0dc0c0a286f4] received 2024-04-20T23:24:00.874516729Z [2024-04-20 23:24:00,874: INFO/ForkPoolWorker-15] [39d57070-41a3-42c8-846f-864e7efdbd4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:24:00.881822410Z [2024-04-20 23:24:00,881: INFO/ForkPoolWorker-16] [b37d2f8d-0015-4e2b-becc-da655de72ba7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:24:00.887190483Z [2024-04-20 23:24:00,886: INFO/ForkPoolWorker-1] [fd00af82-2961-4d7f-9640-179f7512173a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:24:00.896439453Z [2024-04-20 23:24:00,896: INFO/ForkPoolWorker-2] [0242eea5-0f2b-4790-842b-0dc0c0a286f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:24:01.260755143Z [2024-04-20 23:24:01,248: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:24:01.275255309Z [2024-04-20 23:24:01,270: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:24:01.292246425Z [2024-04-20 23:24:01,289: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:24:01.295906018Z [2024-04-20 23:24:01,292: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:24:01.619977125Z [2024-04-20 23:24:01,619: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:24:01.624207111Z [2024-04-20 23:24:01,623: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:24:01.668679674Z [2024-04-20 23:24:01,668: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:24:01.674026890Z [2024-04-20 23:24:01,673: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:24:01.674045900Z [2024-04-20 23:24:01,673: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:24:01.674290934Z [2024-04-20 23:24:01,673: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:24:01.674399198Z [2024-04-20 23:24:01,674: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:24:01.674617463Z [2024-04-20 23:24:01,674: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:24:01.829321158Z [2024-04-20 23:24:01,829: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:24:02.322412981Z [2024-04-20 23:24:02,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39d57070-41a3-42c8-846f-864e7efdbd4b] succeeded in 1.4582646329999989s: None 2024-04-20T23:24:02.527161536Z [2024-04-20 23:24:02,526: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0242eea5-0f2b-4790-842b-0dc0c0a286f4] succeeded in 1.6490645980002228s: None 2024-04-20T23:24:02.871810134Z [2024-04-20 23:24:02,871: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:24:02.875465724Z [2024-04-20 23:24:02,875: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:24:02.904865257Z [2024-04-20 23:24:02,904: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:24:02.907800832Z [2024-04-20 23:24:02,907: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:24:02.907950192Z [2024-04-20 23:24:02,907: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:24:02.908163147Z [2024-04-20 23:24:02,907: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:24:02.908382192Z [2024-04-20 23:24:02,908: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:24:02.908899627Z [2024-04-20 23:24:02,908: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:24:02.909030944Z [2024-04-20 23:24:02,908: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:24:02.921609006Z [2024-04-20 23:24:02,921: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:24:02.925069899Z [2024-04-20 23:24:02,924: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:24:02.943274168Z [2024-04-20 23:24:02,943: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:24:02.944545218Z [2024-04-20 23:24:02,944: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:24:02.944660222Z [2024-04-20 23:24:02,944: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:24:02.944831614Z [2024-04-20 23:24:02,944: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:24:02.944922065Z [2024-04-20 23:24:02,944: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:24:02.945210224Z [2024-04-20 23:24:02,945: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:24:02.945641186Z [2024-04-20 23:24:02,945: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:24:03.014400280Z [2024-04-20 23:24:03,014: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:24:03.025437191Z [2024-04-20 23:24:03,025: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:24:05.322002557Z [2024-04-20 23:24:05,321: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b37d2f8d-0015-4e2b-becc-da655de72ba7] succeeded in 4.454247944000144s: None 2024-04-20T23:24:06.126016134Z [2024-04-20 23:24:06,125: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fd00af82-2961-4d7f-9640-179f7512173a] succeeded in 5.252671029000339s: None 2024-04-20T23:25:00.548473833Z [2024-04-20 23:25:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1f8473a-3125-4096-a84b-9c919e08d3a4] received 2024-04-20T23:25:00.569998288Z [2024-04-20 23:25:00,569: INFO/ForkPoolWorker-15] [d1f8473a-3125-4096-a84b-9c919e08d3a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:25:00.573784007Z [2024-04-20 23:25:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36ba558d-d67a-450a-9e29-f212c98375f1] received 2024-04-20T23:25:00.597821633Z [2024-04-20 23:25:00,597: INFO/ForkPoolWorker-16] [36ba558d-d67a-450a-9e29-f212c98375f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:25:00.605186227Z [2024-04-20 23:25:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10afbb58-ac03-4fda-99af-a451022f490e] received 2024-04-20T23:25:00.611366291Z [2024-04-20 23:25:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[854991a5-7de2-4862-96f8-7fdfe9fad89a] received 2024-04-20T23:25:00.614543219Z [2024-04-20 23:25:00,614: INFO/ForkPoolWorker-1] [10afbb58-ac03-4fda-99af-a451022f490e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:25:00.623744177Z [2024-04-20 23:25:00,623: INFO/ForkPoolWorker-2] [854991a5-7de2-4862-96f8-7fdfe9fad89a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:25:00.933185429Z [2024-04-20 23:25:00,928: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:25:01.016577909Z [2024-04-20 23:25:01,009: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:25:01.127713074Z [2024-04-20 23:25:01,121: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:25:01.161358819Z [2024-04-20 23:25:01,157: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:25:01.309088321Z [2024-04-20 23:25:01,308: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:25:01.314061641Z [2024-04-20 23:25:01,313: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:25:01.378930697Z [2024-04-20 23:25:01,378: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:25:01.381014685Z [2024-04-20 23:25:01,380: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:25:01.381060185Z [2024-04-20 23:25:01,380: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:25:01.381122535Z [2024-04-20 23:25:01,381: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:25:01.381298713Z [2024-04-20 23:25:01,381: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:25:01.573675394Z [2024-04-20 23:25:01,566: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:25:02.389286079Z [2024-04-20 23:25:02,388: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[10afbb58-ac03-4fda-99af-a451022f490e] succeeded in 1.7818251490002694s: None 2024-04-20T23:25:02.693812837Z [2024-04-20 23:25:02,693: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:25:02.697719484Z [2024-04-20 23:25:02,697: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:25:02.733419406Z [2024-04-20 23:25:02,733: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:25:02.736959312Z [2024-04-20 23:25:02,736: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:25:02.737070950Z [2024-04-20 23:25:02,736: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:25:02.737250256Z [2024-04-20 23:25:02,737: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:25:02.737410907Z [2024-04-20 23:25:02,737: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:25:02.737657820Z [2024-04-20 23:25:02,737: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:25:02.737756782Z [2024-04-20 23:25:02,737: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:25:02.817496468Z [2024-04-20 23:25:02,817: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:25:02.821534810Z [2024-04-20 23:25:02,821: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:25:02.867302367Z [2024-04-20 23:25:02,867: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:25:02.868736957Z [2024-04-20 23:25:02,868: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:25:02.868896827Z [2024-04-20 23:25:02,868: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:25:02.869092215Z [2024-04-20 23:25:02,868: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:25:02.869269314Z [2024-04-20 23:25:02,869: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:25:02.869596441Z [2024-04-20 23:25:02,869: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:25:02.869756358Z [2024-04-20 23:25:02,869: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:25:02.892304016Z [2024-04-20 23:25:02,892: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:25:03.045029641Z [2024-04-20 23:25:03,044: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:25:03.049646561Z [2024-04-20 23:25:03,049: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:25:03.078936738Z [2024-04-20 23:25:03,078: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:25:03.079200828Z [2024-04-20 23:25:03,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:25:03.080890644Z [2024-04-20 23:25:03,080: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:25:03.080942396Z [2024-04-20 23:25:03,080: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:25:03.081096778Z [2024-04-20 23:25:03,080: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:25:03.081174574Z [2024-04-20 23:25:03,081: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:25:03.081469713Z [2024-04-20 23:25:03,081: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:25:03.081549804Z [2024-04-20 23:25:03,081: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:25:03.257523892Z [2024-04-20 23:25:03,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:25:04.124932330Z [2024-04-20 23:25:04,124: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1f8473a-3125-4096-a84b-9c919e08d3a4] succeeded in 3.569513889999598s: None 2024-04-20T23:25:04.469579092Z [2024-04-20 23:25:04,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d17cb45a-7211-4807-b1a2-6bb1b8dcbf9f] received 2024-04-20T23:25:04.476949690Z [2024-04-20 23:25:04,476: INFO/ForkPoolWorker-15] [d17cb45a-7211-4807-b1a2-6bb1b8dcbf9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:25:04.772868691Z [2024-04-20 23:25:04,768: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:25:04.874552133Z [2024-04-20 23:25:04,874: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36ba558d-d67a-450a-9e29-f212c98375f1] succeeded in 4.29529256800015s: None 2024-04-20T23:25:05.273642465Z [2024-04-20 23:25:05,273: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[854991a5-7de2-4862-96f8-7fdfe9fad89a] succeeded in 4.656883030000245s: None 2024-04-20T23:25:05.896344133Z [2024-04-20 23:25:05,895: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:25:05.903895921Z [2024-04-20 23:25:05,899: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:25:05.921299479Z [2024-04-20 23:25:05,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:25:05.922967235Z [2024-04-20 23:25:05,922: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:25:05.922981078Z [2024-04-20 23:25:05,922: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:25:05.923082613Z [2024-04-20 23:25:05,922: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:25:05.923111425Z [2024-04-20 23:25:05,923: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:25:05.923341882Z [2024-04-20 23:25:05,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:25:05.923353607Z [2024-04-20 23:25:05,923: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:25:06.008744110Z [2024-04-20 23:25:06,008: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:25:06.675549366Z [2024-04-20 23:25:06,675: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d17cb45a-7211-4807-b1a2-6bb1b8dcbf9f] succeeded in 2.2040160459996514s: None 2024-04-20T23:25:07.188449371Z [2024-04-20 23:25:07,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6eae208-aaf3-47af-8023-6257c86c4c1a] received 2024-04-20T23:25:07.203350485Z [2024-04-20 23:25:07,202: INFO/ForkPoolWorker-15] [c6eae208-aaf3-47af-8023-6257c86c4c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:25:07.479622926Z [2024-04-20 23:25:07,476: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:25:08.587959768Z [2024-04-20 23:25:08,587: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:25:08.593441493Z [2024-04-20 23:25:08,592: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:25:08.618144619Z [2024-04-20 23:25:08,617: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:25:08.619516580Z [2024-04-20 23:25:08,619: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:25:08.619638295Z [2024-04-20 23:25:08,619: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:25:08.619962307Z [2024-04-20 23:25:08,619: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:25:08.620003696Z [2024-04-20 23:25:08,619: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:25:08.620531046Z [2024-04-20 23:25:08,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:25:08.620764657Z [2024-04-20 23:25:08,620: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:25:08.707668614Z [2024-04-20 23:25:08,707: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:25:09.371505683Z [2024-04-20 23:25:09,370: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6eae208-aaf3-47af-8023-6257c86c4c1a] succeeded in 2.180430650999824s: None 2024-04-20T23:25:09.516531457Z [2024-04-20 23:25:09,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7e6f1cb-8793-42e9-bcad-30ae2aa639c8] received 2024-04-20T23:25:09.536488176Z [2024-04-20 23:25:09,536: INFO/ForkPoolWorker-15] [d7e6f1cb-8793-42e9-bcad-30ae2aa639c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:25:09.887659664Z [2024-04-20 23:25:09,884: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:25:11.144799418Z [2024-04-20 23:25:11,144: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:25:11.148185208Z [2024-04-20 23:25:11,147: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:25:11.173274229Z [2024-04-20 23:25:11,172: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:25:11.174958081Z [2024-04-20 23:25:11,174: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:25:11.174976603Z [2024-04-20 23:25:11,174: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:25:11.175155649Z [2024-04-20 23:25:11,174: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:25:11.175167671Z [2024-04-20 23:25:11,175: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:25:11.175448194Z [2024-04-20 23:25:11,175: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:25:11.175458815Z [2024-04-20 23:25:11,175: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:25:11.285527562Z [2024-04-20 23:25:11,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:25:11.999984444Z [2024-04-20 23:25:11,999: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7e6f1cb-8793-42e9-bcad-30ae2aa639c8] succeeded in 2.4801259849996313s: None 2024-04-20T23:26:00.423203640Z [2024-04-20 23:26:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7ae11a6-3693-41a6-a0ca-62a1ab9f3238] received 2024-04-20T23:26:00.429893064Z [2024-04-20 23:26:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8dc83b9-cd81-4abb-bbbf-e2ac60d171a6] received 2024-04-20T23:26:00.433039755Z [2024-04-20 23:26:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a308aa66-507f-4012-8f5e-1bec673d9083] received 2024-04-20T23:26:00.439248344Z [2024-04-20 23:26:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3048934-46d4-4659-b12e-2b156ce360f1] received 2024-04-20T23:26:00.445262154Z [2024-04-20 23:26:00,444: INFO/ForkPoolWorker-15] [a7ae11a6-3693-41a6-a0ca-62a1ab9f3238] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:26:00.445907536Z [2024-04-20 23:26:00,445: INFO/ForkPoolWorker-16] [b8dc83b9-cd81-4abb-bbbf-e2ac60d171a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:26:00.458231728Z [2024-04-20 23:26:00,457: INFO/ForkPoolWorker-2] [f3048934-46d4-4659-b12e-2b156ce360f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:26:00.463572291Z [2024-04-20 23:26:00,463: INFO/ForkPoolWorker-1] [a308aa66-507f-4012-8f5e-1bec673d9083] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:26:00.776176209Z [2024-04-20 23:26:00,772: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:26:00.783994204Z [2024-04-20 23:26:00,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:26:00.804037806Z [2024-04-20 23:26:00,800: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:26:00.813195373Z [2024-04-20 23:26:00,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:26:01.047786371Z [2024-04-20 23:26:01,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:26:01.099459149Z [2024-04-20 23:26:01,090: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:26:01.108610559Z [2024-04-20 23:26:01,108: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:26:01.137936703Z [2024-04-20 23:26:01,137: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:26:01.138845061Z [2024-04-20 23:26:01,138: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:26:01.138881745Z [2024-04-20 23:26:01,138: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:26:01.138950786Z [2024-04-20 23:26:01,138: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:26:01.139138369Z [2024-04-20 23:26:01,139: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:26:01.259166391Z [2024-04-20 23:26:01,258: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:26:01.625344402Z [2024-04-20 23:26:01,624: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7ae11a6-3693-41a6-a0ca-62a1ab9f3238] succeeded in 1.1992680160001328s: None 2024-04-20T23:26:01.889283750Z [2024-04-20 23:26:01,888: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f3048934-46d4-4659-b12e-2b156ce360f1] succeeded in 1.4431516449999435s: None 2024-04-20T23:26:02.318860896Z [2024-04-20 23:26:02,318: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:26:02.322468842Z [2024-04-20 23:26:02,322: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:26:02.348798317Z [2024-04-20 23:26:02,348: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:26:02.350451985Z [2024-04-20 23:26:02,350: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:26:02.350703295Z [2024-04-20 23:26:02,350: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:26:02.350983141Z [2024-04-20 23:26:02,350: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:26:02.351180641Z [2024-04-20 23:26:02,351: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:26:02.351568860Z [2024-04-20 23:26:02,351: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:26:02.352615686Z [2024-04-20 23:26:02,352: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:26:02.399098899Z [2024-04-20 23:26:02,398: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:26:02.402626469Z [2024-04-20 23:26:02,402: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:26:02.432527540Z [2024-04-20 23:26:02,432: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:26:02.433995697Z [2024-04-20 23:26:02,433: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:26:02.434052650Z [2024-04-20 23:26:02,433: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:26:02.434187114Z [2024-04-20 23:26:02,434: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:26:02.434232862Z [2024-04-20 23:26:02,434: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:26:02.434578639Z [2024-04-20 23:26:02,434: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:26:02.434667218Z [2024-04-20 23:26:02,434: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:26:02.449328453Z [2024-04-20 23:26:02,449: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:26:02.539527620Z [2024-04-20 23:26:02,539: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:26:04.218839046Z [2024-04-20 23:26:04,218: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a308aa66-507f-4012-8f5e-1bec673d9083] succeeded in 3.783306382000319s: None 2024-04-20T23:26:04.608038533Z [2024-04-20 23:26:04,607: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b8dc83b9-cd81-4abb-bbbf-e2ac60d171a6] succeeded in 4.17278744100031s: None 2024-04-20T23:27:00.304755358Z [2024-04-20 23:27:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a524c323-56f8-48d0-82ce-c95b56889987] received 2024-04-20T23:27:00.308459887Z [2024-04-20 23:27:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af4ef3eb-dcc8-444d-bc42-60a86d96f3e1] received 2024-04-20T23:27:00.311237823Z [2024-04-20 23:27:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d92b7856-2650-4933-90cf-803023f6e87c] received 2024-04-20T23:27:00.326599749Z [2024-04-20 23:27:00,325: INFO/ForkPoolWorker-1] [d92b7856-2650-4933-90cf-803023f6e87c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:27:00.327302533Z [2024-04-20 23:27:00,326: INFO/ForkPoolWorker-16] [af4ef3eb-dcc8-444d-bc42-60a86d96f3e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:27:00.338919616Z [2024-04-20 23:27:00,338: INFO/ForkPoolWorker-15] [a524c323-56f8-48d0-82ce-c95b56889987] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:27:00.666834693Z [2024-04-20 23:27:00,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:27:00.685963690Z [2024-04-20 23:27:00,681: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:27:00.734989722Z [2024-04-20 23:27:00,729: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:27:00.901964718Z [2024-04-20 23:27:00,901: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:27:00.906543858Z [2024-04-20 23:27:00,906: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:27:00.933973669Z [2024-04-20 23:27:00,933: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:27:00.936428664Z [2024-04-20 23:27:00,936: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:27:00.936714632Z [2024-04-20 23:27:00,936: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:27:00.936933449Z [2024-04-20 23:27:00,936: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:27:00.937544365Z [2024-04-20 23:27:00,937: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:27:01.083852035Z [2024-04-20 23:27:01,082: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:27:01.781707987Z [2024-04-20 23:27:01,781: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af4ef3eb-dcc8-444d-bc42-60a86d96f3e1] succeeded in 1.468153304000225s: None 2024-04-20T23:27:02.153276889Z [2024-04-20 23:27:02,152: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:27:02.156529599Z [2024-04-20 23:27:02,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:27:02.176023065Z [2024-04-20 23:27:02,175: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:27:02.188760667Z [2024-04-20 23:27:02,188: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:27:02.189895828Z [2024-04-20 23:27:02,188: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:27:02.190070578Z [2024-04-20 23:27:02,189: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:27:02.190127651Z [2024-04-20 23:27:02,190: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:27:02.190293884Z [2024-04-20 23:27:02,190: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:27:02.190389079Z [2024-04-20 23:27:02,190: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:27:02.190668725Z [2024-04-20 23:27:02,190: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:27:02.190674571Z [2024-04-20 23:27:02,190: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:27:02.224389153Z [2024-04-20 23:27:02,224: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:27:02.233160921Z [2024-04-20 23:27:02,232: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:27:02.233238285Z [2024-04-20 23:27:02,233: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:27:02.233302235Z [2024-04-20 23:27:02,233: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:27:02.233358192Z [2024-04-20 23:27:02,233: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:27:02.233596624Z [2024-04-20 23:27:02,233: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:27:02.233648593Z [2024-04-20 23:27:02,233: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:27:02.335149474Z [2024-04-20 23:27:02,334: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:27:02.376084119Z [2024-04-20 23:27:02,375: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:27:04.249626847Z [2024-04-20 23:27:04,249: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a524c323-56f8-48d0-82ce-c95b56889987] succeeded in 3.939039006999792s: None 2024-04-20T23:27:05.212483282Z [2024-04-20 23:27:05,211: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d92b7856-2650-4933-90cf-803023f6e87c] succeeded in 4.899326062s: None 2024-04-20T23:28:01.319209846Z [2024-04-20 23:28:01,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6c21dfb-4f5f-4fe7-9967-58a656361241] received 2024-04-20T23:28:01.326048922Z [2024-04-20 23:28:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7807d05d-cfab-4742-b429-7d4a6c57c152] received 2024-04-20T23:28:01.329244703Z [2024-04-20 23:28:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57930ef8-98f8-4364-935f-eeb1c9d0e20e] received 2024-04-20T23:28:01.336283322Z [2024-04-20 23:28:01,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[170afcce-57c7-45be-bcc0-8db79ec3b99f] received 2024-04-20T23:28:01.348112550Z [2024-04-20 23:28:01,347: INFO/ForkPoolWorker-15] [b6c21dfb-4f5f-4fe7-9967-58a656361241] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:28:01.351966347Z [2024-04-20 23:28:01,351: INFO/ForkPoolWorker-16] [7807d05d-cfab-4742-b429-7d4a6c57c152] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:28:01.356438832Z [2024-04-20 23:28:01,355: INFO/ForkPoolWorker-2] [170afcce-57c7-45be-bcc0-8db79ec3b99f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:28:01.356755010Z [2024-04-20 23:28:01,356: INFO/ForkPoolWorker-1] [57930ef8-98f8-4364-935f-eeb1c9d0e20e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:28:01.723324311Z [2024-04-20 23:28:01,720: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:28:01.824940727Z [2024-04-20 23:28:01,821: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:28:01.826270486Z [2024-04-20 23:28:01,822: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:28:01.942279366Z [2024-04-20 23:28:01,928: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:28:02.075356072Z [2024-04-20 23:28:02,075: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:28:02.282308879Z [2024-04-20 23:28:02,281: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:28:02.286802348Z [2024-04-20 23:28:02,286: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:28:02.350394287Z [2024-04-20 23:28:02,350: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:28:02.351331555Z [2024-04-20 23:28:02,351: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:28:02.351372201Z [2024-04-20 23:28:02,351: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:28:02.351423665Z [2024-04-20 23:28:02,351: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:28:02.351586630Z [2024-04-20 23:28:02,351: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:28:02.466409091Z [2024-04-20 23:28:02,466: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:28:02.720681227Z [2024-04-20 23:28:02,720: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7807d05d-cfab-4742-b429-7d4a6c57c152] succeeded in 1.382167397000103s: None 2024-04-20T23:28:03.134093858Z [2024-04-20 23:28:03,133: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:28:03.140306442Z [2024-04-20 23:28:03,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:28:03.167450084Z [2024-04-20 23:28:03,167: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[57930ef8-98f8-4364-935f-eeb1c9d0e20e] succeeded in 1.8257152310002311s: None 2024-04-20T23:28:03.177913673Z [2024-04-20 23:28:03,177: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:28:03.178940563Z [2024-04-20 23:28:03,178: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:28:03.179016793Z [2024-04-20 23:28:03,178: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:28:03.179147755Z [2024-04-20 23:28:03,179: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:28:03.179184977Z [2024-04-20 23:28:03,179: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:28:03.179394671Z [2024-04-20 23:28:03,179: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:28:03.179431156Z [2024-04-20 23:28:03,179: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:28:03.196047070Z [2024-04-20 23:28:03,195: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:28:03.199248686Z [2024-04-20 23:28:03,198: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:28:03.216296516Z [2024-04-20 23:28:03,216: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:28:03.217621307Z [2024-04-20 23:28:03,217: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:28:03.217696004Z [2024-04-20 23:28:03,217: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:28:03.217838033Z [2024-04-20 23:28:03,217: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:28:03.217905490Z [2024-04-20 23:28:03,217: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:28:03.218253450Z [2024-04-20 23:28:03,218: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:28:03.218291720Z [2024-04-20 23:28:03,218: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:28:03.320760435Z [2024-04-20 23:28:03,320: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:28:03.321826065Z [2024-04-20 23:28:03,321: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:28:04.871144770Z [2024-04-20 23:28:04,870: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6c21dfb-4f5f-4fe7-9967-58a656361241] succeeded in 3.5475712259999455s: None 2024-04-20T23:28:05.447321516Z [2024-04-20 23:28:05,446: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[170afcce-57c7-45be-bcc0-8db79ec3b99f] succeeded in 4.107414779999999s: None 2024-04-20T23:29:00.733011033Z [2024-04-20 23:29:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d51f384-bb43-4a09-a369-ee8928bacbb6] received 2024-04-20T23:29:00.739254602Z [2024-04-20 23:29:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e33efea4-b62b-4643-b212-08f442663747] received 2024-04-20T23:29:00.751075441Z [2024-04-20 23:29:00,750: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3deef280-9f7b-422c-b480-167ca9c82402] received 2024-04-20T23:29:00.751483546Z [2024-04-20 23:29:00,751: INFO/ForkPoolWorker-15] [8d51f384-bb43-4a09-a369-ee8928bacbb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:29:00.755536896Z [2024-04-20 23:29:00,755: INFO/ForkPoolWorker-16] [e33efea4-b62b-4643-b212-08f442663747] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:29:00.763965173Z [2024-04-20 23:29:00,763: INFO/ForkPoolWorker-1] [3deef280-9f7b-422c-b480-167ca9c82402] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:29:01.075798473Z [2024-04-20 23:29:01,071: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:29:01.080274046Z [2024-04-20 23:29:01,067: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:29:01.082805793Z [2024-04-20 23:29:01,078: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:29:01.244589332Z [2024-04-20 23:29:01,244: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:29:01.248497262Z [2024-04-20 23:29:01,248: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:29:01.273412841Z [2024-04-20 23:29:01,273: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:29:01.274520050Z [2024-04-20 23:29:01,274: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:29:01.274571462Z [2024-04-20 23:29:01,274: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:29:01.274620632Z [2024-04-20 23:29:01,274: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:29:01.274803484Z [2024-04-20 23:29:01,274: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:29:01.360798055Z [2024-04-20 23:29:01,360: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:29:01.900191621Z [2024-04-20 23:29:01,897: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3deef280-9f7b-422c-b480-167ca9c82402] succeeded in 1.1442675719999897s: None 2024-04-20T23:29:02.376112433Z [2024-04-20 23:29:02,375: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:29:02.379497162Z [2024-04-20 23:29:02,379: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:29:02.381981163Z [2024-04-20 23:29:02,381: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:29:02.383056700Z [2024-04-20 23:29:02,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:29:02.405268522Z [2024-04-20 23:29:02,405: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:29:02.407232736Z [2024-04-20 23:29:02,407: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:29:02.407389934Z [2024-04-20 23:29:02,407: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:29:02.407586906Z [2024-04-20 23:29:02,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:29:02.407662431Z [2024-04-20 23:29:02,407: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:29:02.407856810Z [2024-04-20 23:29:02,407: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:29:02.408189959Z [2024-04-20 23:29:02,408: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:29:02.408430040Z [2024-04-20 23:29:02,408: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:29:02.411541945Z [2024-04-20 23:29:02,411: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:29:02.411558076Z [2024-04-20 23:29:02,411: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:29:02.411715848Z [2024-04-20 23:29:02,411: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:29:02.411762104Z [2024-04-20 23:29:02,411: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:29:02.411982638Z [2024-04-20 23:29:02,411: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:29:02.412014480Z [2024-04-20 23:29:02,411: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:29:02.504658078Z [2024-04-20 23:29:02,504: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:29:02.558250269Z [2024-04-20 23:29:02,558: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:29:04.196789783Z [2024-04-20 23:29:04,195: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e33efea4-b62b-4643-b212-08f442663747] succeeded in 3.454595229000006s: None 2024-04-20T23:29:05.240473710Z [2024-04-20 23:29:05,240: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d51f384-bb43-4a09-a369-ee8928bacbb6] succeeded in 4.495732250000401s: None 2024-04-20T23:30:01.377138989Z [2024-04-20 23:30:01,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90c5d657-b368-4bda-897e-d88f67450ede] received 2024-04-20T23:30:01.379241308Z [2024-04-20 23:30:01,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5cd1ee1-3924-4498-950d-594394d0cbb1] received 2024-04-20T23:30:01.387623691Z [2024-04-20 23:30:01,387: INFO/ForkPoolWorker-15] [90c5d657-b368-4bda-897e-d88f67450ede] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:30:01.388549931Z [2024-04-20 23:30:01,388: INFO/ForkPoolWorker-16] [c5cd1ee1-3924-4498-950d-594394d0cbb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:30:01.400098489Z [2024-04-20 23:30:01,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1862d3a-ae03-4e2c-9d43-e887a462f0ee] received 2024-04-20T23:30:01.406971486Z [2024-04-20 23:30:01,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a0d4231-6bbc-4ed3-ae56-136b51c52250] received 2024-04-20T23:30:01.434065909Z [2024-04-20 23:30:01,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[110abafe-266a-4324-af62-28058954a9a5] received 2024-04-20T23:30:01.437405247Z [2024-04-20 23:30:01,436: INFO/ForkPoolWorker-1] [f1862d3a-ae03-4e2c-9d43-e887a462f0ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:30:01.444409925Z [2024-04-20 23:30:01,443: INFO/ForkPoolWorker-2] [9a0d4231-6bbc-4ed3-ae56-136b51c52250] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:30:01.451494450Z [2024-04-20 23:30:01,451: INFO/ForkPoolWorker-3] [110abafe-266a-4324-af62-28058954a9a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:30:01.868022399Z [2024-04-20 23:30:01,855: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:30:01.870536881Z [2024-04-20 23:30:01,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:30:01.928251613Z [2024-04-20 23:30:01,918: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:30:02.180953025Z [2024-04-20 23:30:02,174: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:30:02.190266636Z [2024-04-20 23:30:02,187: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:30:02.296200369Z [2024-04-20 23:30:02,295: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:30:02.588494536Z [2024-04-20 23:30:02,587: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-20T23:30:02.594351171Z [2024-04-20 23:30:02,593: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:30:02.644355809Z [2024-04-20 23:30:02,643: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:30:02.652511669Z [2024-04-20 23:30:02,652: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:30:02.652703418Z [2024-04-20 23:30:02,652: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:30:02.652941418Z [2024-04-20 23:30:02,652: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-20T23:30:02.653294577Z [2024-04-20 23:30:02,653: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:30:02.853677393Z [2024-04-20 23:30:02,853: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:30:03.221860189Z [2024-04-20 23:30:03,221: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1862d3a-ae03-4e2c-9d43-e887a462f0ee] succeeded in 1.81327255899987s: None 2024-04-20T23:30:03.677094253Z [2024-04-20 23:30:03,676: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90c5d657-b368-4bda-897e-d88f67450ede] succeeded in 2.2982880710001155s: None 2024-04-20T23:30:03.818781488Z [2024-04-20 23:30:03,818: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:30:03.825669386Z [2024-04-20 23:30:03,825: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:30:03.857514854Z [2024-04-20 23:30:03,857: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:30:03.858855879Z [2024-04-20 23:30:03,858: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:30:03.858875402Z [2024-04-20 23:30:03,858: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:30:03.859046526Z [2024-04-20 23:30:03,858: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:30:03.859103817Z [2024-04-20 23:30:03,858: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:30:03.859318092Z [2024-04-20 23:30:03,859: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:30:03.859355833Z [2024-04-20 23:30:03,859: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:30:03.963946315Z [2024-04-20 23:30:03,963: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:30:04.350117453Z [2024-04-20 23:30:04,349: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:30:04.353642753Z [2024-04-20 23:30:04,353: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:30:04.369486569Z [2024-04-20 23:30:04,369: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T23:30:04.374598490Z [2024-04-20 23:30:04,373: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:30:04.397817249Z [2024-04-20 23:30:04,397: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:30:04.399532282Z [2024-04-20 23:30:04,399: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:30:04.399845731Z [2024-04-20 23:30:04,399: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:30:04.399978222Z [2024-04-20 23:30:04,399: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:30:04.400042148Z [2024-04-20 23:30:04,399: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:30:04.400232305Z [2024-04-20 23:30:04,400: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:30:04.400274228Z [2024-04-20 23:30:04,400: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:30:04.407446947Z [2024-04-20 23:30:04,407: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:30:04.409493272Z [2024-04-20 23:30:04,409: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:30:04.409552140Z [2024-04-20 23:30:04,409: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:30:04.409720122Z [2024-04-20 23:30:04,409: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:30:04.409820800Z [2024-04-20 23:30:04,409: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T23:30:04.410073056Z [2024-04-20 23:30:04,409: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:30:04.410176841Z [2024-04-20 23:30:04,410: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:30:04.514380618Z [2024-04-20 23:30:04,514: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:30:04.517023289Z [2024-04-20 23:30:04,516: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:30:04.627592063Z [2024-04-20 23:30:04,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65ad1ca5-8e16-4944-a3ee-a90b4c090834] received 2024-04-20T23:30:04.637874049Z [2024-04-20 23:30:04,637: INFO/ForkPoolWorker-15] [65ad1ca5-8e16-4944-a3ee-a90b4c090834] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:30:04.638892758Z [2024-04-20 23:30:04,638: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5cd1ee1-3924-4498-950d-594394d0cbb1] succeeded in 3.2579347850000886s: None 2024-04-20T23:30:05.070674847Z [2024-04-20 23:30:05,066: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:30:06.162584129Z [2024-04-20 23:30:06,162: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:30:06.165876852Z [2024-04-20 23:30:06,165: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:30:06.176665989Z [2024-04-20 23:30:06,176: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[110abafe-266a-4324-af62-28058954a9a5] succeeded in 4.7395087569998395s: None 2024-04-20T23:30:06.182440574Z [2024-04-20 23:30:06,182: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:30:06.185952007Z [2024-04-20 23:30:06,184: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:30:06.185965307Z [2024-04-20 23:30:06,185: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:30:06.185969066Z [2024-04-20 23:30:06,185: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:30:06.185972710Z [2024-04-20 23:30:06,185: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:30:06.186506333Z [2024-04-20 23:30:06,186: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:30:06.186520493Z [2024-04-20 23:30:06,186: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:30:06.315419064Z [2024-04-20 23:30:06,315: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:30:06.388019280Z [2024-04-20 23:30:06,387: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9a0d4231-6bbc-4ed3-ae56-136b51c52250] succeeded in 4.976985197999966s: None 2024-04-20T23:30:07.030341318Z [2024-04-20 23:30:07,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65ad1ca5-8e16-4944-a3ee-a90b4c090834] succeeded in 2.398747686000206s: None 2024-04-20T23:30:07.127230755Z [2024-04-20 23:30:07,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55183515-afed-44fc-8305-246787a1b6e3] received 2024-04-20T23:30:07.134181354Z [2024-04-20 23:30:07,133: INFO/ForkPoolWorker-15] [55183515-afed-44fc-8305-246787a1b6e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:30:07.391488900Z [2024-04-20 23:30:07,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:30:08.423413651Z [2024-04-20 23:30:08,423: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:30:08.426627990Z [2024-04-20 23:30:08,426: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:30:08.463039793Z [2024-04-20 23:30:08,461: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:30:08.466376196Z [2024-04-20 23:30:08,465: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:30:08.466392949Z [2024-04-20 23:30:08,466: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:30:08.466398082Z [2024-04-20 23:30:08,466: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:30:08.466403122Z [2024-04-20 23:30:08,466: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:30:08.466657573Z [2024-04-20 23:30:08,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:30:08.466673260Z [2024-04-20 23:30:08,466: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:30:08.570319033Z [2024-04-20 23:30:08,570: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:30:09.185318742Z [2024-04-20 23:30:09,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55183515-afed-44fc-8305-246787a1b6e3] succeeded in 2.0561130400001275s: None 2024-04-20T23:30:09.647477782Z [2024-04-20 23:30:09,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21af9aa4-c12e-4056-8a80-0cd1189decc1] received 2024-04-20T23:30:09.661353695Z [2024-04-20 23:30:09,661: INFO/ForkPoolWorker-15] [21af9aa4-c12e-4056-8a80-0cd1189decc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:30:09.915175714Z [2024-04-20 23:30:09,912: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:30:10.981860168Z [2024-04-20 23:30:10,981: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:30:10.985134187Z [2024-04-20 23:30:10,984: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:30:11.009650908Z [2024-04-20 23:30:11,009: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:30:11.011446932Z [2024-04-20 23:30:11,011: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:30:11.011488058Z [2024-04-20 23:30:11,011: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:30:11.011816303Z [2024-04-20 23:30:11,011: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:30:11.011860769Z [2024-04-20 23:30:11,011: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:30:11.012163126Z [2024-04-20 23:30:11,012: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:30:11.012232629Z [2024-04-20 23:30:11,012: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:30:11.123819740Z [2024-04-20 23:30:11,123: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:30:11.773340957Z [2024-04-20 23:30:11,772: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21af9aa4-c12e-4056-8a80-0cd1189decc1] succeeded in 2.125916795000194s: None 2024-04-20T23:31:00.240363291Z [2024-04-20 23:31:00,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f5e92fe-4551-42d9-a80c-2a1811e7c678] received 2024-04-20T23:31:00.242291185Z [2024-04-20 23:31:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b918763-6e8e-4ddf-aa2a-c3effa4ec857] received 2024-04-20T23:31:00.245634713Z [2024-04-20 23:31:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41f2a649-238f-4291-83f8-cd5a999504d1] received 2024-04-20T23:31:00.253365514Z [2024-04-20 23:31:00,252: INFO/ForkPoolWorker-15] [4f5e92fe-4551-42d9-a80c-2a1811e7c678] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:31:00.253970986Z [2024-04-20 23:31:00,253: INFO/ForkPoolWorker-16] [1b918763-6e8e-4ddf-aa2a-c3effa4ec857] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:31:00.254689777Z [2024-04-20 23:31:00,254: INFO/ForkPoolWorker-1] [41f2a649-238f-4291-83f8-cd5a999504d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:31:00.541306637Z [2024-04-20 23:31:00,538: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:31:00.550280740Z [2024-04-20 23:31:00,546: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:31:00.591210684Z [2024-04-20 23:31:00,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:31:00.687142568Z [2024-04-20 23:31:00,686: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:31:00.691058856Z [2024-04-20 23:31:00,690: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:31:00.714238422Z [2024-04-20 23:31:00,714: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:31:00.715133350Z [2024-04-20 23:31:00,714: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:31:00.715298556Z [2024-04-20 23:31:00,715: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:31:00.715908843Z [2024-04-20 23:31:00,715: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:31:00.716302463Z [2024-04-20 23:31:00,716: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:31:00.802360759Z [2024-04-20 23:31:00,802: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:31:01.416322559Z [2024-04-20 23:31:01,415: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41f2a649-238f-4291-83f8-cd5a999504d1] succeeded in 1.1682494800002132s: None 2024-04-20T23:31:01.763270418Z [2024-04-20 23:31:01,762: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:31:01.766631204Z [2024-04-20 23:31:01,766: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:31:01.789407217Z [2024-04-20 23:31:01,789: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:31:01.791240424Z [2024-04-20 23:31:01,791: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:31:01.791300342Z [2024-04-20 23:31:01,791: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:31:01.791506022Z [2024-04-20 23:31:01,791: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:31:01.791575571Z [2024-04-20 23:31:01,791: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:31:01.791927760Z [2024-04-20 23:31:01,791: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:31:01.792098296Z [2024-04-20 23:31:01,791: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:31:01.851831101Z [2024-04-20 23:31:01,851: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:31:01.855125319Z [2024-04-20 23:31:01,854: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:31:01.880659379Z [2024-04-20 23:31:01,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:31:01.882408535Z [2024-04-20 23:31:01,882: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:31:01.883564350Z [2024-04-20 23:31:01,883: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:31:01.883616690Z [2024-04-20 23:31:01,883: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:31:01.883804097Z [2024-04-20 23:31:01,883: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:31:01.883868737Z [2024-04-20 23:31:01,883: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:31:01.884075751Z [2024-04-20 23:31:01,883: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:31:01.884133278Z [2024-04-20 23:31:01,884: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:31:01.967233777Z [2024-04-20 23:31:01,966: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:31:03.529916767Z [2024-04-20 23:31:03,529: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f5e92fe-4551-42d9-a80c-2a1811e7c678] succeeded in 3.284664999999677s: None 2024-04-20T23:31:03.996579810Z [2024-04-20 23:31:03,996: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b918763-6e8e-4ddf-aa2a-c3effa4ec857] succeeded in 3.7524090830002024s: None 2024-04-20T23:32:01.255066151Z [2024-04-20 23:32:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cab227f-b149-494b-b053-49b920b446f0] received 2024-04-20T23:32:01.260149654Z [2024-04-20 23:32:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[470d01dc-b111-40bc-9421-ec9418dcc4bc] received 2024-04-20T23:32:01.268501081Z [2024-04-20 23:32:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f194f50-bdc8-47fc-ac1e-86efdff21976] received 2024-04-20T23:32:01.268802883Z [2024-04-20 23:32:01,268: INFO/ForkPoolWorker-15] [2cab227f-b149-494b-b053-49b920b446f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:32:01.271818046Z [2024-04-20 23:32:01,271: INFO/ForkPoolWorker-16] [470d01dc-b111-40bc-9421-ec9418dcc4bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:32:01.273593124Z [2024-04-20 23:32:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5c73eb9-427d-45ee-a5eb-d80e2aed5a94] received 2024-04-20T23:32:01.285331920Z [2024-04-20 23:32:01,284: INFO/ForkPoolWorker-2] [d5c73eb9-427d-45ee-a5eb-d80e2aed5a94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:32:01.293982683Z [2024-04-20 23:32:01,293: INFO/ForkPoolWorker-1] [6f194f50-bdc8-47fc-ac1e-86efdff21976] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:32:01.832301750Z [2024-04-20 23:32:01,828: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:32:02.018519580Z [2024-04-20 23:32:02,009: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:32:02.047459032Z [2024-04-20 23:32:02,044: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:32:02.076999001Z [2024-04-20 23:32:02,057: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:32:02.641943538Z [2024-04-20 23:32:02,641: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:32:02.656743641Z [2024-04-20 23:32:02,656: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:32:02.739600853Z [2024-04-20 23:32:02,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:32:02.784368505Z [2024-04-20 23:32:02,784: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:32:02.804631885Z [2024-04-20 23:32:02,804: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:32:02.808053927Z [2024-04-20 23:32:02,804: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:32:02.808276306Z [2024-04-20 23:32:02,807: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:32:02.812218782Z [2024-04-20 23:32:02,812: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:32:03.045119680Z [2024-04-20 23:32:03,044: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:32:03.195796566Z [2024-04-20 23:32:03,195: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:32:03.200937002Z [2024-04-20 23:32:03,200: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:32:03.252773549Z [2024-04-20 23:32:03,252: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:32:03.255294950Z [2024-04-20 23:32:03,255: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:32:03.255342878Z [2024-04-20 23:32:03,255: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:32:03.255635945Z [2024-04-20 23:32:03,255: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:32:03.255728807Z [2024-04-20 23:32:03,255: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:32:03.258346241Z [2024-04-20 23:32:03,258: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:32:03.258427782Z [2024-04-20 23:32:03,258: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:32:03.369923077Z [2024-04-20 23:32:03,369: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:32:03.373251719Z [2024-04-20 23:32:03,372: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:32:03.398915932Z [2024-04-20 23:32:03,398: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:32:03.399960949Z [2024-04-20 23:32:03,399: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:32:03.400002587Z [2024-04-20 23:32:03,399: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:32:03.400139142Z [2024-04-20 23:32:03,399: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:32:03.400158561Z [2024-04-20 23:32:03,400: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:32:03.400671342Z [2024-04-20 23:32:03,400: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:32:03.403507906Z [2024-04-20 23:32:03,403: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:32:03.417474068Z [2024-04-20 23:32:03,417: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:32:03.491704196Z [2024-04-20 23:32:03,491: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:32:03.506102222Z [2024-04-20 23:32:03,505: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cab227f-b149-494b-b053-49b920b446f0] succeeded in 2.2472147510002287s: None 2024-04-20T23:32:03.704751263Z [2024-04-20 23:32:03,704: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f194f50-bdc8-47fc-ac1e-86efdff21976] succeeded in 2.431804761999956s: None 2024-04-20T23:32:05.396548377Z [2024-04-20 23:32:05,395: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[470d01dc-b111-40bc-9421-ec9418dcc4bc] succeeded in 4.133678621999934s: None 2024-04-20T23:32:05.698160161Z [2024-04-20 23:32:05,697: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5c73eb9-427d-45ee-a5eb-d80e2aed5a94] succeeded in 4.422143456999947s: None 2024-04-20T23:33:01.272757349Z [2024-04-20 23:33:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9a3e452-a5c6-4621-925d-c9434e40090c] received 2024-04-20T23:33:01.278389250Z [2024-04-20 23:33:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3fdc731-057e-4dc0-ac20-d05aaeb5381e] received 2024-04-20T23:33:01.285057955Z [2024-04-20 23:33:01,284: INFO/ForkPoolWorker-15] [f9a3e452-a5c6-4621-925d-c9434e40090c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:33:01.291092555Z [2024-04-20 23:33:01,290: INFO/ForkPoolWorker-16] [e3fdc731-057e-4dc0-ac20-d05aaeb5381e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:33:01.292113832Z [2024-04-20 23:33:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa56b72d-e877-41f3-8087-3ca9a5c39e84] received 2024-04-20T23:33:01.311820357Z [2024-04-20 23:33:01,311: INFO/ForkPoolWorker-1] [fa56b72d-e877-41f3-8087-3ca9a5c39e84] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:33:01.773209933Z [2024-04-20 23:33:01,769: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:33:01.795092734Z [2024-04-20 23:33:01,790: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:33:01.823836006Z [2024-04-20 23:33:01,814: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:33:01.957650016Z [2024-04-20 23:33:01,957: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:33:01.961739198Z [2024-04-20 23:33:01,961: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:33:02.004812192Z [2024-04-20 23:33:02,004: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:33:02.007941427Z [2024-04-20 23:33:02,007: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:33:02.008073176Z [2024-04-20 23:33:02,007: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:33:02.008145858Z [2024-04-20 23:33:02,008: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:33:02.008403040Z [2024-04-20 23:33:02,008: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:33:02.091948693Z [2024-04-20 23:33:02,091: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:33:02.860614936Z [2024-04-20 23:33:02,860: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fa56b72d-e877-41f3-8087-3ca9a5c39e84] succeeded in 1.563861987999644s: None 2024-04-20T23:33:03.280868551Z [2024-04-20 23:33:03,280: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:33:03.284413558Z [2024-04-20 23:33:03,283: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:33:03.302945424Z [2024-04-20 23:33:03,301: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:33:03.308015877Z [2024-04-20 23:33:03,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:33:03.310690557Z [2024-04-20 23:33:03,310: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:33:03.313017542Z [2024-04-20 23:33:03,312: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:33:03.313061386Z [2024-04-20 23:33:03,312: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:33:03.313212447Z [2024-04-20 23:33:03,313: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:33:03.313325942Z [2024-04-20 23:33:03,313: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:33:03.313573020Z [2024-04-20 23:33:03,313: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:33:03.313636101Z [2024-04-20 23:33:03,313: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:33:03.357273889Z [2024-04-20 23:33:03,357: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:33:03.358521787Z [2024-04-20 23:33:03,358: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:33:03.358633005Z [2024-04-20 23:33:03,358: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:33:03.358946988Z [2024-04-20 23:33:03,358: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:33:03.359010774Z [2024-04-20 23:33:03,358: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:33:03.359317796Z [2024-04-20 23:33:03,359: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:33:03.359369003Z [2024-04-20 23:33:03,359: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:33:03.437447359Z [2024-04-20 23:33:03,437: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:33:03.467545770Z [2024-04-20 23:33:03,467: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:33:05.444344663Z [2024-04-20 23:33:05,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9a3e452-a5c6-4621-925d-c9434e40090c] succeeded in 4.169210661999841s: None 2024-04-20T23:33:06.375186316Z [2024-04-20 23:33:06,374: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3fdc731-057e-4dc0-ac20-d05aaeb5381e] succeeded in 5.0939274469997144s: None 2024-04-20T23:34:00.716457724Z [2024-04-20 23:34:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad1f9e98-95c3-451a-b5bf-7e51050c2781] received 2024-04-20T23:34:00.723028255Z [2024-04-20 23:34:00,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a95a746a-d929-45e4-931c-0d4f5b5472bf] received 2024-04-20T23:34:00.734216288Z [2024-04-20 23:34:00,733: INFO/ForkPoolWorker-16] [a95a746a-d929-45e4-931c-0d4f5b5472bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:34:00.734903241Z [2024-04-20 23:34:00,734: INFO/ForkPoolWorker-15] [ad1f9e98-95c3-451a-b5bf-7e51050c2781] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:34:00.737039492Z [2024-04-20 23:34:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6dbf3d8-8562-400c-809e-9cf9c8fdd6cf] received 2024-04-20T23:34:00.758475962Z [2024-04-20 23:34:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52337bec-7074-46da-9d43-986aa3d2cc42] received 2024-04-20T23:34:00.770252997Z [2024-04-20 23:34:00,769: INFO/ForkPoolWorker-1] [c6dbf3d8-8562-400c-809e-9cf9c8fdd6cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:34:00.779148467Z [2024-04-20 23:34:00,778: INFO/ForkPoolWorker-2] [52337bec-7074-46da-9d43-986aa3d2cc42] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:34:01.145050675Z [2024-04-20 23:34:01,139: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:34:01.157671976Z [2024-04-20 23:34:01,154: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:34:01.183370547Z [2024-04-20 23:34:01,179: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:34:01.266619604Z [2024-04-20 23:34:01,262: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:34:01.344905189Z [2024-04-20 23:34:01,344: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:34:01.349133805Z [2024-04-20 23:34:01,348: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:34:01.385289152Z [2024-04-20 23:34:01,385: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:34:01.387057304Z [2024-04-20 23:34:01,386: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:34:01.387270034Z [2024-04-20 23:34:01,387: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:34:01.387394192Z [2024-04-20 23:34:01,387: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:34:01.387610739Z [2024-04-20 23:34:01,387: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:34:01.547484665Z [2024-04-20 23:34:01,547: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:34:01.622677134Z [2024-04-20 23:34:01,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:34:02.241615107Z [2024-04-20 23:34:02,241: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad1f9e98-95c3-451a-b5bf-7e51050c2781] succeeded in 1.5229512519999844s: None 2024-04-20T23:34:02.253638960Z [2024-04-20 23:34:02,253: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[52337bec-7074-46da-9d43-986aa3d2cc42] succeeded in 1.4918177539998396s: None 2024-04-20T23:34:02.754799125Z [2024-04-20 23:34:02,754: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:34:02.758051411Z [2024-04-20 23:34:02,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:34:02.780046867Z [2024-04-20 23:34:02,779: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:34:02.783629963Z [2024-04-20 23:34:02,783: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:34:02.783647047Z [2024-04-20 23:34:02,783: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:34:02.783894471Z [2024-04-20 23:34:02,783: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:34:02.784009745Z [2024-04-20 23:34:02,783: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:34:02.784568905Z [2024-04-20 23:34:02,784: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:34:02.784631836Z [2024-04-20 23:34:02,784: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:34:02.839099286Z [2024-04-20 23:34:02,838: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:34:02.849521337Z [2024-04-20 23:34:02,848: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:34:02.884818147Z [2024-04-20 23:34:02,884: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:34:02.886040222Z [2024-04-20 23:34:02,885: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:34:02.887544213Z [2024-04-20 23:34:02,887: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:34:02.887917758Z [2024-04-20 23:34:02,887: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:34:02.888171907Z [2024-04-20 23:34:02,887: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:34:02.888342068Z [2024-04-20 23:34:02,888: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:34:02.888764662Z [2024-04-20 23:34:02,888: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:34:02.889609516Z [2024-04-20 23:34:02,889: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:34:03.010548218Z [2024-04-20 23:34:03,010: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:34:04.807586795Z [2024-04-20 23:34:04,807: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a95a746a-d929-45e4-931c-0d4f5b5472bf] succeeded in 4.082096246000219s: None 2024-04-20T23:34:05.418545710Z [2024-04-20 23:34:05,417: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c6dbf3d8-8562-400c-809e-9cf9c8fdd6cf] succeeded in 4.676044989000275s: None 2024-04-20T23:35:01.019336050Z [2024-04-20 23:35:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75bcc22e-3eff-47ab-9066-671222b4dbc1] received 2024-04-20T23:35:01.024981803Z [2024-04-20 23:35:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db729fa3-3c72-4625-b287-d9450072445d] received 2024-04-20T23:35:01.035034811Z [2024-04-20 23:35:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70d6ce61-1bb5-493d-8f1a-faab86a762a5] received 2024-04-20T23:35:01.035907622Z [2024-04-20 23:35:01,035: INFO/ForkPoolWorker-15] [75bcc22e-3eff-47ab-9066-671222b4dbc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:35:01.036399602Z [2024-04-20 23:35:01,036: INFO/ForkPoolWorker-16] [db729fa3-3c72-4625-b287-d9450072445d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:35:01.041451251Z [2024-04-20 23:35:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cfe8319-ca7e-43df-afb8-eadc4e9e97a9] received 2024-04-20T23:35:01.042227315Z [2024-04-20 23:35:01,041: INFO/ForkPoolWorker-1] [70d6ce61-1bb5-493d-8f1a-faab86a762a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:35:01.057905878Z [2024-04-20 23:35:01,057: INFO/ForkPoolWorker-2] [1cfe8319-ca7e-43df-afb8-eadc4e9e97a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:35:01.379043356Z [2024-04-20 23:35:01,375: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:35:01.449002920Z [2024-04-20 23:35:01,445: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:35:01.454904907Z [2024-04-20 23:35:01,450: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:35:01.547883573Z [2024-04-20 23:35:01,544: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:35:01.708782086Z [2024-04-20 23:35:01,708: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:35:01.712835001Z [2024-04-20 23:35:01,712: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:35:01.737366973Z [2024-04-20 23:35:01,737: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:35:01.738328990Z [2024-04-20 23:35:01,738: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:35:01.738478349Z [2024-04-20 23:35:01,738: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:35:01.738583027Z [2024-04-20 23:35:01,738: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:35:01.738802068Z [2024-04-20 23:35:01,738: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:35:01.863857657Z [2024-04-20 23:35:01,860: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:35:02.505421699Z [2024-04-20 23:35:02,504: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[70d6ce61-1bb5-493d-8f1a-faab86a762a5] succeeded in 1.4683001380003589s: None 2024-04-20T23:35:02.851512170Z [2024-04-20 23:35:02,851: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:35:02.855754330Z [2024-04-20 23:35:02,855: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:35:02.887282995Z [2024-04-20 23:35:02,887: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:35:02.889412696Z [2024-04-20 23:35:02,889: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:35:02.889676536Z [2024-04-20 23:35:02,889: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:35:02.889940806Z [2024-04-20 23:35:02,889: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:35:02.890242587Z [2024-04-20 23:35:02,890: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:35:02.890585205Z [2024-04-20 23:35:02,890: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:35:02.890727131Z [2024-04-20 23:35:02,890: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:35:02.916644437Z [2024-04-20 23:35:02,916: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:35:02.919792829Z [2024-04-20 23:35:02,919: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:35:02.948455799Z [2024-04-20 23:35:02,948: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:35:02.949863918Z [2024-04-20 23:35:02,949: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:35:02.950058689Z [2024-04-20 23:35:02,949: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:35:02.950277419Z [2024-04-20 23:35:02,950: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:35:02.950418394Z [2024-04-20 23:35:02,950: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:35:02.950719884Z [2024-04-20 23:35:02,950: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:35:02.951135325Z [2024-04-20 23:35:02,951: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:35:02.985523045Z [2024-04-20 23:35:02,985: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:35:03.049476390Z [2024-04-20 23:35:03,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:35:03.086974172Z [2024-04-20 23:35:03,086: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:35:03.090150432Z [2024-04-20 23:35:03,089: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:35:03.115368977Z [2024-04-20 23:35:03,115: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:35:03.118146652Z [2024-04-20 23:35:03,117: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:35:03.118187693Z [2024-04-20 23:35:03,118: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:35:03.118342276Z [2024-04-20 23:35:03,118: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:35:03.118405474Z [2024-04-20 23:35:03,118: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:35:03.118643641Z [2024-04-20 23:35:03,118: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:35:03.118702207Z [2024-04-20 23:35:03,118: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:35:03.274896112Z [2024-04-20 23:35:03,270: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:35:03.832465048Z [2024-04-20 23:35:03,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75bcc22e-3eff-47ab-9066-671222b4dbc1] succeeded in 2.8038121970002976s: None 2024-04-20T23:35:04.563658867Z [2024-04-20 23:35:04,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[148ffddc-4c7f-4d1a-9271-e398857c7818] received 2024-04-20T23:35:04.579834006Z [2024-04-20 23:35:04,579: INFO/ForkPoolWorker-15] [148ffddc-4c7f-4d1a-9271-e398857c7818] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:35:04.790353550Z [2024-04-20 23:35:04,789: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db729fa3-3c72-4625-b287-d9450072445d] succeeded in 3.7618488889997934s: None 2024-04-20T23:35:04.873787598Z [2024-04-20 23:35:04,870: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:35:05.660398912Z [2024-04-20 23:35:05,659: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1cfe8319-ca7e-43df-afb8-eadc4e9e97a9] succeeded in 4.614909016999718s: None 2024-04-20T23:35:05.972200889Z [2024-04-20 23:35:05,971: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:35:05.975287352Z [2024-04-20 23:35:05,974: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:35:05.996807471Z [2024-04-20 23:35:05,996: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:35:05.998430477Z [2024-04-20 23:35:05,998: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:35:05.998456677Z [2024-04-20 23:35:05,998: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:35:05.998534180Z [2024-04-20 23:35:05,998: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:35:05.998636221Z [2024-04-20 23:35:05,998: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:35:05.998851062Z [2024-04-20 23:35:05,998: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:35:05.998935459Z [2024-04-20 23:35:05,998: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:35:06.087190030Z [2024-04-20 23:35:06,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:35:06.795815565Z [2024-04-20 23:35:06,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[148ffddc-4c7f-4d1a-9271-e398857c7818] succeeded in 2.228166111000064s: None 2024-04-20T23:35:06.999068678Z [2024-04-20 23:35:06,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13ddec7f-03a1-47a9-bdb9-b3e76ff8b50f] received 2024-04-20T23:35:07.010117500Z [2024-04-20 23:35:07,009: INFO/ForkPoolWorker-15] [13ddec7f-03a1-47a9-bdb9-b3e76ff8b50f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:35:07.293175277Z [2024-04-20 23:35:07,280: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:35:08.508575891Z [2024-04-20 23:35:08,508: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:35:08.511551036Z [2024-04-20 23:35:08,511: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:35:08.531604131Z [2024-04-20 23:35:08,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:35:08.532905021Z [2024-04-20 23:35:08,532: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:35:08.532952229Z [2024-04-20 23:35:08,532: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:35:08.533148474Z [2024-04-20 23:35:08,532: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:35:08.533233804Z [2024-04-20 23:35:08,533: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:35:08.533504057Z [2024-04-20 23:35:08,533: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:35:08.533549652Z [2024-04-20 23:35:08,533: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:35:08.642362026Z [2024-04-20 23:35:08,642: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:35:09.246608285Z [2024-04-20 23:35:09,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13ddec7f-03a1-47a9-bdb9-b3e76ff8b50f] succeeded in 2.2451877010003045s: None 2024-04-20T23:35:09.960493397Z [2024-04-20 23:35:09,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dfe1424-4132-4984-9b86-44c947a71fa9] received 2024-04-20T23:35:09.984325238Z [2024-04-20 23:35:09,984: INFO/ForkPoolWorker-15] [2dfe1424-4132-4984-9b86-44c947a71fa9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:35:10.298809398Z [2024-04-20 23:35:10,295: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:35:11.379183411Z [2024-04-20 23:35:11,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:35:11.382194447Z [2024-04-20 23:35:11,381: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:35:11.407415022Z [2024-04-20 23:35:11,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:35:11.410164242Z [2024-04-20 23:35:11,409: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:35:11.410295100Z [2024-04-20 23:35:11,410: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:35:11.410575987Z [2024-04-20 23:35:11,410: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:35:11.410729556Z [2024-04-20 23:35:11,410: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:35:11.411247208Z [2024-04-20 23:35:11,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:35:11.411409139Z [2024-04-20 23:35:11,411: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:35:11.538265805Z [2024-04-20 23:35:11,537: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:35:12.135567569Z [2024-04-20 23:35:12,134: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2dfe1424-4132-4984-9b86-44c947a71fa9] succeeded in 2.1706075520000923s: None 2024-04-20T23:36:00.418805475Z [2024-04-20 23:36:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a26a3568-a5eb-4dc0-9b4e-232436227afe] received 2024-04-20T23:36:00.421820019Z [2024-04-20 23:36:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a839258-4b42-4353-86f0-7c1ef5e73472] received 2024-04-20T23:36:00.430922604Z [2024-04-20 23:36:00,430: INFO/ForkPoolWorker-15] [a26a3568-a5eb-4dc0-9b4e-232436227afe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:36:00.437621851Z [2024-04-20 23:36:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54b51903-fe39-4d71-957a-b75dfb191322] received 2024-04-20T23:36:00.438099975Z [2024-04-20 23:36:00,437: INFO/ForkPoolWorker-16] [7a839258-4b42-4353-86f0-7c1ef5e73472] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:36:00.446033851Z [2024-04-20 23:36:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6acd222c-be05-4925-9a4a-60e5530c0226] received 2024-04-20T23:36:00.454905301Z [2024-04-20 23:36:00,453: INFO/ForkPoolWorker-1] [54b51903-fe39-4d71-957a-b75dfb191322] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:36:00.461925117Z [2024-04-20 23:36:00,461: INFO/ForkPoolWorker-2] [6acd222c-be05-4925-9a4a-60e5530c0226] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:36:00.767244370Z [2024-04-20 23:36:00,763: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:36:00.775907434Z [2024-04-20 23:36:00,772: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:36:00.865750086Z [2024-04-20 23:36:00,862: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:36:00.888271672Z [2024-04-20 23:36:00,884: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:36:00.931366852Z [2024-04-20 23:36:00,930: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:36:00.935849282Z [2024-04-20 23:36:00,935: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:36:00.965067105Z [2024-04-20 23:36:00,964: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:36:00.966782767Z [2024-04-20 23:36:00,966: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:36:00.967044933Z [2024-04-20 23:36:00,966: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:36:00.967220075Z [2024-04-20 23:36:00,967: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:36:00.967508274Z [2024-04-20 23:36:00,967: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:36:01.043392672Z [2024-04-20 23:36:01,043: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:36:01.091086029Z [2024-04-20 23:36:01,090: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:36:01.755076176Z [2024-04-20 23:36:01,754: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[54b51903-fe39-4d71-957a-b75dfb191322] succeeded in 1.3134954980000657s: None 2024-04-20T23:36:01.857996145Z [2024-04-20 23:36:01,857: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a839258-4b42-4353-86f0-7c1ef5e73472] succeeded in 1.4340899730000274s: None 2024-04-20T23:36:02.238450105Z [2024-04-20 23:36:02,238: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:36:02.241980303Z [2024-04-20 23:36:02,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:36:02.273611977Z [2024-04-20 23:36:02,273: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:36:02.275093205Z [2024-04-20 23:36:02,274: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:36:02.275109915Z [2024-04-20 23:36:02,275: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:36:02.275238565Z [2024-04-20 23:36:02,275: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:36:02.275263574Z [2024-04-20 23:36:02,275: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:36:02.275571118Z [2024-04-20 23:36:02,275: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:36:02.275583994Z [2024-04-20 23:36:02,275: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:36:02.362914807Z [2024-04-20 23:36:02,362: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:36:02.363539019Z [2024-04-20 23:36:02,363: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:36:02.367813618Z [2024-04-20 23:36:02,366: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:36:02.394975683Z [2024-04-20 23:36:02,394: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:36:02.396403955Z [2024-04-20 23:36:02,396: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:36:02.396462254Z [2024-04-20 23:36:02,396: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:36:02.396599455Z [2024-04-20 23:36:02,396: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:36:02.396644497Z [2024-04-20 23:36:02,396: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:36:02.396926326Z [2024-04-20 23:36:02,396: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:36:02.396977732Z [2024-04-20 23:36:02,396: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:36:02.470803813Z [2024-04-20 23:36:02,470: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:36:04.987024370Z [2024-04-20 23:36:04,986: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6acd222c-be05-4925-9a4a-60e5530c0226] succeeded in 4.534711417999915s: None 2024-04-20T23:36:05.386924795Z [2024-04-20 23:36:05,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a26a3568-a5eb-4dc0-9b4e-232436227afe] succeeded in 4.963268965000225s: None 2024-04-20T23:37:00.864604225Z [2024-04-20 23:37:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c5924f2-f803-40d4-9cc3-13a3324966c7] received 2024-04-20T23:37:00.866282843Z [2024-04-20 23:37:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17168afa-87c5-41c9-9e83-56de9583e0dc] received 2024-04-20T23:37:00.867725597Z [2024-04-20 23:37:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[316d8770-69ac-44b0-bb4a-c4d28792a309] received 2024-04-20T23:37:00.880689621Z [2024-04-20 23:37:00,880: INFO/ForkPoolWorker-1] [316d8770-69ac-44b0-bb4a-c4d28792a309] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:37:00.884378679Z [2024-04-20 23:37:00,884: INFO/ForkPoolWorker-15] [6c5924f2-f803-40d4-9cc3-13a3324966c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:37:00.886520198Z [2024-04-20 23:37:00,886: INFO/ForkPoolWorker-16] [17168afa-87c5-41c9-9e83-56de9583e0dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:37:01.160312694Z [2024-04-20 23:37:01,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:37:01.195529222Z [2024-04-20 23:37:01,192: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:37:01.210268342Z [2024-04-20 23:37:01,206: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:37:01.369212660Z [2024-04-20 23:37:01,368: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:37:01.373093217Z [2024-04-20 23:37:01,372: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:37:01.401760455Z [2024-04-20 23:37:01,401: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:37:01.403666165Z [2024-04-20 23:37:01,403: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:37:01.403885361Z [2024-04-20 23:37:01,403: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:37:01.404029264Z [2024-04-20 23:37:01,403: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:37:01.404309055Z [2024-04-20 23:37:01,404: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:37:01.499754238Z [2024-04-20 23:37:01,497: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:37:02.128948636Z [2024-04-20 23:37:02,128: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[316d8770-69ac-44b0-bb4a-c4d28792a309] succeeded in 1.2594567389996882s: None 2024-04-20T23:37:02.595616845Z [2024-04-20 23:37:02,595: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:37:02.599137036Z [2024-04-20 23:37:02,598: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:37:02.646575789Z [2024-04-20 23:37:02,641: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:37:02.648058904Z [2024-04-20 23:37:02,647: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:37:02.648126864Z [2024-04-20 23:37:02,647: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:37:02.648310051Z [2024-04-20 23:37:02,648: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:37:02.648393386Z [2024-04-20 23:37:02,648: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:37:02.648863657Z [2024-04-20 23:37:02,648: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:37:02.648926626Z [2024-04-20 23:37:02,648: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:37:02.742500318Z [2024-04-20 23:37:02,742: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:37:02.750331854Z [2024-04-20 23:37:02,749: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:37:02.753772125Z [2024-04-20 23:37:02,753: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:37:02.779869031Z [2024-04-20 23:37:02,779: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:37:02.781300024Z [2024-04-20 23:37:02,781: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:37:02.781409432Z [2024-04-20 23:37:02,781: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:37:02.781616683Z [2024-04-20 23:37:02,781: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:37:02.781715096Z [2024-04-20 23:37:02,781: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:37:02.781989869Z [2024-04-20 23:37:02,781: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:37:02.782370209Z [2024-04-20 23:37:02,782: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:37:02.890875470Z [2024-04-20 23:37:02,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:37:04.814807043Z [2024-04-20 23:37:04,814: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c5924f2-f803-40d4-9cc3-13a3324966c7] succeeded in 3.9475257359999887s: None 2024-04-20T23:37:05.104291841Z [2024-04-20 23:37:05,103: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17168afa-87c5-41c9-9e83-56de9583e0dc] succeeded in 4.233230626000022s: None 2024-04-20T23:38:00.292963798Z [2024-04-20 23:38:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd12af95-29a1-4d02-b5e5-5a824d2cef4e] received 2024-04-20T23:38:00.294996755Z [2024-04-20 23:38:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eec3b569-cb84-4188-bdae-aa21bbc0b242] received 2024-04-20T23:38:00.303332359Z [2024-04-20 23:38:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2741148-7901-4f37-9d75-bf7ec364a257] received 2024-04-20T23:38:00.304571360Z [2024-04-20 23:38:00,304: INFO/ForkPoolWorker-16] [eec3b569-cb84-4188-bdae-aa21bbc0b242] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:38:00.306383246Z [2024-04-20 23:38:00,306: INFO/ForkPoolWorker-15] [dd12af95-29a1-4d02-b5e5-5a824d2cef4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:38:00.312505558Z [2024-04-20 23:38:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd721f47-a127-4ae1-9724-7de5545f090b] received 2024-04-20T23:38:00.343104830Z [2024-04-20 23:38:00,342: INFO/ForkPoolWorker-2] [bd721f47-a127-4ae1-9724-7de5545f090b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:38:00.344942480Z [2024-04-20 23:38:00,344: INFO/ForkPoolWorker-1] [b2741148-7901-4f37-9d75-bf7ec364a257] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:38:00.655121338Z [2024-04-20 23:38:00,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:38:00.658748984Z [2024-04-20 23:38:00,655: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:38:00.661097923Z [2024-04-20 23:38:00,658: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:38:00.803636470Z [2024-04-20 23:38:00,799: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:38:00.834923146Z [2024-04-20 23:38:00,834: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:38:00.840583686Z [2024-04-20 23:38:00,840: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:38:00.876510900Z [2024-04-20 23:38:00,876: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:38:00.881291655Z [2024-04-20 23:38:00,881: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:38:00.881448508Z [2024-04-20 23:38:00,881: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:38:00.881549574Z [2024-04-20 23:38:00,881: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:38:00.881799630Z [2024-04-20 23:38:00,881: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:38:00.896190480Z [2024-04-20 23:38:00,895: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:38:00.994142870Z [2024-04-20 23:38:00,993: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:38:01.457821805Z [2024-04-20 23:38:01,457: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd12af95-29a1-4d02-b5e5-5a824d2cef4e] succeeded in 1.1608703019996938s: None 2024-04-20T23:38:01.722882536Z [2024-04-20 23:38:01,722: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bd721f47-a127-4ae1-9724-7de5545f090b] succeeded in 1.4009514750000562s: None 2024-04-20T23:38:02.033280995Z [2024-04-20 23:38:02,032: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:38:02.036689054Z [2024-04-20 23:38:02,036: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:38:02.057793178Z [2024-04-20 23:38:02,057: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:38:02.059239286Z [2024-04-20 23:38:02,058: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:38:02.059279884Z [2024-04-20 23:38:02,059: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:38:02.059393578Z [2024-04-20 23:38:02,059: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:38:02.059439252Z [2024-04-20 23:38:02,059: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:38:02.059714418Z [2024-04-20 23:38:02,059: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:38:02.059828080Z [2024-04-20 23:38:02,059: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:38:02.136030495Z [2024-04-20 23:38:02,135: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:38:02.245796608Z [2024-04-20 23:38:02,245: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:38:02.248957011Z [2024-04-20 23:38:02,248: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:38:02.272347544Z [2024-04-20 23:38:02,272: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:38:02.273818283Z [2024-04-20 23:38:02,273: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:38:02.273925254Z [2024-04-20 23:38:02,273: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:38:02.274111728Z [2024-04-20 23:38:02,273: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:38:02.274219013Z [2024-04-20 23:38:02,274: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:38:02.274506683Z [2024-04-20 23:38:02,274: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:38:02.274954156Z [2024-04-20 23:38:02,274: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:38:02.361670215Z [2024-04-20 23:38:02,361: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:38:03.932271733Z [2024-04-20 23:38:03,931: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eec3b569-cb84-4188-bdae-aa21bbc0b242] succeeded in 3.6352663779998693s: None 2024-04-20T23:38:04.066229367Z [2024-04-20 23:38:04,065: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b2741148-7901-4f37-9d75-bf7ec364a257] succeeded in 3.7572817929999474s: None 2024-04-20T23:39:00.493635391Z [2024-04-20 23:39:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9555b1b-e54f-45ea-9192-1f287f2a3df7] received 2024-04-20T23:39:00.505941788Z [2024-04-20 23:39:00,505: INFO/ForkPoolWorker-15] [c9555b1b-e54f-45ea-9192-1f287f2a3df7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:39:00.506343053Z [2024-04-20 23:39:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2da64c2-2b09-4c36-9b50-e9bff1587663] received 2024-04-20T23:39:00.512070714Z [2024-04-20 23:39:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[512fce0d-25e0-4ebe-b37b-694a8c4c7d2b] received 2024-04-20T23:39:00.520429617Z [2024-04-20 23:39:00,520: INFO/ForkPoolWorker-1] [512fce0d-25e0-4ebe-b37b-694a8c4c7d2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:39:00.522409106Z [2024-04-20 23:39:00,520: INFO/ForkPoolWorker-16] [f2da64c2-2b09-4c36-9b50-e9bff1587663] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:39:00.814748328Z [2024-04-20 23:39:00,811: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:39:00.818095499Z [2024-04-20 23:39:00,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:39:00.834048245Z [2024-04-20 23:39:00,830: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:39:00.963920532Z [2024-04-20 23:39:00,963: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:39:00.968164084Z [2024-04-20 23:39:00,967: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:39:00.997772556Z [2024-04-20 23:39:00,997: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:39:01.000146566Z [2024-04-20 23:39:00,999: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:39:01.000310359Z [2024-04-20 23:39:01,000: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:39:01.000396175Z [2024-04-20 23:39:01,000: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:39:01.000737950Z [2024-04-20 23:39:01,000: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:39:01.099832968Z [2024-04-20 23:39:01,096: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:39:01.739915102Z [2024-04-20 23:39:01,739: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[512fce0d-25e0-4ebe-b37b-694a8c4c7d2b] succeeded in 1.2263126920001923s: None 2024-04-20T23:39:02.127196590Z [2024-04-20 23:39:02,126: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:39:02.130263997Z [2024-04-20 23:39:02,129: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:39:02.157716613Z [2024-04-20 23:39:02,157: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:39:02.161255328Z [2024-04-20 23:39:02,160: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:39:02.161329341Z [2024-04-20 23:39:02,161: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:39:02.161599578Z [2024-04-20 23:39:02,161: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:39:02.161740740Z [2024-04-20 23:39:02,161: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:39:02.162308091Z [2024-04-20 23:39:02,162: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:39:02.162394452Z [2024-04-20 23:39:02,162: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:39:02.254891789Z [2024-04-20 23:39:02,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:39:02.272105664Z [2024-04-20 23:39:02,271: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:39:02.275330186Z [2024-04-20 23:39:02,274: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:39:02.297184827Z [2024-04-20 23:39:02,296: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:39:02.298174170Z [2024-04-20 23:39:02,297: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:39:02.298186120Z [2024-04-20 23:39:02,298: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:39:02.298339838Z [2024-04-20 23:39:02,298: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:39:02.298346217Z [2024-04-20 23:39:02,298: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:39:02.298600032Z [2024-04-20 23:39:02,298: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:39:02.298718910Z [2024-04-20 23:39:02,298: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:39:02.388049574Z [2024-04-20 23:39:02,387: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:39:04.123601117Z [2024-04-20 23:39:04,123: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2da64c2-2b09-4c36-9b50-e9bff1587663] succeeded in 3.6139859640002214s: None 2024-04-20T23:39:04.422870589Z [2024-04-20 23:39:04,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9555b1b-e54f-45ea-9192-1f287f2a3df7] succeeded in 3.9262234620000527s: None 2024-04-20T23:40:01.029498508Z [2024-04-20 23:40:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a607717-e429-4b14-8d96-cafc46d4b2d3] received 2024-04-20T23:40:01.032199058Z [2024-04-20 23:40:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80dad62a-91a6-4fcb-9947-70c23d3789a9] received 2024-04-20T23:40:01.041487927Z [2024-04-20 23:40:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[584279c7-10db-4d96-b19d-17d118e4306e] received 2024-04-20T23:40:01.043766094Z [2024-04-20 23:40:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[281e5a7f-8ef8-4be7-afde-142fc8f79e0b] received 2024-04-20T23:40:01.045542845Z [2024-04-20 23:40:01,045: INFO/ForkPoolWorker-16] [80dad62a-91a6-4fcb-9947-70c23d3789a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:40:01.051197653Z [2024-04-20 23:40:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[beef5bcd-0a49-4d8a-9add-84b795743b09] received 2024-04-20T23:40:01.054884398Z [2024-04-20 23:40:01,054: INFO/ForkPoolWorker-15] [0a607717-e429-4b14-8d96-cafc46d4b2d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:40:01.061788163Z [2024-04-20 23:40:01,061: INFO/ForkPoolWorker-2] [281e5a7f-8ef8-4be7-afde-142fc8f79e0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:40:01.062551530Z [2024-04-20 23:40:01,062: INFO/ForkPoolWorker-1] [584279c7-10db-4d96-b19d-17d118e4306e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:40:01.067791014Z [2024-04-20 23:40:01,067: INFO/ForkPoolWorker-3] [beef5bcd-0a49-4d8a-9add-84b795743b09] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:40:01.366472689Z [2024-04-20 23:40:01,362: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:40:01.498713290Z [2024-04-20 23:40:01,490: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:40:01.498745390Z [2024-04-20 23:40:01,491: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:40:01.694290684Z [2024-04-20 23:40:01,689: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:40:01.780331335Z [2024-04-20 23:40:01,780: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:40:01.806754551Z [2024-04-20 23:40:01,803: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:40:01.875802895Z [2024-04-20 23:40:01,875: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-20T23:40:01.879912832Z [2024-04-20 23:40:01,879: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:40:01.928201842Z [2024-04-20 23:40:01,927: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:40:01.932695829Z [2024-04-20 23:40:01,932: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:40:01.932869183Z [2024-04-20 23:40:01,932: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:40:01.932987287Z [2024-04-20 23:40:01,932: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-20T23:40:01.933272294Z [2024-04-20 23:40:01,933: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:40:02.061747066Z [2024-04-20 23:40:02,061: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:40:02.474354080Z [2024-04-20 23:40:02,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80dad62a-91a6-4fcb-9947-70c23d3789a9] succeeded in 1.4401574230000733s: None 2024-04-20T23:40:02.850270262Z [2024-04-20 23:40:02,849: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[beef5bcd-0a49-4d8a-9add-84b795743b09] succeeded in 1.7935694379998495s: None 2024-04-20T23:40:03.245502161Z [2024-04-20 23:40:03,245: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:40:03.248990580Z [2024-04-20 23:40:03,248: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:40:03.300847041Z [2024-04-20 23:40:03,300: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:40:03.304720836Z [2024-04-20 23:40:03,304: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:40:03.304783764Z [2024-04-20 23:40:03,304: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:40:03.304958669Z [2024-04-20 23:40:03,304: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:40:03.305023470Z [2024-04-20 23:40:03,304: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:40:03.305366774Z [2024-04-20 23:40:03,305: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:40:03.305485225Z [2024-04-20 23:40:03,305: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:40:03.406916752Z [2024-04-20 23:40:03,406: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:40:03.470192013Z [2024-04-20 23:40:03,469: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:40:03.473732439Z [2024-04-20 23:40:03,473: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:40:03.505321406Z [2024-04-20 23:40:03,505: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:40:03.512668214Z [2024-04-20 23:40:03,512: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:40:03.512684129Z [2024-04-20 23:40:03,512: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:40:03.512909318Z [2024-04-20 23:40:03,512: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:40:03.513010721Z [2024-04-20 23:40:03,512: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:40:03.513231612Z [2024-04-20 23:40:03,513: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:40:03.513270092Z [2024-04-20 23:40:03,513: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:40:03.625449665Z [2024-04-20 23:40:03,625: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:40:03.629035183Z [2024-04-20 23:40:03,628: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:40:03.641190864Z [2024-04-20 23:40:03,640: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:40:03.672772917Z [2024-04-20 23:40:03,672: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:40:03.674847589Z [2024-04-20 23:40:03,674: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:40:03.678234071Z [2024-04-20 23:40:03,674: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:40:03.678698283Z [2024-04-20 23:40:03,678: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:40:03.678869079Z [2024-04-20 23:40:03,678: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:40:03.679287571Z [2024-04-20 23:40:03,679: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:40:03.679928727Z [2024-04-20 23:40:03,679: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:40:03.770996495Z [2024-04-20 23:40:03,770: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:40:04.515597501Z [2024-04-20 23:40:04,515: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a607717-e429-4b14-8d96-cafc46d4b2d3] succeeded in 3.477639344000181s: None 2024-04-20T23:40:05.208167416Z [2024-04-20 23:40:05,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbc5b4aa-626b-482f-aeca-38ac61118440] received 2024-04-20T23:40:05.218202279Z [2024-04-20 23:40:05,217: INFO/ForkPoolWorker-15] [fbc5b4aa-626b-482f-aeca-38ac61118440] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:40:05.443299820Z [2024-04-20 23:40:05,442: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[281e5a7f-8ef8-4be7-afde-142fc8f79e0b] succeeded in 4.394217776999994s: None 2024-04-20T23:40:05.567918631Z [2024-04-20 23:40:05,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:40:05.579864012Z [2024-04-20 23:40:05,579: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[584279c7-10db-4d96-b19d-17d118e4306e] succeeded in 4.53601596999988s: None 2024-04-20T23:40:06.746364277Z [2024-04-20 23:40:06,745: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:40:06.749753086Z [2024-04-20 23:40:06,749: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:40:06.767715690Z [2024-04-20 23:40:06,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:40:06.769681235Z [2024-04-20 23:40:06,769: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:40:06.769815506Z [2024-04-20 23:40:06,769: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:40:06.770100215Z [2024-04-20 23:40:06,769: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:40:06.770221079Z [2024-04-20 23:40:06,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:40:06.770736318Z [2024-04-20 23:40:06,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:40:06.770872148Z [2024-04-20 23:40:06,770: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:40:06.874958828Z [2024-04-20 23:40:06,874: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:40:07.601641551Z [2024-04-20 23:40:07,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69b52e65-e223-44e3-a996-8c6637eee686] received 2024-04-20T23:40:07.613111691Z [2024-04-20 23:40:07,612: INFO/ForkPoolWorker-16] [69b52e65-e223-44e3-a996-8c6637eee686] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:40:07.627184603Z [2024-04-20 23:40:07,626: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbc5b4aa-626b-482f-aeca-38ac61118440] succeeded in 2.416965719000018s: None 2024-04-20T23:40:07.880813011Z [2024-04-20 23:40:07,877: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:40:08.914070621Z [2024-04-20 23:40:08,913: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:40:08.917282413Z [2024-04-20 23:40:08,916: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:40:08.942410028Z [2024-04-20 23:40:08,942: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:40:08.943952377Z [2024-04-20 23:40:08,943: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:40:08.944081485Z [2024-04-20 23:40:08,943: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:40:08.944408383Z [2024-04-20 23:40:08,944: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:40:08.944510953Z [2024-04-20 23:40:08,944: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:40:08.945062272Z [2024-04-20 23:40:08,944: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:40:08.945073645Z [2024-04-20 23:40:08,944: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:40:09.036601710Z [2024-04-20 23:40:09,036: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:40:09.684047013Z [2024-04-20 23:40:09,683: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69b52e65-e223-44e3-a996-8c6637eee686] succeeded in 2.0791475460000584s: None 2024-04-20T23:40:10.162313711Z [2024-04-20 23:40:10,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af231272-bb69-44ed-9caa-18679ab6b330] received 2024-04-20T23:40:10.176492944Z [2024-04-20 23:40:10,176: INFO/ForkPoolWorker-15] [af231272-bb69-44ed-9caa-18679ab6b330] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:40:10.473303092Z [2024-04-20 23:40:10,470: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:40:11.629928222Z [2024-04-20 23:40:11,629: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:40:11.633183460Z [2024-04-20 23:40:11,632: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:40:11.668257266Z [2024-04-20 23:40:11,667: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:40:11.670193468Z [2024-04-20 23:40:11,669: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:40:11.670379298Z [2024-04-20 23:40:11,670: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:40:11.670696803Z [2024-04-20 23:40:11,670: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:40:11.671451812Z [2024-04-20 23:40:11,671: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:40:11.672274369Z [2024-04-20 23:40:11,671: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:40:11.672611778Z [2024-04-20 23:40:11,672: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:40:11.753402215Z [2024-04-20 23:40:11,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:40:12.388042076Z [2024-04-20 23:40:12,387: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af231272-bb69-44ed-9caa-18679ab6b330] succeeded in 2.220327159000135s: None 2024-04-20T23:41:01.073410573Z [2024-04-20 23:41:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a336dbf1-e9c2-48fd-b8d3-d4eab8d3bd45] received 2024-04-20T23:41:01.075414968Z [2024-04-20 23:41:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[160c131b-3c22-4df5-bc4f-9bd39b7861b8] received 2024-04-20T23:41:01.081341209Z [2024-04-20 23:41:01,081: INFO/ForkPoolWorker-15] [a336dbf1-e9c2-48fd-b8d3-d4eab8d3bd45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:41:01.083173326Z [2024-04-20 23:41:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afbec097-b9ab-4ff6-9850-6a8a49a2da7d] received 2024-04-20T23:41:01.092810899Z [2024-04-20 23:41:01,091: INFO/ForkPoolWorker-1] [afbec097-b9ab-4ff6-9850-6a8a49a2da7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:41:01.103811141Z [2024-04-20 23:41:01,100: INFO/ForkPoolWorker-16] [160c131b-3c22-4df5-bc4f-9bd39b7861b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:41:01.390038150Z [2024-04-20 23:41:01,386: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:41:01.390806231Z [2024-04-20 23:41:01,387: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:41:01.560775663Z [2024-04-20 23:41:01,553: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:41:01.847168885Z [2024-04-20 23:41:01,846: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:41:01.851278707Z [2024-04-20 23:41:01,850: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:41:01.879045347Z [2024-04-20 23:41:01,878: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:41:01.880304581Z [2024-04-20 23:41:01,880: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:41:01.880501720Z [2024-04-20 23:41:01,880: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:41:01.880668300Z [2024-04-20 23:41:01,880: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:41:01.880935130Z [2024-04-20 23:41:01,880: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:41:01.969071076Z [2024-04-20 23:41:01,968: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:41:02.659335867Z [2024-04-20 23:41:02,658: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[160c131b-3c22-4df5-bc4f-9bd39b7861b8] succeeded in 1.5799769420000302s: None 2024-04-20T23:41:02.739242379Z [2024-04-20 23:41:02,738: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:41:02.743151440Z [2024-04-20 23:41:02,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:41:02.772205510Z [2024-04-20 23:41:02,771: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:41:02.776982581Z [2024-04-20 23:41:02,776: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:41:02.777166561Z [2024-04-20 23:41:02,776: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:41:02.777441479Z [2024-04-20 23:41:02,777: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:41:02.777613980Z [2024-04-20 23:41:02,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:41:02.778012066Z [2024-04-20 23:41:02,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:41:02.778188891Z [2024-04-20 23:41:02,777: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:41:02.816067248Z [2024-04-20 23:41:02,815: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:41:02.819460783Z [2024-04-20 23:41:02,819: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:41:02.859790169Z [2024-04-20 23:41:02,859: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:41:02.861555879Z [2024-04-20 23:41:02,861: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:41:02.861772254Z [2024-04-20 23:41:02,861: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:41:02.862068190Z [2024-04-20 23:41:02,861: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:41:02.862314355Z [2024-04-20 23:41:02,862: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:41:02.862827487Z [2024-04-20 23:41:02,862: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:41:02.862998787Z [2024-04-20 23:41:02,862: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:41:02.903426391Z [2024-04-20 23:41:02,903: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:41:02.952301507Z [2024-04-20 23:41:02,952: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:41:05.850800405Z [2024-04-20 23:41:05,849: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[afbec097-b9ab-4ff6-9850-6a8a49a2da7d] succeeded in 4.762580607000018s: None 2024-04-20T23:41:05.853181813Z [2024-04-20 23:41:05,852: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a336dbf1-e9c2-48fd-b8d3-d4eab8d3bd45] succeeded in 4.778507979999631s: None 2024-04-20T23:42:01.127778013Z [2024-04-20 23:42:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb9ea03e-8690-4b71-abf3-05c87a5e9557] received 2024-04-20T23:42:01.135395725Z [2024-04-20 23:42:01,135: INFO/ForkPoolWorker-15] [fb9ea03e-8690-4b71-abf3-05c87a5e9557] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:42:01.140081224Z [2024-04-20 23:42:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22e06604-771a-4ed2-9757-bc4acfb35ab0] received 2024-04-20T23:42:01.142780839Z [2024-04-20 23:42:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51bb0c2f-5131-443e-8985-5914ca1e74fa] received 2024-04-20T23:42:01.147577221Z [2024-04-20 23:42:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4eef1fe-8a54-462d-80e9-1f663a71f569] received 2024-04-20T23:42:01.149620483Z [2024-04-20 23:42:01,149: INFO/ForkPoolWorker-16] [22e06604-771a-4ed2-9757-bc4acfb35ab0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:42:01.164264214Z [2024-04-20 23:42:01,163: INFO/ForkPoolWorker-1] [51bb0c2f-5131-443e-8985-5914ca1e74fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:42:01.166795359Z [2024-04-20 23:42:01,166: INFO/ForkPoolWorker-2] [a4eef1fe-8a54-462d-80e9-1f663a71f569] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:42:01.593757541Z [2024-04-20 23:42:01,589: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:42:01.680253699Z [2024-04-20 23:42:01,675: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:42:01.806890292Z [2024-04-20 23:42:01,803: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:42:01.858959581Z [2024-04-20 23:42:01,839: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:42:01.864002162Z [2024-04-20 23:42:01,863: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:42:02.390665952Z [2024-04-20 23:42:02,390: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:42:02.398253282Z [2024-04-20 23:42:02,397: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:42:02.437275637Z [2024-04-20 23:42:02,437: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:42:02.440023076Z [2024-04-20 23:42:02,439: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:42:02.440330741Z [2024-04-20 23:42:02,440: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:42:02.440510278Z [2024-04-20 23:42:02,440: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:42:02.440828462Z [2024-04-20 23:42:02,440: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:42:02.582189270Z [2024-04-20 23:42:02,581: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:42:02.722675161Z [2024-04-20 23:42:02,722: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb9ea03e-8690-4b71-abf3-05c87a5e9557] succeeded in 1.5942090990001816s: None 2024-04-20T23:42:03.180548388Z [2024-04-20 23:42:03,180: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a4eef1fe-8a54-462d-80e9-1f663a71f569] succeeded in 2.029687195000406s: None 2024-04-20T23:42:03.191552513Z [2024-04-20 23:42:03,191: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:42:03.194826781Z [2024-04-20 23:42:03,194: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:42:03.229021322Z [2024-04-20 23:42:03,228: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:42:03.230545796Z [2024-04-20 23:42:03,230: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:42:03.230560152Z [2024-04-20 23:42:03,230: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:42:03.230684355Z [2024-04-20 23:42:03,230: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:42:03.230698650Z [2024-04-20 23:42:03,230: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:42:03.231055537Z [2024-04-20 23:42:03,230: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:42:03.231086828Z [2024-04-20 23:42:03,231: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:42:03.347515935Z [2024-04-20 23:42:03,347: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:42:03.498297856Z [2024-04-20 23:42:03,497: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:42:03.501477392Z [2024-04-20 23:42:03,501: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:42:03.525218698Z [2024-04-20 23:42:03,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:42:03.526454503Z [2024-04-20 23:42:03,526: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:42:03.526546206Z [2024-04-20 23:42:03,526: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:42:03.526697959Z [2024-04-20 23:42:03,526: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:42:03.526770614Z [2024-04-20 23:42:03,526: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:42:03.527019726Z [2024-04-20 23:42:03,526: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:42:03.527457916Z [2024-04-20 23:42:03,527: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:42:03.603469751Z [2024-04-20 23:42:03,603: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:42:05.576853477Z [2024-04-20 23:42:05,576: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51bb0c2f-5131-443e-8985-5914ca1e74fa] succeeded in 4.430254113000046s: None 2024-04-20T23:42:05.905655070Z [2024-04-20 23:42:05,905: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22e06604-771a-4ed2-9757-bc4acfb35ab0] succeeded in 4.7635937770000965s: None 2024-04-20T23:43:00.405516187Z [2024-04-20 23:43:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06455d54-849c-4f71-aa14-0f5d5771e33d] received 2024-04-20T23:43:00.408045748Z [2024-04-20 23:43:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8414067e-0a17-4acf-925e-4bdbd6706f73] received 2024-04-20T23:43:00.415380750Z [2024-04-20 23:43:00,414: INFO/ForkPoolWorker-15] [06455d54-849c-4f71-aa14-0f5d5771e33d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:43:00.419173716Z [2024-04-20 23:43:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25555b17-4e0f-4257-8d48-398a11f17c2f] received 2024-04-20T23:43:00.428364940Z [2024-04-20 23:43:00,428: INFO/ForkPoolWorker-16] [8414067e-0a17-4acf-925e-4bdbd6706f73] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:43:00.428966895Z [2024-04-20 23:43:00,428: INFO/ForkPoolWorker-1] [25555b17-4e0f-4257-8d48-398a11f17c2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:43:00.683505438Z [2024-04-20 23:43:00,680: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:43:00.699000946Z [2024-04-20 23:43:00,694: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:43:00.707300646Z [2024-04-20 23:43:00,704: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:43:00.844149767Z [2024-04-20 23:43:00,843: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:43:00.847919446Z [2024-04-20 23:43:00,847: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:43:00.872559388Z [2024-04-20 23:43:00,872: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:43:00.874098080Z [2024-04-20 23:43:00,873: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:43:00.874343808Z [2024-04-20 23:43:00,874: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:43:00.874466581Z [2024-04-20 23:43:00,874: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:43:00.874797608Z [2024-04-20 23:43:00,874: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:43:00.956243755Z [2024-04-20 23:43:00,955: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:43:01.554024494Z [2024-04-20 23:43:01,553: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8414067e-0a17-4acf-925e-4bdbd6706f73] succeeded in 1.1430834399998275s: None 2024-04-20T23:43:01.831770927Z [2024-04-20 23:43:01,831: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:43:01.835408801Z [2024-04-20 23:43:01,835: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:43:01.856276427Z [2024-04-20 23:43:01,855: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:43:01.859638890Z [2024-04-20 23:43:01,859: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:43:01.867120050Z [2024-04-20 23:43:01,866: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:43:01.870878480Z [2024-04-20 23:43:01,870: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:43:01.871139638Z [2024-04-20 23:43:01,870: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:43:01.871601798Z [2024-04-20 23:43:01,871: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:43:01.871957075Z [2024-04-20 23:43:01,871: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:43:01.872407572Z [2024-04-20 23:43:01,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:43:01.872542543Z [2024-04-20 23:43:01,872: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:43:01.887553338Z [2024-04-20 23:43:01,887: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:43:01.896808329Z [2024-04-20 23:43:01,896: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:43:01.896871654Z [2024-04-20 23:43:01,896: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:43:01.897346173Z [2024-04-20 23:43:01,897: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:43:01.897457405Z [2024-04-20 23:43:01,897: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:43:01.897694729Z [2024-04-20 23:43:01,897: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:43:01.898072257Z [2024-04-20 23:43:01,897: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:43:01.977907679Z [2024-04-20 23:43:01,977: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:43:01.988020025Z [2024-04-20 23:43:01,987: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:43:03.654679817Z [2024-04-20 23:43:03,654: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06455d54-849c-4f71-aa14-0f5d5771e33d] succeeded in 3.246287209000002s: None 2024-04-20T23:43:04.015793591Z [2024-04-20 23:43:04,015: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25555b17-4e0f-4257-8d48-398a11f17c2f] succeeded in 3.5953731290001087s: None 2024-04-20T23:44:01.030320773Z [2024-04-20 23:44:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87b11d3c-f018-4a2e-8133-4c384e4f6a0c] received 2024-04-20T23:44:01.033029102Z [2024-04-20 23:44:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8310f7b-e414-45ec-8ee6-4318e9fb6594] received 2024-04-20T23:44:01.034841056Z [2024-04-20 23:44:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b945e32-285d-4909-bc34-cfb83e701d71] received 2024-04-20T23:44:01.046472597Z [2024-04-20 23:44:01,046: INFO/ForkPoolWorker-16] [a8310f7b-e414-45ec-8ee6-4318e9fb6594] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:44:01.050639976Z [2024-04-20 23:44:01,050: INFO/ForkPoolWorker-15] [87b11d3c-f018-4a2e-8133-4c384e4f6a0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:44:01.051406334Z [2024-04-20 23:44:01,051: INFO/ForkPoolWorker-1] [2b945e32-285d-4909-bc34-cfb83e701d71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:44:01.326172351Z [2024-04-20 23:44:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d17ad27-4cab-4c6c-a171-0f1b28e1db0c] received 2024-04-20T23:44:01.352809288Z [2024-04-20 23:44:01,352: INFO/ForkPoolWorker-2] [3d17ad27-4cab-4c6c-a171-0f1b28e1db0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:44:01.425984964Z [2024-04-20 23:44:01,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:44:01.592457317Z [2024-04-20 23:44:01,579: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:44:01.655455624Z [2024-04-20 23:44:01,650: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:44:01.765218493Z [2024-04-20 23:44:01,760: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:44:02.067595825Z [2024-04-20 23:44:02,067: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:44:02.085251984Z [2024-04-20 23:44:02,074: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:44:02.133469453Z [2024-04-20 23:44:02,133: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:44:02.136384396Z [2024-04-20 23:44:02,136: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:44:02.136527622Z [2024-04-20 23:44:02,136: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:44:02.136593574Z [2024-04-20 23:44:02,136: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:44:02.136879746Z [2024-04-20 23:44:02,136: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:44:02.247222598Z [2024-04-20 23:44:02,246: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:44:02.281325856Z [2024-04-20 23:44:02,281: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:44:02.916372416Z [2024-04-20 23:44:02,915: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a8310f7b-e414-45ec-8ee6-4318e9fb6594] succeeded in 1.8804728379991502s: None 2024-04-20T23:44:02.931650422Z [2024-04-20 23:44:02,931: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d17ad27-4cab-4c6c-a171-0f1b28e1db0c] succeeded in 1.6028331190000245s: None 2024-04-20T23:44:03.024951834Z [2024-04-20 23:44:03,024: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:44:03.028191111Z [2024-04-20 23:44:03,027: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:44:03.072127268Z [2024-04-20 23:44:03,071: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:44:03.073415195Z [2024-04-20 23:44:03,073: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:44:03.073439680Z [2024-04-20 23:44:03,073: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:44:03.073542221Z [2024-04-20 23:44:03,073: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:44:03.073609048Z [2024-04-20 23:44:03,073: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:44:03.074085102Z [2024-04-20 23:44:03,073: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:44:03.074255382Z [2024-04-20 23:44:03,073: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:44:03.243324946Z [2024-04-20 23:44:03,242: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:44:03.339652110Z [2024-04-20 23:44:03,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:44:03.343989846Z [2024-04-20 23:44:03,343: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:44:03.412770451Z [2024-04-20 23:44:03,412: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:44:03.413899513Z [2024-04-20 23:44:03,413: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:44:03.413930693Z [2024-04-20 23:44:03,413: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:44:03.414037386Z [2024-04-20 23:44:03,413: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:44:03.414095715Z [2024-04-20 23:44:03,414: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:44:03.414375731Z [2024-04-20 23:44:03,414: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:44:03.414383421Z [2024-04-20 23:44:03,414: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:44:03.505197038Z [2024-04-20 23:44:03,504: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:44:04.924554112Z [2024-04-20 23:44:04,923: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b945e32-285d-4909-bc34-cfb83e701d71] succeeded in 3.886108882999906s: None 2024-04-20T23:44:05.150980283Z [2024-04-20 23:44:05,150: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87b11d3c-f018-4a2e-8133-4c384e4f6a0c] succeeded in 4.116499576000024s: None 2024-04-20T23:45:01.224420033Z [2024-04-20 23:45:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94c2efb9-4d92-452c-8bd1-897fe4a1f5fa] received 2024-04-20T23:45:01.225749386Z [2024-04-20 23:45:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b3a4f7c-55fe-4768-aff2-06d8d4668bb3] received 2024-04-20T23:45:01.228352101Z [2024-04-20 23:45:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aebda494-26df-4c6a-ad64-47b78f3aaecc] received 2024-04-20T23:45:01.231745666Z [2024-04-20 23:45:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b502baa-21f3-4a3a-a227-4e173a649152] received 2024-04-20T23:45:01.235426241Z [2024-04-20 23:45:01,235: INFO/ForkPoolWorker-16] [7b3a4f7c-55fe-4768-aff2-06d8d4668bb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:45:01.236232375Z [2024-04-20 23:45:01,236: INFO/ForkPoolWorker-1] [aebda494-26df-4c6a-ad64-47b78f3aaecc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:45:01.243511000Z [2024-04-20 23:45:01,243: INFO/ForkPoolWorker-2] [4b502baa-21f3-4a3a-a227-4e173a649152] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:45:01.255271312Z [2024-04-20 23:45:01,254: INFO/ForkPoolWorker-15] [94c2efb9-4d92-452c-8bd1-897fe4a1f5fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:45:01.695748113Z [2024-04-20 23:45:01,684: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:45:01.695767759Z [2024-04-20 23:45:01,687: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:45:01.814737939Z [2024-04-20 23:45:01,811: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:45:01.846148906Z [2024-04-20 23:45:01,843: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:45:01.971267013Z [2024-04-20 23:45:01,970: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-20T23:45:01.975192639Z [2024-04-20 23:45:01,974: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:45:02.023892213Z [2024-04-20 23:45:02,023: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:45:02.025049318Z [2024-04-20 23:45:02,024: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:45:02.025089479Z [2024-04-20 23:45:02,024: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:45:02.025149960Z [2024-04-20 23:45:02,025: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-20T23:45:02.025320242Z [2024-04-20 23:45:02,025: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:45:02.175385629Z [2024-04-20 23:45:02,174: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:45:02.941930790Z [2024-04-20 23:45:02,941: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94c2efb9-4d92-452c-8bd1-897fe4a1f5fa] succeeded in 1.7128479430002699s: None 2024-04-20T23:45:03.183437286Z [2024-04-20 23:45:03,183: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:45:03.187078135Z [2024-04-20 23:45:03,186: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:45:03.241063388Z [2024-04-20 23:45:03,240: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:45:03.244914649Z [2024-04-20 23:45:03,244: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:45:03.245098185Z [2024-04-20 23:45:03,244: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:45:03.245352222Z [2024-04-20 23:45:03,245: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:45:03.245503019Z [2024-04-20 23:45:03,245: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:45:03.245853561Z [2024-04-20 23:45:03,245: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:45:03.245929156Z [2024-04-20 23:45:03,245: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:45:03.334045356Z [2024-04-20 23:45:03,333: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:45:03.457042221Z [2024-04-20 23:45:03,456: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:45:03.460726757Z [2024-04-20 23:45:03,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:45:03.486213872Z [2024-04-20 23:45:03,485: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:45:03.488705626Z [2024-04-20 23:45:03,488: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:45:03.488806520Z [2024-04-20 23:45:03,488: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:45:03.488994927Z [2024-04-20 23:45:03,488: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:45:03.489098716Z [2024-04-20 23:45:03,488: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:45:03.489377071Z [2024-04-20 23:45:03,489: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:45:03.489838615Z [2024-04-20 23:45:03,489: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:45:03.570337068Z [2024-04-20 23:45:03,570: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:45:04.135740577Z [2024-04-20 23:45:04,135: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:45:04.144487640Z [2024-04-20 23:45:04,144: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:45:04.183003878Z [2024-04-20 23:45:04,182: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:45:04.185089781Z [2024-04-20 23:45:04,184: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:45:04.185409804Z [2024-04-20 23:45:04,185: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:45:04.185709695Z [2024-04-20 23:45:04,185: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:45:04.185875702Z [2024-04-20 23:45:04,185: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:45:04.186340483Z [2024-04-20 23:45:04,186: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:45:04.186508995Z [2024-04-20 23:45:04,186: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:45:04.275505691Z [2024-04-20 23:45:04,275: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:45:04.511769412Z [2024-04-20 23:45:04,511: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aebda494-26df-4c6a-ad64-47b78f3aaecc] succeeded in 3.2815975629991954s: None 2024-04-20T23:45:05.223010382Z [2024-04-20 23:45:05,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23ab9740-e485-431f-bb3c-2696154ad5e1] received 2024-04-20T23:45:05.237992371Z [2024-04-20 23:45:05,237: INFO/ForkPoolWorker-15] [23ab9740-e485-431f-bb3c-2696154ad5e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:45:05.504237005Z [2024-04-20 23:45:05,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:45:05.705893980Z [2024-04-20 23:45:05,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b3a4f7c-55fe-4768-aff2-06d8d4668bb3] succeeded in 4.478042847999859s: None 2024-04-20T23:45:05.942532985Z [2024-04-20 23:45:05,942: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4b502baa-21f3-4a3a-a227-4e173a649152] succeeded in 4.706071067999801s: None 2024-04-20T23:45:06.623127159Z [2024-04-20 23:45:06,622: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:45:06.626580446Z [2024-04-20 23:45:06,626: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:45:06.650008265Z [2024-04-20 23:45:06,649: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:45:06.651322942Z [2024-04-20 23:45:06,651: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:45:06.651498202Z [2024-04-20 23:45:06,651: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:45:06.651661025Z [2024-04-20 23:45:06,651: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:45:06.651785487Z [2024-04-20 23:45:06,651: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:45:06.652079865Z [2024-04-20 23:45:06,651: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:45:06.652245820Z [2024-04-20 23:45:06,651: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:45:06.749069662Z [2024-04-20 23:45:06,748: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:45:07.452314592Z [2024-04-20 23:45:07,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23ab9740-e485-431f-bb3c-2696154ad5e1] succeeded in 2.226130366999314s: None 2024-04-20T23:45:07.700595595Z [2024-04-20 23:45:07,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f38ee32-8ebe-42c5-bf6e-3232c8dea584] received 2024-04-20T23:45:07.710072740Z [2024-04-20 23:45:07,709: INFO/ForkPoolWorker-15] [7f38ee32-8ebe-42c5-bf6e-3232c8dea584] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:45:08.010328519Z [2024-04-20 23:45:08,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:45:09.062181034Z [2024-04-20 23:45:09,061: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:45:09.065555957Z [2024-04-20 23:45:09,065: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:45:09.086971119Z [2024-04-20 23:45:09,086: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:45:09.088494961Z [2024-04-20 23:45:09,088: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:45:09.088510247Z [2024-04-20 23:45:09,088: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:45:09.088937015Z [2024-04-20 23:45:09,088: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:45:09.089098436Z [2024-04-20 23:45:09,088: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:45:09.089536908Z [2024-04-20 23:45:09,089: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:45:09.089833286Z [2024-04-20 23:45:09,089: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:45:09.184490764Z [2024-04-20 23:45:09,184: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:45:09.847953593Z [2024-04-20 23:45:09,847: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f38ee32-8ebe-42c5-bf6e-3232c8dea584] succeeded in 2.1440249040006165s: None 2024-04-20T23:45:10.108832693Z [2024-04-20 23:45:10,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[140fc9d0-b90a-4b8b-a54a-651536db3463] received 2024-04-20T23:45:10.120469020Z [2024-04-20 23:45:10,119: INFO/ForkPoolWorker-15] [140fc9d0-b90a-4b8b-a54a-651536db3463] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:45:10.418103736Z [2024-04-20 23:45:10,414: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:45:11.440202663Z [2024-04-20 23:45:11,439: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:45:11.443380694Z [2024-04-20 23:45:11,442: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:45:11.480563352Z [2024-04-20 23:45:11,479: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:45:11.492744480Z [2024-04-20 23:45:11,484: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:45:11.492756558Z [2024-04-20 23:45:11,484: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:45:11.492761830Z [2024-04-20 23:45:11,484: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:45:11.492767471Z [2024-04-20 23:45:11,484: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:45:11.492772068Z [2024-04-20 23:45:11,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:45:11.492776496Z [2024-04-20 23:45:11,484: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:45:11.563169037Z [2024-04-20 23:45:11,562: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:45:12.220654955Z [2024-04-20 23:45:12,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[140fc9d0-b90a-4b8b-a54a-651536db3463] succeeded in 2.1076154189995577s: None 2024-04-20T23:46:00.982827139Z [2024-04-20 23:46:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8b1aa29-ca07-4317-ac1e-602e19eaf6d6] received 2024-04-20T23:46:00.988488699Z [2024-04-20 23:46:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52d4a1db-ccd6-421f-8888-c99908b2924a] received 2024-04-20T23:46:00.991438313Z [2024-04-20 23:46:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9c6b9d7-60de-4b0c-89f8-d61e087cf1b6] received 2024-04-20T23:46:00.992824522Z [2024-04-20 23:46:00,992: INFO/ForkPoolWorker-15] [f8b1aa29-ca07-4317-ac1e-602e19eaf6d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:46:00.994344498Z [2024-04-20 23:46:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cf829ee-beff-4c10-aef7-6464543d6e8b] received 2024-04-20T23:46:00.997355897Z [2024-04-20 23:46:00,997: INFO/ForkPoolWorker-16] [52d4a1db-ccd6-421f-8888-c99908b2924a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:46:01.011795492Z [2024-04-20 23:46:01,010: INFO/ForkPoolWorker-2] [9cf829ee-beff-4c10-aef7-6464543d6e8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:46:01.023395290Z [2024-04-20 23:46:01,022: INFO/ForkPoolWorker-1] [f9c6b9d7-60de-4b0c-89f8-d61e087cf1b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:46:01.338605233Z [2024-04-20 23:46:01,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:46:01.527764416Z [2024-04-20 23:46:01,519: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:46:01.678875696Z [2024-04-20 23:46:01,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:46:01.715233419Z [2024-04-20 23:46:01,704: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:46:01.810744045Z [2024-04-20 23:46:01,810: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:46:02.171638966Z [2024-04-20 23:46:02,171: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:46:02.187029711Z [2024-04-20 23:46:02,186: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:46:02.249239315Z [2024-04-20 23:46:02,249: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:46:02.250156970Z [2024-04-20 23:46:02,249: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:46:02.250211266Z [2024-04-20 23:46:02,250: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:46:02.250253648Z [2024-04-20 23:46:02,250: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:46:02.250649398Z [2024-04-20 23:46:02,250: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:46:02.416495619Z [2024-04-20 23:46:02,416: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:46:02.603810435Z [2024-04-20 23:46:02,598: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8b1aa29-ca07-4317-ac1e-602e19eaf6d6] succeeded in 1.6142780959999072s: None 2024-04-20T23:46:02.909580098Z [2024-04-20 23:46:02,909: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:46:02.914224571Z [2024-04-20 23:46:02,913: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:46:02.934268374Z [2024-04-20 23:46:02,934: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:46:02.935555564Z [2024-04-20 23:46:02,935: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:46:02.935703585Z [2024-04-20 23:46:02,935: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:46:02.935895239Z [2024-04-20 23:46:02,935: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:46:02.936012176Z [2024-04-20 23:46:02,935: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:46:02.936315907Z [2024-04-20 23:46:02,936: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:46:02.936729984Z [2024-04-20 23:46:02,936: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:46:03.052951938Z [2024-04-20 23:46:03,052: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:46:03.080599696Z [2024-04-20 23:46:03,080: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9cf829ee-beff-4c10-aef7-6464543d6e8b] succeeded in 2.084464530999867s: None 2024-04-20T23:46:03.187128350Z [2024-04-20 23:46:03,186: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:46:03.196053474Z [2024-04-20 23:46:03,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:46:03.229447555Z [2024-04-20 23:46:03,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:46:03.232421282Z [2024-04-20 23:46:03,231: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:46:03.232627715Z [2024-04-20 23:46:03,232: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:46:03.232857878Z [2024-04-20 23:46:03,232: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:46:03.233187513Z [2024-04-20 23:46:03,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:46:03.233636516Z [2024-04-20 23:46:03,233: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:46:03.234257872Z [2024-04-20 23:46:03,233: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:46:03.314196374Z [2024-04-20 23:46:03,313: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:46:04.888079070Z [2024-04-20 23:46:04,887: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[52d4a1db-ccd6-421f-8888-c99908b2924a] succeeded in 3.8972302550000677s: None 2024-04-20T23:46:05.180137016Z [2024-04-20 23:46:05,179: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f9c6b9d7-60de-4b0c-89f8-d61e087cf1b6] succeeded in 4.183491280999988s: None 2024-04-20T23:47:00.907004718Z [2024-04-20 23:47:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26f412be-8f4b-4816-b80a-0f98d56d6254] received 2024-04-20T23:47:00.912973516Z [2024-04-20 23:47:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a99670b-9851-4a8b-9a27-6413e023870f] received 2024-04-20T23:47:00.918549769Z [2024-04-20 23:47:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fb47211-0d77-4245-98e5-bb2880d6f272] received 2024-04-20T23:47:00.921988577Z [2024-04-20 23:47:00,921: INFO/ForkPoolWorker-15] [26f412be-8f4b-4816-b80a-0f98d56d6254] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:47:00.923210525Z [2024-04-20 23:47:00,922: INFO/ForkPoolWorker-16] [4a99670b-9851-4a8b-9a27-6413e023870f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:47:00.928699406Z [2024-04-20 23:47:00,927: INFO/ForkPoolWorker-1] [0fb47211-0d77-4245-98e5-bb2880d6f272] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:47:01.240687791Z [2024-04-20 23:47:01,237: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:47:01.245464508Z [2024-04-20 23:47:01,242: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:47:01.271225631Z [2024-04-20 23:47:01,268: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:47:01.417457874Z [2024-04-20 23:47:01,417: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:47:01.421242437Z [2024-04-20 23:47:01,420: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:47:01.455297360Z [2024-04-20 23:47:01,455: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:47:01.456736714Z [2024-04-20 23:47:01,456: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:47:01.456927961Z [2024-04-20 23:47:01,456: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:47:01.457066238Z [2024-04-20 23:47:01,456: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:47:01.457368111Z [2024-04-20 23:47:01,457: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:47:01.589675499Z [2024-04-20 23:47:01,589: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:47:02.200645540Z [2024-04-20 23:47:02,200: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0fb47211-0d77-4245-98e5-bb2880d6f272] succeeded in 1.2804920270000366s: None 2024-04-20T23:47:02.460004542Z [2024-04-20 23:47:02,459: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:47:02.463365716Z [2024-04-20 23:47:02,462: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:47:02.486016045Z [2024-04-20 23:47:02,485: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:47:02.487182168Z [2024-04-20 23:47:02,486: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:47:02.487822103Z [2024-04-20 23:47:02,487: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:47:02.487989139Z [2024-04-20 23:47:02,487: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:47:02.488176485Z [2024-04-20 23:47:02,487: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:47:02.488826102Z [2024-04-20 23:47:02,488: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:47:02.488991238Z [2024-04-20 23:47:02,488: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:47:02.498741834Z [2024-04-20 23:47:02,498: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:47:02.502317653Z [2024-04-20 23:47:02,501: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:47:02.536182424Z [2024-04-20 23:47:02,535: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:47:02.540815347Z [2024-04-20 23:47:02,540: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:47:02.541108183Z [2024-04-20 23:47:02,540: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:47:02.541399113Z [2024-04-20 23:47:02,541: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:47:02.541723215Z [2024-04-20 23:47:02,541: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:47:02.542117399Z [2024-04-20 23:47:02,541: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:47:02.542405594Z [2024-04-20 23:47:02,542: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:47:02.574874814Z [2024-04-20 23:47:02,574: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:47:02.627317914Z [2024-04-20 23:47:02,626: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:47:04.089164175Z [2024-04-20 23:47:04,088: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26f412be-8f4b-4816-b80a-0f98d56d6254] succeeded in 3.1764711449995957s: None 2024-04-20T23:47:04.416987511Z [2024-04-20 23:47:04,416: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a99670b-9851-4a8b-9a27-6413e023870f] succeeded in 3.50100921000012s: None 2024-04-20T23:48:00.637945054Z [2024-04-20 23:48:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dfa405a-fb67-4832-a433-01b4e78046d1] received 2024-04-20T23:48:00.644071697Z [2024-04-20 23:48:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78a19d7c-d27a-4e04-aebe-c511d8beb619] received 2024-04-20T23:48:00.651034427Z [2024-04-20 23:48:00,650: INFO/ForkPoolWorker-15] [2dfa405a-fb67-4832-a433-01b4e78046d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:48:00.654562563Z [2024-04-20 23:48:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4174f3e0-e7ac-42bb-82cc-586f5907ba4c] received 2024-04-20T23:48:00.656410265Z [2024-04-20 23:48:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd9d6058-17fc-48e8-bcf0-c76633653f52] received 2024-04-20T23:48:00.657254037Z [2024-04-20 23:48:00,657: INFO/ForkPoolWorker-16] [78a19d7c-d27a-4e04-aebe-c511d8beb619] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:48:00.668790215Z [2024-04-20 23:48:00,668: INFO/ForkPoolWorker-2] [dd9d6058-17fc-48e8-bcf0-c76633653f52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:48:00.673701303Z [2024-04-20 23:48:00,673: INFO/ForkPoolWorker-1] [4174f3e0-e7ac-42bb-82cc-586f5907ba4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:48:00.932425345Z [2024-04-20 23:48:00,929: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:48:00.989372966Z [2024-04-20 23:48:00,984: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:48:00.993669388Z [2024-04-20 23:48:00,989: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:48:01.017436474Z [2024-04-20 23:48:01,013: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:48:01.219210175Z [2024-04-20 23:48:01,218: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:48:01.223357839Z [2024-04-20 23:48:01,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:48:01.287895607Z [2024-04-20 23:48:01,287: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:48:01.313651422Z [2024-04-20 23:48:01,313: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:48:01.314897803Z [2024-04-20 23:48:01,314: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:48:01.314992696Z [2024-04-20 23:48:01,314: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:48:01.315040084Z [2024-04-20 23:48:01,314: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:48:01.315339506Z [2024-04-20 23:48:01,315: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:48:01.511817113Z [2024-04-20 23:48:01,508: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:48:01.999273319Z [2024-04-20 23:48:01,998: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78a19d7c-d27a-4e04-aebe-c511d8beb619] succeeded in 1.3525933220007573s: None 2024-04-20T23:48:02.205371128Z [2024-04-20 23:48:02,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4174f3e0-e7ac-42bb-82cc-586f5907ba4c] succeeded in 1.5457878759998493s: None 2024-04-20T23:48:02.602303001Z [2024-04-20 23:48:02,601: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:48:02.605579500Z [2024-04-20 23:48:02,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:48:02.632424539Z [2024-04-20 23:48:02,632: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:48:02.633862960Z [2024-04-20 23:48:02,633: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:48:02.633920568Z [2024-04-20 23:48:02,633: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:48:02.634101938Z [2024-04-20 23:48:02,633: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:48:02.634176748Z [2024-04-20 23:48:02,634: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:48:02.634742065Z [2024-04-20 23:48:02,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:48:02.634836492Z [2024-04-20 23:48:02,634: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:48:02.673539013Z [2024-04-20 23:48:02,673: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:48:02.676854068Z [2024-04-20 23:48:02,676: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:48:02.704981275Z [2024-04-20 23:48:02,704: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:48:02.706158240Z [2024-04-20 23:48:02,705: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:48:02.706264032Z [2024-04-20 23:48:02,706: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:48:02.706459770Z [2024-04-20 23:48:02,706: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:48:02.706594928Z [2024-04-20 23:48:02,706: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:48:02.706847878Z [2024-04-20 23:48:02,706: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:48:02.706880009Z [2024-04-20 23:48:02,706: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:48:02.716967655Z [2024-04-20 23:48:02,716: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:48:02.798699427Z [2024-04-20 23:48:02,798: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:48:04.683295817Z [2024-04-20 23:48:04,682: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dd9d6058-17fc-48e8-bcf0-c76633653f52] succeeded in 4.025287835000199s: None 2024-04-20T23:48:05.249057001Z [2024-04-20 23:48:05,247: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2dfa405a-fb67-4832-a433-01b4e78046d1] succeeded in 4.600152635000086s: None 2024-04-20T23:49:00.800095935Z [2024-04-20 23:49:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9753c880-8d46-42da-9844-1b4bf782fa56] received 2024-04-20T23:49:00.802297821Z [2024-04-20 23:49:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e53757a1-1dde-4aac-aa03-1206f8601acc] received 2024-04-20T23:49:00.809805431Z [2024-04-20 23:49:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c20e4cf0-0034-4556-b960-aac0d7eb83b3] received 2024-04-20T23:49:00.813050259Z [2024-04-20 23:49:00,812: INFO/ForkPoolWorker-16] [e53757a1-1dde-4aac-aa03-1206f8601acc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:49:00.816376345Z [2024-04-20 23:49:00,816: INFO/ForkPoolWorker-15] [9753c880-8d46-42da-9844-1b4bf782fa56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:49:00.822897550Z [2024-04-20 23:49:00,822: INFO/ForkPoolWorker-1] [c20e4cf0-0034-4556-b960-aac0d7eb83b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:49:01.123540539Z [2024-04-20 23:49:01,116: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:49:01.139759490Z [2024-04-20 23:49:01,133: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:49:01.172001643Z [2024-04-20 23:49:01,164: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:49:01.298047610Z [2024-04-20 23:49:01,297: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:49:01.302940319Z [2024-04-20 23:49:01,302: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:49:01.324479235Z [2024-04-20 23:49:01,324: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:49:01.325421058Z [2024-04-20 23:49:01,325: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:49:01.325559315Z [2024-04-20 23:49:01,325: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:49:01.325616007Z [2024-04-20 23:49:01,325: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:49:01.325843612Z [2024-04-20 23:49:01,325: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:49:01.456768127Z [2024-04-20 23:49:01,456: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:49:02.169061719Z [2024-04-20 23:49:02,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e53757a1-1dde-4aac-aa03-1206f8601acc] succeeded in 1.3645646580007451s: None 2024-04-20T23:49:02.423471203Z [2024-04-20 23:49:02,423: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:49:02.426943893Z [2024-04-20 23:49:02,426: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:49:02.452503859Z [2024-04-20 23:49:02,452: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:49:02.453908413Z [2024-04-20 23:49:02,453: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:49:02.454116979Z [2024-04-20 23:49:02,453: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:49:02.454339478Z [2024-04-20 23:49:02,454: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:49:02.454516213Z [2024-04-20 23:49:02,454: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:49:02.454944596Z [2024-04-20 23:49:02,454: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:49:02.455499367Z [2024-04-20 23:49:02,454: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:49:02.554924924Z [2024-04-20 23:49:02,554: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:49:02.577651427Z [2024-04-20 23:49:02,577: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:49:02.580988221Z [2024-04-20 23:49:02,580: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:49:02.601741197Z [2024-04-20 23:49:02,601: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:49:02.603140770Z [2024-04-20 23:49:02,602: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:49:02.603258097Z [2024-04-20 23:49:02,603: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:49:02.603436109Z [2024-04-20 23:49:02,603: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:49:02.603539175Z [2024-04-20 23:49:02,603: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:49:02.603950707Z [2024-04-20 23:49:02,603: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:49:02.604061902Z [2024-04-20 23:49:02,603: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:49:02.680410800Z [2024-04-20 23:49:02,680: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:49:04.319623438Z [2024-04-20 23:49:04,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9753c880-8d46-42da-9844-1b4bf782fa56] succeeded in 3.516659160999552s: None 2024-04-20T23:49:04.761586289Z [2024-04-20 23:49:04,760: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c20e4cf0-0034-4556-b960-aac0d7eb83b3] succeeded in 3.9496850229998017s: None 2024-04-20T23:50:00.293440943Z [2024-04-20 23:50:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd1e2491-a714-4e0e-a7fa-23ad2fcb0529] received 2024-04-20T23:50:00.306287716Z [2024-04-20 23:50:00,305: INFO/ForkPoolWorker-15] [dd1e2491-a714-4e0e-a7fa-23ad2fcb0529] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:50:00.306728044Z [2024-04-20 23:50:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ac745b3-081a-4545-8457-d4d6d94e848d] received 2024-04-20T23:50:00.312341615Z [2024-04-20 23:50:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02cc6f0e-9a9b-4631-aa47-53ffa04ab454] received 2024-04-20T23:50:00.314153365Z [2024-04-20 23:50:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87fb46e8-6ea4-46fd-be10-983bd1c1b1ce] received 2024-04-20T23:50:00.315425417Z [2024-04-20 23:50:00,315: INFO/ForkPoolWorker-16] [9ac745b3-081a-4545-8457-d4d6d94e848d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:50:00.322342193Z [2024-04-20 23:50:00,322: INFO/ForkPoolWorker-1] [02cc6f0e-9a9b-4631-aa47-53ffa04ab454] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:50:00.330744997Z [2024-04-20 23:50:00,330: INFO/ForkPoolWorker-2] [87fb46e8-6ea4-46fd-be10-983bd1c1b1ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:50:00.336537598Z [2024-04-20 23:50:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ea5fbe6-0997-4c3a-8323-66f9c6384f8e] received 2024-04-20T23:50:00.360004458Z [2024-04-20 23:50:00,359: INFO/ForkPoolWorker-3] [5ea5fbe6-0997-4c3a-8323-66f9c6384f8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:50:00.637602514Z [2024-04-20 23:50:00,634: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:50:00.651379669Z [2024-04-20 23:50:00,648: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:50:00.803963035Z [2024-04-20 23:50:00,793: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:50:00.855327670Z [2024-04-20 23:50:00,846: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:50:00.877010960Z [2024-04-20 23:50:00,873: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:50:00.902469139Z [2024-04-20 23:50:00,902: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:50:01.167603666Z [2024-04-20 23:50:01,167: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-20T23:50:01.171291758Z [2024-04-20 23:50:01,170: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:50:01.256585839Z [2024-04-20 23:50:01,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:50:01.258859248Z [2024-04-20 23:50:01,258: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:50:01.258903862Z [2024-04-20 23:50:01,258: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:50:01.258961777Z [2024-04-20 23:50:01,258: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-20T23:50:01.259117875Z [2024-04-20 23:50:01,259: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:50:01.533773938Z [2024-04-20 23:50:01,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:50:02.018771613Z [2024-04-20 23:50:02,018: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[87fb46e8-6ea4-46fd-be10-983bd1c1b1ce] succeeded in 1.7021038160000899s: None 2024-04-20T23:50:02.484459318Z [2024-04-20 23:50:02,484: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:50:02.487788829Z [2024-04-20 23:50:02,487: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:50:02.525257494Z [2024-04-20 23:50:02,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:50:02.528992410Z [2024-04-20 23:50:02,528: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:50:02.529009757Z [2024-04-20 23:50:02,528: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:50:02.529115689Z [2024-04-20 23:50:02,528: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:50:02.529129185Z [2024-04-20 23:50:02,529: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:50:02.529348180Z [2024-04-20 23:50:02,529: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:50:02.529370613Z [2024-04-20 23:50:02,529: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:50:02.679397479Z [2024-04-20 23:50:02,679: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:50:02.913759140Z [2024-04-20 23:50:02,913: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd1e2491-a714-4e0e-a7fa-23ad2fcb0529] succeeded in 2.614907463000236s: None 2024-04-20T23:50:03.392103062Z [2024-04-20 23:50:03,391: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-20T23:50:03.395237943Z [2024-04-20 23:50:03,394: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:50:03.419458566Z [2024-04-20 23:50:03,419: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-20T23:50:03.420619070Z [2024-04-20 23:50:03,420: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:50:03.420630968Z [2024-04-20 23:50:03,420: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:50:03.420793032Z [2024-04-20 23:50:03,420: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:50:03.420861045Z [2024-04-20 23:50:03,420: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-20T23:50:03.421088032Z [2024-04-20 23:50:03,420: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:50:03.421127906Z [2024-04-20 23:50:03,421: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:50:03.504389001Z [2024-04-20 23:50:03,504: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:50:03.514857510Z [2024-04-20 23:50:03,514: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:50:03.518321929Z [2024-04-20 23:50:03,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:50:03.537731445Z [2024-04-20 23:50:03,537: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:50:03.539027867Z [2024-04-20 23:50:03,538: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:50:03.539208503Z [2024-04-20 23:50:03,538: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:50:03.539392719Z [2024-04-20 23:50:03,539: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:50:03.539530989Z [2024-04-20 23:50:03,539: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:50:03.539953684Z [2024-04-20 23:50:03,539: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:50:03.540104755Z [2024-04-20 23:50:03,539: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:50:03.611363091Z [2024-04-20 23:50:03,611: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:50:04.307517582Z [2024-04-20 23:50:04,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abbe9f35-e3d4-44b5-8103-ddddf94e0a24] received 2024-04-20T23:50:04.320675396Z [2024-04-20 23:50:04,314: INFO/ForkPoolWorker-15] [abbe9f35-e3d4-44b5-8103-ddddf94e0a24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:50:04.349196327Z [2024-04-20 23:50:04,348: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ac745b3-081a-4545-8457-d4d6d94e848d] succeeded in 4.040521318000174s: None 2024-04-20T23:50:04.420376419Z [2024-04-20 23:50:04,419: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[02cc6f0e-9a9b-4631-aa47-53ffa04ab454] succeeded in 4.104788585999813s: None 2024-04-20T23:50:04.614132491Z [2024-04-20 23:50:04,611: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:50:05.576870967Z [2024-04-20 23:50:05,576: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5ea5fbe6-0997-4c3a-8323-66f9c6384f8e] succeeded in 5.2376645579997785s: None 2024-04-20T23:50:05.729923199Z [2024-04-20 23:50:05,729: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:50:05.733093271Z [2024-04-20 23:50:05,732: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:50:05.756145382Z [2024-04-20 23:50:05,755: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:50:05.757480750Z [2024-04-20 23:50:05,757: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:50:05.757522545Z [2024-04-20 23:50:05,757: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:50:05.757667007Z [2024-04-20 23:50:05,757: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:50:05.757676332Z [2024-04-20 23:50:05,757: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:50:05.757934081Z [2024-04-20 23:50:05,757: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:50:05.757944592Z [2024-04-20 23:50:05,757: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:50:05.840736731Z [2024-04-20 23:50:05,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:50:06.418293110Z [2024-04-20 23:50:06,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63852fca-a02b-4278-b29c-1bc3977b2443] received 2024-04-20T23:50:06.426174367Z [2024-04-20 23:50:06,425: INFO/ForkPoolWorker-16] [63852fca-a02b-4278-b29c-1bc3977b2443] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:50:06.474472494Z [2024-04-20 23:50:06,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abbe9f35-e3d4-44b5-8103-ddddf94e0a24] succeeded in 2.1641466460005176s: None 2024-04-20T23:50:06.681131110Z [2024-04-20 23:50:06,677: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:50:07.690435031Z [2024-04-20 23:50:07,689: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:50:07.693635381Z [2024-04-20 23:50:07,693: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:50:07.713814729Z [2024-04-20 23:50:07,713: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:50:07.715085869Z [2024-04-20 23:50:07,714: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:50:07.715179770Z [2024-04-20 23:50:07,715: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:50:07.715280041Z [2024-04-20 23:50:07,715: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:50:07.715332128Z [2024-04-20 23:50:07,715: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:50:07.715585668Z [2024-04-20 23:50:07,715: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:50:07.715632936Z [2024-04-20 23:50:07,715: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:50:07.814545480Z [2024-04-20 23:50:07,813: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:50:08.516939547Z [2024-04-20 23:50:08,516: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63852fca-a02b-4278-b29c-1bc3977b2443] succeeded in 2.09664295300081s: None 2024-04-20T23:50:09.373349329Z [2024-04-20 23:50:09,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed661d4e-5d2d-44fa-8c09-2f6096bc63f1] received 2024-04-20T23:50:09.381783391Z [2024-04-20 23:50:09,381: INFO/ForkPoolWorker-15] [ed661d4e-5d2d-44fa-8c09-2f6096bc63f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:50:09.722070196Z [2024-04-20 23:50:09,718: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:50:10.846996530Z [2024-04-20 23:50:10,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:50:10.850131337Z [2024-04-20 23:50:10,849: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:50:10.878599290Z [2024-04-20 23:50:10,878: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:50:10.880262864Z [2024-04-20 23:50:10,879: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:50:10.880520616Z [2024-04-20 23:50:10,880: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:50:10.880791947Z [2024-04-20 23:50:10,880: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:50:10.880979715Z [2024-04-20 23:50:10,880: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:50:10.881336451Z [2024-04-20 23:50:10,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:50:10.881490173Z [2024-04-20 23:50:10,881: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:50:10.974911515Z [2024-04-20 23:50:10,974: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:50:11.548562444Z [2024-04-20 23:50:11,548: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed661d4e-5d2d-44fa-8c09-2f6096bc63f1] succeeded in 2.1729104309997638s: None 2024-04-20T23:51:00.300219831Z [2024-04-20 23:51:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c32041de-b396-4908-bac0-7b4efe343fa6] received 2024-04-20T23:51:00.305841060Z [2024-04-20 23:51:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b844c620-832f-4396-9380-e3b3469c96be] received 2024-04-20T23:51:00.310374872Z [2024-04-20 23:51:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c03e6bf8-7434-4988-a923-fc43b5ebac52] received 2024-04-20T23:51:00.319297627Z [2024-04-20 23:51:00,318: INFO/ForkPoolWorker-15] [c32041de-b396-4908-bac0-7b4efe343fa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:51:00.320023892Z [2024-04-20 23:51:00,319: INFO/ForkPoolWorker-16] [b844c620-832f-4396-9380-e3b3469c96be] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:51:00.321945893Z [2024-04-20 23:51:00,321: INFO/ForkPoolWorker-1] [c03e6bf8-7434-4988-a923-fc43b5ebac52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:51:00.692934919Z [2024-04-20 23:51:00,689: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:51:00.693912600Z [2024-04-20 23:51:00,690: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:51:00.756290170Z [2024-04-20 23:51:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:51:00.843343931Z [2024-04-20 23:51:00,842: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:51:00.847383192Z [2024-04-20 23:51:00,846: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:51:00.870609626Z [2024-04-20 23:51:00,870: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:51:00.872063428Z [2024-04-20 23:51:00,871: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:51:00.872130843Z [2024-04-20 23:51:00,871: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:51:00.872146877Z [2024-04-20 23:51:00,871: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:51:00.872406880Z [2024-04-20 23:51:00,872: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:51:00.970056623Z [2024-04-20 23:51:00,969: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:51:01.628503672Z [2024-04-20 23:51:01,628: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b844c620-832f-4396-9380-e3b3469c96be] succeeded in 1.320276427000863s: None 2024-04-20T23:51:02.101097314Z [2024-04-20 23:51:02,100: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:51:02.104417949Z [2024-04-20 23:51:02,104: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:51:02.128836037Z [2024-04-20 23:51:02,128: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:51:02.132889973Z [2024-04-20 23:51:02,132: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:51:02.133016301Z [2024-04-20 23:51:02,132: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:51:02.133240864Z [2024-04-20 23:51:02,133: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:51:02.133399336Z [2024-04-20 23:51:02,133: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:51:02.133811723Z [2024-04-20 23:51:02,133: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:51:02.133932565Z [2024-04-20 23:51:02,133: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:51:02.229800197Z [2024-04-20 23:51:02,229: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:51:02.372395320Z [2024-04-20 23:51:02,371: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:51:02.377445427Z [2024-04-20 23:51:02,375: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:51:02.431561802Z [2024-04-20 23:51:02,431: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:51:02.437949736Z [2024-04-20 23:51:02,437: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:51:02.444058596Z [2024-04-20 23:51:02,443: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:51:02.444229323Z [2024-04-20 23:51:02,444: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:51:02.444311816Z [2024-04-20 23:51:02,444: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:51:02.444629444Z [2024-04-20 23:51:02,444: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:51:02.444702151Z [2024-04-20 23:51:02,444: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:51:02.610716616Z [2024-04-20 23:51:02,610: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:51:04.051459177Z [2024-04-20 23:51:04,050: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c03e6bf8-7434-4988-a923-fc43b5ebac52] succeeded in 3.7374873030003073s: None 2024-04-20T23:51:05.431499454Z [2024-04-20 23:51:05,430: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c32041de-b396-4908-bac0-7b4efe343fa6] succeeded in 5.123229184000593s: None 2024-04-20T23:52:00.291190269Z [2024-04-20 23:52:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e14c5fe0-caf0-4483-8c7c-c68e16f609c7] received 2024-04-20T23:52:00.296743286Z [2024-04-20 23:52:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f954cec-3f93-47df-bf01-7bb60253536e] received 2024-04-20T23:52:00.298157189Z [2024-04-20 23:52:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33ffd564-24ff-442e-bec9-0d3aac9fe00c] received 2024-04-20T23:52:00.298991074Z [2024-04-20 23:52:00,298: INFO/ForkPoolWorker-15] [e14c5fe0-caf0-4483-8c7c-c68e16f609c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:52:00.299627189Z [2024-04-20 23:52:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f90ed2de-d760-4a5f-8014-6d05f4755668] received 2024-04-20T23:52:00.317858726Z [2024-04-20 23:52:00,317: INFO/ForkPoolWorker-16] [0f954cec-3f93-47df-bf01-7bb60253536e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:52:00.326288788Z [2024-04-20 23:52:00,326: INFO/ForkPoolWorker-1] [33ffd564-24ff-442e-bec9-0d3aac9fe00c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:52:00.333487739Z [2024-04-20 23:52:00,333: INFO/ForkPoolWorker-2] [f90ed2de-d760-4a5f-8014-6d05f4755668] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:52:00.608589891Z [2024-04-20 23:52:00,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:52:00.671037194Z [2024-04-20 23:52:00,667: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:52:00.854511305Z [2024-04-20 23:52:00,845: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:52:00.950825906Z [2024-04-20 23:52:00,947: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:52:01.149812697Z [2024-04-20 23:52:01,148: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:52:01.157539161Z [2024-04-20 23:52:01,157: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:52:01.179315731Z [2024-04-20 23:52:01,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:52:01.180294718Z [2024-04-20 23:52:01,180: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:52:01.180427663Z [2024-04-20 23:52:01,180: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:52:01.180500113Z [2024-04-20 23:52:01,180: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:52:01.180689924Z [2024-04-20 23:52:01,180: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:52:01.354471939Z [2024-04-20 23:52:01,354: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:52:01.472648297Z [2024-04-20 23:52:01,471: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:52:02.092802175Z [2024-04-20 23:52:02,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:52:02.096152422Z [2024-04-20 23:52:02,095: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:52:02.140748717Z [2024-04-20 23:52:02,140: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:52:02.144636237Z [2024-04-20 23:52:02,144: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:52:02.144676640Z [2024-04-20 23:52:02,144: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:52:02.144762692Z [2024-04-20 23:52:02,144: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:52:02.144774487Z [2024-04-20 23:52:02,144: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:52:02.144996248Z [2024-04-20 23:52:02,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:52:02.145029008Z [2024-04-20 23:52:02,144: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:52:02.242147178Z [2024-04-20 23:52:02,241: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f954cec-3f93-47df-bf01-7bb60253536e] succeeded in 1.9424498429998494s: None 2024-04-20T23:52:02.283599715Z [2024-04-20 23:52:02,283: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:52:02.330436243Z [2024-04-20 23:52:02,330: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33ffd564-24ff-442e-bec9-0d3aac9fe00c] succeeded in 2.0296469469994918s: None 2024-04-20T23:52:02.578262640Z [2024-04-20 23:52:02,577: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-20T23:52:02.581424834Z [2024-04-20 23:52:02,581: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:52:02.610350772Z [2024-04-20 23:52:02,610: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:52:02.612863152Z [2024-04-20 23:52:02,612: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:52:02.613037648Z [2024-04-20 23:52:02,612: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:52:02.613294197Z [2024-04-20 23:52:02,613: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:52:02.613456245Z [2024-04-20 23:52:02,613: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-20T23:52:02.614104908Z [2024-04-20 23:52:02,613: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:52:02.614361520Z [2024-04-20 23:52:02,614: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:52:02.695948478Z [2024-04-20 23:52:02,695: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:52:04.175009283Z [2024-04-20 23:52:04,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e14c5fe0-caf0-4483-8c7c-c68e16f609c7] succeeded in 3.881308600999546s: None 2024-04-20T23:52:04.175602399Z [2024-04-20 23:52:04,174: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f90ed2de-d760-4a5f-8014-6d05f4755668] succeeded in 3.8526305610002964s: None 2024-04-20T23:53:00.895105680Z [2024-04-20 23:53:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76be9429-6d78-4843-b2f1-950c14b202d9] received 2024-04-20T23:53:00.902238115Z [2024-04-20 23:53:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[994be20a-9101-4bb7-8c9f-90712c4a6a32] received 2024-04-20T23:53:00.951623862Z [2024-04-20 23:53:00,951: INFO/ForkPoolWorker-16] [994be20a-9101-4bb7-8c9f-90712c4a6a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:53:00.958058315Z [2024-04-20 23:53:00,957: INFO/ForkPoolWorker-15] [76be9429-6d78-4843-b2f1-950c14b202d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:53:00.976759107Z [2024-04-20 23:53:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73100255-bad1-4f9d-9735-1544f8fe91df] received 2024-04-20T23:53:01.017000920Z [2024-04-20 23:53:01,016: INFO/ForkPoolWorker-1] [73100255-bad1-4f9d-9735-1544f8fe91df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:53:01.597586543Z [2024-04-20 23:53:01,585: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:53:01.619089275Z [2024-04-20 23:53:01,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:53:01.848902793Z [2024-04-20 23:53:01,848: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:53:01.854632383Z [2024-04-20 23:53:01,853: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:53:01.874119277Z [2024-04-20 23:53:01,869: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:53:01.895897076Z [2024-04-20 23:53:01,895: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:53:01.906883710Z [2024-04-20 23:53:01,906: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:53:01.906926029Z [2024-04-20 23:53:01,906: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:53:01.906975339Z [2024-04-20 23:53:01,906: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:53:01.907166031Z [2024-04-20 23:53:01,907: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:53:02.030359671Z [2024-04-20 23:53:02,030: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:53:02.772267810Z [2024-04-20 23:53:02,771: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[994be20a-9101-4bb7-8c9f-90712c4a6a32] succeeded in 1.8651852540006075s: None 2024-04-20T23:53:03.207760811Z [2024-04-20 23:53:03,207: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:53:03.213859437Z [2024-04-20 23:53:03,213: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:53:03.249160764Z [2024-04-20 23:53:03,248: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:53:03.253514409Z [2024-04-20 23:53:03,253: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:53:03.253566720Z [2024-04-20 23:53:03,253: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:53:03.253755899Z [2024-04-20 23:53:03,253: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:53:03.253795948Z [2024-04-20 23:53:03,253: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:53:03.254017808Z [2024-04-20 23:53:03,253: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:53:03.254070408Z [2024-04-20 23:53:03,253: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:53:03.383472064Z [2024-04-20 23:53:03,383: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:53:04.552036496Z [2024-04-20 23:53:04,551: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:53:04.555578284Z [2024-04-20 23:53:04,555: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:53:04.596281707Z [2024-04-20 23:53:04,596: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:53:04.597257683Z [2024-04-20 23:53:04,597: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:53:04.597322889Z [2024-04-20 23:53:04,597: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:53:04.597426610Z [2024-04-20 23:53:04,597: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:53:04.599898070Z [2024-04-20 23:53:04,597: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:53:04.600120686Z [2024-04-20 23:53:04,599: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:53:04.600480952Z [2024-04-20 23:53:04,600: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:53:04.758300009Z [2024-04-20 23:53:04,758: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:53:05.892220564Z [2024-04-20 23:53:05,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76be9429-6d78-4843-b2f1-950c14b202d9] succeeded in 4.990343261999442s: None 2024-04-20T23:53:06.793806863Z [2024-04-20 23:53:06,793: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73100255-bad1-4f9d-9735-1544f8fe91df] succeeded in 5.8142747879992385s: None 2024-04-20T23:54:01.241588858Z [2024-04-20 23:54:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61d46444-930c-4db1-a42c-33b35bb5c129] received 2024-04-20T23:54:01.247454156Z [2024-04-20 23:54:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ce3c084-1bac-4d2c-b213-0833b7ab59d9] received 2024-04-20T23:54:01.261758191Z [2024-04-20 23:54:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d84a9ad-0802-4090-841a-f671760af852] received 2024-04-20T23:54:01.262554790Z [2024-04-20 23:54:01,262: INFO/ForkPoolWorker-16] [2ce3c084-1bac-4d2c-b213-0833b7ab59d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:54:01.264281089Z [2024-04-20 23:54:01,263: INFO/ForkPoolWorker-15] [61d46444-930c-4db1-a42c-33b35bb5c129] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:54:01.265489354Z [2024-04-20 23:54:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bab54c9-86ff-4358-baa5-9452e8191d43] received 2024-04-20T23:54:01.280413710Z [2024-04-20 23:54:01,280: INFO/ForkPoolWorker-1] [4d84a9ad-0802-4090-841a-f671760af852] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:54:01.288931366Z [2024-04-20 23:54:01,288: INFO/ForkPoolWorker-2] [9bab54c9-86ff-4358-baa5-9452e8191d43] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:54:01.614996955Z [2024-04-20 23:54:01,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:54:01.633118047Z [2024-04-20 23:54:01,629: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:54:01.660410400Z [2024-04-20 23:54:01,657: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:54:01.909866591Z [2024-04-20 23:54:01,906: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:54:01.915421644Z [2024-04-20 23:54:01,915: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:54:02.082669074Z [2024-04-20 23:54:02,082: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:54:02.090799578Z [2024-04-20 23:54:02,090: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:54:02.140353763Z [2024-04-20 23:54:02,140: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:54:02.144549987Z [2024-04-20 23:54:02,144: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:54:02.144698714Z [2024-04-20 23:54:02,144: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:54:02.144738550Z [2024-04-20 23:54:02,144: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:54:02.144967256Z [2024-04-20 23:54:02,144: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:54:02.306686993Z [2024-04-20 23:54:02,306: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:54:02.534267227Z [2024-04-20 23:54:02,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61d46444-930c-4db1-a42c-33b35bb5c129] succeeded in 1.2896676620002836s: None 2024-04-20T23:54:02.967914505Z [2024-04-20 23:54:02,967: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9bab54c9-86ff-4358-baa5-9452e8191d43] succeeded in 1.6985562829995615s: None 2024-04-20T23:54:03.132668464Z [2024-04-20 23:54:03,132: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:54:03.135749798Z [2024-04-20 23:54:03,135: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:54:03.157997765Z [2024-04-20 23:54:03,157: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:54:03.159150578Z [2024-04-20 23:54:03,158: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:54:03.159197314Z [2024-04-20 23:54:03,159: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:54:03.159341660Z [2024-04-20 23:54:03,159: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:54:03.159398607Z [2024-04-20 23:54:03,159: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:54:03.159613422Z [2024-04-20 23:54:03,159: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:54:03.160010490Z [2024-04-20 23:54:03,159: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:54:03.231398192Z [2024-04-20 23:54:03,231: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:54:03.280937413Z [2024-04-20 23:54:03,280: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:54:03.284288281Z [2024-04-20 23:54:03,283: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:54:03.309031129Z [2024-04-20 23:54:03,308: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:54:03.310462829Z [2024-04-20 23:54:03,310: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:54:03.310491064Z [2024-04-20 23:54:03,310: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:54:03.310590230Z [2024-04-20 23:54:03,310: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:54:03.310611837Z [2024-04-20 23:54:03,310: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:54:03.310847345Z [2024-04-20 23:54:03,310: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:54:03.310928557Z [2024-04-20 23:54:03,310: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:54:03.397301507Z [2024-04-20 23:54:03,396: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:54:05.475437813Z [2024-04-20 23:54:05,474: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d84a9ad-0802-4090-841a-f671760af852] succeeded in 4.209119142999953s: None 2024-04-20T23:54:05.814066716Z [2024-04-20 23:54:05,813: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ce3c084-1bac-4d2c-b213-0833b7ab59d9] succeeded in 4.563013113000125s: None 2024-04-20T23:55:00.387591031Z [2024-04-20 23:55:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea405ab8-a491-4866-be52-b524c8a0b9d4] received 2024-04-20T23:55:00.394166528Z [2024-04-20 23:55:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ff5982e-591b-4640-81b9-de1d067b43f1] received 2024-04-20T23:55:00.398401708Z [2024-04-20 23:55:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc3a5fdf-8798-4e78-8921-8121bfb6d917] received 2024-04-20T23:55:00.399420174Z [2024-04-20 23:55:00,399: INFO/ForkPoolWorker-15] [ea405ab8-a491-4866-be52-b524c8a0b9d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:55:00.409535744Z [2024-04-20 23:55:00,409: INFO/ForkPoolWorker-16] [9ff5982e-591b-4640-81b9-de1d067b43f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:55:00.411729528Z [2024-04-20 23:55:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3535ae5-8d10-41b1-9b18-71b36bb61b8d] received 2024-04-20T23:55:00.418721543Z [2024-04-20 23:55:00,417: INFO/ForkPoolWorker-1] [dc3a5fdf-8798-4e78-8921-8121bfb6d917] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:55:00.438244055Z [2024-04-20 23:55:00,437: INFO/ForkPoolWorker-2] [f3535ae5-8d10-41b1-9b18-71b36bb61b8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:55:00.702713078Z [2024-04-20 23:55:00,698: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:55:00.725832257Z [2024-04-20 23:55:00,722: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:55:00.748088155Z [2024-04-20 23:55:00,743: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:55:00.854050791Z [2024-04-20 23:55:00,848: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:55:00.954957361Z [2024-04-20 23:55:00,954: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:55:00.959837920Z [2024-04-20 23:55:00,959: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:55:00.984388982Z [2024-04-20 23:55:00,984: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:55:00.986065786Z [2024-04-20 23:55:00,985: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:55:00.986280494Z [2024-04-20 23:55:00,986: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:55:00.986416290Z [2024-04-20 23:55:00,986: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:55:00.986681862Z [2024-04-20 23:55:00,986: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:55:01.182955240Z [2024-04-20 23:55:01,182: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:55:01.812128041Z [2024-04-20 23:55:01,811: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f3535ae5-8d10-41b1-9b18-71b36bb61b8d] succeeded in 1.3878392300002815s: None 2024-04-20T23:55:02.221209968Z [2024-04-20 23:55:02,220: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:55:02.226577689Z [2024-04-20 23:55:02,225: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:55:02.238020982Z [2024-04-20 23:55:02,237: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:55:02.241077507Z [2024-04-20 23:55:02,240: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:55:02.245488246Z [2024-04-20 23:55:02,245: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:55:02.251702152Z [2024-04-20 23:55:02,251: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:55:02.260344900Z [2024-04-20 23:55:02,260: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:55:02.261667964Z [2024-04-20 23:55:02,261: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:55:02.261700412Z [2024-04-20 23:55:02,261: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:55:02.261854603Z [2024-04-20 23:55:02,261: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:55:02.261890939Z [2024-04-20 23:55:02,261: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:55:02.262128600Z [2024-04-20 23:55:02,262: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:55:02.262175395Z [2024-04-20 23:55:02,262: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:55:02.262263573Z [2024-04-20 23:55:02,260: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:55:02.265096521Z [2024-04-20 23:55:02,264: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:55:02.265626748Z [2024-04-20 23:55:02,265: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:55:02.265788616Z [2024-04-20 23:55:02,265: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:55:02.266123770Z [2024-04-20 23:55:02,265: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:55:02.272327678Z [2024-04-20 23:55:02,266: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:55:02.272670457Z [2024-04-20 23:55:02,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:55:02.274290535Z [2024-04-20 23:55:02,274: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:55:02.281957877Z [2024-04-20 23:55:02,281: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:55:02.281973698Z [2024-04-20 23:55:02,281: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:55:02.282166988Z [2024-04-20 23:55:02,281: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:55:02.282256601Z [2024-04-20 23:55:02,282: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:55:02.282581263Z [2024-04-20 23:55:02,282: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:55:02.284709816Z [2024-04-20 23:55:02,284: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:55:02.350487180Z [2024-04-20 23:55:02,350: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:55:02.366915517Z [2024-04-20 23:55:02,366: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:55:02.497849701Z [2024-04-20 23:55:02,497: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:55:03.252683612Z [2024-04-20 23:55:03,252: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea405ab8-a491-4866-be52-b524c8a0b9d4] succeeded in 2.8620388670005923s: None 2024-04-20T23:55:03.308274594Z [2024-04-20 23:55:03,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6102a002-20dd-495d-9606-bd75bb11d587] received 2024-04-20T23:55:03.335357391Z [2024-04-20 23:55:03,335: INFO/ForkPoolWorker-15] [6102a002-20dd-495d-9606-bd75bb11d587] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:55:03.646462064Z [2024-04-20 23:55:03,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:55:04.243845408Z [2024-04-20 23:55:04,243: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ff5982e-591b-4640-81b9-de1d067b43f1] succeeded in 3.8459789360003924s: None 2024-04-20T23:55:04.301092316Z [2024-04-20 23:55:04,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc3a5fdf-8798-4e78-8921-8121bfb6d917] succeeded in 3.9001694850003332s: None 2024-04-20T23:55:05.009272474Z [2024-04-20 23:55:05,008: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:55:05.012439504Z [2024-04-20 23:55:05,012: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:55:05.032485021Z [2024-04-20 23:55:05,032: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:55:05.034340654Z [2024-04-20 23:55:05,034: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:55:05.034357418Z [2024-04-20 23:55:05,034: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:55:05.034464498Z [2024-04-20 23:55:05,034: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:55:05.034519335Z [2024-04-20 23:55:05,034: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:55:05.034743453Z [2024-04-20 23:55:05,034: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:55:05.034786664Z [2024-04-20 23:55:05,034: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:55:05.119541477Z [2024-04-20 23:55:05,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:55:05.788717077Z [2024-04-20 23:55:05,788: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6102a002-20dd-495d-9606-bd75bb11d587] succeeded in 2.4783886980003444s: None 2024-04-20T23:55:06.141932701Z [2024-04-20 23:55:06,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20eb7df8-8295-485b-9e7b-b1d76c574a59] received 2024-04-20T23:55:06.151545331Z [2024-04-20 23:55:06,151: INFO/ForkPoolWorker-15] [20eb7df8-8295-485b-9e7b-b1d76c574a59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-20T23:55:06.477072011Z [2024-04-20 23:55:06,473: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:55:07.502937672Z [2024-04-20 23:55:07,502: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:55:07.505982363Z [2024-04-20 23:55:07,505: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:55:07.533426106Z [2024-04-20 23:55:07,533: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:55:07.534541311Z [2024-04-20 23:55:07,534: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:55:07.534557266Z [2024-04-20 23:55:07,534: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:55:07.534605358Z [2024-04-20 23:55:07,534: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:55:07.534645060Z [2024-04-20 23:55:07,534: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:55:07.534840986Z [2024-04-20 23:55:07,534: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:55:07.534855263Z [2024-04-20 23:55:07,534: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:55:07.613587290Z [2024-04-20 23:55:07,613: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:55:08.231776422Z [2024-04-20 23:55:08,231: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20eb7df8-8295-485b-9e7b-b1d76c574a59] succeeded in 2.0874023309997938s: None 2024-04-20T23:55:08.559843711Z [2024-04-20 23:55:08,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ff30986-e161-4968-9f77-fb082fbcd897] received 2024-04-20T23:55:08.569119225Z [2024-04-20 23:55:08,568: INFO/ForkPoolWorker-15] [0ff30986-e161-4968-9f77-fb082fbcd897] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-20T23:55:08.857925397Z [2024-04-20 23:55:08,854: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-20T23:55:09.877289506Z [2024-04-20 23:55:09,876: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:55:09.880551976Z [2024-04-20 23:55:09,880: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:55:09.926208001Z [2024-04-20 23:55:09,925: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:55:09.929330368Z [2024-04-20 23:55:09,928: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:55:09.929344273Z [2024-04-20 23:55:09,929: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:55:09.929891488Z [2024-04-20 23:55:09,929: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:55:09.930007268Z [2024-04-20 23:55:09,929: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:55:09.930853739Z [2024-04-20 23:55:09,930: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-20T23:55:09.931039141Z [2024-04-20 23:55:09,930: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:55:10.032194116Z [2024-04-20 23:55:10,031: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:55:10.668475428Z [2024-04-20 23:55:10,667: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ff30986-e161-4968-9f77-fb082fbcd897] succeeded in 2.1059991960000843s: None 2024-04-20T23:56:01.097657962Z [2024-04-20 23:56:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01aafd42-3bee-47cd-8aee-6f5663b411d0] received 2024-04-20T23:56:01.126976491Z [2024-04-20 23:56:01,126: INFO/ForkPoolWorker-15] [01aafd42-3bee-47cd-8aee-6f5663b411d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:56:01.148863271Z [2024-04-20 23:56:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5acf56fe-d104-425d-b139-91ad300a6d7c] received 2024-04-20T23:56:01.169713511Z [2024-04-20 23:56:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f31c532-c421-42c4-b89e-16e2249ed84a] received 2024-04-20T23:56:01.190552954Z [2024-04-20 23:56:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfff6ba9-5544-4c14-bfc9-e9f7cb219f06] received 2024-04-20T23:56:01.195696339Z [2024-04-20 23:56:01,195: INFO/ForkPoolWorker-16] [5acf56fe-d104-425d-b139-91ad300a6d7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:56:01.204980193Z [2024-04-20 23:56:01,204: INFO/ForkPoolWorker-2] [dfff6ba9-5544-4c14-bfc9-e9f7cb219f06] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:56:01.218821669Z [2024-04-20 23:56:01,218: INFO/ForkPoolWorker-1] [6f31c532-c421-42c4-b89e-16e2249ed84a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:56:01.645741549Z [2024-04-20 23:56:01,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:56:01.668954728Z [2024-04-20 23:56:01,660: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:56:01.865735450Z [2024-04-20 23:56:01,861: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:56:01.947018095Z [2024-04-20 23:56:01,946: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:56:01.963515314Z [2024-04-20 23:56:01,956: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:56:02.148441288Z [2024-04-20 23:56:02,147: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:56:02.165884660Z [2024-04-20 23:56:02,165: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:56:02.254992915Z [2024-04-20 23:56:02,254: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:56:02.260513606Z [2024-04-20 23:56:02,260: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:56:02.260585322Z [2024-04-20 23:56:02,260: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:56:02.260616116Z [2024-04-20 23:56:02,260: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:56:02.260816159Z [2024-04-20 23:56:02,260: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:56:02.501117461Z [2024-04-20 23:56:02,500: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:56:03.065971818Z [2024-04-20 23:56:03,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[01aafd42-3bee-47cd-8aee-6f5663b411d0] succeeded in 1.9647013730000253s: None 2024-04-20T23:56:03.643865450Z [2024-04-20 23:56:03,643: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dfff6ba9-5544-4c14-bfc9-e9f7cb219f06] succeeded in 2.450355760000093s: None 2024-04-20T23:56:03.990523676Z [2024-04-20 23:56:03,990: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:56:03.995004878Z [2024-04-20 23:56:03,994: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:56:04.017025598Z [2024-04-20 23:56:04,016: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:56:04.022489220Z [2024-04-20 23:56:04,022: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:56:04.024379321Z [2024-04-20 23:56:04,024: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:56:04.024576391Z [2024-04-20 23:56:04,024: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:56:04.024751060Z [2024-04-20 23:56:04,024: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:56:04.028677073Z [2024-04-20 23:56:04,028: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:56:04.029375941Z [2024-04-20 23:56:04,029: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:56:04.039075195Z [2024-04-20 23:56:04,038: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:56:04.042550861Z [2024-04-20 23:56:04,042: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:56:04.090519102Z [2024-04-20 23:56:04,089: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:56:04.095339743Z [2024-04-20 23:56:04,095: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:56:04.095376909Z [2024-04-20 23:56:04,095: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:56:04.095387740Z [2024-04-20 23:56:04,095: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:56:04.095468448Z [2024-04-20 23:56:04,095: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:56:04.095706048Z [2024-04-20 23:56:04,095: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:56:04.095737450Z [2024-04-20 23:56:04,095: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:56:04.227099811Z [2024-04-20 23:56:04,226: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:56:04.230369069Z [2024-04-20 23:56:04,230: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:56:05.914768761Z [2024-04-20 23:56:05,914: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5acf56fe-d104-425d-b139-91ad300a6d7c] succeeded in 4.736942688999989s: None 2024-04-20T23:56:06.381273919Z [2024-04-20 23:56:06,380: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f31c532-c421-42c4-b89e-16e2249ed84a] succeeded in 5.203894493999542s: None 2024-04-20T23:57:00.692820051Z [2024-04-20 23:57:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95599742-549b-4602-ad6d-df3bdb06a00a] received 2024-04-20T23:57:00.704300025Z [2024-04-20 23:57:00,703: INFO/ForkPoolWorker-15] [95599742-549b-4602-ad6d-df3bdb06a00a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:57:00.707410991Z [2024-04-20 23:57:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a40d5d2-ce6c-4bd9-b40b-da2bdbd31778] received 2024-04-20T23:57:00.716470525Z [2024-04-20 23:57:00,715: INFO/ForkPoolWorker-16] [3a40d5d2-ce6c-4bd9-b40b-da2bdbd31778] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:57:00.717562589Z [2024-04-20 23:57:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c009139f-22bd-4505-9918-0eb0ac72ffa7] received 2024-04-20T23:57:00.732816446Z [2024-04-20 23:57:00,732: INFO/ForkPoolWorker-1] [c009139f-22bd-4505-9918-0eb0ac72ffa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:57:01.007455173Z [2024-04-20 23:57:00,999: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:57:01.049732455Z [2024-04-20 23:57:01,043: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:57:01.170714350Z [2024-04-20 23:57:01,165: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:57:01.442210491Z [2024-04-20 23:57:01,441: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-20T23:57:01.461504339Z [2024-04-20 23:57:01,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:57:01.516284488Z [2024-04-20 23:57:01,512: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:57:01.531152777Z [2024-04-20 23:57:01,528: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:57:01.531176478Z [2024-04-20 23:57:01,528: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:57:01.531180773Z [2024-04-20 23:57:01,529: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-20T23:57:01.531195351Z [2024-04-20 23:57:01,529: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:57:01.689957431Z [2024-04-20 23:57:01,689: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:57:02.333193210Z [2024-04-20 23:57:02,332: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c009139f-22bd-4505-9918-0eb0ac72ffa7] succeeded in 1.613544854999418s: None 2024-04-20T23:57:02.491462652Z [2024-04-20 23:57:02,491: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:57:02.494679454Z [2024-04-20 23:57:02,494: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:57:02.510588575Z [2024-04-20 23:57:02,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:57:02.511498061Z [2024-04-20 23:57:02,511: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:57:02.511513389Z [2024-04-20 23:57:02,511: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:57:02.511628254Z [2024-04-20 23:57:02,511: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:57:02.511654608Z [2024-04-20 23:57:02,511: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:57:02.511895315Z [2024-04-20 23:57:02,511: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:57:02.511925462Z [2024-04-20 23:57:02,511: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:57:02.568327533Z [2024-04-20 23:57:02,567: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:57:02.571989432Z [2024-04-20 23:57:02,571: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:57:02.599461850Z [2024-04-20 23:57:02,599: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:57:02.603391600Z [2024-04-20 23:57:02,603: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:57:02.603515834Z [2024-04-20 23:57:02,603: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:57:02.603779082Z [2024-04-20 23:57:02,603: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:57:02.603916835Z [2024-04-20 23:57:02,603: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:57:02.604249358Z [2024-04-20 23:57:02,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:57:02.604409163Z [2024-04-20 23:57:02,604: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:57:02.605975568Z [2024-04-20 23:57:02,605: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:57:02.686156025Z [2024-04-20 23:57:02,685: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:57:04.448583927Z [2024-04-20 23:57:04,448: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a40d5d2-ce6c-4bd9-b40b-da2bdbd31778] succeeded in 3.739036035999561s: None 2024-04-20T23:57:05.809670993Z [2024-04-20 23:57:05,808: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95599742-549b-4602-ad6d-df3bdb06a00a] succeeded in 5.1142505389998405s: None 2024-04-20T23:58:01.026551475Z [2024-04-20 23:58:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85d42fa7-3942-4a5a-8ce4-b25107cd3e93] received 2024-04-20T23:58:01.028313764Z [2024-04-20 23:58:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7dee464-b06f-4843-97a5-1578e721800e] received 2024-04-20T23:58:01.040040239Z [2024-04-20 23:58:01,039: INFO/ForkPoolWorker-16] [c7dee464-b06f-4843-97a5-1578e721800e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:58:01.041917073Z [2024-04-20 23:58:01,041: INFO/ForkPoolWorker-15] [85d42fa7-3942-4a5a-8ce4-b25107cd3e93] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-20T23:58:01.043871536Z [2024-04-20 23:58:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c693446a-b90b-4e1e-8bed-bd326e302590] received 2024-04-20T23:58:01.048121650Z [2024-04-20 23:58:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d390b8b1-0305-439b-921f-5783bac853c7] received 2024-04-20T23:58:01.069937154Z [2024-04-20 23:58:01,069: INFO/ForkPoolWorker-1] [c693446a-b90b-4e1e-8bed-bd326e302590] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:58:01.077706675Z [2024-04-20 23:58:01,077: INFO/ForkPoolWorker-2] [d390b8b1-0305-439b-921f-5783bac853c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:58:01.420493003Z [2024-04-20 23:58:01,414: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:58:01.531022269Z [2024-04-20 23:58:01,523: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:58:01.785563351Z [2024-04-20 23:58:01,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-20T23:58:01.886448658Z [2024-04-20 23:58:01,881: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:58:02.059007220Z [2024-04-20 23:58:02,058: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-20T23:58:02.065052032Z [2024-04-20 23:58:02,064: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:58:02.102310519Z [2024-04-20 23:58:02,102: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-20T23:58:02.106362366Z [2024-04-20 23:58:02,106: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:58:02.106512299Z [2024-04-20 23:58:02,106: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:58:02.106612776Z [2024-04-20 23:58:02,106: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-20T23:58:02.107158006Z [2024-04-20 23:58:02,106: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:58:02.227806828Z [2024-04-20 23:58:02,227: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:58:02.248555619Z [2024-04-20 23:58:02,240: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:58:03.051987575Z [2024-04-20 23:58:03,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85d42fa7-3942-4a5a-8ce4-b25107cd3e93] succeeded in 2.0190231750002567s: None 2024-04-20T23:58:03.348091444Z [2024-04-20 23:58:03,347: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d390b8b1-0305-439b-921f-5783bac853c7] succeeded in 2.2928992570004993s: None 2024-04-20T23:58:03.573815421Z [2024-04-20 23:58:03,573: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-20T23:58:03.577628538Z [2024-04-20 23:58:03,577: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:58:03.615313687Z [2024-04-20 23:58:03,615: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:58:03.617402873Z [2024-04-20 23:58:03,616: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:58:03.618088026Z [2024-04-20 23:58:03,617: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:58:03.618306821Z [2024-04-20 23:58:03,618: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:58:03.618468830Z [2024-04-20 23:58:03,618: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-20T23:58:03.619049928Z [2024-04-20 23:58:03,618: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:58:03.619060303Z [2024-04-20 23:58:03,618: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:58:03.750660170Z [2024-04-20 23:58:03,750: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:58:04.760720784Z [2024-04-20 23:58:04,760: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:58:04.775851439Z [2024-04-20 23:58:04,774: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:58:04.807101845Z [2024-04-20 23:58:04,806: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:58:04.811663504Z [2024-04-20 23:58:04,811: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:58:04.811706563Z [2024-04-20 23:58:04,811: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:58:04.811826147Z [2024-04-20 23:58:04,811: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:58:04.811837502Z [2024-04-20 23:58:04,811: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:58:04.815059440Z [2024-04-20 23:58:04,811: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:58:04.819120210Z [2024-04-20 23:58:04,816: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:58:04.929319214Z [2024-04-20 23:58:04,929: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:58:06.010319862Z [2024-04-20 23:58:06,009: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7dee464-b06f-4843-97a5-1578e721800e] succeeded in 4.977494597999794s: None 2024-04-20T23:58:06.485165343Z [2024-04-20 23:58:06,484: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c693446a-b90b-4e1e-8bed-bd326e302590] succeeded in 5.438182951999806s: None 2024-04-20T23:59:00.207027505Z [2024-04-20 23:59:00,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbd7bf5a-33e6-40cb-8d6a-1f86ded326ee] received 2024-04-20T23:59:00.209458153Z [2024-04-20 23:59:00,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b84ea33-5080-4498-bd50-f73e7d81f3de] received 2024-04-20T23:59:00.218336122Z [2024-04-20 23:59:00,218: INFO/ForkPoolWorker-15] [cbd7bf5a-33e6-40cb-8d6a-1f86ded326ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-20T23:59:00.218863762Z [2024-04-20 23:59:00,218: INFO/ForkPoolWorker-16] [5b84ea33-5080-4498-bd50-f73e7d81f3de] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-20T23:59:00.221093253Z [2024-04-20 23:59:00,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a259d9a-7f56-4666-b945-67eeceb482a2] received 2024-04-20T23:59:00.231401240Z [2024-04-20 23:59:00,231: INFO/ForkPoolWorker-1] [0a259d9a-7f56-4666-b945-67eeceb482a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-20T23:59:00.561924506Z [2024-04-20 23:59:00,557: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-20T23:59:00.567959344Z [2024-04-20 23:59:00,564: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-20T23:59:00.574930664Z [2024-04-20 23:59:00,571: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-20T23:59:00.727089913Z [2024-04-20 23:59:00,726: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-20T23:59:00.733105498Z [2024-04-20 23:59:00,732: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:59:00.772462112Z [2024-04-20 23:59:00,772: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-20T23:59:00.780458709Z [2024-04-20 23:59:00,780: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-20T23:59:00.780549822Z [2024-04-20 23:59:00,780: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-20T23:59:00.780770178Z [2024-04-20 23:59:00,780: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-20T23:59:00.781340743Z [2024-04-20 23:59:00,781: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-20T23:59:00.885561599Z [2024-04-20 23:59:00,885: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:59:01.535291291Z [2024-04-20 23:59:01,534: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b84ea33-5080-4498-bd50-f73e7d81f3de] succeeded in 1.3226552440000887s: None 2024-04-20T23:59:01.887971060Z [2024-04-20 23:59:01,887: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-20T23:59:01.891107936Z [2024-04-20 23:59:01,890: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:59:01.910831666Z [2024-04-20 23:59:01,910: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-20T23:59:01.912029166Z [2024-04-20 23:59:01,911: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:59:01.912124130Z [2024-04-20 23:59:01,912: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:59:01.912353590Z [2024-04-20 23:59:01,912: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:59:01.912421344Z [2024-04-20 23:59:01,912: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-20T23:59:01.912708233Z [2024-04-20 23:59:01,912: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-20T23:59:01.912785273Z [2024-04-20 23:59:01,912: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:59:01.917523720Z [2024-04-20 23:59:01,917: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-20T23:59:01.920739077Z [2024-04-20 23:59:01,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-20T23:59:01.940875080Z [2024-04-20 23:59:01,940: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-20T23:59:01.941979879Z [2024-04-20 23:59:01,941: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-20T23:59:01.942086687Z [2024-04-20 23:59:01,941: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-20T23:59:01.942251631Z [2024-04-20 23:59:01,942: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-20T23:59:01.942375048Z [2024-04-20 23:59:01,942: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-20T23:59:01.942635842Z [2024-04-20 23:59:01,942: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-20T23:59:01.942744192Z [2024-04-20 23:59:01,942: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-20T23:59:01.997061932Z [2024-04-20 23:59:01,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:59:02.021746620Z [2024-04-20 23:59:02,021: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-20T23:59:03.491915275Z [2024-04-20 23:59:03,491: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a259d9a-7f56-4666-b945-67eeceb482a2] succeeded in 3.2682266129995696s: None 2024-04-20T23:59:03.862731925Z [2024-04-20 23:59:03,862: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbd7bf5a-33e6-40cb-8d6a-1f86ded326ee] succeeded in 3.652705261999472s: None 2024-04-21T00:00:01.070617546Z [2024-04-21 00:00:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ceb05dc-cbd0-4504-8611-8bf1093d43b1] received 2024-04-21T00:00:01.083767270Z [2024-04-21 00:00:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4abe176-2eb6-4af2-91ac-79d29006b070] received 2024-04-21T00:00:01.095848533Z [2024-04-21 00:00:01,091: INFO/ForkPoolWorker-15] [3ceb05dc-cbd0-4504-8611-8bf1093d43b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:00:01.097386461Z [2024-04-21 00:00:01,096: INFO/ForkPoolWorker-16] [f4abe176-2eb6-4af2-91ac-79d29006b070] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:00:01.111587812Z [2024-04-21 00:00:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[349ce2ee-a003-49ef-9fb8-aee0d376fa76] received 2024-04-21T00:00:01.111609172Z [2024-04-21 00:00:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e309b8d0-bad4-432d-a4c9-558b35ac6de2] received 2024-04-21T00:00:01.124983158Z [2024-04-21 00:00:01,119: INFO/ForkPoolWorker-1] [349ce2ee-a003-49ef-9fb8-aee0d376fa76] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:00:01.126569041Z [2024-04-21 00:00:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00e46fa3-c247-4d55-ac3f-73c36ed419f4] received 2024-04-21T00:00:01.154307796Z [2024-04-21 00:00:01,152: INFO/ForkPoolWorker-3] [00e46fa3-c247-4d55-ac3f-73c36ed419f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:00:01.172987826Z [2024-04-21 00:00:01,172: INFO/ForkPoolWorker-2] [e309b8d0-bad4-432d-a4c9-558b35ac6de2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:00:01.777955240Z [2024-04-21 00:00:01,774: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:00:01.809166345Z [2024-04-21 00:00:01,803: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:00:01.885543992Z [2024-04-21 00:00:01,882: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:00:02.019560443Z [2024-04-21 00:00:02,016: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:00:02.080423803Z [2024-04-21 00:00:02,067: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:00:02.219749642Z [2024-04-21 00:00:02,219: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:00:02.236244905Z [2024-04-21 00:00:02,231: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:00:02.274217455Z [2024-04-21 00:00:02,273: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:00:02.276999028Z [2024-04-21 00:00:02,276: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:00:02.277294713Z [2024-04-21 00:00:02,276: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:00:02.278266091Z [2024-04-21 00:00:02,277: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:00:02.279374993Z [2024-04-21 00:00:02,278: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:00:02.372244549Z [2024-04-21 00:00:02,371: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:00:02.465887136Z [2024-04-21 00:00:02,465: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:00:03.141935813Z [2024-04-21 00:00:03,141: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4abe176-2eb6-4af2-91ac-79d29006b070] succeeded in 2.0604013329993904s: None 2024-04-21T00:00:03.160457058Z [2024-04-21 00:00:03,160: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[349ce2ee-a003-49ef-9fb8-aee0d376fa76] succeeded in 2.048076807000143s: None 2024-04-21T00:00:03.448709331Z [2024-04-21 00:00:03,448: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:00:03.452443971Z [2024-04-21 00:00:03,451: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:00:03.476688789Z [2024-04-21 00:00:03,476: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:00:03.478793047Z [2024-04-21 00:00:03,478: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:00:03.478959938Z [2024-04-21 00:00:03,478: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:00:03.479341447Z [2024-04-21 00:00:03,478: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:00:03.479531571Z [2024-04-21 00:00:03,479: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:00:03.480201176Z [2024-04-21 00:00:03,479: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:00:03.480383976Z [2024-04-21 00:00:03,480: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:00:03.595592480Z [2024-04-21 00:00:03,595: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:00:04.367487767Z [2024-04-21 00:00:04,367: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:00:04.370924305Z [2024-04-21 00:00:04,370: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:00:04.373939801Z [2024-04-21 00:00:04,373: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T00:00:04.388836128Z [2024-04-21 00:00:04,386: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:00:04.424613530Z [2024-04-21 00:00:04,424: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:00:04.425986035Z [2024-04-21 00:00:04,425: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:00:04.426306936Z [2024-04-21 00:00:04,425: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:00:04.426562149Z [2024-04-21 00:00:04,426: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:00:04.426740549Z [2024-04-21 00:00:04,426: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:00:04.427049863Z [2024-04-21 00:00:04,426: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:00:04.427542272Z [2024-04-21 00:00:04,427: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:00:04.454512129Z [2024-04-21 00:00:04,454: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T00:00:04.457233242Z [2024-04-21 00:00:04,457: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:00:04.457250439Z [2024-04-21 00:00:04,457: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:00:04.457378689Z [2024-04-21 00:00:04,457: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:00:04.457408971Z [2024-04-21 00:00:04,457: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T00:00:04.457606495Z [2024-04-21 00:00:04,457: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:00:04.457628207Z [2024-04-21 00:00:04,457: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:00:04.523145930Z [2024-04-21 00:00:04,522: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:00:04.587654306Z [2024-04-21 00:00:04,587: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ceb05dc-cbd0-4504-8611-8bf1093d43b1] succeeded in 3.5090092109994657s: None 2024-04-21T00:00:04.589327887Z [2024-04-21 00:00:04,589: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:00:05.470355944Z [2024-04-21 00:00:05,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da936ce2-6b14-4f7a-b030-29532ed5b739] received 2024-04-21T00:00:05.477494574Z [2024-04-21 00:00:05,477: INFO/ForkPoolWorker-15] [da936ce2-6b14-4f7a-b030-29532ed5b739] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:00:05.803903275Z [2024-04-21 00:00:05,800: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:00:06.040810575Z [2024-04-21 00:00:06,040: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[00e46fa3-c247-4d55-ac3f-73c36ed419f4] succeeded in 4.912481930000467s: None 2024-04-21T00:00:06.300628776Z [2024-04-21 00:00:06,300: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e309b8d0-bad4-432d-a4c9-558b35ac6de2] succeeded in 5.170542091000243s: None 2024-04-21T00:00:07.032861477Z [2024-04-21 00:00:07,032: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:00:07.036274565Z [2024-04-21 00:00:07,035: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:00:07.063623000Z [2024-04-21 00:00:07,063: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:00:07.065351705Z [2024-04-21 00:00:07,065: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:00:07.065509338Z [2024-04-21 00:00:07,065: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:00:07.065814998Z [2024-04-21 00:00:07,065: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:00:07.065957179Z [2024-04-21 00:00:07,065: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:00:07.066432240Z [2024-04-21 00:00:07,066: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:00:07.066630956Z [2024-04-21 00:00:07,066: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:00:07.145777340Z [2024-04-21 00:00:07,145: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:00:07.819492596Z [2024-04-21 00:00:07,818: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da936ce2-6b14-4f7a-b030-29532ed5b739] succeeded in 2.347344535999582s: None 2024-04-21T00:00:07.929911397Z [2024-04-21 00:00:07,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a4131b1-cec4-489e-b30a-95da141cb5c7] received 2024-04-21T00:00:07.938072766Z [2024-04-21 00:00:07,937: INFO/ForkPoolWorker-15] [8a4131b1-cec4-489e-b30a-95da141cb5c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:00:08.202823677Z [2024-04-21 00:00:08,199: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:00:09.272260355Z [2024-04-21 00:00:09,271: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:00:09.275780952Z [2024-04-21 00:00:09,275: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:00:09.299891771Z [2024-04-21 00:00:09,299: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:00:09.305034784Z [2024-04-21 00:00:09,304: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:00:09.305258415Z [2024-04-21 00:00:09,305: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:00:09.305518508Z [2024-04-21 00:00:09,305: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:00:09.305716031Z [2024-04-21 00:00:09,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:00:09.306094075Z [2024-04-21 00:00:09,305: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:00:09.306318088Z [2024-04-21 00:00:09,306: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:00:09.395995378Z [2024-04-21 00:00:09,395: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:00:10.066722303Z [2024-04-21 00:00:10,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a4131b1-cec4-489e-b30a-95da141cb5c7] succeeded in 2.1331508379998922s: None 2024-04-21T00:00:10.528115308Z [2024-04-21 00:00:10,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58c0c866-ee20-437a-920c-035423fda7e7] received 2024-04-21T00:00:10.537685232Z [2024-04-21 00:00:10,537: INFO/ForkPoolWorker-15] [58c0c866-ee20-437a-920c-035423fda7e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:00:10.819876339Z [2024-04-21 00:00:10,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:00:11.895638696Z [2024-04-21 00:00:11,895: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:00:11.906985030Z [2024-04-21 00:00:11,898: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:00:11.924886979Z [2024-04-21 00:00:11,924: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:00:11.926058098Z [2024-04-21 00:00:11,925: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:00:11.926373314Z [2024-04-21 00:00:11,925: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:00:11.926408239Z [2024-04-21 00:00:11,925: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:00:11.926428445Z [2024-04-21 00:00:11,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:00:11.926435450Z [2024-04-21 00:00:11,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:00:11.926441830Z [2024-04-21 00:00:11,926: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:00:12.004861859Z [2024-04-21 00:00:12,004: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:00:12.619087491Z [2024-04-21 00:00:12,618: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58c0c866-ee20-437a-920c-035423fda7e7] succeeded in 2.0887018909998005s: None 2024-04-21T00:01:00.318880224Z [2024-04-21 00:01:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[453e7bc6-0bc9-4ef8-a36a-8b6e926e77cb] received 2024-04-21T00:01:00.329634443Z [2024-04-21 00:01:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8b28e28-0608-483b-bbd2-6ed25f84685a] received 2024-04-21T00:01:00.332473562Z [2024-04-21 00:01:00,332: INFO/ForkPoolWorker-15] [453e7bc6-0bc9-4ef8-a36a-8b6e926e77cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:01:00.336931203Z [2024-04-21 00:01:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dabc870-4531-4b56-b72e-10e7f76beb6a] received 2024-04-21T00:01:00.346198424Z [2024-04-21 00:01:00,345: INFO/ForkPoolWorker-16] [f8b28e28-0608-483b-bbd2-6ed25f84685a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:01:00.357066055Z [2024-04-21 00:01:00,356: INFO/ForkPoolWorker-1] [0dabc870-4531-4b56-b72e-10e7f76beb6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:01:00.645928953Z [2024-04-21 00:01:00,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:01:00.675227998Z [2024-04-21 00:01:00,671: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:01:00.706254951Z [2024-04-21 00:01:00,702: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:01:00.835747418Z [2024-04-21 00:01:00,835: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:01:00.839534378Z [2024-04-21 00:01:00,839: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:01:00.866330486Z [2024-04-21 00:01:00,866: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:01:00.868237410Z [2024-04-21 00:01:00,868: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:01:00.868289456Z [2024-04-21 00:01:00,868: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:01:00.868357733Z [2024-04-21 00:01:00,868: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:01:00.868564636Z [2024-04-21 00:01:00,868: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:01:00.969601136Z [2024-04-21 00:01:00,969: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:01:01.604479068Z [2024-04-21 00:01:01,604: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0dabc870-4531-4b56-b72e-10e7f76beb6a] succeeded in 1.26409764500022s: None 2024-04-21T00:01:01.940232522Z [2024-04-21 00:01:01,939: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:01:01.943500791Z [2024-04-21 00:01:01,943: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:01:01.964668720Z [2024-04-21 00:01:01,964: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:01:01.965943275Z [2024-04-21 00:01:01,965: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:01:01.966008868Z [2024-04-21 00:01:01,965: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:01:01.966148749Z [2024-04-21 00:01:01,965: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:01:01.966213955Z [2024-04-21 00:01:01,966: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:01:01.966502039Z [2024-04-21 00:01:01,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:01:01.966595195Z [2024-04-21 00:01:01,966: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:01:02.036532070Z [2024-04-21 00:01:02,036: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:01:02.043866140Z [2024-04-21 00:01:02,043: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:01:02.055031502Z [2024-04-21 00:01:02,054: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:01:02.094103541Z [2024-04-21 00:01:02,093: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:01:02.096627986Z [2024-04-21 00:01:02,096: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:01:02.096833271Z [2024-04-21 00:01:02,096: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:01:02.097055765Z [2024-04-21 00:01:02,096: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:01:02.097214452Z [2024-04-21 00:01:02,097: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:01:02.097535000Z [2024-04-21 00:01:02,097: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:01:02.097779959Z [2024-04-21 00:01:02,097: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:01:02.191307752Z [2024-04-21 00:01:02,191: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:01:03.528171165Z [2024-04-21 00:01:03,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[453e7bc6-0bc9-4ef8-a36a-8b6e926e77cb] succeeded in 3.205842526000197s: None 2024-04-21T00:01:03.991492888Z [2024-04-21 00:01:03,991: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f8b28e28-0608-483b-bbd2-6ed25f84685a] succeeded in 3.6600316300000486s: None 2024-04-21T00:02:00.881729929Z [2024-04-21 00:02:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01aef1db-251a-4429-bbd1-0f368f486ed8] received 2024-04-21T00:02:00.883666698Z [2024-04-21 00:02:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[961cb06b-dc2f-44f4-8fae-64687a498d53] received 2024-04-21T00:02:00.890400753Z [2024-04-21 00:02:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdb32d4f-763b-4b01-998f-61e260eed081] received 2024-04-21T00:02:00.895141720Z [2024-04-21 00:02:00,894: INFO/ForkPoolWorker-15] [01aef1db-251a-4429-bbd1-0f368f486ed8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:02:00.907540905Z [2024-04-21 00:02:00,907: INFO/ForkPoolWorker-1] [bdb32d4f-763b-4b01-998f-61e260eed081] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:02:00.912607961Z [2024-04-21 00:02:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ccaf31a-8246-40e9-b765-7acdaf875c2d] received 2024-04-21T00:02:00.913264237Z [2024-04-21 00:02:00,912: INFO/ForkPoolWorker-16] [961cb06b-dc2f-44f4-8fae-64687a498d53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:02:00.923751615Z [2024-04-21 00:02:00,923: INFO/ForkPoolWorker-2] [5ccaf31a-8246-40e9-b765-7acdaf875c2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:02:01.285849912Z [2024-04-21 00:02:01,282: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:02:01.286006906Z [2024-04-21 00:02:01,281: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:02:01.386972410Z [2024-04-21 00:02:01,370: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:02:01.491105223Z [2024-04-21 00:02:01,478: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:02:01.507264974Z [2024-04-21 00:02:01,506: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:02:01.512933996Z [2024-04-21 00:02:01,511: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:02:01.573913846Z [2024-04-21 00:02:01,573: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:02:01.583229801Z [2024-04-21 00:02:01,583: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:02:01.589266907Z [2024-04-21 00:02:01,588: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:02:01.589734948Z [2024-04-21 00:02:01,589: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:02:01.589936594Z [2024-04-21 00:02:01,589: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:02:01.591696132Z [2024-04-21 00:02:01,591: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:02:01.703765739Z [2024-04-21 00:02:01,703: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:02:02.358300454Z [2024-04-21 00:02:02,357: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[01aef1db-251a-4429-bbd1-0f368f486ed8] succeeded in 1.472909492999861s: None 2024-04-21T00:02:02.358647650Z [2024-04-21 00:02:02,358: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5ccaf31a-8246-40e9-b765-7acdaf875c2d] succeeded in 1.442642627999703s: None 2024-04-21T00:02:02.871397406Z [2024-04-21 00:02:02,871: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:02:02.875140106Z [2024-04-21 00:02:02,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:02:02.907421569Z [2024-04-21 00:02:02,907: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:02:02.908910756Z [2024-04-21 00:02:02,908: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:02:02.909364908Z [2024-04-21 00:02:02,908: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:02:02.909595136Z [2024-04-21 00:02:02,909: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:02:02.909733969Z [2024-04-21 00:02:02,909: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:02:02.910284475Z [2024-04-21 00:02:02,910: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:02:02.910418012Z [2024-04-21 00:02:02,910: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:02:03.009027707Z [2024-04-21 00:02:03,008: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:02:03.144259530Z [2024-04-21 00:02:03,143: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:02:03.147461830Z [2024-04-21 00:02:03,147: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:02:03.167553435Z [2024-04-21 00:02:03,167: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:02:03.168828506Z [2024-04-21 00:02:03,168: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:02:03.168843636Z [2024-04-21 00:02:03,168: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:02:03.168945329Z [2024-04-21 00:02:03,168: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:02:03.168972055Z [2024-04-21 00:02:03,168: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:02:03.169191582Z [2024-04-21 00:02:03,169: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:02:03.169216414Z [2024-04-21 00:02:03,169: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:02:03.254987282Z [2024-04-21 00:02:03,254: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:02:04.859830224Z [2024-04-21 00:02:04,859: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[961cb06b-dc2f-44f4-8fae-64687a498d53] succeeded in 3.9710353290001876s: None 2024-04-21T00:02:05.760387918Z [2024-04-21 00:02:05,759: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bdb32d4f-763b-4b01-998f-61e260eed081] succeeded in 4.866769770000246s: None 2024-04-21T00:03:00.893303174Z [2024-04-21 00:03:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63cde8c9-d752-4296-9978-bceef21e82db] received 2024-04-21T00:03:00.895140433Z [2024-04-21 00:03:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ccb4ce8-da6e-4174-9638-af3c63232439] received 2024-04-21T00:03:00.897018207Z [2024-04-21 00:03:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[337c4d97-d30f-4f6a-82ae-010253600c73] received 2024-04-21T00:03:00.910646612Z [2024-04-21 00:03:00,910: INFO/ForkPoolWorker-15] [63cde8c9-d752-4296-9978-bceef21e82db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:03:00.914896806Z [2024-04-21 00:03:00,914: INFO/ForkPoolWorker-1] [337c4d97-d30f-4f6a-82ae-010253600c73] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:03:00.915623480Z [2024-04-21 00:03:00,915: INFO/ForkPoolWorker-16] [9ccb4ce8-da6e-4174-9638-af3c63232439] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:03:01.235797292Z [2024-04-21 00:03:01,231: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:03:01.248743841Z [2024-04-21 00:03:01,244: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:03:01.300829322Z [2024-04-21 00:03:01,297: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:03:01.576384360Z [2024-04-21 00:03:01,575: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:03:01.585591250Z [2024-04-21 00:03:01,585: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:03:01.652717247Z [2024-04-21 00:03:01,652: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:03:01.655305325Z [2024-04-21 00:03:01,655: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:03:01.655524270Z [2024-04-21 00:03:01,655: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:03:01.655652881Z [2024-04-21 00:03:01,655: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:03:01.656320489Z [2024-04-21 00:03:01,656: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:03:01.784048930Z [2024-04-21 00:03:01,783: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:03:02.605095926Z [2024-04-21 00:03:02,604: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[337c4d97-d30f-4f6a-82ae-010253600c73] succeeded in 1.7033004790000632s: None 2024-04-21T00:03:02.778684685Z [2024-04-21 00:03:02,778: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:03:02.782501901Z [2024-04-21 00:03:02,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:03:02.821603180Z [2024-04-21 00:03:02,821: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:03:02.822990262Z [2024-04-21 00:03:02,822: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:03:02.823020052Z [2024-04-21 00:03:02,822: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:03:02.823186106Z [2024-04-21 00:03:02,823: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:03:02.823250610Z [2024-04-21 00:03:02,823: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:03:02.823500740Z [2024-04-21 00:03:02,823: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:03:02.823557370Z [2024-04-21 00:03:02,823: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:03:02.845967371Z [2024-04-21 00:03:02,845: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:03:02.850990945Z [2024-04-21 00:03:02,850: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:03:02.886236727Z [2024-04-21 00:03:02,885: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:03:02.887501747Z [2024-04-21 00:03:02,887: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:03:02.887712476Z [2024-04-21 00:03:02,887: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:03:02.887975464Z [2024-04-21 00:03:02,887: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:03:02.888197974Z [2024-04-21 00:03:02,888: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:03:02.888744519Z [2024-04-21 00:03:02,888: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:03:02.888753141Z [2024-04-21 00:03:02,888: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:03:02.945132004Z [2024-04-21 00:03:02,944: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:03:03.044527564Z [2024-04-21 00:03:03,044: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:03:05.255180966Z [2024-04-21 00:03:05,254: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ccb4ce8-da6e-4174-9638-af3c63232439] succeeded in 4.358079224999528s: None 2024-04-21T00:03:05.630668305Z [2024-04-21 00:03:05,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63cde8c9-d752-4296-9978-bceef21e82db] succeeded in 4.735159722999924s: None 2024-04-21T00:04:00.836756121Z [2024-04-21 00:04:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[300d0a9e-6404-44eb-bd37-15e2ceb5b259] received 2024-04-21T00:04:00.842464153Z [2024-04-21 00:04:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f717673-ff2b-4e24-9a7c-b6b26d38bd8d] received 2024-04-21T00:04:00.849184327Z [2024-04-21 00:04:00,848: INFO/ForkPoolWorker-15] [300d0a9e-6404-44eb-bd37-15e2ceb5b259] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:04:00.851181767Z [2024-04-21 00:04:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f35202e-9071-460d-a046-36f4077adb37] received 2024-04-21T00:04:00.853065220Z [2024-04-21 00:04:00,852: INFO/ForkPoolWorker-16] [4f717673-ff2b-4e24-9a7c-b6b26d38bd8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:04:00.861016931Z [2024-04-21 00:04:00,860: INFO/ForkPoolWorker-1] [7f35202e-9071-460d-a046-36f4077adb37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:04:00.868315390Z [2024-04-21 00:04:00,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ea72aca-fce3-4a34-b9c1-a05c3b62d8d7] received 2024-04-21T00:04:00.889348528Z [2024-04-21 00:04:00,887: INFO/ForkPoolWorker-2] [2ea72aca-fce3-4a34-b9c1-a05c3b62d8d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:04:01.300426866Z [2024-04-21 00:04:01,291: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:04:01.302501097Z [2024-04-21 00:04:01,296: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:04:01.319172837Z [2024-04-21 00:04:01,315: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:04:01.410544189Z [2024-04-21 00:04:01,407: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:04:01.638968742Z [2024-04-21 00:04:01,638: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:04:01.646915443Z [2024-04-21 00:04:01,646: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:04:01.653645194Z [2024-04-21 00:04:01,653: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:04:01.696886527Z [2024-04-21 00:04:01,696: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:04:01.701544861Z [2024-04-21 00:04:01,701: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:04:01.701809721Z [2024-04-21 00:04:01,701: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:04:01.701975201Z [2024-04-21 00:04:01,701: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:04:01.702288923Z [2024-04-21 00:04:01,702: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:04:01.828149616Z [2024-04-21 00:04:01,827: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:04:02.181707732Z [2024-04-21 00:04:02,181: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[300d0a9e-6404-44eb-bd37-15e2ceb5b259] succeeded in 1.3393849229996704s: None 2024-04-21T00:04:02.507576231Z [2024-04-21 00:04:02,507: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2ea72aca-fce3-4a34-b9c1-a05c3b62d8d7] succeeded in 1.6333725510003205s: None 2024-04-21T00:04:02.864945955Z [2024-04-21 00:04:02,864: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:04:02.870975585Z [2024-04-21 00:04:02,870: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:04:02.911890875Z [2024-04-21 00:04:02,911: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:04:02.914668295Z [2024-04-21 00:04:02,914: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:04:02.915014103Z [2024-04-21 00:04:02,914: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:04:02.915249552Z [2024-04-21 00:04:02,914: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:04:02.915430714Z [2024-04-21 00:04:02,915: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:04:02.916096288Z [2024-04-21 00:04:02,915: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:04:02.916168606Z [2024-04-21 00:04:02,916: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:04:03.006380253Z [2024-04-21 00:04:03,006: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:04:03.227982821Z [2024-04-21 00:04:03,227: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:04:03.234554869Z [2024-04-21 00:04:03,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:04:03.279026626Z [2024-04-21 00:04:03,278: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:04:03.280655188Z [2024-04-21 00:04:03,280: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:04:03.280851786Z [2024-04-21 00:04:03,280: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:04:03.281082092Z [2024-04-21 00:04:03,280: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:04:03.281288815Z [2024-04-21 00:04:03,281: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:04:03.281554958Z [2024-04-21 00:04:03,281: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:04:03.281701848Z [2024-04-21 00:04:03,281: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:04:03.399708568Z [2024-04-21 00:04:03,399: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:04:04.792797435Z [2024-04-21 00:04:04,792: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f717673-ff2b-4e24-9a7c-b6b26d38bd8d] succeeded in 3.947721432000435s: None 2024-04-21T00:04:05.460245015Z [2024-04-21 00:04:05,459: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7f35202e-9071-460d-a046-36f4077adb37] succeeded in 4.606344914999681s: None 2024-04-21T00:05:00.759478728Z [2024-04-21 00:05:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8914c1cb-b0ef-4472-9a92-5bd6bc1e6481] received 2024-04-21T00:05:00.761251459Z [2024-04-21 00:05:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac25be1f-199d-4ec7-a228-bc737c76d174] received 2024-04-21T00:05:00.763540280Z [2024-04-21 00:05:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18c5ec4f-050b-4b95-9d74-686fcdc9171d] received 2024-04-21T00:05:00.779062225Z [2024-04-21 00:05:00,778: INFO/ForkPoolWorker-1] [18c5ec4f-050b-4b95-9d74-686fcdc9171d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:05:00.782075172Z [2024-04-21 00:05:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3efdf871-25c8-4749-b043-af2abe55f2ad] received 2024-04-21T00:05:00.796663748Z [2024-04-21 00:05:00,796: INFO/ForkPoolWorker-2] [3efdf871-25c8-4749-b043-af2abe55f2ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:05:00.800101189Z [2024-04-21 00:05:00,799: INFO/ForkPoolWorker-16] [ac25be1f-199d-4ec7-a228-bc737c76d174] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:05:00.806755140Z [2024-04-21 00:05:00,806: INFO/ForkPoolWorker-15] [8914c1cb-b0ef-4472-9a92-5bd6bc1e6481] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:05:01.193920656Z [2024-04-21 00:05:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:05:01.221946959Z [2024-04-21 00:05:01,217: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:05:01.415901267Z [2024-04-21 00:05:01,411: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:05:01.507796055Z [2024-04-21 00:05:01,491: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:05:02.001899967Z [2024-04-21 00:05:02,001: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:05:02.010337990Z [2024-04-21 00:05:02,009: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:05:02.088969829Z [2024-04-21 00:05:02,088: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:05:02.093975811Z [2024-04-21 00:05:02,093: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:05:02.094018843Z [2024-04-21 00:05:02,093: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:05:02.094063661Z [2024-04-21 00:05:02,094: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:05:02.094227481Z [2024-04-21 00:05:02,094: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:05:02.374354560Z [2024-04-21 00:05:02,374: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:05:03.296708846Z [2024-04-21 00:05:03,296: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18c5ec4f-050b-4b95-9d74-686fcdc9171d] succeeded in 2.530149555999742s: None 2024-04-21T00:05:03.393391953Z [2024-04-21 00:05:03,392: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:05:03.403164978Z [2024-04-21 00:05:03,402: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:05:03.424417416Z [2024-04-21 00:05:03,424: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:05:03.426109307Z [2024-04-21 00:05:03,425: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:05:03.426298702Z [2024-04-21 00:05:03,426: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:05:03.426463522Z [2024-04-21 00:05:03,426: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:05:03.426550623Z [2024-04-21 00:05:03,426: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:05:03.426780833Z [2024-04-21 00:05:03,426: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:05:03.427169567Z [2024-04-21 00:05:03,427: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:05:03.440515027Z [2024-04-21 00:05:03,440: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:05:03.445246437Z [2024-04-21 00:05:03,444: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:05:03.481337524Z [2024-04-21 00:05:03,481: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:05:03.482569678Z [2024-04-21 00:05:03,482: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:05:03.482613974Z [2024-04-21 00:05:03,482: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:05:03.482778154Z [2024-04-21 00:05:03,482: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:05:03.482815594Z [2024-04-21 00:05:03,482: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:05:03.483099940Z [2024-04-21 00:05:03,482: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:05:03.483148083Z [2024-04-21 00:05:03,483: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:05:03.534044547Z [2024-04-21 00:05:03,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:05:03.553047191Z [2024-04-21 00:05:03,552: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:05:03.556561712Z [2024-04-21 00:05:03,556: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:05:03.586369340Z [2024-04-21 00:05:03,586: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:05:03.588028266Z [2024-04-21 00:05:03,587: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:05:03.588047791Z [2024-04-21 00:05:03,587: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:05:03.588127466Z [2024-04-21 00:05:03,588: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:05:03.588254649Z [2024-04-21 00:05:03,588: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:05:03.588435097Z [2024-04-21 00:05:03,588: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:05:03.588455387Z [2024-04-21 00:05:03,588: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:05:03.602018357Z [2024-04-21 00:05:03,601: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:05:03.690592999Z [2024-04-21 00:05:03,690: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:05:04.459837924Z [2024-04-21 00:05:04,459: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8914c1cb-b0ef-4472-9a92-5bd6bc1e6481] succeeded in 3.69186346800052s: None 2024-04-21T00:05:04.594691330Z [2024-04-21 00:05:04,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b59da821-84b8-4ccd-82bb-80d8e22b7736] received 2024-04-21T00:05:04.611703623Z [2024-04-21 00:05:04,611: INFO/ForkPoolWorker-15] [b59da821-84b8-4ccd-82bb-80d8e22b7736] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:05:04.975615385Z [2024-04-21 00:05:04,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:05:05.436367314Z [2024-04-21 00:05:05,435: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac25be1f-199d-4ec7-a228-bc737c76d174] succeeded in 4.6710254099998565s: None 2024-04-21T00:05:05.897520916Z [2024-04-21 00:05:05,896: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3efdf871-25c8-4749-b043-af2abe55f2ad] succeeded in 5.110857647000557s: None 2024-04-21T00:05:06.344374997Z [2024-04-21 00:05:06,344: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:05:06.347937246Z [2024-04-21 00:05:06,347: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:05:06.397030912Z [2024-04-21 00:05:06,396: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:05:06.398619654Z [2024-04-21 00:05:06,398: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:05:06.398799463Z [2024-04-21 00:05:06,398: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:05:06.399090457Z [2024-04-21 00:05:06,398: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:05:06.399253417Z [2024-04-21 00:05:06,399: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:05:06.399752761Z [2024-04-21 00:05:06,399: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:05:06.400752857Z [2024-04-21 00:05:06,400: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:05:06.498141836Z [2024-04-21 00:05:06,497: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:05:07.141843734Z [2024-04-21 00:05:07,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fd60b2c-21c3-4802-909c-57af582e043c] received 2024-04-21T00:05:07.176402365Z [2024-04-21 00:05:07,176: INFO/ForkPoolWorker-16] [1fd60b2c-21c3-4802-909c-57af582e043c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:05:07.186090388Z [2024-04-21 00:05:07,185: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b59da821-84b8-4ccd-82bb-80d8e22b7736] succeeded in 2.5850672329997906s: None 2024-04-21T00:05:07.462919814Z [2024-04-21 00:05:07,459: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:05:08.585150732Z [2024-04-21 00:05:08,584: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:05:08.588704806Z [2024-04-21 00:05:08,588: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:05:08.620382111Z [2024-04-21 00:05:08,620: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:05:08.625149649Z [2024-04-21 00:05:08,624: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:05:08.625176125Z [2024-04-21 00:05:08,625: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:05:08.625367474Z [2024-04-21 00:05:08,625: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:05:08.625424400Z [2024-04-21 00:05:08,625: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:05:08.625741251Z [2024-04-21 00:05:08,625: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:05:08.625799813Z [2024-04-21 00:05:08,625: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:05:08.741575816Z [2024-04-21 00:05:08,741: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:05:09.439198609Z [2024-04-21 00:05:09,438: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1fd60b2c-21c3-4802-909c-57af582e043c] succeeded in 2.294267494000451s: None 2024-04-21T00:05:09.604701453Z [2024-04-21 00:05:09,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce6a2e69-0248-4606-8a5a-925e93a8912a] received 2024-04-21T00:05:09.618349314Z [2024-04-21 00:05:09,617: INFO/ForkPoolWorker-15] [ce6a2e69-0248-4606-8a5a-925e93a8912a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:05:09.899355355Z [2024-04-21 00:05:09,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:05:10.993539767Z [2024-04-21 00:05:10,992: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:05:10.997971784Z [2024-04-21 00:05:10,997: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:05:11.022015377Z [2024-04-21 00:05:11,021: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:05:11.023503028Z [2024-04-21 00:05:11,023: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:05:11.023721511Z [2024-04-21 00:05:11,023: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:05:11.024037176Z [2024-04-21 00:05:11,023: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:05:11.024253092Z [2024-04-21 00:05:11,023: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:05:11.024747332Z [2024-04-21 00:05:11,024: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:05:11.025203398Z [2024-04-21 00:05:11,024: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:05:11.096587171Z [2024-04-21 00:05:11,096: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:05:11.727440403Z [2024-04-21 00:05:11,723: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce6a2e69-0248-4606-8a5a-925e93a8912a] succeeded in 2.119172126000194s: None 2024-04-21T00:06:00.953697255Z [2024-04-21 00:06:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[844d77a3-3a54-4bba-b9ee-a2723a6de01e] received 2024-04-21T00:06:00.964913747Z [2024-04-21 00:06:00,964: INFO/ForkPoolWorker-15] [844d77a3-3a54-4bba-b9ee-a2723a6de01e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:06:00.966583260Z [2024-04-21 00:06:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca6422d6-bcc3-44b3-a2cf-0b0cca0cb809] received 2024-04-21T00:06:00.980283084Z [2024-04-21 00:06:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87dc2688-7693-46cb-a90d-f961051cb2ec] received 2024-04-21T00:06:00.982394521Z [2024-04-21 00:06:00,981: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75a9ceb8-eed9-44b9-9a91-b5915c8d0cf0] received 2024-04-21T00:06:00.990853677Z [2024-04-21 00:06:00,990: INFO/ForkPoolWorker-1] [87dc2688-7693-46cb-a90d-f961051cb2ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:06:00.992322645Z [2024-04-21 00:06:00,992: INFO/ForkPoolWorker-2] [75a9ceb8-eed9-44b9-9a91-b5915c8d0cf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:06:00.994370296Z [2024-04-21 00:06:00,992: INFO/ForkPoolWorker-16] [ca6422d6-bcc3-44b3-a2cf-0b0cca0cb809] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:06:01.364539998Z [2024-04-21 00:06:01,360: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:06:01.385567231Z [2024-04-21 00:06:01,378: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:06:01.483302152Z [2024-04-21 00:06:01,473: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:06:01.512994951Z [2024-04-21 00:06:01,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:06:01.771195198Z [2024-04-21 00:06:01,770: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:06:01.783889224Z [2024-04-21 00:06:01,783: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:06:01.807693998Z [2024-04-21 00:06:01,807: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:06:01.852283382Z [2024-04-21 00:06:01,852: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:06:01.853480860Z [2024-04-21 00:06:01,853: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:06:01.853598722Z [2024-04-21 00:06:01,853: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:06:01.853656706Z [2024-04-21 00:06:01,853: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:06:01.853857546Z [2024-04-21 00:06:01,853: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:06:01.976355549Z [2024-04-21 00:06:01,976: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:06:02.513202724Z [2024-04-21 00:06:02,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[844d77a3-3a54-4bba-b9ee-a2723a6de01e] succeeded in 1.55733470999985s: None 2024-04-21T00:06:02.603287955Z [2024-04-21 00:06:02,601: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[75a9ceb8-eed9-44b9-9a91-b5915c8d0cf0] succeeded in 1.6161213580007825s: None 2024-04-21T00:06:02.891577404Z [2024-04-21 00:06:02,891: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:06:02.895020260Z [2024-04-21 00:06:02,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:06:02.917436954Z [2024-04-21 00:06:02,917: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:06:02.919365921Z [2024-04-21 00:06:02,919: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:06:02.919514861Z [2024-04-21 00:06:02,919: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:06:02.919794867Z [2024-04-21 00:06:02,919: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:06:02.919942419Z [2024-04-21 00:06:02,919: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:06:02.920426972Z [2024-04-21 00:06:02,920: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:06:02.920670447Z [2024-04-21 00:06:02,920: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:06:03.017824579Z [2024-04-21 00:06:03,017: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:06:03.178394308Z [2024-04-21 00:06:03,177: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:06:03.181930456Z [2024-04-21 00:06:03,181: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:06:03.211714560Z [2024-04-21 00:06:03,211: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:06:03.213083799Z [2024-04-21 00:06:03,212: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:06:03.213230828Z [2024-04-21 00:06:03,213: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:06:03.213428396Z [2024-04-21 00:06:03,213: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:06:03.213562228Z [2024-04-21 00:06:03,213: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:06:03.213857372Z [2024-04-21 00:06:03,213: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:06:03.214008601Z [2024-04-21 00:06:03,213: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:06:03.340575200Z [2024-04-21 00:06:03,340: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:06:04.737330582Z [2024-04-21 00:06:04,736: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca6422d6-bcc3-44b3-a2cf-0b0cca0cb809] succeeded in 3.768980601000294s: None 2024-04-21T00:06:05.252804146Z [2024-04-21 00:06:05,252: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[87dc2688-7693-46cb-a90d-f961051cb2ec] succeeded in 4.270334736000223s: None 2024-04-21T00:07:00.742771180Z [2024-04-21 00:07:00,741: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46089a6e-95b1-4b64-80a5-dc88596380bb] received 2024-04-21T00:07:00.747935562Z [2024-04-21 00:07:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be3ede2e-40fc-4838-ac89-cf61081e46ff] received 2024-04-21T00:07:00.754779160Z [2024-04-21 00:07:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d85088fa-6a22-4acc-8b52-36fbec10216b] received 2024-04-21T00:07:00.763563729Z [2024-04-21 00:07:00,763: INFO/ForkPoolWorker-15] [46089a6e-95b1-4b64-80a5-dc88596380bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:07:00.765354744Z [2024-04-21 00:07:00,764: INFO/ForkPoolWorker-16] [be3ede2e-40fc-4838-ac89-cf61081e46ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:07:00.779408010Z [2024-04-21 00:07:00,778: INFO/ForkPoolWorker-1] [d85088fa-6a22-4acc-8b52-36fbec10216b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:07:01.061770377Z [2024-04-21 00:07:01,058: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:07:01.068055274Z [2024-04-21 00:07:01,064: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:07:01.157132734Z [2024-04-21 00:07:01,152: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:07:01.332539454Z [2024-04-21 00:07:01,332: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:07:01.342071147Z [2024-04-21 00:07:01,340: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:07:01.373296194Z [2024-04-21 00:07:01,373: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:07:01.377048785Z [2024-04-21 00:07:01,376: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:07:01.377202128Z [2024-04-21 00:07:01,377: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:07:01.377339693Z [2024-04-21 00:07:01,377: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:07:01.377641481Z [2024-04-21 00:07:01,377: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:07:01.542131926Z [2024-04-21 00:07:01,540: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:07:02.151420872Z [2024-04-21 00:07:02,151: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d85088fa-6a22-4acc-8b52-36fbec10216b] succeeded in 1.3939665210000385s: None 2024-04-21T00:07:02.408875529Z [2024-04-21 00:07:02,408: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:07:02.412137745Z [2024-04-21 00:07:02,411: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:07:02.452146210Z [2024-04-21 00:07:02,451: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:07:02.454021608Z [2024-04-21 00:07:02,453: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:07:02.454068958Z [2024-04-21 00:07:02,453: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:07:02.454274396Z [2024-04-21 00:07:02,454: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:07:02.454346555Z [2024-04-21 00:07:02,454: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:07:02.454644847Z [2024-04-21 00:07:02,454: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:07:02.454709623Z [2024-04-21 00:07:02,454: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:07:02.514798179Z [2024-04-21 00:07:02,514: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:07:02.519471263Z [2024-04-21 00:07:02,519: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:07:02.537331473Z [2024-04-21 00:07:02,537: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:07:02.540277846Z [2024-04-21 00:07:02,540: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:07:02.541564630Z [2024-04-21 00:07:02,541: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:07:02.541782482Z [2024-04-21 00:07:02,541: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:07:02.542033031Z [2024-04-21 00:07:02,541: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:07:02.542223477Z [2024-04-21 00:07:02,542: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:07:02.542762540Z [2024-04-21 00:07:02,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:07:02.543323001Z [2024-04-21 00:07:02,543: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:07:02.624939030Z [2024-04-21 00:07:02,624: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:07:04.536534328Z [2024-04-21 00:07:04,535: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46089a6e-95b1-4b64-80a5-dc88596380bb] succeeded in 3.7853313720006554s: None 2024-04-21T00:07:05.298036897Z [2024-04-21 00:07:05,297: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be3ede2e-40fc-4838-ac89-cf61081e46ff] succeeded in 4.54520069299997s: None 2024-04-21T00:08:00.695389382Z [2024-04-21 00:08:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24db99e4-13d6-44fb-8ddb-a46adee6867c] received 2024-04-21T00:08:00.698483239Z [2024-04-21 00:08:00,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38018024-b7ca-4c7b-b22e-7a7f8c6b4708] received 2024-04-21T00:08:00.707373694Z [2024-04-21 00:08:00,707: INFO/ForkPoolWorker-16] [38018024-b7ca-4c7b-b22e-7a7f8c6b4708] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:08:00.707951988Z [2024-04-21 00:08:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df745152-91c5-472b-ab7d-623b7079bcb3] received 2024-04-21T00:08:00.712113136Z [2024-04-21 00:08:00,711: INFO/ForkPoolWorker-15] [24db99e4-13d6-44fb-8ddb-a46adee6867c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:08:00.715989106Z [2024-04-21 00:08:00,715: INFO/ForkPoolWorker-1] [df745152-91c5-472b-ab7d-623b7079bcb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:08:00.720725354Z [2024-04-21 00:08:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0515ba07-2392-4dea-8c93-577bb5fdd2b3] received 2024-04-21T00:08:00.742080758Z [2024-04-21 00:08:00,741: INFO/ForkPoolWorker-2] [0515ba07-2392-4dea-8c93-577bb5fdd2b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:08:01.049053844Z [2024-04-21 00:08:01,045: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:08:01.114113147Z [2024-04-21 00:08:01,109: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:08:01.159171317Z [2024-04-21 00:08:01,151: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:08:01.193058795Z [2024-04-21 00:08:01,189: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:08:01.378902329Z [2024-04-21 00:08:01,378: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:08:01.392884166Z [2024-04-21 00:08:01,392: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:08:01.398159449Z [2024-04-21 00:08:01,397: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:08:01.452706099Z [2024-04-21 00:08:01,452: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:08:01.455617979Z [2024-04-21 00:08:01,455: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:08:01.455844313Z [2024-04-21 00:08:01,455: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:08:01.456013131Z [2024-04-21 00:08:01,455: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:08:01.456293352Z [2024-04-21 00:08:01,456: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:08:01.588497399Z [2024-04-21 00:08:01,588: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:08:02.147781837Z [2024-04-21 00:08:02,147: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[38018024-b7ca-4c7b-b22e-7a7f8c6b4708] succeeded in 1.4474695729995801s: None 2024-04-21T00:08:02.349601217Z [2024-04-21 00:08:02,349: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df745152-91c5-472b-ab7d-623b7079bcb3] succeeded in 1.63982051199946s: None 2024-04-21T00:08:02.684949598Z [2024-04-21 00:08:02,684: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:08:02.688084351Z [2024-04-21 00:08:02,687: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:08:02.712506517Z [2024-04-21 00:08:02,712: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:08:02.713890565Z [2024-04-21 00:08:02,713: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:08:02.714064762Z [2024-04-21 00:08:02,713: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:08:02.714262291Z [2024-04-21 00:08:02,714: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:08:02.714362104Z [2024-04-21 00:08:02,714: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:08:02.714932820Z [2024-04-21 00:08:02,714: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:08:02.715046809Z [2024-04-21 00:08:02,714: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:08:02.784581362Z [2024-04-21 00:08:02,784: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:08:03.027881202Z [2024-04-21 00:08:03,027: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:08:03.031837303Z [2024-04-21 00:08:03,031: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:08:03.058741701Z [2024-04-21 00:08:03,058: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:08:03.060008988Z [2024-04-21 00:08:03,059: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:08:03.060032668Z [2024-04-21 00:08:03,059: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:08:03.060148916Z [2024-04-21 00:08:03,060: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:08:03.060163652Z [2024-04-21 00:08:03,060: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:08:03.060410889Z [2024-04-21 00:08:03,060: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:08:03.060424171Z [2024-04-21 00:08:03,060: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:08:03.150344492Z [2024-04-21 00:08:03,150: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:08:04.732281105Z [2024-04-21 00:08:04,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24db99e4-13d6-44fb-8ddb-a46adee6867c] succeeded in 4.03066667100029s: None 2024-04-21T00:08:04.805644660Z [2024-04-21 00:08:04,804: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0515ba07-2392-4dea-8c93-577bb5fdd2b3] succeeded in 4.0781923610002195s: None 2024-04-21T00:09:00.577474701Z [2024-04-21 00:09:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb56ce71-1689-4e49-87c0-a63a83f0f0cb] received 2024-04-21T00:09:00.580768093Z [2024-04-21 00:09:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57a882ae-1962-4318-98d3-c0f706b98dd9] received 2024-04-21T00:09:00.585583812Z [2024-04-21 00:09:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c995d9f-4f63-4e5b-81ea-76ffa03e775e] received 2024-04-21T00:09:00.610924482Z [2024-04-21 00:09:00,608: INFO/ForkPoolWorker-1] [6c995d9f-4f63-4e5b-81ea-76ffa03e775e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:09:00.611438351Z [2024-04-21 00:09:00,610: INFO/ForkPoolWorker-15] [fb56ce71-1689-4e49-87c0-a63a83f0f0cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:09:00.612331117Z [2024-04-21 00:09:00,611: INFO/ForkPoolWorker-16] [57a882ae-1962-4318-98d3-c0f706b98dd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:09:01.014268826Z [2024-04-21 00:09:01,010: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:09:01.020622241Z [2024-04-21 00:09:01,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:09:01.024782155Z [2024-04-21 00:09:01,001: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:09:01.187157628Z [2024-04-21 00:09:01,186: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:09:01.194500649Z [2024-04-21 00:09:01,194: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:09:01.245240909Z [2024-04-21 00:09:01,244: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:09:01.247081388Z [2024-04-21 00:09:01,246: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:09:01.247369433Z [2024-04-21 00:09:01,247: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:09:01.247573759Z [2024-04-21 00:09:01,247: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:09:01.248030287Z [2024-04-21 00:09:01,247: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:09:01.368966416Z [2024-04-21 00:09:01,368: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:09:02.437948182Z [2024-04-21 00:09:02,437: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6c995d9f-4f63-4e5b-81ea-76ffa03e775e] succeeded in 1.8502547520001826s: None 2024-04-21T00:09:02.705820802Z [2024-04-21 00:09:02,705: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:09:02.709228412Z [2024-04-21 00:09:02,708: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:09:02.755658207Z [2024-04-21 00:09:02,755: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:09:02.760077863Z [2024-04-21 00:09:02,759: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:09:02.760237143Z [2024-04-21 00:09:02,760: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:09:02.760632334Z [2024-04-21 00:09:02,760: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:09:02.760895380Z [2024-04-21 00:09:02,760: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:09:02.761230724Z [2024-04-21 00:09:02,761: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:09:02.761393142Z [2024-04-21 00:09:02,761: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:09:02.887831679Z [2024-04-21 00:09:02,887: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:09:02.909639590Z [2024-04-21 00:09:02,909: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:09:02.913327488Z [2024-04-21 00:09:02,912: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:09:02.989201396Z [2024-04-21 00:09:02,989: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:09:03.008574183Z [2024-04-21 00:09:03,008: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:09:03.013321985Z [2024-04-21 00:09:03,008: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:09:03.017024344Z [2024-04-21 00:09:03,016: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:09:03.019978015Z [2024-04-21 00:09:03,016: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:09:03.020395050Z [2024-04-21 00:09:03,020: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:09:03.020563939Z [2024-04-21 00:09:03,020: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:09:03.443615632Z [2024-04-21 00:09:03,443: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:09:04.605948191Z [2024-04-21 00:09:04,605: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb56ce71-1689-4e49-87c0-a63a83f0f0cb] succeeded in 4.021791281000333s: None 2024-04-21T00:09:05.505490014Z [2024-04-21 00:09:05,503: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[57a882ae-1962-4318-98d3-c0f706b98dd9] succeeded in 4.906811746999665s: None 2024-04-21T00:10:00.602325742Z [2024-04-21 00:10:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20ac327a-ad52-4530-bb1a-c30a04c5b416] received 2024-04-21T00:10:00.606099539Z [2024-04-21 00:10:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baf8544c-f444-4be5-aab6-ccede5a68c4b] received 2024-04-21T00:10:00.610024683Z [2024-04-21 00:10:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acb444c7-798a-4b8f-aa1c-4c84bbbd1a88] received 2024-04-21T00:10:00.611756600Z [2024-04-21 00:10:00,611: INFO/ForkPoolWorker-15] [20ac327a-ad52-4530-bb1a-c30a04c5b416] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:10:00.614114101Z [2024-04-21 00:10:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca5d2ecd-599f-4267-a627-822816d288dc] received 2024-04-21T00:10:00.616840431Z [2024-04-21 00:10:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[827aed02-fd1d-49ed-a9fe-e61e13973705] received 2024-04-21T00:10:00.617984943Z [2024-04-21 00:10:00,617: INFO/ForkPoolWorker-1] [acb444c7-798a-4b8f-aa1c-4c84bbbd1a88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:10:00.618601598Z [2024-04-21 00:10:00,618: INFO/ForkPoolWorker-16] [baf8544c-f444-4be5-aab6-ccede5a68c4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:10:00.646874475Z [2024-04-21 00:10:00,646: INFO/ForkPoolWorker-2] [ca5d2ecd-599f-4267-a627-822816d288dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:10:00.648093279Z [2024-04-21 00:10:00,647: INFO/ForkPoolWorker-3] [827aed02-fd1d-49ed-a9fe-e61e13973705] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:10:00.987631012Z [2024-04-21 00:10:00,984: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:10:00.997000435Z [2024-04-21 00:10:00,993: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:10:01.079793545Z [2024-04-21 00:10:01,061: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:10:01.171875498Z [2024-04-21 00:10:01,155: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:10:01.346617812Z [2024-04-21 00:10:01,346: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:10:01.385974157Z [2024-04-21 00:10:01,381: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:10:01.642458116Z [2024-04-21 00:10:01,642: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:10:01.646651484Z [2024-04-21 00:10:01,646: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:10:01.693586277Z [2024-04-21 00:10:01,693: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:10:01.704193030Z [2024-04-21 00:10:01,703: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:10:01.704521000Z [2024-04-21 00:10:01,704: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:10:01.704695940Z [2024-04-21 00:10:01,704: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:10:01.705020289Z [2024-04-21 00:10:01,704: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:10:01.862794649Z [2024-04-21 00:10:01,861: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:10:02.164763059Z [2024-04-21 00:10:02,164: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[827aed02-fd1d-49ed-a9fe-e61e13973705] succeeded in 1.5410590069996033s: None 2024-04-21T00:10:02.453066895Z [2024-04-21 00:10:02,452: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[acb444c7-798a-4b8f-aa1c-4c84bbbd1a88] succeeded in 1.8410462940000798s: None 2024-04-21T00:10:02.799756189Z [2024-04-21 00:10:02,799: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:10:02.803234061Z [2024-04-21 00:10:02,802: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:10:02.809825482Z [2024-04-21 00:10:02,809: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:10:02.813674555Z [2024-04-21 00:10:02,813: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:10:02.836924442Z [2024-04-21 00:10:02,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:10:02.839036914Z [2024-04-21 00:10:02,838: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:10:02.839288293Z [2024-04-21 00:10:02,839: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:10:02.839697728Z [2024-04-21 00:10:02,839: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:10:02.839992192Z [2024-04-21 00:10:02,839: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:10:02.840741879Z [2024-04-21 00:10:02,840: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:10:02.841012142Z [2024-04-21 00:10:02,840: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:10:02.860890596Z [2024-04-21 00:10:02,860: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:10:02.869066495Z [2024-04-21 00:10:02,868: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:10:02.869543544Z [2024-04-21 00:10:02,869: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:10:02.870003854Z [2024-04-21 00:10:02,869: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:10:02.870466017Z [2024-04-21 00:10:02,870: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:10:02.871086734Z [2024-04-21 00:10:02,870: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:10:02.871494071Z [2024-04-21 00:10:02,871: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:10:02.949374113Z [2024-04-21 00:10:02,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:10:02.959704123Z [2024-04-21 00:10:02,959: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:10:02.963731397Z [2024-04-21 00:10:02,963: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:10:02.968533943Z [2024-04-21 00:10:02,967: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:10:02.994611205Z [2024-04-21 00:10:02,994: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:10:02.995705774Z [2024-04-21 00:10:02,995: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:10:02.995765937Z [2024-04-21 00:10:02,995: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:10:02.995884107Z [2024-04-21 00:10:02,995: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:10:02.995929525Z [2024-04-21 00:10:02,995: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:10:02.996141227Z [2024-04-21 00:10:02,996: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:10:02.998723731Z [2024-04-21 00:10:02,996: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:10:03.088373444Z [2024-04-21 00:10:03,088: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:10:03.734236284Z [2024-04-21 00:10:03,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f64fa50-9d5a-48b8-bf9b-9f0699862354] received 2024-04-21T00:10:03.760279606Z [2024-04-21 00:10:03,760: INFO/ForkPoolWorker-1] [9f64fa50-9d5a-48b8-bf9b-9f0699862354] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:10:03.798131760Z [2024-04-21 00:10:03,797: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ca5d2ecd-599f-4267-a627-822816d288dc] succeeded in 3.179665820000082s: None 2024-04-21T00:10:04.263904254Z [2024-04-21 00:10:04,260: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:10:05.129362977Z [2024-04-21 00:10:05,128: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20ac327a-ad52-4530-bb1a-c30a04c5b416] succeeded in 4.524946958000328s: None 2024-04-21T00:10:05.131920282Z [2024-04-21 00:10:05,131: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[baf8544c-f444-4be5-aab6-ccede5a68c4b] succeeded in 4.5239198999997825s: None 2024-04-21T00:10:05.453195165Z [2024-04-21 00:10:05,452: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:10:05.458432810Z [2024-04-21 00:10:05,457: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:10:05.486241807Z [2024-04-21 00:10:05,485: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:10:05.487986849Z [2024-04-21 00:10:05,487: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:10:05.488001541Z [2024-04-21 00:10:05,487: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:10:05.488352959Z [2024-04-21 00:10:05,488: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:10:05.488499235Z [2024-04-21 00:10:05,488: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:10:05.488987871Z [2024-04-21 00:10:05,488: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:10:05.489187373Z [2024-04-21 00:10:05,488: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:10:05.583765523Z [2024-04-21 00:10:05,583: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:10:06.293558394Z [2024-04-21 00:10:06,291: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f64fa50-9d5a-48b8-bf9b-9f0699862354] succeeded in 2.550114900999688s: None 2024-04-21T00:10:06.435222438Z [2024-04-21 00:10:06,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[627e6f6d-108c-4270-ad03-5ebee088564c] received 2024-04-21T00:10:06.451708946Z [2024-04-21 00:10:06,451: INFO/ForkPoolWorker-15] [627e6f6d-108c-4270-ad03-5ebee088564c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:10:06.752438260Z [2024-04-21 00:10:06,749: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:10:07.889648529Z [2024-04-21 00:10:07,889: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:10:07.892902186Z [2024-04-21 00:10:07,892: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:10:07.926011083Z [2024-04-21 00:10:07,925: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:10:07.926951943Z [2024-04-21 00:10:07,926: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:10:07.926987877Z [2024-04-21 00:10:07,926: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:10:07.927168187Z [2024-04-21 00:10:07,926: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:10:07.927195422Z [2024-04-21 00:10:07,927: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:10:07.927353614Z [2024-04-21 00:10:07,927: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:10:07.927364649Z [2024-04-21 00:10:07,927: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:10:08.026132354Z [2024-04-21 00:10:08,025: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:10:08.590077477Z [2024-04-21 00:10:08,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[627e6f6d-108c-4270-ad03-5ebee088564c] succeeded in 2.1492549610002243s: None 2024-04-21T00:10:08.833219133Z [2024-04-21 00:10:08,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a39bb450-3253-44e4-baba-76606d4cfb30] received 2024-04-21T00:10:08.852253876Z [2024-04-21 00:10:08,851: INFO/ForkPoolWorker-15] [a39bb450-3253-44e4-baba-76606d4cfb30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:10:09.131654385Z [2024-04-21 00:10:09,127: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:10:10.231561064Z [2024-04-21 00:10:10,231: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:10:10.234575427Z [2024-04-21 00:10:10,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:10:10.255189969Z [2024-04-21 00:10:10,254: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:10:10.256470480Z [2024-04-21 00:10:10,256: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:10:10.256644007Z [2024-04-21 00:10:10,256: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:10:10.256912491Z [2024-04-21 00:10:10,256: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:10:10.257059792Z [2024-04-21 00:10:10,256: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:10:10.257340102Z [2024-04-21 00:10:10,257: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:10:10.257507565Z [2024-04-21 00:10:10,257: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:10:10.353734366Z [2024-04-21 00:10:10,353: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:10:11.009016156Z [2024-04-21 00:10:11,008: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a39bb450-3253-44e4-baba-76606d4cfb30] succeeded in 2.173712763000367s: None 2024-04-21T00:11:00.230060678Z [2024-04-21 00:11:00,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecad1416-1ed3-4bc2-9937-3bd770a3e9c6] received 2024-04-21T00:11:00.237965040Z [2024-04-21 00:11:00,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b30827e-7208-4870-9a70-00043d642c1a] received 2024-04-21T00:11:00.240829529Z [2024-04-21 00:11:00,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf3d0d35-568b-4151-82cf-2e87f276ac0a] received 2024-04-21T00:11:00.251494166Z [2024-04-21 00:11:00,251: INFO/ForkPoolWorker-15] [ecad1416-1ed3-4bc2-9937-3bd770a3e9c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:11:00.256196350Z [2024-04-21 00:11:00,255: INFO/ForkPoolWorker-16] [8b30827e-7208-4870-9a70-00043d642c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:11:00.266339479Z [2024-04-21 00:11:00,265: INFO/ForkPoolWorker-1] [bf3d0d35-568b-4151-82cf-2e87f276ac0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:11:00.552441714Z [2024-04-21 00:11:00,549: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:11:00.573200556Z [2024-04-21 00:11:00,570: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:11:00.652086346Z [2024-04-21 00:11:00,648: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:11:00.812684156Z [2024-04-21 00:11:00,812: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:11:00.817091938Z [2024-04-21 00:11:00,816: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:11:00.853279062Z [2024-04-21 00:11:00,853: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:11:00.854060254Z [2024-04-21 00:11:00,853: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:11:00.854127816Z [2024-04-21 00:11:00,853: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:11:00.854144736Z [2024-04-21 00:11:00,854: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:11:00.854332472Z [2024-04-21 00:11:00,854: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:11:00.955509425Z [2024-04-21 00:11:00,955: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:11:01.624787291Z [2024-04-21 00:11:01,624: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf3d0d35-568b-4151-82cf-2e87f276ac0a] succeeded in 1.378448176999882s: None 2024-04-21T00:11:01.806023147Z [2024-04-21 00:11:01,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:11:01.810778390Z [2024-04-21 00:11:01,810: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:11:01.829837953Z [2024-04-21 00:11:01,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:11:01.831069209Z [2024-04-21 00:11:01,830: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:11:01.831269028Z [2024-04-21 00:11:01,831: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:11:01.831470020Z [2024-04-21 00:11:01,831: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:11:01.831649838Z [2024-04-21 00:11:01,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:11:01.832037298Z [2024-04-21 00:11:01,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:11:01.832262578Z [2024-04-21 00:11:01,832: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:11:01.863751062Z [2024-04-21 00:11:01,863: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:11:01.866910171Z [2024-04-21 00:11:01,866: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:11:01.906184359Z [2024-04-21 00:11:01,905: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:11:01.907252548Z [2024-04-21 00:11:01,907: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:11:01.907500035Z [2024-04-21 00:11:01,907: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:11:01.907705834Z [2024-04-21 00:11:01,907: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:11:01.908098833Z [2024-04-21 00:11:01,907: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:11:01.908217985Z [2024-04-21 00:11:01,908: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:11:01.909077823Z [2024-04-21 00:11:01,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:11:01.909111759Z [2024-04-21 00:11:01,909: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:11:01.995360514Z [2024-04-21 00:11:01,994: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:11:03.574915359Z [2024-04-21 00:11:03,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ecad1416-1ed3-4bc2-9937-3bd770a3e9c6] succeeded in 3.341771203999997s: None 2024-04-21T00:11:04.888472673Z [2024-04-21 00:11:04,887: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b30827e-7208-4870-9a70-00043d642c1a] succeeded in 4.6430033679998814s: None 2024-04-21T00:12:01.196177655Z [2024-04-21 00:12:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d79ae82c-fd7c-40cc-a545-c129fdefa191] received 2024-04-21T00:12:01.200900327Z [2024-04-21 00:12:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59fdcf6b-7059-476b-8613-b3344ddf9dd2] received 2024-04-21T00:12:01.215506272Z [2024-04-21 00:12:01,215: INFO/ForkPoolWorker-15] [d79ae82c-fd7c-40cc-a545-c129fdefa191] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:12:01.219437481Z [2024-04-21 00:12:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9042008b-633e-4909-82d2-50be4006f774] received 2024-04-21T00:12:01.227989720Z [2024-04-21 00:12:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6610d1be-8932-4cbc-b2f8-7d9721795970] received 2024-04-21T00:12:01.228758432Z [2024-04-21 00:12:01,228: INFO/ForkPoolWorker-1] [9042008b-633e-4909-82d2-50be4006f774] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:12:01.237908018Z [2024-04-21 00:12:01,237: INFO/ForkPoolWorker-16] [59fdcf6b-7059-476b-8613-b3344ddf9dd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:12:01.253041531Z [2024-04-21 00:12:01,252: INFO/ForkPoolWorker-2] [6610d1be-8932-4cbc-b2f8-7d9721795970] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:12:01.574804559Z [2024-04-21 00:12:01,570: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:12:01.605067879Z [2024-04-21 00:12:01,601: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:12:01.723685574Z [2024-04-21 00:12:01,719: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:12:01.822861098Z [2024-04-21 00:12:01,811: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:12:01.823556974Z [2024-04-21 00:12:01,823: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:12:01.827954962Z [2024-04-21 00:12:01,827: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:12:01.851908310Z [2024-04-21 00:12:01,851: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:12:01.856677553Z [2024-04-21 00:12:01,856: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:12:01.856758132Z [2024-04-21 00:12:01,856: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:12:01.856763602Z [2024-04-21 00:12:01,856: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:12:01.858270235Z [2024-04-21 00:12:01,856: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:12:01.974797320Z [2024-04-21 00:12:01,974: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:12:01.975994922Z [2024-04-21 00:12:01,973: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:12:02.817402657Z [2024-04-21 00:12:02,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d79ae82c-fd7c-40cc-a545-c129fdefa191] succeeded in 1.6178955659997882s: None 2024-04-21T00:12:02.978072326Z [2024-04-21 00:12:02,977: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9042008b-633e-4909-82d2-50be4006f774] succeeded in 1.756539342999531s: None 2024-04-21T00:12:03.333840321Z [2024-04-21 00:12:03,333: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:12:03.337045986Z [2024-04-21 00:12:03,336: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:12:03.361183447Z [2024-04-21 00:12:03,360: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:12:03.362727392Z [2024-04-21 00:12:03,362: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:12:03.362761225Z [2024-04-21 00:12:03,362: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:12:03.362903705Z [2024-04-21 00:12:03,362: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:12:03.362952050Z [2024-04-21 00:12:03,362: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:12:03.363170815Z [2024-04-21 00:12:03,363: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:12:03.363214485Z [2024-04-21 00:12:03,363: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:12:03.437690127Z [2024-04-21 00:12:03,437: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:12:03.494358894Z [2024-04-21 00:12:03,493: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:12:03.498354692Z [2024-04-21 00:12:03,497: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:12:03.529521224Z [2024-04-21 00:12:03,529: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:12:03.530685405Z [2024-04-21 00:12:03,530: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:12:03.530743139Z [2024-04-21 00:12:03,530: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:12:03.530883594Z [2024-04-21 00:12:03,530: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:12:03.531008510Z [2024-04-21 00:12:03,530: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:12:03.531450956Z [2024-04-21 00:12:03,531: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:12:03.531853388Z [2024-04-21 00:12:03,531: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:12:03.643567092Z [2024-04-21 00:12:03,643: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:12:05.080704369Z [2024-04-21 00:12:05,080: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59fdcf6b-7059-476b-8613-b3344ddf9dd2] succeeded in 3.873582348999662s: None 2024-04-21T00:12:05.569674937Z [2024-04-21 00:12:05,569: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6610d1be-8932-4cbc-b2f8-7d9721795970] succeeded in 4.3342821759997605s: None 2024-04-21T00:13:01.172971184Z [2024-04-21 00:13:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24591a44-d474-4779-b128-7d0dd7567b43] received 2024-04-21T00:13:01.175938113Z [2024-04-21 00:13:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6282a92-a021-4a63-bc80-a7c61a1ebd15] received 2024-04-21T00:13:01.177912962Z [2024-04-21 00:13:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4681d441-f592-4f98-80ca-3fd789d8f6af] received 2024-04-21T00:13:01.198361185Z [2024-04-21 00:13:01,198: INFO/ForkPoolWorker-15] [24591a44-d474-4779-b128-7d0dd7567b43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:13:01.199981128Z [2024-04-21 00:13:01,199: INFO/ForkPoolWorker-1] [4681d441-f592-4f98-80ca-3fd789d8f6af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:13:01.209280371Z [2024-04-21 00:13:01,197: INFO/ForkPoolWorker-16] [b6282a92-a021-4a63-bc80-a7c61a1ebd15] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:13:01.577526096Z [2024-04-21 00:13:01,573: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:13:01.606050356Z [2024-04-21 00:13:01,602: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:13:01.754863916Z [2024-04-21 00:13:01,751: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:13:01.909652200Z [2024-04-21 00:13:01,909: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:13:01.913978083Z [2024-04-21 00:13:01,913: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:13:01.955138359Z [2024-04-21 00:13:01,954: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:13:01.960525386Z [2024-04-21 00:13:01,960: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:13:01.960715014Z [2024-04-21 00:13:01,960: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:13:01.960838565Z [2024-04-21 00:13:01,960: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:13:01.961088389Z [2024-04-21 00:13:01,960: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:13:02.066927773Z [2024-04-21 00:13:02,066: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:13:02.677233451Z [2024-04-21 00:13:02,676: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6282a92-a021-4a63-bc80-a7c61a1ebd15] succeeded in 1.4979306499999439s: None 2024-04-21T00:13:03.068454046Z [2024-04-21 00:13:03,068: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:13:03.073066553Z [2024-04-21 00:13:03,072: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:13:03.092471582Z [2024-04-21 00:13:03,092: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:13:03.095424286Z [2024-04-21 00:13:03,095: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:13:03.095544361Z [2024-04-21 00:13:03,095: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:13:03.095733809Z [2024-04-21 00:13:03,095: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:13:03.095950507Z [2024-04-21 00:13:03,095: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:13:03.096246089Z [2024-04-21 00:13:03,096: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:13:03.096473333Z [2024-04-21 00:13:03,096: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:13:03.145806605Z [2024-04-21 00:13:03,145: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:13:03.154876791Z [2024-04-21 00:13:03,154: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:13:03.180217175Z [2024-04-21 00:13:03,179: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:13:03.205747171Z [2024-04-21 00:13:03,205: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:13:03.207087268Z [2024-04-21 00:13:03,206: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:13:03.207315714Z [2024-04-21 00:13:03,207: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:13:03.207494542Z [2024-04-21 00:13:03,207: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:13:03.207541080Z [2024-04-21 00:13:03,207: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:13:03.207816832Z [2024-04-21 00:13:03,207: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:13:03.208109581Z [2024-04-21 00:13:03,207: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:13:03.292430005Z [2024-04-21 00:13:03,292: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:13:05.083753809Z [2024-04-21 00:13:05,083: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4681d441-f592-4f98-80ca-3fd789d8f6af] succeeded in 3.9034966380004334s: None 2024-04-21T00:13:05.414513360Z [2024-04-21 00:13:05,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24591a44-d474-4779-b128-7d0dd7567b43] succeeded in 4.236639733000629s: None 2024-04-21T00:14:01.147953480Z [2024-04-21 00:14:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[118aed7e-07a4-4501-aa27-0651506b2b22] received 2024-04-21T00:14:01.149080232Z [2024-04-21 00:14:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ded27b25-23b4-447e-8a33-7284a85e2e28] received 2024-04-21T00:14:01.151084851Z [2024-04-21 00:14:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4578e5a5-8e8b-46b0-8693-7b6060e08567] received 2024-04-21T00:14:01.152363574Z [2024-04-21 00:14:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cb0ffb6-d8f3-4fd5-972c-a656efbb97d0] received 2024-04-21T00:14:01.161554548Z [2024-04-21 00:14:01,161: INFO/ForkPoolWorker-15] [118aed7e-07a4-4501-aa27-0651506b2b22] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:14:01.173486139Z [2024-04-21 00:14:01,173: INFO/ForkPoolWorker-2] [0cb0ffb6-d8f3-4fd5-972c-a656efbb97d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:14:01.182642049Z [2024-04-21 00:14:01,182: INFO/ForkPoolWorker-16] [ded27b25-23b4-447e-8a33-7284a85e2e28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:14:01.188448684Z [2024-04-21 00:14:01,188: INFO/ForkPoolWorker-1] [4578e5a5-8e8b-46b0-8693-7b6060e08567] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:14:01.584274055Z [2024-04-21 00:14:01,580: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:14:01.663131264Z [2024-04-21 00:14:01,658: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:14:01.770296606Z [2024-04-21 00:14:01,761: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:14:01.802609535Z [2024-04-21 00:14:01,799: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:14:01.941243316Z [2024-04-21 00:14:01,940: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:14:02.026830722Z [2024-04-21 00:14:02,026: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:14:02.030845710Z [2024-04-21 00:14:02,030: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:14:02.059985465Z [2024-04-21 00:14:02,059: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:14:02.064666446Z [2024-04-21 00:14:02,064: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:14:02.064806683Z [2024-04-21 00:14:02,064: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:14:02.064907191Z [2024-04-21 00:14:02,064: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:14:02.065199207Z [2024-04-21 00:14:02,065: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:14:02.217207182Z [2024-04-21 00:14:02,216: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:14:02.400710231Z [2024-04-21 00:14:02,400: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[118aed7e-07a4-4501-aa27-0651506b2b22] succeeded in 1.250112953000098s: None 2024-04-21T00:14:02.896056920Z [2024-04-21 00:14:02,895: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0cb0ffb6-d8f3-4fd5-972c-a656efbb97d0] succeeded in 1.7326702489999661s: None 2024-04-21T00:14:02.979929545Z [2024-04-21 00:14:02,977: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:14:02.983573316Z [2024-04-21 00:14:02,982: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:14:03.027469988Z [2024-04-21 00:14:03,027: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:14:03.029069175Z [2024-04-21 00:14:03,028: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:14:03.029237915Z [2024-04-21 00:14:03,029: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:14:03.029489999Z [2024-04-21 00:14:03,029: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:14:03.029650808Z [2024-04-21 00:14:03,029: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:14:03.030028007Z [2024-04-21 00:14:03,029: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:14:03.030204761Z [2024-04-21 00:14:03,030: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:14:03.101806920Z [2024-04-21 00:14:03,101: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:14:03.191448169Z [2024-04-21 00:14:03,191: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:14:03.194776271Z [2024-04-21 00:14:03,194: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:14:03.230942896Z [2024-04-21 00:14:03,230: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:14:03.233100411Z [2024-04-21 00:14:03,232: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:14:03.233377890Z [2024-04-21 00:14:03,233: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:14:03.233690191Z [2024-04-21 00:14:03,233: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:14:03.233910031Z [2024-04-21 00:14:03,233: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:14:03.234671621Z [2024-04-21 00:14:03,234: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:14:03.234938822Z [2024-04-21 00:14:03,234: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:14:03.350854805Z [2024-04-21 00:14:03,350: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:14:04.742508447Z [2024-04-21 00:14:04,741: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ded27b25-23b4-447e-8a33-7284a85e2e28] succeeded in 3.590925994999452s: None 2024-04-21T00:14:05.679129985Z [2024-04-21 00:14:05,678: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4578e5a5-8e8b-46b0-8693-7b6060e08567] succeeded in 4.515647628999432s: None 2024-04-21T00:15:00.939806843Z [2024-04-21 00:15:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82367ba8-0ee3-424b-8aa2-59b05a4203cb] received 2024-04-21T00:15:00.952443432Z [2024-04-21 00:15:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8489c012-2602-4d84-a92e-30939a95d447] received 2024-04-21T00:15:00.955314061Z [2024-04-21 00:15:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23afc4c1-e6c2-42c7-ab62-27193bec102e] received 2024-04-21T00:15:00.957500965Z [2024-04-21 00:15:00,957: INFO/ForkPoolWorker-15] [82367ba8-0ee3-424b-8aa2-59b05a4203cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:15:00.963219402Z [2024-04-21 00:15:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e093479c-c26b-4251-9afd-539b60867f20] received 2024-04-21T00:15:00.964221679Z [2024-04-21 00:15:00,963: INFO/ForkPoolWorker-1] [23afc4c1-e6c2-42c7-ab62-27193bec102e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:15:00.964736386Z [2024-04-21 00:15:00,964: INFO/ForkPoolWorker-16] [8489c012-2602-4d84-a92e-30939a95d447] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:15:01.004772374Z [2024-04-21 00:15:01,004: INFO/ForkPoolWorker-2] [e093479c-c26b-4251-9afd-539b60867f20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:15:01.322344089Z [2024-04-21 00:15:01,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:15:01.381744338Z [2024-04-21 00:15:01,378: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:15:01.505163922Z [2024-04-21 00:15:01,489: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:15:01.609651806Z [2024-04-21 00:15:01,606: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:15:01.634604149Z [2024-04-21 00:15:01,634: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:15:01.643640541Z [2024-04-21 00:15:01,643: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:15:01.713581672Z [2024-04-21 00:15:01,713: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:15:01.718477113Z [2024-04-21 00:15:01,718: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:15:01.718590286Z [2024-04-21 00:15:01,718: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:15:01.718656371Z [2024-04-21 00:15:01,718: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:15:01.718870123Z [2024-04-21 00:15:01,718: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:15:01.842278044Z [2024-04-21 00:15:01,841: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:15:02.464943635Z [2024-04-21 00:15:02,464: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8489c012-2602-4d84-a92e-30939a95d447] succeeded in 1.5096372580001116s: None 2024-04-21T00:15:02.605076926Z [2024-04-21 00:15:02,604: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:15:02.608495608Z [2024-04-21 00:15:02,608: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:15:02.628158255Z [2024-04-21 00:15:02,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:15:02.629935930Z [2024-04-21 00:15:02,629: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:15:02.630146787Z [2024-04-21 00:15:02,629: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:15:02.630324878Z [2024-04-21 00:15:02,630: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:15:02.630466708Z [2024-04-21 00:15:02,630: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:15:02.631482688Z [2024-04-21 00:15:02,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:15:02.631987273Z [2024-04-21 00:15:02,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:15:02.706605425Z [2024-04-21 00:15:02,706: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:15:02.939713293Z [2024-04-21 00:15:02,939: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:15:02.942952567Z [2024-04-21 00:15:02,942: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:15:02.968702666Z [2024-04-21 00:15:02,968: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:15:02.970043642Z [2024-04-21 00:15:02,969: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:15:02.970132994Z [2024-04-21 00:15:02,970: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:15:02.970266294Z [2024-04-21 00:15:02,970: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:15:02.970329109Z [2024-04-21 00:15:02,970: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:15:02.970559307Z [2024-04-21 00:15:02,970: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:15:02.970921196Z [2024-04-21 00:15:02,970: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:15:03.064046727Z [2024-04-21 00:15:03,063: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:15:03.221349902Z [2024-04-21 00:15:03,220: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:15:03.225644963Z [2024-04-21 00:15:03,225: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:15:03.269010475Z [2024-04-21 00:15:03,268: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:15:03.272791730Z [2024-04-21 00:15:03,272: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:15:03.272904056Z [2024-04-21 00:15:03,272: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:15:03.273109948Z [2024-04-21 00:15:03,272: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:15:03.273235474Z [2024-04-21 00:15:03,273: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:15:03.273580400Z [2024-04-21 00:15:03,273: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:15:03.273716024Z [2024-04-21 00:15:03,273: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:15:03.334923799Z [2024-04-21 00:15:03,334: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82367ba8-0ee3-424b-8aa2-59b05a4203cb] succeeded in 2.3899606919994767s: None 2024-04-21T00:15:03.350046493Z [2024-04-21 00:15:03,349: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:15:03.896379338Z [2024-04-21 00:15:03,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce466a84-f750-4b10-8baf-7a1d53760101] received 2024-04-21T00:15:03.902698231Z [2024-04-21 00:15:03,902: INFO/ForkPoolWorker-15] [ce466a84-f750-4b10-8baf-7a1d53760101] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:15:04.269837168Z [2024-04-21 00:15:04,266: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:15:04.688589634Z [2024-04-21 00:15:04,687: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23afc4c1-e6c2-42c7-ab62-27193bec102e] succeeded in 3.731035589000385s: None 2024-04-21T00:15:05.338354094Z [2024-04-21 00:15:05,337: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e093479c-c26b-4251-9afd-539b60867f20] succeeded in 4.35870741600047s: None 2024-04-21T00:15:05.398307060Z [2024-04-21 00:15:05,397: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:15:05.401806191Z [2024-04-21 00:15:05,401: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:15:05.423335994Z [2024-04-21 00:15:05,423: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:15:05.425648664Z [2024-04-21 00:15:05,425: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:15:05.425900628Z [2024-04-21 00:15:05,425: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:15:05.426239650Z [2024-04-21 00:15:05,425: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:15:05.426458996Z [2024-04-21 00:15:05,426: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:15:05.427034992Z [2024-04-21 00:15:05,426: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:15:05.427337758Z [2024-04-21 00:15:05,427: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:15:05.530792402Z [2024-04-21 00:15:05,530: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:15:06.262130483Z [2024-04-21 00:15:06,261: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce466a84-f750-4b10-8baf-7a1d53760101] succeeded in 2.363951487999657s: None 2024-04-21T00:15:06.336092420Z [2024-04-21 00:15:06,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96c16300-95b3-49ed-aa7f-e2ffea0ea0a6] received 2024-04-21T00:15:06.349771290Z [2024-04-21 00:15:06,349: INFO/ForkPoolWorker-15] [96c16300-95b3-49ed-aa7f-e2ffea0ea0a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:15:06.633386596Z [2024-04-21 00:15:06,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:15:07.675247278Z [2024-04-21 00:15:07,674: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:15:07.678613405Z [2024-04-21 00:15:07,678: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:15:07.707443084Z [2024-04-21 00:15:07,707: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:15:07.709215179Z [2024-04-21 00:15:07,708: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:15:07.709296284Z [2024-04-21 00:15:07,709: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:15:07.709490424Z [2024-04-21 00:15:07,709: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:15:07.709564441Z [2024-04-21 00:15:07,709: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:15:07.709864352Z [2024-04-21 00:15:07,709: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:15:07.710041869Z [2024-04-21 00:15:07,709: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:15:07.793369817Z [2024-04-21 00:15:07,793: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:15:08.477946940Z [2024-04-21 00:15:08,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96c16300-95b3-49ed-aa7f-e2ffea0ea0a6] succeeded in 2.1381568420001713s: None 2024-04-21T00:15:08.678502621Z [2024-04-21 00:15:08,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[828125c1-68ed-4ccc-beee-b45e2ff3e8e4] received 2024-04-21T00:15:08.688910517Z [2024-04-21 00:15:08,688: INFO/ForkPoolWorker-15] [828125c1-68ed-4ccc-beee-b45e2ff3e8e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:15:09.015355088Z [2024-04-21 00:15:09,012: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:15:10.125705057Z [2024-04-21 00:15:10,125: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:15:10.128973992Z [2024-04-21 00:15:10,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:15:10.146975933Z [2024-04-21 00:15:10,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:15:10.148220459Z [2024-04-21 00:15:10,147: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:15:10.148382375Z [2024-04-21 00:15:10,148: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:15:10.148668699Z [2024-04-21 00:15:10,148: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:15:10.148862122Z [2024-04-21 00:15:10,148: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:15:10.149522284Z [2024-04-21 00:15:10,149: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:15:10.149683063Z [2024-04-21 00:15:10,149: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:15:10.243758416Z [2024-04-21 00:15:10,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:15:10.864471873Z [2024-04-21 00:15:10,863: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[828125c1-68ed-4ccc-beee-b45e2ff3e8e4] succeeded in 2.1825113790000614s: None 2024-04-21T00:16:00.362629139Z [2024-04-21 00:16:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80354c7b-88cc-4884-8420-ee7d5102b5c4] received 2024-04-21T00:16:00.365938222Z [2024-04-21 00:16:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3adea21-d40d-454e-bc03-5e846dbf97c9] received 2024-04-21T00:16:00.379599344Z [2024-04-21 00:16:00,377: INFO/ForkPoolWorker-15] [80354c7b-88cc-4884-8420-ee7d5102b5c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:16:00.384976510Z [2024-04-21 00:16:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07a22aa7-572f-49fe-942d-79f45c0d28b1] received 2024-04-21T00:16:00.388342615Z [2024-04-21 00:16:00,387: INFO/ForkPoolWorker-16] [d3adea21-d40d-454e-bc03-5e846dbf97c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:16:00.393010410Z [2024-04-21 00:16:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e854bcd-58d2-409a-9071-4f5d3de98d97] received 2024-04-21T00:16:00.405049381Z [2024-04-21 00:16:00,404: INFO/ForkPoolWorker-2] [5e854bcd-58d2-409a-9071-4f5d3de98d97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:16:00.416760374Z [2024-04-21 00:16:00,416: INFO/ForkPoolWorker-1] [07a22aa7-572f-49fe-942d-79f45c0d28b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:16:00.720636961Z [2024-04-21 00:16:00,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:16:00.851213271Z [2024-04-21 00:16:00,843: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:16:00.904444330Z [2024-04-21 00:16:00,900: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:16:01.142699792Z [2024-04-21 00:16:01,139: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:16:01.162045998Z [2024-04-21 00:16:01,161: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:16:01.166689475Z [2024-04-21 00:16:01,166: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:16:01.222972963Z [2024-04-21 00:16:01,222: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:16:01.225879407Z [2024-04-21 00:16:01,225: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:16:01.226005688Z [2024-04-21 00:16:01,225: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:16:01.226058250Z [2024-04-21 00:16:01,225: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:16:01.226310037Z [2024-04-21 00:16:01,226: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:16:01.233084872Z [2024-04-21 00:16:01,232: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:16:01.441037580Z [2024-04-21 00:16:01,440: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:16:02.040971681Z [2024-04-21 00:16:02,040: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07a22aa7-572f-49fe-942d-79f45c0d28b1] succeeded in 1.648803326000234s: None 2024-04-21T00:16:02.179573940Z [2024-04-21 00:16:02,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d3adea21-d40d-454e-bc03-5e846dbf97c9] succeeded in 1.8120031659991582s: None 2024-04-21T00:16:02.353577556Z [2024-04-21 00:16:02,353: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:16:02.358132515Z [2024-04-21 00:16:02,357: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:16:02.402892972Z [2024-04-21 00:16:02,402: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:16:02.409044667Z [2024-04-21 00:16:02,407: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:16:02.409061600Z [2024-04-21 00:16:02,407: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:16:02.409065517Z [2024-04-21 00:16:02,408: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:16:02.409069428Z [2024-04-21 00:16:02,408: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:16:02.410383401Z [2024-04-21 00:16:02,409: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:16:02.410614805Z [2024-04-21 00:16:02,410: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:16:02.587902419Z [2024-04-21 00:16:02,587: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:16:02.603529210Z [2024-04-21 00:16:02,603: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:16:02.606761518Z [2024-04-21 00:16:02,606: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:16:02.641874326Z [2024-04-21 00:16:02,641: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:16:02.642982451Z [2024-04-21 00:16:02,642: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:16:02.643115568Z [2024-04-21 00:16:02,642: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:16:02.643331103Z [2024-04-21 00:16:02,643: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:16:02.643467256Z [2024-04-21 00:16:02,643: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:16:02.643835261Z [2024-04-21 00:16:02,643: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:16:02.644027302Z [2024-04-21 00:16:02,643: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:16:02.716645649Z [2024-04-21 00:16:02,716: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:16:04.504903975Z [2024-04-21 00:16:04,504: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5e854bcd-58d2-409a-9071-4f5d3de98d97] succeeded in 4.10722634800004s: None 2024-04-21T00:16:05.795056582Z [2024-04-21 00:16:05,794: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80354c7b-88cc-4884-8420-ee7d5102b5c4] succeeded in 5.4277732350001315s: None 2024-04-21T00:17:00.777641374Z [2024-04-21 00:17:00,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[484c9027-5e5e-43cd-a19a-92a7d0066f40] received 2024-04-21T00:17:00.787035395Z [2024-04-21 00:17:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[964936b0-a348-4cb6-9e73-2968ea49d854] received 2024-04-21T00:17:00.790016936Z [2024-04-21 00:17:00,789: INFO/ForkPoolWorker-15] [484c9027-5e5e-43cd-a19a-92a7d0066f40] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:17:00.801097221Z [2024-04-21 00:17:00,800: INFO/ForkPoolWorker-16] [964936b0-a348-4cb6-9e73-2968ea49d854] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:17:00.812298701Z [2024-04-21 00:17:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4297ca4a-302e-456e-bfd6-9299506cf09b] received 2024-04-21T00:17:00.844423889Z [2024-04-21 00:17:00,844: INFO/ForkPoolWorker-1] [4297ca4a-302e-456e-bfd6-9299506cf09b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:17:01.141893365Z [2024-04-21 00:17:01,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:17:01.204457402Z [2024-04-21 00:17:01,201: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:17:01.211610319Z [2024-04-21 00:17:01,208: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:17:01.399524862Z [2024-04-21 00:17:01,399: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T00:17:01.407762754Z [2024-04-21 00:17:01,407: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:17:01.458419600Z [2024-04-21 00:17:01,458: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:17:01.467725669Z [2024-04-21 00:17:01,463: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:17:01.467744847Z [2024-04-21 00:17:01,463: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:17:01.467748856Z [2024-04-21 00:17:01,463: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T00:17:01.467752005Z [2024-04-21 00:17:01,464: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:17:01.653545248Z [2024-04-21 00:17:01,653: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:17:02.341801521Z [2024-04-21 00:17:02,341: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[484c9027-5e5e-43cd-a19a-92a7d0066f40] succeeded in 1.5617321869995067s: None 2024-04-21T00:17:02.597112430Z [2024-04-21 00:17:02,596: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:17:02.600364319Z [2024-04-21 00:17:02,599: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:17:02.619448195Z [2024-04-21 00:17:02,619: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:17:02.622470242Z [2024-04-21 00:17:02,620: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:17:02.622743217Z [2024-04-21 00:17:02,622: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:17:02.622961040Z [2024-04-21 00:17:02,622: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:17:02.623094024Z [2024-04-21 00:17:02,622: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:17:02.623490725Z [2024-04-21 00:17:02,623: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:17:02.623605024Z [2024-04-21 00:17:02,623: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:17:02.650528098Z [2024-04-21 00:17:02,650: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:17:02.655642268Z [2024-04-21 00:17:02,655: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:17:02.674130080Z [2024-04-21 00:17:02,673: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:17:02.675062899Z [2024-04-21 00:17:02,674: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:17:02.675078582Z [2024-04-21 00:17:02,675: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:17:02.675197098Z [2024-04-21 00:17:02,675: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:17:02.675222766Z [2024-04-21 00:17:02,675: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:17:02.675409960Z [2024-04-21 00:17:02,675: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:17:02.675436349Z [2024-04-21 00:17:02,675: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:17:02.709353672Z [2024-04-21 00:17:02,709: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:17:02.758906345Z [2024-04-21 00:17:02,758: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:17:04.344803183Z [2024-04-21 00:17:04,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4297ca4a-302e-456e-bfd6-9299506cf09b] succeeded in 3.5237717449999764s: None 2024-04-21T00:17:04.548308524Z [2024-04-21 00:17:04,547: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[964936b0-a348-4cb6-9e73-2968ea49d854] succeeded in 3.7573261540001113s: None 2024-04-21T00:18:01.256670045Z [2024-04-21 00:18:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ef7134f-05c0-434a-a783-79fa0c9cebb2] received 2024-04-21T00:18:01.264070183Z [2024-04-21 00:18:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d970771-0b7d-4f4e-9576-23a38cff6840] received 2024-04-21T00:18:01.264637420Z [2024-04-21 00:18:01,264: INFO/ForkPoolWorker-15] [8ef7134f-05c0-434a-a783-79fa0c9cebb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:18:01.275273472Z [2024-04-21 00:18:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afd5b22f-0280-4448-8e9b-1bf066fdfc3b] received 2024-04-21T00:18:01.280589542Z [2024-04-21 00:18:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4685244c-cd76-49aa-9780-abb4922331e4] received 2024-04-21T00:18:01.281973414Z [2024-04-21 00:18:01,281: INFO/ForkPoolWorker-16] [0d970771-0b7d-4f4e-9576-23a38cff6840] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:18:01.289951192Z [2024-04-21 00:18:01,289: INFO/ForkPoolWorker-2] [4685244c-cd76-49aa-9780-abb4922331e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:18:01.294193670Z [2024-04-21 00:18:01,293: INFO/ForkPoolWorker-1] [afd5b22f-0280-4448-8e9b-1bf066fdfc3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:18:01.741457631Z [2024-04-21 00:18:01,738: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:18:01.751073949Z [2024-04-21 00:18:01,748: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:18:01.774325547Z [2024-04-21 00:18:01,766: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:18:01.917766504Z [2024-04-21 00:18:01,910: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:18:01.948152189Z [2024-04-21 00:18:01,947: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:18:01.952393174Z [2024-04-21 00:18:01,951: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:18:01.988730103Z [2024-04-21 00:18:01,988: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:18:01.992567820Z [2024-04-21 00:18:01,992: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:18:01.992646137Z [2024-04-21 00:18:01,992: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:18:01.992727734Z [2024-04-21 00:18:01,992: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:18:01.993142633Z [2024-04-21 00:18:01,992: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:18:02.071628184Z [2024-04-21 00:18:02,071: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:18:02.126326043Z [2024-04-21 00:18:02,126: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:18:02.723148634Z [2024-04-21 00:18:02,722: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d970771-0b7d-4f4e-9576-23a38cff6840] succeeded in 1.4476367699999173s: None 2024-04-21T00:18:02.784158619Z [2024-04-21 00:18:02,783: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4685244c-cd76-49aa-9780-abb4922331e4] succeeded in 1.501034836999679s: None 2024-04-21T00:18:03.140694308Z [2024-04-21 00:18:03,140: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:18:03.143756870Z [2024-04-21 00:18:03,143: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:18:03.176854290Z [2024-04-21 00:18:03,176: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:18:03.178121446Z [2024-04-21 00:18:03,177: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:18:03.178156832Z [2024-04-21 00:18:03,178: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:18:03.178318729Z [2024-04-21 00:18:03,178: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:18:03.178350664Z [2024-04-21 00:18:03,178: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:18:03.178593481Z [2024-04-21 00:18:03,178: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:18:03.178636258Z [2024-04-21 00:18:03,178: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:18:03.261939743Z [2024-04-21 00:18:03,261: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:18:03.628733613Z [2024-04-21 00:18:03,628: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:18:03.632393818Z [2024-04-21 00:18:03,631: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:18:03.659587354Z [2024-04-21 00:18:03,659: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:18:03.672319259Z [2024-04-21 00:18:03,671: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:18:03.672508453Z [2024-04-21 00:18:03,672: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:18:03.672799666Z [2024-04-21 00:18:03,672: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:18:03.672975565Z [2024-04-21 00:18:03,672: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:18:03.673612620Z [2024-04-21 00:18:03,673: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:18:03.673627919Z [2024-04-21 00:18:03,673: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:18:03.763479968Z [2024-04-21 00:18:03,763: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:18:05.045357760Z [2024-04-21 00:18:05,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[afd5b22f-0280-4448-8e9b-1bf066fdfc3b] succeeded in 3.763417674000266s: None 2024-04-21T00:18:05.361221463Z [2024-04-21 00:18:05,360: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ef7134f-05c0-434a-a783-79fa0c9cebb2] succeeded in 4.102974016000189s: None 2024-04-21T00:19:00.585996501Z [2024-04-21 00:19:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dccc417e-96f8-422a-8dc7-2cba211d396c] received 2024-04-21T00:19:00.589352392Z [2024-04-21 00:19:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9eca49e2-6745-4862-b482-1eb0bccd341b] received 2024-04-21T00:19:00.600311189Z [2024-04-21 00:19:00,600: INFO/ForkPoolWorker-15] [dccc417e-96f8-422a-8dc7-2cba211d396c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:19:00.600842857Z [2024-04-21 00:19:00,600: INFO/ForkPoolWorker-16] [9eca49e2-6745-4862-b482-1eb0bccd341b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:19:00.603766012Z [2024-04-21 00:19:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5805b6ab-f7bd-4ea3-82de-9734f13b5d65] received 2024-04-21T00:19:00.624230789Z [2024-04-21 00:19:00,623: INFO/ForkPoolWorker-1] [5805b6ab-f7bd-4ea3-82de-9734f13b5d65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:19:00.919226484Z [2024-04-21 00:19:00,915: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:19:00.920914821Z [2024-04-21 00:19:00,917: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:19:00.935378743Z [2024-04-21 00:19:00,932: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:19:01.115775646Z [2024-04-21 00:19:01,110: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T00:19:01.115799930Z [2024-04-21 00:19:01,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:19:01.153012652Z [2024-04-21 00:19:01,152: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:19:01.156307989Z [2024-04-21 00:19:01,156: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:19:01.156586900Z [2024-04-21 00:19:01,156: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:19:01.156746045Z [2024-04-21 00:19:01,156: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T00:19:01.157033993Z [2024-04-21 00:19:01,156: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:19:01.244566064Z [2024-04-21 00:19:01,244: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:19:01.746171439Z [2024-04-21 00:19:01,745: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dccc417e-96f8-422a-8dc7-2cba211d396c] succeeded in 1.1553944819997923s: None 2024-04-21T00:19:02.199892531Z [2024-04-21 00:19:02,199: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:19:02.204429510Z [2024-04-21 00:19:02,203: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:19:02.230168094Z [2024-04-21 00:19:02,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:19:02.231535254Z [2024-04-21 00:19:02,231: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:19:02.231607261Z [2024-04-21 00:19:02,231: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:19:02.231852142Z [2024-04-21 00:19:02,231: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:19:02.231865801Z [2024-04-21 00:19:02,231: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:19:02.232086560Z [2024-04-21 00:19:02,231: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:19:02.232146733Z [2024-04-21 00:19:02,232: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:19:02.251617532Z [2024-04-21 00:19:02,251: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:19:02.254817200Z [2024-04-21 00:19:02,254: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:19:02.281374070Z [2024-04-21 00:19:02,281: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:19:02.284111711Z [2024-04-21 00:19:02,283: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:19:02.284212069Z [2024-04-21 00:19:02,284: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:19:02.284515827Z [2024-04-21 00:19:02,284: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:19:02.284686077Z [2024-04-21 00:19:02,284: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:19:02.285394358Z [2024-04-21 00:19:02,284: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:19:02.285548349Z [2024-04-21 00:19:02,285: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:19:02.325706931Z [2024-04-21 00:19:02,325: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:19:02.395933509Z [2024-04-21 00:19:02,395: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:19:03.754700794Z [2024-04-21 00:19:03,754: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5805b6ab-f7bd-4ea3-82de-9734f13b5d65] succeeded in 3.1459551380003177s: None 2024-04-21T00:19:04.149538543Z [2024-04-21 00:19:04,149: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9eca49e2-6745-4862-b482-1eb0bccd341b] succeeded in 3.5575138619997233s: None 2024-04-21T00:20:01.214456443Z [2024-04-21 00:20:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46476194-ee2b-458e-aa79-748b179a0c87] received 2024-04-21T00:20:01.220301288Z [2024-04-21 00:20:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d0bf6da-4cd5-477d-91f0-1f7b1ba4aa13] received 2024-04-21T00:20:01.223014355Z [2024-04-21 00:20:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd5604ee-3fda-421c-ae86-8bf361903388] received 2024-04-21T00:20:01.233018669Z [2024-04-21 00:20:01,232: INFO/ForkPoolWorker-16] [5d0bf6da-4cd5-477d-91f0-1f7b1ba4aa13] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:20:01.234221804Z [2024-04-21 00:20:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad21725e-534a-4e1d-9c99-65a4e6a4b161] received 2024-04-21T00:20:01.236176140Z [2024-04-21 00:20:01,235: INFO/ForkPoolWorker-1] [cd5604ee-3fda-421c-ae86-8bf361903388] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:20:01.242340573Z [2024-04-21 00:20:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7fb8f23-a9c8-42ff-ab57-1f2ab0562dbd] received 2024-04-21T00:20:01.244024920Z [2024-04-21 00:20:01,243: INFO/ForkPoolWorker-15] [46476194-ee2b-458e-aa79-748b179a0c87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:20:01.266736151Z [2024-04-21 00:20:01,266: INFO/ForkPoolWorker-2] [ad21725e-534a-4e1d-9c99-65a4e6a4b161] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:20:01.271206439Z [2024-04-21 00:20:01,270: INFO/ForkPoolWorker-3] [c7fb8f23-a9c8-42ff-ab57-1f2ab0562dbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:20:01.628397845Z [2024-04-21 00:20:01,624: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:20:01.676228123Z [2024-04-21 00:20:01,672: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:20:01.812427747Z [2024-04-21 00:20:01,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:20:01.831535642Z [2024-04-21 00:20:01,814: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:20:01.998239465Z [2024-04-21 00:20:01,983: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:20:02.045018989Z [2024-04-21 00:20:02,044: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-21T00:20:02.066531744Z [2024-04-21 00:20:02,066: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:20:02.125670159Z [2024-04-21 00:20:02,125: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T00:20:02.126932104Z [2024-04-21 00:20:02,126: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:20:02.127197348Z [2024-04-21 00:20:02,127: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:20:02.127308225Z [2024-04-21 00:20:02,127: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-21T00:20:02.127636477Z [2024-04-21 00:20:02,127: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:20:02.153704685Z [2024-04-21 00:20:02,153: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:20:02.247079845Z [2024-04-21 00:20:02,246: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:20:02.943732752Z [2024-04-21 00:20:02,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d0bf6da-4cd5-477d-91f0-1f7b1ba4aa13] succeeded in 1.7211159770004087s: None 2024-04-21T00:20:02.970610297Z [2024-04-21 00:20:02,970: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c7fb8f23-a9c8-42ff-ab57-1f2ab0562dbd] succeeded in 1.7208433890000379s: None 2024-04-21T00:20:03.472588667Z [2024-04-21 00:20:03,472: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:20:03.476198199Z [2024-04-21 00:20:03,475: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:20:03.494275722Z [2024-04-21 00:20:03,494: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:20:03.496295911Z [2024-04-21 00:20:03,496: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:20:03.496398902Z [2024-04-21 00:20:03,496: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:20:03.496586168Z [2024-04-21 00:20:03,496: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:20:03.496761389Z [2024-04-21 00:20:03,496: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:20:03.497074859Z [2024-04-21 00:20:03,496: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:20:03.497793794Z [2024-04-21 00:20:03,497: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:20:03.545325424Z [2024-04-21 00:20:03,544: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:20:03.554789452Z [2024-04-21 00:20:03,554: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:20:03.579630912Z [2024-04-21 00:20:03,579: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:20:03.580900655Z [2024-04-21 00:20:03,580: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:20:03.581064334Z [2024-04-21 00:20:03,580: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:20:03.581311822Z [2024-04-21 00:20:03,581: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:20:03.581447359Z [2024-04-21 00:20:03,581: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:20:03.581738915Z [2024-04-21 00:20:03,581: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:20:03.581853830Z [2024-04-21 00:20:03,581: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:20:03.602356948Z [2024-04-21 00:20:03,602: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:20:03.602930374Z [2024-04-21 00:20:03,602: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:20:03.606193530Z [2024-04-21 00:20:03,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:20:03.642080403Z [2024-04-21 00:20:03,641: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:20:03.643347864Z [2024-04-21 00:20:03,643: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:20:03.643498237Z [2024-04-21 00:20:03,643: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:20:03.643718250Z [2024-04-21 00:20:03,643: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:20:03.643819622Z [2024-04-21 00:20:03,643: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:20:03.644094791Z [2024-04-21 00:20:03,643: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:20:03.644254899Z [2024-04-21 00:20:03,644: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:20:03.677621978Z [2024-04-21 00:20:03,677: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:20:03.734114483Z [2024-04-21 00:20:03,733: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:20:04.480565330Z [2024-04-21 00:20:04,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46476194-ee2b-458e-aa79-748b179a0c87] succeeded in 3.263726604999647s: None 2024-04-21T00:20:04.517552375Z [2024-04-21 00:20:04,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bc0625d-4a60-49f4-9b0c-6735a6d974ea] received 2024-04-21T00:20:04.529017753Z [2024-04-21 00:20:04,528: INFO/ForkPoolWorker-15] [8bc0625d-4a60-49f4-9b0c-6735a6d974ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:20:04.813141820Z [2024-04-21 00:20:04,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:20:05.289923600Z [2024-04-21 00:20:05,289: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ad21725e-534a-4e1d-9c99-65a4e6a4b161] succeeded in 4.040425846999824s: None 2024-04-21T00:20:05.916452689Z [2024-04-21 00:20:05,913: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:20:05.917470872Z [2024-04-21 00:20:05,917: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:20:05.941755761Z [2024-04-21 00:20:05,941: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:20:05.943106570Z [2024-04-21 00:20:05,942: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:20:05.943147581Z [2024-04-21 00:20:05,943: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:20:05.943385284Z [2024-04-21 00:20:05,943: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:20:05.943483771Z [2024-04-21 00:20:05,943: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:20:05.943934522Z [2024-04-21 00:20:05,943: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:20:05.944037628Z [2024-04-21 00:20:05,943: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:20:05.948490141Z [2024-04-21 00:20:05,947: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd5604ee-3fda-421c-ae86-8bf361903388] succeeded in 4.723824761000287s: None 2024-04-21T00:20:06.022707998Z [2024-04-21 00:20:06,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:20:06.746245410Z [2024-04-21 00:20:06,745: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8bc0625d-4a60-49f4-9b0c-6735a6d974ea] succeeded in 2.2255247990005955s: None 2024-04-21T00:20:06.964477272Z [2024-04-21 00:20:06,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[774ba204-9660-4044-8702-cc000429e3c4] received 2024-04-21T00:20:06.972052594Z [2024-04-21 00:20:06,971: INFO/ForkPoolWorker-15] [774ba204-9660-4044-8702-cc000429e3c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:20:07.276437448Z [2024-04-21 00:20:07,259: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:20:08.351183211Z [2024-04-21 00:20:08,350: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:20:08.354505827Z [2024-04-21 00:20:08,353: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:20:08.382610478Z [2024-04-21 00:20:08,382: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:20:08.384230002Z [2024-04-21 00:20:08,383: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:20:08.384412706Z [2024-04-21 00:20:08,384: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:20:08.384668439Z [2024-04-21 00:20:08,384: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:20:08.384853796Z [2024-04-21 00:20:08,384: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:20:08.385540013Z [2024-04-21 00:20:08,385: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:20:08.385748539Z [2024-04-21 00:20:08,385: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:20:08.477542688Z [2024-04-21 00:20:08,477: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:20:09.078292424Z [2024-04-21 00:20:09,077: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[774ba204-9660-4044-8702-cc000429e3c4] succeeded in 2.1112939989998267s: None 2024-04-21T00:20:10.022450200Z [2024-04-21 00:20:10,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27dc029e-a49e-4097-9dcd-1a29cfe0467e] received 2024-04-21T00:20:10.029579147Z [2024-04-21 00:20:10,029: INFO/ForkPoolWorker-15] [27dc029e-a49e-4097-9dcd-1a29cfe0467e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:20:10.324561193Z [2024-04-21 00:20:10,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:20:11.390571281Z [2024-04-21 00:20:11,390: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:20:11.393721037Z [2024-04-21 00:20:11,393: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:20:11.418406431Z [2024-04-21 00:20:11,418: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:20:11.420017974Z [2024-04-21 00:20:11,419: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:20:11.420216894Z [2024-04-21 00:20:11,419: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:20:11.420317308Z [2024-04-21 00:20:11,419: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:20:11.420370635Z [2024-04-21 00:20:11,419: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:20:11.420739641Z [2024-04-21 00:20:11,420: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:20:11.420925478Z [2024-04-21 00:20:11,420: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:20:11.543912648Z [2024-04-21 00:20:11,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:20:12.205097977Z [2024-04-21 00:20:12,204: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27dc029e-a49e-4097-9dcd-1a29cfe0467e] succeeded in 2.180293318000622s: None 2024-04-21T00:21:00.257196458Z [2024-04-21 00:21:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de41dcbb-9253-4235-9102-c80206672537] received 2024-04-21T00:21:00.260880068Z [2024-04-21 00:21:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f990773-572a-45ce-85c8-aa0a02ffdd28] received 2024-04-21T00:21:00.263854710Z [2024-04-21 00:21:00,263: INFO/ForkPoolWorker-15] [de41dcbb-9253-4235-9102-c80206672537] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:21:00.263916471Z [2024-04-21 00:21:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7822f483-eb78-4566-82d9-5c9f97a6b033] received 2024-04-21T00:21:00.275188229Z [2024-04-21 00:21:00,274: INFO/ForkPoolWorker-16] [7f990773-572a-45ce-85c8-aa0a02ffdd28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:21:00.278057723Z [2024-04-21 00:21:00,277: INFO/ForkPoolWorker-1] [7822f483-eb78-4566-82d9-5c9f97a6b033] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:21:00.516438394Z [2024-04-21 00:21:00,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:21:00.547206084Z [2024-04-21 00:21:00,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:21:00.552667959Z [2024-04-21 00:21:00,549: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:21:00.708155387Z [2024-04-21 00:21:00,707: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:21:00.712166157Z [2024-04-21 00:21:00,711: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:21:00.748419293Z [2024-04-21 00:21:00,748: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:21:00.750084564Z [2024-04-21 00:21:00,749: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:21:00.750215066Z [2024-04-21 00:21:00,750: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:21:00.750331763Z [2024-04-21 00:21:00,750: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:21:00.750569151Z [2024-04-21 00:21:00,750: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:21:00.851252464Z [2024-04-21 00:21:00,850: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:21:01.445240848Z [2024-04-21 00:21:01,444: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7822f483-eb78-4566-82d9-5c9f97a6b033] succeeded in 1.1795378079996226s: None 2024-04-21T00:21:01.666578095Z [2024-04-21 00:21:01,666: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:21:01.669989511Z [2024-04-21 00:21:01,669: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:21:01.691968773Z [2024-04-21 00:21:01,691: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:21:01.696404696Z [2024-04-21 00:21:01,696: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:21:01.696484228Z [2024-04-21 00:21:01,696: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:21:01.696634283Z [2024-04-21 00:21:01,696: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:21:01.696692615Z [2024-04-21 00:21:01,696: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:21:01.697084154Z [2024-04-21 00:21:01,696: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:21:01.697180968Z [2024-04-21 00:21:01,697: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:21:01.784201666Z [2024-04-21 00:21:01,783: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:21:01.807995302Z [2024-04-21 00:21:01,807: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:21:01.812267344Z [2024-04-21 00:21:01,811: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:21:01.836402876Z [2024-04-21 00:21:01,836: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:21:01.838360814Z [2024-04-21 00:21:01,838: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:21:01.838505765Z [2024-04-21 00:21:01,838: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:21:01.838708706Z [2024-04-21 00:21:01,838: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:21:01.838838055Z [2024-04-21 00:21:01,838: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:21:01.839234853Z [2024-04-21 00:21:01,839: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:21:01.839612358Z [2024-04-21 00:21:01,839: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:21:01.938217179Z [2024-04-21 00:21:01,938: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:21:03.587737313Z [2024-04-21 00:21:03,587: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f990773-572a-45ce-85c8-aa0a02ffdd28] succeeded in 3.325273233000189s: None 2024-04-21T00:21:03.714681547Z [2024-04-21 00:21:03,714: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de41dcbb-9253-4235-9102-c80206672537] succeeded in 3.455865320999692s: None 2024-04-21T00:22:01.183241703Z [2024-04-21 00:22:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec71edad-b9b3-4aeb-9566-2d801a6ddd2b] received 2024-04-21T00:22:01.185158382Z [2024-04-21 00:22:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2fce0c5-2b05-40d1-b7bd-adbaaba1cefa] received 2024-04-21T00:22:01.190637450Z [2024-04-21 00:22:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf62a383-cee1-4e56-a4a9-45e038c1ad3a] received 2024-04-21T00:22:01.196106061Z [2024-04-21 00:22:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d327c0dd-c9bc-468d-8a50-60a834a359c3] received 2024-04-21T00:22:01.207496964Z [2024-04-21 00:22:01,207: INFO/ForkPoolWorker-1] [cf62a383-cee1-4e56-a4a9-45e038c1ad3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:22:01.209390822Z [2024-04-21 00:22:01,208: INFO/ForkPoolWorker-2] [d327c0dd-c9bc-468d-8a50-60a834a359c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:22:01.221155265Z [2024-04-21 00:22:01,220: INFO/ForkPoolWorker-16] [b2fce0c5-2b05-40d1-b7bd-adbaaba1cefa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:22:01.225359665Z [2024-04-21 00:22:01,225: INFO/ForkPoolWorker-15] [ec71edad-b9b3-4aeb-9566-2d801a6ddd2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:22:01.657513877Z [2024-04-21 00:22:01,653: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:22:01.667986458Z [2024-04-21 00:22:01,664: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:22:01.695449063Z [2024-04-21 00:22:01,691: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:22:01.826975441Z [2024-04-21 00:22:01,822: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:22:01.934823022Z [2024-04-21 00:22:01,934: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:22:02.086243385Z [2024-04-21 00:22:02,085: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:22:02.099436067Z [2024-04-21 00:22:02,098: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:22:02.169612396Z [2024-04-21 00:22:02,169: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:22:02.181120677Z [2024-04-21 00:22:02,180: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:22:02.181220567Z [2024-04-21 00:22:02,181: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:22:02.181304486Z [2024-04-21 00:22:02,181: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:22:02.182143012Z [2024-04-21 00:22:02,181: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:22:02.280044969Z [2024-04-21 00:22:02,279: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:22:02.531280229Z [2024-04-21 00:22:02,530: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec71edad-b9b3-4aeb-9566-2d801a6ddd2b] succeeded in 1.3399693709998246s: None 2024-04-21T00:22:02.890615692Z [2024-04-21 00:22:02,890: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf62a383-cee1-4e56-a4a9-45e038c1ad3a] succeeded in 1.69309469000018s: None 2024-04-21T00:22:03.032519466Z [2024-04-21 00:22:03,029: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:22:03.033493015Z [2024-04-21 00:22:03,033: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:22:03.058159298Z [2024-04-21 00:22:03,055: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:22:03.058181015Z [2024-04-21 00:22:03,057: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:22:03.058184672Z [2024-04-21 00:22:03,057: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:22:03.058188957Z [2024-04-21 00:22:03,057: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:22:03.058192732Z [2024-04-21 00:22:03,057: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:22:03.058195986Z [2024-04-21 00:22:03,057: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:22:03.058199011Z [2024-04-21 00:22:03,057: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:22:03.150324149Z [2024-04-21 00:22:03,150: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:22:03.228871854Z [2024-04-21 00:22:03,228: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:22:03.232556291Z [2024-04-21 00:22:03,232: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:22:03.249112633Z [2024-04-21 00:22:03,248: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:22:03.250170271Z [2024-04-21 00:22:03,250: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:22:03.250203836Z [2024-04-21 00:22:03,250: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:22:03.250327173Z [2024-04-21 00:22:03,250: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:22:03.250352891Z [2024-04-21 00:22:03,250: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:22:03.250537360Z [2024-04-21 00:22:03,250: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:22:03.250566378Z [2024-04-21 00:22:03,250: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:22:03.331258445Z [2024-04-21 00:22:03,330: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:22:04.916423452Z [2024-04-21 00:22:04,916: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2fce0c5-2b05-40d1-b7bd-adbaaba1cefa] succeeded in 3.7260820379997313s: None 2024-04-21T00:22:06.135388875Z [2024-04-21 00:22:06,134: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d327c0dd-c9bc-468d-8a50-60a834a359c3] succeeded in 4.933840928000791s: None 2024-04-21T00:23:00.967698768Z [2024-04-21 00:23:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f79cb8a5-686b-43a6-8a15-d795008f17da] received 2024-04-21T00:23:00.975383206Z [2024-04-21 00:23:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d382f13c-2100-430b-b699-a330ad2e9896] received 2024-04-21T00:23:00.978743253Z [2024-04-21 00:23:00,978: INFO/ForkPoolWorker-15] [f79cb8a5-686b-43a6-8a15-d795008f17da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:23:00.984598573Z [2024-04-21 00:23:00,984: INFO/ForkPoolWorker-16] [d382f13c-2100-430b-b699-a330ad2e9896] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:23:01.003253953Z [2024-04-21 00:23:01,002: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec7fe581-0f8d-46f9-b1a2-71c6aaa1c034] received 2024-04-21T00:23:01.014424024Z [2024-04-21 00:23:01,014: INFO/ForkPoolWorker-1] [ec7fe581-0f8d-46f9-b1a2-71c6aaa1c034] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:23:01.332746733Z [2024-04-21 00:23:01,329: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:23:01.371095981Z [2024-04-21 00:23:01,367: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:23:01.394586078Z [2024-04-21 00:23:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:23:01.555976507Z [2024-04-21 00:23:01,547: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:23:01.561554706Z [2024-04-21 00:23:01,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:23:01.620045503Z [2024-04-21 00:23:01,619: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:23:01.640291316Z [2024-04-21 00:23:01,640: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:23:01.643090517Z [2024-04-21 00:23:01,640: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:23:01.643405615Z [2024-04-21 00:23:01,643: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:23:01.643736395Z [2024-04-21 00:23:01,643: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:23:01.748393582Z [2024-04-21 00:23:01,748: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:23:02.334793440Z [2024-04-21 00:23:02,334: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec7fe581-0f8d-46f9-b1a2-71c6aaa1c034] succeeded in 1.3298284749998857s: None 2024-04-21T00:23:02.597747648Z [2024-04-21 00:23:02,597: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:23:02.600932699Z [2024-04-21 00:23:02,600: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:23:02.627631484Z [2024-04-21 00:23:02,627: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:23:02.629008616Z [2024-04-21 00:23:02,628: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:23:02.629121853Z [2024-04-21 00:23:02,628: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:23:02.629507347Z [2024-04-21 00:23:02,629: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:23:02.629598644Z [2024-04-21 00:23:02,629: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:23:02.629829577Z [2024-04-21 00:23:02,629: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:23:02.629917799Z [2024-04-21 00:23:02,629: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:23:02.722685649Z [2024-04-21 00:23:02,722: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:23:02.791037489Z [2024-04-21 00:23:02,790: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:23:02.795984996Z [2024-04-21 00:23:02,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:23:02.820799587Z [2024-04-21 00:23:02,820: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:23:02.822141490Z [2024-04-21 00:23:02,821: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:23:02.822301892Z [2024-04-21 00:23:02,822: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:23:02.822517062Z [2024-04-21 00:23:02,822: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:23:02.822634457Z [2024-04-21 00:23:02,822: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:23:02.823034335Z [2024-04-21 00:23:02,822: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:23:02.823191749Z [2024-04-21 00:23:02,823: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:23:02.921384656Z [2024-04-21 00:23:02,921: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:23:04.918688135Z [2024-04-21 00:23:04,918: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d382f13c-2100-430b-b699-a330ad2e9896] succeeded in 3.9411906940003973s: None 2024-04-21T00:23:05.815894437Z [2024-04-21 00:23:05,815: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f79cb8a5-686b-43a6-8a15-d795008f17da] succeeded in 4.844682183999794s: None 2024-04-21T00:24:00.805484531Z [2024-04-21 00:24:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fd0e255-ac38-4389-b565-0d87ce9b3e52] received 2024-04-21T00:24:00.808072337Z [2024-04-21 00:24:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69c81a4b-e9c3-42e0-a2cb-058cc0e851bc] received 2024-04-21T00:24:00.816920296Z [2024-04-21 00:24:00,816: INFO/ForkPoolWorker-16] [69c81a4b-e9c3-42e0-a2cb-058cc0e851bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:24:00.822422279Z [2024-04-21 00:24:00,822: INFO/ForkPoolWorker-15] [2fd0e255-ac38-4389-b565-0d87ce9b3e52] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:24:00.826329515Z [2024-04-21 00:24:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f9d53b0-a4a5-4abd-92f9-3778080b9f3e] received 2024-04-21T00:24:00.828802426Z [2024-04-21 00:24:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5367142-b212-4237-bdf3-72996ce28985] received 2024-04-21T00:24:00.839244351Z [2024-04-21 00:24:00,838: INFO/ForkPoolWorker-1] [7f9d53b0-a4a5-4abd-92f9-3778080b9f3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:24:00.839529316Z [2024-04-21 00:24:00,839: INFO/ForkPoolWorker-2] [f5367142-b212-4237-bdf3-72996ce28985] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:24:01.194200045Z [2024-04-21 00:24:01,190: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:24:01.226169553Z [2024-04-21 00:24:01,222: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:24:01.274845793Z [2024-04-21 00:24:01,271: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:24:01.372389142Z [2024-04-21 00:24:01,369: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:24:01.606693082Z [2024-04-21 00:24:01,606: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:24:01.623493071Z [2024-04-21 00:24:01,623: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:24:01.641835573Z [2024-04-21 00:24:01,641: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:24:01.732276078Z [2024-04-21 00:24:01,732: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:24:01.735882305Z [2024-04-21 00:24:01,735: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:24:01.738880385Z [2024-04-21 00:24:01,735: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:24:01.739056488Z [2024-04-21 00:24:01,738: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:24:01.739367020Z [2024-04-21 00:24:01,739: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:24:01.958308190Z [2024-04-21 00:24:01,958: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:24:02.379319630Z [2024-04-21 00:24:02,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2fd0e255-ac38-4389-b565-0d87ce9b3e52] succeeded in 1.5714828910004144s: None 2024-04-21T00:24:02.684015591Z [2024-04-21 00:24:02,683: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f5367142-b212-4237-bdf3-72996ce28985] succeeded in 1.8531061019994013s: None 2024-04-21T00:24:02.714975337Z [2024-04-21 00:24:02,714: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:24:02.718599071Z [2024-04-21 00:24:02,717: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:24:02.750157907Z [2024-04-21 00:24:02,749: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:24:02.751713607Z [2024-04-21 00:24:02,751: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:24:02.751989508Z [2024-04-21 00:24:02,751: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:24:02.752151386Z [2024-04-21 00:24:02,751: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:24:02.752220894Z [2024-04-21 00:24:02,752: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:24:02.752509130Z [2024-04-21 00:24:02,752: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:24:02.752574794Z [2024-04-21 00:24:02,752: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:24:02.772411953Z [2024-04-21 00:24:02,772: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:24:02.775435607Z [2024-04-21 00:24:02,775: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:24:02.798260877Z [2024-04-21 00:24:02,798: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:24:02.799509041Z [2024-04-21 00:24:02,799: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:24:02.799519768Z [2024-04-21 00:24:02,799: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:24:02.799643287Z [2024-04-21 00:24:02,799: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:24:02.799665265Z [2024-04-21 00:24:02,799: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:24:02.799981485Z [2024-04-21 00:24:02,799: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:24:02.799994090Z [2024-04-21 00:24:02,799: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:24:02.844111837Z [2024-04-21 00:24:02,843: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:24:02.912664043Z [2024-04-21 00:24:02,912: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:24:05.305164717Z [2024-04-21 00:24:05,304: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7f9d53b0-a4a5-4abd-92f9-3778080b9f3e] succeeded in 4.476142577999781s: None 2024-04-21T00:24:06.111588335Z [2024-04-21 00:24:06,110: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69c81a4b-e9c3-42e0-a2cb-058cc0e851bc] succeeded in 5.301523810999242s: None 2024-04-21T00:25:00.416863444Z [2024-04-21 00:25:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7c76393-5b13-497f-aa71-92686b4a11fc] received 2024-04-21T00:25:00.419910130Z [2024-04-21 00:25:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf113f9a-e5c9-4167-999e-7ca065065e43] received 2024-04-21T00:25:00.424141807Z [2024-04-21 00:25:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d28967b5-6665-4179-8714-d061f2b9fdef] received 2024-04-21T00:25:00.428420614Z [2024-04-21 00:25:00,427: INFO/ForkPoolWorker-15] [a7c76393-5b13-497f-aa71-92686b4a11fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:25:00.429964516Z [2024-04-21 00:25:00,429: INFO/ForkPoolWorker-16] [cf113f9a-e5c9-4167-999e-7ca065065e43] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:25:00.432457307Z [2024-04-21 00:25:00,432: INFO/ForkPoolWorker-1] [d28967b5-6665-4179-8714-d061f2b9fdef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:25:00.673389999Z [2024-04-21 00:25:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[624ecfc9-b541-4eb7-a140-98d400cf384d] received 2024-04-21T00:25:00.683126589Z [2024-04-21 00:25:00,682: INFO/ForkPoolWorker-2] [624ecfc9-b541-4eb7-a140-98d400cf384d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:25:00.706549746Z [2024-04-21 00:25:00,703: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:25:00.708918092Z [2024-04-21 00:25:00,705: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:25:00.789914336Z [2024-04-21 00:25:00,781: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:25:00.870740243Z [2024-04-21 00:25:00,870: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:25:00.874546789Z [2024-04-21 00:25:00,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:25:00.895826160Z [2024-04-21 00:25:00,895: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:25:00.896806618Z [2024-04-21 00:25:00,896: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:25:00.897017226Z [2024-04-21 00:25:00,896: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:25:00.897100211Z [2024-04-21 00:25:00,896: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:25:00.897307000Z [2024-04-21 00:25:00,897: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:25:01.020686554Z [2024-04-21 00:25:01,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:25:01.079880702Z [2024-04-21 00:25:01,075: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:25:01.649308961Z [2024-04-21 00:25:01,648: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf113f9a-e5c9-4167-999e-7ca065065e43] succeeded in 1.2271873440004128s: None 2024-04-21T00:25:01.990832762Z [2024-04-21 00:25:01,990: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:25:01.994291355Z [2024-04-21 00:25:01,993: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:25:02.023849621Z [2024-04-21 00:25:02,023: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:25:02.025541770Z [2024-04-21 00:25:02,025: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:25:02.025817629Z [2024-04-21 00:25:02,025: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:25:02.026073839Z [2024-04-21 00:25:02,025: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:25:02.026418474Z [2024-04-21 00:25:02,026: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:25:02.027054531Z [2024-04-21 00:25:02,026: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:25:02.027243304Z [2024-04-21 00:25:02,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:25:02.135082234Z [2024-04-21 00:25:02,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:25:02.258713054Z [2024-04-21 00:25:02,258: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:25:02.262381306Z [2024-04-21 00:25:02,261: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:25:02.309930523Z [2024-04-21 00:25:02,309: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:25:02.312511757Z [2024-04-21 00:25:02,312: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:25:02.312695153Z [2024-04-21 00:25:02,312: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:25:02.312916168Z [2024-04-21 00:25:02,312: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:25:02.313053951Z [2024-04-21 00:25:02,312: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:25:02.313344391Z [2024-04-21 00:25:02,313: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:25:02.313544122Z [2024-04-21 00:25:02,313: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:25:02.416339915Z [2024-04-21 00:25:02,416: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:25:02.512842846Z [2024-04-21 00:25:02,512: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:25:02.516142496Z [2024-04-21 00:25:02,515: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:25:02.544707333Z [2024-04-21 00:25:02,544: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:25:02.546296942Z [2024-04-21 00:25:02,546: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:25:02.546703315Z [2024-04-21 00:25:02,546: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:25:02.547001604Z [2024-04-21 00:25:02,546: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:25:02.547151503Z [2024-04-21 00:25:02,546: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:25:02.547509618Z [2024-04-21 00:25:02,547: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:25:02.547656794Z [2024-04-21 00:25:02,547: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:25:02.629280320Z [2024-04-21 00:25:02,629: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:25:02.827482015Z [2024-04-21 00:25:02,826: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7c76393-5b13-497f-aa71-92686b4a11fc] succeeded in 2.4073580569993283s: None 2024-04-21T00:25:03.408316956Z [2024-04-21 00:25:03,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6c0d1e3-351f-4c2f-8088-405b35aa0756] received 2024-04-21T00:25:03.419422733Z [2024-04-21 00:25:03,419: INFO/ForkPoolWorker-15] [e6c0d1e3-351f-4c2f-8088-405b35aa0756] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:25:03.708298321Z [2024-04-21 00:25:03,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:25:04.001997574Z [2024-04-21 00:25:04,001: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d28967b5-6665-4179-8714-d061f2b9fdef] succeeded in 3.5760958240007312s: None 2024-04-21T00:25:04.935574936Z [2024-04-21 00:25:04,935: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:25:04.938821237Z [2024-04-21 00:25:04,938: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:25:04.960945097Z [2024-04-21 00:25:04,960: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:25:04.962475265Z [2024-04-21 00:25:04,962: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:25:04.962746915Z [2024-04-21 00:25:04,962: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:25:04.963068572Z [2024-04-21 00:25:04,962: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:25:04.963225099Z [2024-04-21 00:25:04,963: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:25:04.963627939Z [2024-04-21 00:25:04,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:25:04.964064857Z [2024-04-21 00:25:04,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:25:05.047760078Z [2024-04-21 00:25:05,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:25:05.686668886Z [2024-04-21 00:25:05,684: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[624ecfc9-b541-4eb7-a140-98d400cf384d] succeeded in 5.008766668000135s: None 2024-04-21T00:25:05.760454440Z [2024-04-21 00:25:05,760: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6c0d1e3-351f-4c2f-8088-405b35aa0756] succeeded in 2.3502937530001873s: None 2024-04-21T00:25:06.443856528Z [2024-04-21 00:25:06,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5bdd6cb-8f79-4310-bd16-b10883a3376c] received 2024-04-21T00:25:06.453162478Z [2024-04-21 00:25:06,452: INFO/ForkPoolWorker-15] [d5bdd6cb-8f79-4310-bd16-b10883a3376c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:25:06.796024961Z [2024-04-21 00:25:06,792: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:25:07.832128526Z [2024-04-21 00:25:07,831: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:25:07.835401151Z [2024-04-21 00:25:07,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:25:07.854536712Z [2024-04-21 00:25:07,854: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:25:07.856066180Z [2024-04-21 00:25:07,855: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:25:07.856363393Z [2024-04-21 00:25:07,856: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:25:07.856647917Z [2024-04-21 00:25:07,856: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:25:07.856826631Z [2024-04-21 00:25:07,856: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:25:07.857206423Z [2024-04-21 00:25:07,857: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:25:07.857488046Z [2024-04-21 00:25:07,857: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:25:07.947177936Z [2024-04-21 00:25:07,946: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:25:08.527714691Z [2024-04-21 00:25:08,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5bdd6cb-8f79-4310-bd16-b10883a3376c] succeeded in 2.082100859000093s: None 2024-04-21T00:25:08.544397870Z [2024-04-21 00:25:08,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20025c91-c510-45da-8745-12415613e156] received 2024-04-21T00:25:08.552430350Z [2024-04-21 00:25:08,552: INFO/ForkPoolWorker-15] [20025c91-c510-45da-8745-12415613e156] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:25:08.870798711Z [2024-04-21 00:25:08,867: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:25:09.979795044Z [2024-04-21 00:25:09,979: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:25:09.983269923Z [2024-04-21 00:25:09,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:25:10.014300374Z [2024-04-21 00:25:10,013: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:25:10.017012386Z [2024-04-21 00:25:10,015: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:25:10.017048647Z [2024-04-21 00:25:10,016: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:25:10.017058760Z [2024-04-21 00:25:10,016: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:25:10.017066337Z [2024-04-21 00:25:10,016: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:25:10.017620561Z [2024-04-21 00:25:10,017: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:25:10.017757482Z [2024-04-21 00:25:10,017: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:25:10.129942999Z [2024-04-21 00:25:10,129: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:25:10.732825155Z [2024-04-21 00:25:10,732: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20025c91-c510-45da-8745-12415613e156] succeeded in 2.1858337929998015s: None 2024-04-21T00:26:00.591961641Z [2024-04-21 00:26:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4417bf12-6001-4ddc-a715-23c0e46b4f08] received 2024-04-21T00:26:00.594388366Z [2024-04-21 00:26:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cdae8c4-7667-4c4f-a708-a2ac0c875dbe] received 2024-04-21T00:26:00.601950678Z [2024-04-21 00:26:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a092fdda-2c88-4427-910f-6ccbedd2c264] received 2024-04-21T00:26:00.604567906Z [2024-04-21 00:26:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7046556-a113-4f7c-964b-6da6795b2428] received 2024-04-21T00:26:00.607899837Z [2024-04-21 00:26:00,607: INFO/ForkPoolWorker-15] [4417bf12-6001-4ddc-a715-23c0e46b4f08] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:26:00.623611442Z [2024-04-21 00:26:00,623: INFO/ForkPoolWorker-2] [b7046556-a113-4f7c-964b-6da6795b2428] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:26:00.624332784Z [2024-04-21 00:26:00,624: INFO/ForkPoolWorker-1] [a092fdda-2c88-4427-910f-6ccbedd2c264] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:26:00.625094241Z [2024-04-21 00:26:00,624: INFO/ForkPoolWorker-16] [8cdae8c4-7667-4c4f-a708-a2ac0c875dbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:26:00.915025717Z [2024-04-21 00:26:00,911: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:26:01.075850257Z [2024-04-21 00:26:01,058: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:26:01.111868190Z [2024-04-21 00:26:01,102: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:26:01.258300862Z [2024-04-21 00:26:01,244: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:26:01.535837630Z [2024-04-21 00:26:01,533: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:26:01.610145577Z [2024-04-21 00:26:01,609: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:26:01.614595190Z [2024-04-21 00:26:01,614: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:26:01.661207723Z [2024-04-21 00:26:01,661: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:26:01.664401408Z [2024-04-21 00:26:01,664: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:26:01.664502674Z [2024-04-21 00:26:01,664: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:26:01.664595103Z [2024-04-21 00:26:01,664: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:26:01.665248329Z [2024-04-21 00:26:01,665: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:26:01.798356433Z [2024-04-21 00:26:01,798: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:26:02.466395708Z [2024-04-21 00:26:02,466: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4417bf12-6001-4ddc-a715-23c0e46b4f08] succeeded in 1.8719257180000568s: None 2024-04-21T00:26:02.588967199Z [2024-04-21 00:26:02,588: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b7046556-a113-4f7c-964b-6da6795b2428] succeeded in 1.98053423500005s: None 2024-04-21T00:26:02.784001117Z [2024-04-21 00:26:02,783: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:26:02.787326522Z [2024-04-21 00:26:02,786: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:26:02.812815553Z [2024-04-21 00:26:02,812: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:26:02.816835574Z [2024-04-21 00:26:02,816: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:26:02.817084855Z [2024-04-21 00:26:02,816: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:26:02.817373250Z [2024-04-21 00:26:02,817: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:26:02.817588784Z [2024-04-21 00:26:02,817: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:26:02.818020389Z [2024-04-21 00:26:02,817: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:26:02.818734144Z [2024-04-21 00:26:02,817: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:26:02.864810887Z [2024-04-21 00:26:02,864: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:26:02.868247852Z [2024-04-21 00:26:02,867: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:26:02.914865619Z [2024-04-21 00:26:02,914: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:26:02.925278534Z [2024-04-21 00:26:02,924: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:26:02.925449279Z [2024-04-21 00:26:02,925: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:26:02.925670585Z [2024-04-21 00:26:02,925: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:26:02.926691859Z [2024-04-21 00:26:02,926: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:26:02.930272988Z [2024-04-21 00:26:02,930: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:26:02.930472176Z [2024-04-21 00:26:02,930: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:26:02.947335370Z [2024-04-21 00:26:02,947: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:26:03.025244824Z [2024-04-21 00:26:03,024: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:26:05.172498963Z [2024-04-21 00:26:05,172: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a092fdda-2c88-4427-910f-6ccbedd2c264] succeeded in 4.566253359999791s: None 2024-04-21T00:26:05.813481797Z [2024-04-21 00:26:05,812: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8cdae8c4-7667-4c4f-a708-a2ac0c875dbe] succeeded in 5.2115801520003515s: None 2024-04-21T00:27:00.489036319Z [2024-04-21 00:27:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b77a71a-3ea4-4a4d-850b-c1a3bb4d3c32] received 2024-04-21T00:27:00.495688271Z [2024-04-21 00:27:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[362e857a-f4fe-4da2-aeb9-a00a083ac39d] received 2024-04-21T00:27:00.502968252Z [2024-04-21 00:27:00,502: INFO/ForkPoolWorker-15] [5b77a71a-3ea4-4a4d-850b-c1a3bb4d3c32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:27:00.504417955Z [2024-04-21 00:27:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00c90e97-a872-4fd4-9c3f-0e073f3e253a] received 2024-04-21T00:27:00.505217820Z [2024-04-21 00:27:00,504: INFO/ForkPoolWorker-16] [362e857a-f4fe-4da2-aeb9-a00a083ac39d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:27:00.525641398Z [2024-04-21 00:27:00,525: INFO/ForkPoolWorker-1] [00c90e97-a872-4fd4-9c3f-0e073f3e253a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:27:00.840881466Z [2024-04-21 00:27:00,836: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:27:00.862045825Z [2024-04-21 00:27:00,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:27:00.964507037Z [2024-04-21 00:27:00,961: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:27:01.034022756Z [2024-04-21 00:27:01,033: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:27:01.037966005Z [2024-04-21 00:27:01,037: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:27:01.082977015Z [2024-04-21 00:27:01,081: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:27:01.087749171Z [2024-04-21 00:27:01,083: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:27:01.087768957Z [2024-04-21 00:27:01,083: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:27:01.087779387Z [2024-04-21 00:27:01,083: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:27:01.087782491Z [2024-04-21 00:27:01,083: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:27:01.224242617Z [2024-04-21 00:27:01,223: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:27:01.784252740Z [2024-04-21 00:27:01,783: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[362e857a-f4fe-4da2-aeb9-a00a083ac39d] succeeded in 1.2865440400000807s: None 2024-04-21T00:27:02.278708045Z [2024-04-21 00:27:02,278: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:27:02.282192998Z [2024-04-21 00:27:02,281: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:27:02.306283431Z [2024-04-21 00:27:02,306: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:27:02.307901200Z [2024-04-21 00:27:02,307: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:27:02.307936213Z [2024-04-21 00:27:02,307: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:27:02.308048631Z [2024-04-21 00:27:02,307: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:27:02.308077753Z [2024-04-21 00:27:02,308: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:27:02.308301493Z [2024-04-21 00:27:02,308: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:27:02.308332120Z [2024-04-21 00:27:02,308: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:27:02.389092633Z [2024-04-21 00:27:02,388: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:27:02.392727432Z [2024-04-21 00:27:02,392: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:27:02.395465888Z [2024-04-21 00:27:02,395: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:27:02.418031055Z [2024-04-21 00:27:02,417: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:27:02.419828056Z [2024-04-21 00:27:02,419: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:27:02.419846239Z [2024-04-21 00:27:02,419: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:27:02.420211884Z [2024-04-21 00:27:02,419: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:27:02.420251725Z [2024-04-21 00:27:02,420: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:27:02.420548590Z [2024-04-21 00:27:02,420: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:27:02.420595978Z [2024-04-21 00:27:02,420: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:27:02.501385165Z [2024-04-21 00:27:02,501: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:27:04.215034871Z [2024-04-21 00:27:04,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b77a71a-3ea4-4a4d-850b-c1a3bb4d3c32] succeeded in 3.7225402459998804s: None 2024-04-21T00:27:04.993456455Z [2024-04-21 00:27:04,992: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00c90e97-a872-4fd4-9c3f-0e073f3e253a] succeeded in 4.477010798000265s: None 2024-04-21T00:28:01.259867689Z [2024-04-21 00:28:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[722d3502-aed5-446a-9ae9-3448df40c5f6] received 2024-04-21T00:28:01.262691869Z [2024-04-21 00:28:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[823da5b7-cb94-4a58-abd4-ad0e049a59dc] received 2024-04-21T00:28:01.273407720Z [2024-04-21 00:28:01,273: INFO/ForkPoolWorker-16] [823da5b7-cb94-4a58-abd4-ad0e049a59dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:28:01.276939887Z [2024-04-21 00:28:01,276: INFO/ForkPoolWorker-15] [722d3502-aed5-446a-9ae9-3448df40c5f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:28:01.279451285Z [2024-04-21 00:28:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c29e04b7-42d7-4b59-a7db-05d1a83f905c] received 2024-04-21T00:28:01.286749162Z [2024-04-21 00:28:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[febc711e-4a89-4f3a-85fc-a7f76beba47d] received 2024-04-21T00:28:01.300110259Z [2024-04-21 00:28:01,299: INFO/ForkPoolWorker-1] [c29e04b7-42d7-4b59-a7db-05d1a83f905c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:28:01.300788488Z [2024-04-21 00:28:01,300: INFO/ForkPoolWorker-2] [febc711e-4a89-4f3a-85fc-a7f76beba47d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:28:01.600484841Z [2024-04-21 00:28:01,597: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:28:01.672359571Z [2024-04-21 00:28:01,668: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:28:01.832181149Z [2024-04-21 00:28:01,831: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:28:01.836247626Z [2024-04-21 00:28:01,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:28:01.869573624Z [2024-04-21 00:28:01,869: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:28:01.872437703Z [2024-04-21 00:28:01,872: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:28:01.872601560Z [2024-04-21 00:28:01,872: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:28:01.872726567Z [2024-04-21 00:28:01,872: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:28:01.872964939Z [2024-04-21 00:28:01,872: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:28:01.949827173Z [2024-04-21 00:28:01,944: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:28:01.951218996Z [2024-04-21 00:28:01,941: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:28:02.007555590Z [2024-04-21 00:28:02,007: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:28:02.320470459Z [2024-04-21 00:28:02,319: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:28:02.927803533Z [2024-04-21 00:28:02,927: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[823da5b7-cb94-4a58-abd4-ad0e049a59dc] succeeded in 1.662205915999948s: None 2024-04-21T00:28:03.118266295Z [2024-04-21 00:28:03,117: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c29e04b7-42d7-4b59-a7db-05d1a83f905c] succeeded in 1.828861345000405s: None 2024-04-21T00:28:03.151613201Z [2024-04-21 00:28:03,150: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:28:03.154446606Z [2024-04-21 00:28:03,154: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:28:03.183251692Z [2024-04-21 00:28:03,183: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:28:03.184615082Z [2024-04-21 00:28:03,184: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:28:03.184652385Z [2024-04-21 00:28:03,184: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:28:03.184862188Z [2024-04-21 00:28:03,184: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:28:03.184883724Z [2024-04-21 00:28:03,184: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:28:03.185148432Z [2024-04-21 00:28:03,185: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:28:03.185219254Z [2024-04-21 00:28:03,185: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:28:03.280846160Z [2024-04-21 00:28:03,280: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:28:03.724998547Z [2024-04-21 00:28:03,724: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:28:03.735234468Z [2024-04-21 00:28:03,734: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:28:03.784978494Z [2024-04-21 00:28:03,784: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:28:03.788904339Z [2024-04-21 00:28:03,788: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:28:03.788923747Z [2024-04-21 00:28:03,788: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:28:03.788930029Z [2024-04-21 00:28:03,788: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:28:03.788935742Z [2024-04-21 00:28:03,788: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:28:03.789112701Z [2024-04-21 00:28:03,789: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:28:03.789148562Z [2024-04-21 00:28:03,789: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:28:03.888099801Z [2024-04-21 00:28:03,887: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:28:05.168963732Z [2024-04-21 00:28:05,168: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[722d3502-aed5-446a-9ae9-3448df40c5f6] succeeded in 3.90321762900021s: None 2024-04-21T00:28:05.854623532Z [2024-04-21 00:28:05,853: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[febc711e-4a89-4f3a-85fc-a7f76beba47d] succeeded in 4.561991964000299s: None 2024-04-21T00:29:00.525248192Z [2024-04-21 00:29:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d420c52-79b5-4866-ad44-de5efef6796e] received 2024-04-21T00:29:00.533319840Z [2024-04-21 00:29:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0800c182-361d-477d-ae56-946b98126e09] received 2024-04-21T00:29:00.534312969Z [2024-04-21 00:29:00,533: INFO/ForkPoolWorker-15] [3d420c52-79b5-4866-ad44-de5efef6796e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:29:00.545980441Z [2024-04-21 00:29:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7083848e-86f5-4d87-9c6f-3a0c9161917b] received 2024-04-21T00:29:00.546272616Z [2024-04-21 00:29:00,546: INFO/ForkPoolWorker-16] [0800c182-361d-477d-ae56-946b98126e09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:29:00.564280407Z [2024-04-21 00:29:00,564: INFO/ForkPoolWorker-1] [7083848e-86f5-4d87-9c6f-3a0c9161917b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:29:00.803646550Z [2024-04-21 00:29:00,800: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:29:00.864939863Z [2024-04-21 00:29:00,862: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:29:00.879803771Z [2024-04-21 00:29:00,875: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:29:01.075596953Z [2024-04-21 00:29:01,073: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:29:01.079814049Z [2024-04-21 00:29:01,079: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:29:01.144033220Z [2024-04-21 00:29:01,127: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:29:01.153968229Z [2024-04-21 00:29:01,153: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:29:01.154367671Z [2024-04-21 00:29:01,153: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:29:01.154718107Z [2024-04-21 00:29:01,154: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:29:01.155793044Z [2024-04-21 00:29:01,155: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:29:01.371186401Z [2024-04-21 00:29:01,370: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:29:01.944733404Z [2024-04-21 00:29:01,944: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:29:01.948950648Z [2024-04-21 00:29:01,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:29:01.963810636Z [2024-04-21 00:29:01,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:29:01.964863243Z [2024-04-21 00:29:01,964: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:29:01.964882659Z [2024-04-21 00:29:01,964: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:29:01.964985150Z [2024-04-21 00:29:01,964: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:29:01.965019018Z [2024-04-21 00:29:01,964: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:29:01.965207858Z [2024-04-21 00:29:01,965: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:29:01.965240165Z [2024-04-21 00:29:01,965: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:29:02.060307544Z [2024-04-21 00:29:02,058: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7083848e-86f5-4d87-9c6f-3a0c9161917b] succeeded in 1.5053231059991958s: None 2024-04-21T00:29:02.069287977Z [2024-04-21 00:29:02,069: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:29:02.144008674Z [2024-04-21 00:29:02,143: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:29:02.147208680Z [2024-04-21 00:29:02,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:29:02.190462440Z [2024-04-21 00:29:02,190: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:29:02.197186276Z [2024-04-21 00:29:02,196: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:29:02.203102761Z [2024-04-21 00:29:02,202: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:29:02.204931197Z [2024-04-21 00:29:02,203: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:29:02.206004753Z [2024-04-21 00:29:02,204: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:29:02.207744778Z [2024-04-21 00:29:02,207: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:29:02.207881638Z [2024-04-21 00:29:02,207: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:29:02.305494140Z [2024-04-21 00:29:02,305: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:29:03.966252849Z [2024-04-21 00:29:03,965: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d420c52-79b5-4866-ad44-de5efef6796e] succeeded in 3.439157529000113s: None 2024-04-21T00:29:03.975475686Z [2024-04-21 00:29:03,975: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0800c182-361d-477d-ae56-946b98126e09] succeeded in 3.4399811709999994s: None 2024-04-21T00:30:00.443377087Z [2024-04-21 00:30:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[505677cb-e39a-44ab-a548-f68fae261846] received 2024-04-21T00:30:00.446899804Z [2024-04-21 00:30:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2da54b0b-165e-47d1-a4f4-8e46d99500a2] received 2024-04-21T00:30:00.455297334Z [2024-04-21 00:30:00,455: INFO/ForkPoolWorker-16] [2da54b0b-165e-47d1-a4f4-8e46d99500a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:30:00.464150909Z [2024-04-21 00:30:00,463: INFO/ForkPoolWorker-15] [505677cb-e39a-44ab-a548-f68fae261846] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:30:00.472414348Z [2024-04-21 00:30:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9327e22f-f224-4e57-ab49-9ab57541ce90] received 2024-04-21T00:30:00.474059253Z [2024-04-21 00:30:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4e9f5ae-e680-4bf3-8368-c7fa663b31ee] received 2024-04-21T00:30:00.476568613Z [2024-04-21 00:30:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07b70d6a-dcd7-426f-917f-2721397c669c] received 2024-04-21T00:30:00.485703654Z [2024-04-21 00:30:00,485: INFO/ForkPoolWorker-1] [9327e22f-f224-4e57-ab49-9ab57541ce90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:30:00.498845011Z [2024-04-21 00:30:00,498: INFO/ForkPoolWorker-2] [f4e9f5ae-e680-4bf3-8368-c7fa663b31ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:30:00.507166528Z [2024-04-21 00:30:00,506: INFO/ForkPoolWorker-3] [07b70d6a-dcd7-426f-917f-2721397c669c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:30:00.770215183Z [2024-04-21 00:30:00,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:30:00.829570413Z [2024-04-21 00:30:00,825: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:30:00.897902041Z [2024-04-21 00:30:00,894: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:30:01.211540570Z [2024-04-21 00:30:01,208: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:30:01.295433635Z [2024-04-21 00:30:01,292: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:30:01.656967808Z [2024-04-21 00:30:01,656: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:30:01.659762130Z [2024-04-21 00:30:01,659: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:30:01.663658354Z [2024-04-21 00:30:01,663: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:30:01.720846790Z [2024-04-21 00:30:01,720: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:30:01.722677926Z [2024-04-21 00:30:01,722: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:30:01.723971700Z [2024-04-21 00:30:01,723: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:30:01.724001446Z [2024-04-21 00:30:01,723: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:30:01.724174764Z [2024-04-21 00:30:01,724: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:30:01.881338117Z [2024-04-21 00:30:01,881: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:30:02.401786635Z [2024-04-21 00:30:02,401: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2da54b0b-165e-47d1-a4f4-8e46d99500a2] succeeded in 1.9530260279998402s: None 2024-04-21T00:30:02.538242971Z [2024-04-21 00:30:02,537: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T00:30:02.541548003Z [2024-04-21 00:30:02,541: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:30:02.596475035Z [2024-04-21 00:30:02,596: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T00:30:02.598630253Z [2024-04-21 00:30:02,598: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:30:02.598682968Z [2024-04-21 00:30:02,598: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:30:02.598866171Z [2024-04-21 00:30:02,598: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:30:02.598997431Z [2024-04-21 00:30:02,598: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T00:30:02.599504343Z [2024-04-21 00:30:02,599: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:30:02.599652494Z [2024-04-21 00:30:02,599: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:30:02.640744474Z [2024-04-21 00:30:02,640: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f4e9f5ae-e680-4bf3-8368-c7fa663b31ee] succeeded in 2.1614395829992645s: None 2024-04-21T00:30:02.648611841Z [2024-04-21 00:30:02,648: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:30:02.652033334Z [2024-04-21 00:30:02,651: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:30:02.677290970Z [2024-04-21 00:30:02,676: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:30:02.692446947Z [2024-04-21 00:30:02,692: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:30:02.694698997Z [2024-04-21 00:30:02,694: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:30:02.694742086Z [2024-04-21 00:30:02,694: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:30:02.694928873Z [2024-04-21 00:30:02,694: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:30:02.694957202Z [2024-04-21 00:30:02,694: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:30:02.695171024Z [2024-04-21 00:30:02,695: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:30:02.695203251Z [2024-04-21 00:30:02,695: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:30:02.755578555Z [2024-04-21 00:30:02,755: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:30:02.764541529Z [2024-04-21 00:30:02,764: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:30:02.819167967Z [2024-04-21 00:30:02,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:30:02.841993524Z [2024-04-21 00:30:02,841: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:30:02.843109676Z [2024-04-21 00:30:02,842: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:30:02.843228236Z [2024-04-21 00:30:02,843: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:30:02.843403484Z [2024-04-21 00:30:02,843: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:30:02.843544900Z [2024-04-21 00:30:02,843: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:30:02.843904792Z [2024-04-21 00:30:02,843: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:30:02.844077260Z [2024-04-21 00:30:02,843: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:30:02.916731223Z [2024-04-21 00:30:02,916: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:30:03.433247188Z [2024-04-21 00:30:03,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[225d2b58-bfa0-4c98-a581-06af5ea5197c] received 2024-04-21T00:30:03.439141380Z [2024-04-21 00:30:03,438: INFO/ForkPoolWorker-16] [225d2b58-bfa0-4c98-a581-06af5ea5197c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:30:03.510947442Z [2024-04-21 00:30:03,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[505677cb-e39a-44ab-a548-f68fae261846] succeeded in 3.0612594989997888s: None 2024-04-21T00:30:03.767332624Z [2024-04-21 00:30:03,764: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:30:04.366603872Z [2024-04-21 00:30:04,366: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[07b70d6a-dcd7-426f-917f-2721397c669c] succeeded in 3.886139688000185s: None 2024-04-21T00:30:04.921097790Z [2024-04-21 00:30:04,920: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:30:04.924886441Z [2024-04-21 00:30:04,924: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:30:04.947194997Z [2024-04-21 00:30:04,946: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:30:04.949750083Z [2024-04-21 00:30:04,949: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:30:04.949789317Z [2024-04-21 00:30:04,949: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:30:04.949965666Z [2024-04-21 00:30:04,949: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:30:04.950031513Z [2024-04-21 00:30:04,949: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:30:04.950374145Z [2024-04-21 00:30:04,950: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:30:04.950403760Z [2024-04-21 00:30:04,950: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:30:05.034661642Z [2024-04-21 00:30:05,034: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:30:05.142009607Z [2024-04-21 00:30:05,141: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9327e22f-f224-4e57-ab49-9ab57541ce90] succeeded in 4.665464632999829s: None 2024-04-21T00:30:05.746737726Z [2024-04-21 00:30:05,745: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[225d2b58-bfa0-4c98-a581-06af5ea5197c] succeeded in 2.311578136999742s: None 2024-04-21T00:30:05.990554484Z [2024-04-21 00:30:05,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21bb280e-770e-468e-9e17-6934e0401437] received 2024-04-21T00:30:06.005954341Z [2024-04-21 00:30:06,005: INFO/ForkPoolWorker-15] [21bb280e-770e-468e-9e17-6934e0401437] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:30:06.304841162Z [2024-04-21 00:30:06,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:30:07.704895012Z [2024-04-21 00:30:07,704: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:30:07.708297018Z [2024-04-21 00:30:07,707: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:30:07.744451566Z [2024-04-21 00:30:07,744: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:30:07.746598130Z [2024-04-21 00:30:07,746: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:30:07.746866649Z [2024-04-21 00:30:07,746: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:30:07.747143610Z [2024-04-21 00:30:07,746: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:30:07.747323822Z [2024-04-21 00:30:07,747: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:30:07.747710664Z [2024-04-21 00:30:07,747: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:30:07.747933938Z [2024-04-21 00:30:07,747: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:30:07.870877138Z [2024-04-21 00:30:07,870: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:30:08.498429591Z [2024-04-21 00:30:08,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1598f31e-8df6-49a6-9580-faa0729c1951] received 2024-04-21T00:30:08.507732634Z [2024-04-21 00:30:08,507: INFO/ForkPoolWorker-16] [1598f31e-8df6-49a6-9580-faa0729c1951] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:30:08.533881233Z [2024-04-21 00:30:08,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21bb280e-770e-468e-9e17-6934e0401437] succeeded in 2.5398813230003725s: None 2024-04-21T00:30:08.798810128Z [2024-04-21 00:30:08,794: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:30:09.867087561Z [2024-04-21 00:30:09,866: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:30:09.870317741Z [2024-04-21 00:30:09,869: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:30:09.908896228Z [2024-04-21 00:30:09,908: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:30:09.910777579Z [2024-04-21 00:30:09,910: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:30:09.910791438Z [2024-04-21 00:30:09,910: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:30:09.911066083Z [2024-04-21 00:30:09,910: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:30:09.911222894Z [2024-04-21 00:30:09,911: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:30:09.911787230Z [2024-04-21 00:30:09,911: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:30:09.911994335Z [2024-04-21 00:30:09,911: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:30:10.019030542Z [2024-04-21 00:30:10,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:30:10.715453717Z [2024-04-21 00:30:10,714: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1598f31e-8df6-49a6-9580-faa0729c1951] succeeded in 2.2146446979995744s: None 2024-04-21T00:31:00.564122117Z [2024-04-21 00:31:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7af2e94c-7768-440b-92a1-952682ece654] received 2024-04-21T00:31:00.569074149Z [2024-04-21 00:31:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6389ffd6-aca2-41b0-b54f-e2e8abeb2a0b] received 2024-04-21T00:31:00.573511380Z [2024-04-21 00:31:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c28c7bd-f7f1-4bd5-85a7-7d59c21b5f22] received 2024-04-21T00:31:00.577276551Z [2024-04-21 00:31:00,577: INFO/ForkPoolWorker-15] [7af2e94c-7768-440b-92a1-952682ece654] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:31:00.582589886Z [2024-04-21 00:31:00,582: INFO/ForkPoolWorker-16] [6389ffd6-aca2-41b0-b54f-e2e8abeb2a0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:31:00.583660741Z [2024-04-21 00:31:00,583: INFO/ForkPoolWorker-1] [0c28c7bd-f7f1-4bd5-85a7-7d59c21b5f22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:31:00.868991128Z [2024-04-21 00:31:00,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:31:00.874207573Z [2024-04-21 00:31:00,871: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:31:00.920188585Z [2024-04-21 00:31:00,916: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:31:01.034338484Z [2024-04-21 00:31:01,033: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T00:31:01.038450831Z [2024-04-21 00:31:01,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:31:01.085995457Z [2024-04-21 00:31:01,085: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:31:01.094369779Z [2024-04-21 00:31:01,094: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:31:01.094565083Z [2024-04-21 00:31:01,094: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:31:01.094670040Z [2024-04-21 00:31:01,094: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T00:31:01.094952110Z [2024-04-21 00:31:01,094: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:31:01.225488935Z [2024-04-21 00:31:01,225: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:31:01.852342260Z [2024-04-21 00:31:01,851: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7af2e94c-7768-440b-92a1-952682ece654] succeeded in 1.2816170810001495s: None 2024-04-21T00:31:02.126515372Z [2024-04-21 00:31:02,126: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:31:02.129785599Z [2024-04-21 00:31:02,129: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:31:02.148329094Z [2024-04-21 00:31:02,148: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:31:02.152546721Z [2024-04-21 00:31:02,152: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:31:02.152558875Z [2024-04-21 00:31:02,152: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:31:02.152832892Z [2024-04-21 00:31:02,152: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:31:02.152977386Z [2024-04-21 00:31:02,152: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:31:02.153406809Z [2024-04-21 00:31:02,153: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:31:02.153846831Z [2024-04-21 00:31:02,153: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:31:02.244249576Z [2024-04-21 00:31:02,243: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:31:02.262250661Z [2024-04-21 00:31:02,261: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:31:02.265553944Z [2024-04-21 00:31:02,265: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:31:02.294617936Z [2024-04-21 00:31:02,294: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:31:02.296758347Z [2024-04-21 00:31:02,296: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:31:02.296969227Z [2024-04-21 00:31:02,296: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:31:02.297385625Z [2024-04-21 00:31:02,297: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:31:02.297614424Z [2024-04-21 00:31:02,297: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:31:02.298019223Z [2024-04-21 00:31:02,297: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:31:02.298254548Z [2024-04-21 00:31:02,298: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:31:02.446101622Z [2024-04-21 00:31:02,445: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:31:04.277114757Z [2024-04-21 00:31:04,276: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6389ffd6-aca2-41b0-b54f-e2e8abeb2a0b] succeeded in 3.701363981999748s: None 2024-04-21T00:31:04.550173020Z [2024-04-21 00:31:04,549: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c28c7bd-f7f1-4bd5-85a7-7d59c21b5f22] succeeded in 3.9748371409996253s: None 2024-04-21T00:32:00.428804893Z [2024-04-21 00:32:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[158ac38b-1aa5-429f-bb0d-2929686e2c20] received 2024-04-21T00:32:00.430310978Z [2024-04-21 00:32:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14b24677-226f-41c0-a5b6-a379dd13851e] received 2024-04-21T00:32:00.431881081Z [2024-04-21 00:32:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5493dfa6-d82f-4638-a74f-bfaaa08a7ca2] received 2024-04-21T00:32:00.438040994Z [2024-04-21 00:32:00,437: INFO/ForkPoolWorker-15] [158ac38b-1aa5-429f-bb0d-2929686e2c20] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:32:00.440089213Z [2024-04-21 00:32:00,439: INFO/ForkPoolWorker-16] [14b24677-226f-41c0-a5b6-a379dd13851e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:32:00.441615817Z [2024-04-21 00:32:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c785f805-f438-4339-a7b6-4c30f5f9a13a] received 2024-04-21T00:32:00.451343048Z [2024-04-21 00:32:00,450: INFO/ForkPoolWorker-1] [5493dfa6-d82f-4638-a74f-bfaaa08a7ca2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:32:00.456495867Z [2024-04-21 00:32:00,456: INFO/ForkPoolWorker-2] [c785f805-f438-4339-a7b6-4c30f5f9a13a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:32:00.738617410Z [2024-04-21 00:32:00,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:32:00.755140785Z [2024-04-21 00:32:00,751: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:32:00.762960670Z [2024-04-21 00:32:00,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:32:00.841468046Z [2024-04-21 00:32:00,835: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:32:01.006029402Z [2024-04-21 00:32:01,005: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:32:01.053417678Z [2024-04-21 00:32:01,052: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:32:01.058008342Z [2024-04-21 00:32:01,057: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:32:01.085810364Z [2024-04-21 00:32:01,085: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:32:01.100950677Z [2024-04-21 00:32:01,100: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:32:01.104993862Z [2024-04-21 00:32:01,100: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:32:01.105001437Z [2024-04-21 00:32:01,101: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:32:01.105005150Z [2024-04-21 00:32:01,101: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:32:01.266237144Z [2024-04-21 00:32:01,265: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:32:01.845962099Z [2024-04-21 00:32:01,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[158ac38b-1aa5-429f-bb0d-2929686e2c20] succeeded in 1.4155579390007915s: None 2024-04-21T00:32:02.006363083Z [2024-04-21 00:32:02,005: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c785f805-f438-4339-a7b6-4c30f5f9a13a] succeeded in 1.5611595709997346s: None 2024-04-21T00:32:02.242262945Z [2024-04-21 00:32:02,241: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:32:02.245821908Z [2024-04-21 00:32:02,245: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:32:02.263946457Z [2024-04-21 00:32:02,263: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:32:02.266949075Z [2024-04-21 00:32:02,266: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:32:02.267185105Z [2024-04-21 00:32:02,266: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:32:02.267669100Z [2024-04-21 00:32:02,267: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:32:02.267949177Z [2024-04-21 00:32:02,267: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:32:02.268216094Z [2024-04-21 00:32:02,268: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:32:02.268241621Z [2024-04-21 00:32:02,268: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:32:02.374114728Z [2024-04-21 00:32:02,373: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:32:02.509308596Z [2024-04-21 00:32:02,508: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:32:02.512505372Z [2024-04-21 00:32:02,512: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:32:02.530346957Z [2024-04-21 00:32:02,530: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:32:02.531443944Z [2024-04-21 00:32:02,531: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:32:02.531458074Z [2024-04-21 00:32:02,531: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:32:02.531546772Z [2024-04-21 00:32:02,531: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:32:02.531558269Z [2024-04-21 00:32:02,531: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:32:02.531920859Z [2024-04-21 00:32:02,531: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:32:02.531937099Z [2024-04-21 00:32:02,531: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:32:02.618095206Z [2024-04-21 00:32:02,617: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:32:04.900754115Z [2024-04-21 00:32:04,899: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5493dfa6-d82f-4638-a74f-bfaaa08a7ca2] succeeded in 4.465794587000346s: None 2024-04-21T00:32:05.163838130Z [2024-04-21 00:32:05,162: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[14b24677-226f-41c0-a5b6-a379dd13851e] succeeded in 4.731090053999651s: None 2024-04-21T00:33:00.215218999Z [2024-04-21 00:33:00,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0aa73564-92c5-4646-98fd-28c159f3ab34] received 2024-04-21T00:33:00.219810319Z [2024-04-21 00:33:00,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f86c6478-4865-4b4b-8f95-bfe97bfcc7a7] received 2024-04-21T00:33:00.222195795Z [2024-04-21 00:33:00,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[122e1220-fec2-4989-a817-1f124015ec47] received 2024-04-21T00:33:00.228039562Z [2024-04-21 00:33:00,227: INFO/ForkPoolWorker-15] [0aa73564-92c5-4646-98fd-28c159f3ab34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:33:00.235008855Z [2024-04-21 00:33:00,234: INFO/ForkPoolWorker-16] [f86c6478-4865-4b4b-8f95-bfe97bfcc7a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:33:00.237031755Z [2024-04-21 00:33:00,236: INFO/ForkPoolWorker-1] [122e1220-fec2-4989-a817-1f124015ec47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:33:00.519118324Z [2024-04-21 00:33:00,515: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:33:00.566570985Z [2024-04-21 00:33:00,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:33:00.580595110Z [2024-04-21 00:33:00,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:33:00.716824073Z [2024-04-21 00:33:00,716: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:33:00.720494098Z [2024-04-21 00:33:00,720: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:33:00.746918192Z [2024-04-21 00:33:00,746: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:33:00.748133084Z [2024-04-21 00:33:00,747: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:33:00.748209912Z [2024-04-21 00:33:00,748: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:33:00.748326173Z [2024-04-21 00:33:00,748: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:33:00.748545198Z [2024-04-21 00:33:00,748: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:33:00.844018182Z [2024-04-21 00:33:00,843: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:33:01.352173187Z [2024-04-21 00:33:01,351: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f86c6478-4865-4b4b-8f95-bfe97bfcc7a7] succeeded in 1.1273914899993542s: None 2024-04-21T00:33:01.632345529Z [2024-04-21 00:33:01,632: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:33:01.635482556Z [2024-04-21 00:33:01,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:33:01.651887032Z [2024-04-21 00:33:01,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:33:01.653048057Z [2024-04-21 00:33:01,652: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:33:01.653220601Z [2024-04-21 00:33:01,653: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:33:01.653347495Z [2024-04-21 00:33:01,653: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:33:01.653420561Z [2024-04-21 00:33:01,653: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:33:01.653654172Z [2024-04-21 00:33:01,653: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:33:01.654044661Z [2024-04-21 00:33:01,653: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:33:01.739371849Z [2024-04-21 00:33:01,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:33:01.806825779Z [2024-04-21 00:33:01,806: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:33:01.809985714Z [2024-04-21 00:33:01,809: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:33:01.840713976Z [2024-04-21 00:33:01,840: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:33:01.842156384Z [2024-04-21 00:33:01,841: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:33:01.842243556Z [2024-04-21 00:33:01,842: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:33:01.842547533Z [2024-04-21 00:33:01,842: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:33:01.842611694Z [2024-04-21 00:33:01,842: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:33:01.843231887Z [2024-04-21 00:33:01,843: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:33:01.843461884Z [2024-04-21 00:33:01,843: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:33:01.935903666Z [2024-04-21 00:33:01,935: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:33:03.421981636Z [2024-04-21 00:33:03,421: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[122e1220-fec2-4989-a817-1f124015ec47] succeeded in 3.1962420070003645s: None 2024-04-21T00:33:03.589169514Z [2024-04-21 00:33:03,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0aa73564-92c5-4646-98fd-28c159f3ab34] succeeded in 3.37063756400039s: None 2024-04-21T00:33:22.878813924Z [2024-04-21 00:33:22,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[672a28d0-4ca1-487d-9b62-9157e2756bf5] received 2024-04-21T00:33:22.891636634Z [2024-04-21 00:33:22,891: INFO/ForkPoolWorker-15] [672a28d0-4ca1-487d-9b62-9157e2756bf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b188916b-5e5a-41b8-be8a-8cb1c841edf2', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:33:23.174668513Z [2024-04-21 00:33:23,171: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:33:23.321639856Z [2024-04-21 00:33:23,321: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T00:33:23.325856985Z [2024-04-21 00:33:23,325: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:33:23.346992290Z [2024-04-21 00:33:23,346: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:33:23.348709623Z [2024-04-21 00:33:23,348: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:33:23.348789405Z [2024-04-21 00:33:23,348: INFO/ForkPoolWorker-15] Read SDNC b188916b-5e5a-41b8-be8a-8cb1c841edf2 (epa_03) 2024-04-21T00:33:23.348930181Z [2024-04-21 00:33:23,348: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'b188916b-5e5a-41b8-be8a-8cb1c841edf2', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-21T00:33:23.349002670Z [2024-04-21 00:33:23,348: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T00:33:23.349206893Z [2024-04-21 00:33:23,349: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:33:23.355542500Z [2024-04-21 00:33:23,355: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_b188916b-5e5a-41b8-be8a-8cb1c841edf2 2024-04-21T00:33:23.446443082Z [2024-04-21 00:33:23,446: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:33:24.122837277Z [2024-04-21 00:33:24,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[672a28d0-4ca1-487d-9b62-9157e2756bf5] succeeded in 1.2405169429994203s: None 2024-04-21T00:34:00.674663424Z [2024-04-21 00:34:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb3febde-2510-4a81-89c1-e0f642b95e03] received 2024-04-21T00:34:00.680203614Z [2024-04-21 00:34:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e06db74-898c-42bf-9b90-5fe55b0c6f0b] received 2024-04-21T00:34:00.685144589Z [2024-04-21 00:34:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0010e02-01df-470c-9cc3-28b0af19655f] received 2024-04-21T00:34:00.688938522Z [2024-04-21 00:34:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[099fbae5-b352-4ccc-8ebd-44881183a46e] received 2024-04-21T00:34:00.694772687Z [2024-04-21 00:34:00,694: INFO/ForkPoolWorker-1] [f0010e02-01df-470c-9cc3-28b0af19655f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:34:00.699556060Z [2024-04-21 00:34:00,699: INFO/ForkPoolWorker-16] [9e06db74-898c-42bf-9b90-5fe55b0c6f0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_b188916b-5e5a-41b8-be8a-8cb1c841edf2', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:34:00.699961936Z [2024-04-21 00:34:00,694: INFO/ForkPoolWorker-15] [bb3febde-2510-4a81-89c1-e0f642b95e03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:34:00.704359005Z [2024-04-21 00:34:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f982b062-4f89-4a5a-b841-1ab415f9a43a] received 2024-04-21T00:34:00.710578502Z [2024-04-21 00:34:00,710: INFO/ForkPoolWorker-2] [099fbae5-b352-4ccc-8ebd-44881183a46e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:34:00.732093609Z [2024-04-21 00:34:00,730: INFO/ForkPoolWorker-3] [f982b062-4f89-4a5a-b841-1ab415f9a43a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:34:01.041026890Z [2024-04-21 00:34:01,037: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:34:01.146393463Z [2024-04-21 00:34:01,142: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:34:01.215977947Z [2024-04-21 00:34:01,212: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:34:01.267199684Z [2024-04-21 00:34:01,263: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:34:01.370912879Z [2024-04-21 00:34:01,370: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:34:01.488303256Z [2024-04-21 00:34:01,477: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-21T00:34:01.491753123Z [2024-04-21 00:34:01,490: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:34:01.495728899Z [2024-04-21 00:34:01,481: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:34:01.550597673Z [2024-04-21 00:34:01,549: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T00:34:01.556354711Z [2024-04-21 00:34:01,556: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:34:01.556404799Z [2024-04-21 00:34:01,556: INFO/ForkPoolWorker-3] Read SDNC b188916b-5e5a-41b8-be8a-8cb1c841edf2 (epa_03) 2024-04-21T00:34:01.556581830Z [2024-04-21 00:34:01,556: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'b188916b-5e5a-41b8-be8a-8cb1c841edf2', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-21T00:34:01.556726296Z [2024-04-21 00:34:01,556: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-21T00:34:01.557554826Z [2024-04-21 00:34:01,557: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:34:01.566294863Z [2024-04-21 00:34:01,566: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_b188916b-5e5a-41b8-be8a-8cb1c841edf2 2024-04-21T00:34:01.717897743Z [2024-04-21 00:34:01,717: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:34:01.879934479Z [2024-04-21 00:34:01,879: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:34:01.885312963Z [2024-04-21 00:34:01,883: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:34:01.931758699Z [2024-04-21 00:34:01,931: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:34:01.935617989Z [2024-04-21 00:34:01,935: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:34:01.935633317Z [2024-04-21 00:34:01,935: INFO/ForkPoolWorker-16] Read SDNC b188916b-5e5a-41b8-be8a-8cb1c841edf2 (epa_03) 2024-04-21T00:34:01.935844258Z [2024-04-21 00:34:01,935: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'b188916b-5e5a-41b8-be8a-8cb1c841edf2', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-21T00:34:01.935913743Z [2024-04-21 00:34:01,935: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:34:01.936347402Z [2024-04-21 00:34:01,936: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:34:01.942322187Z [2024-04-21 00:34:01,942: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_b188916b-5e5a-41b8-be8a-8cb1c841edf2 2024-04-21T00:34:02.156755095Z [2024-04-21 00:34:02,156: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f0010e02-01df-470c-9cc3-28b0af19655f] succeeded in 1.4695455969995237s: None 2024-04-21T00:34:02.175088599Z [2024-04-21 00:34:02,174: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:34:02.529969118Z [2024-04-21 00:34:02,529: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f982b062-4f89-4a5a-b841-1ab415f9a43a] succeeded in 1.8224300009997023s: None 2024-04-21T00:34:02.579982925Z [2024-04-21 00:34:02,574: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:34:02.583054228Z [2024-04-21 00:34:02,582: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:34:02.617232007Z [2024-04-21 00:34:02,617: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:34:02.618537787Z [2024-04-21 00:34:02,618: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:34:02.618623670Z [2024-04-21 00:34:02,618: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:34:02.618764428Z [2024-04-21 00:34:02,618: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:34:02.618835779Z [2024-04-21 00:34:02,618: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:34:02.619069957Z [2024-04-21 00:34:02,618: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:34:02.619150152Z [2024-04-21 00:34:02,619: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:34:02.696005130Z [2024-04-21 00:34:02,695: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:34:02.790981541Z [2024-04-21 00:34:02,790: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:34:02.794224772Z [2024-04-21 00:34:02,793: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:34:02.816001764Z [2024-04-21 00:34:02,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:34:02.817655999Z [2024-04-21 00:34:02,817: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:34:02.817820900Z [2024-04-21 00:34:02,817: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:34:02.818095557Z [2024-04-21 00:34:02,817: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:34:02.818240842Z [2024-04-21 00:34:02,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:34:02.818597984Z [2024-04-21 00:34:02,818: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:34:02.819268530Z [2024-04-21 00:34:02,819: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:34:02.928546018Z [2024-04-21 00:34:02,928: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e06db74-898c-42bf-9b90-5fe55b0c6f0b] succeeded in 2.2463939039998877s: None 2024-04-21T00:34:02.965570678Z [2024-04-21 00:34:02,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:34:05.003537445Z [2024-04-21 00:34:05,002: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[099fbae5-b352-4ccc-8ebd-44881183a46e] succeeded in 4.311937657999806s: None 2024-04-21T00:34:05.282856788Z [2024-04-21 00:34:05,282: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb3febde-2510-4a81-89c1-e0f642b95e03] succeeded in 4.6048317129998395s: None 2024-04-21T00:35:01.192602945Z [2024-04-21 00:35:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8ec8096-e004-443c-977d-0c977206f81c] received 2024-04-21T00:35:01.194868094Z [2024-04-21 00:35:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16f0933c-e6b8-412d-8497-e9a628ade63b] received 2024-04-21T00:35:01.207963001Z [2024-04-21 00:35:01,207: INFO/ForkPoolWorker-15] [d8ec8096-e004-443c-977d-0c977206f81c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:35:01.210282253Z [2024-04-21 00:35:01,209: INFO/ForkPoolWorker-16] [16f0933c-e6b8-412d-8497-e9a628ade63b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:35:01.230984622Z [2024-04-21 00:35:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5283c09c-2f3e-4bf5-b35e-c59b1f308ed1] received 2024-04-21T00:35:01.232847643Z [2024-04-21 00:35:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e94a625-d1ce-42c5-9aee-a633a3f7b7ac] received 2024-04-21T00:35:01.241779863Z [2024-04-21 00:35:01,241: INFO/ForkPoolWorker-2] [4e94a625-d1ce-42c5-9aee-a633a3f7b7ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:35:01.242468966Z [2024-04-21 00:35:01,242: INFO/ForkPoolWorker-1] [5283c09c-2f3e-4bf5-b35e-c59b1f308ed1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:35:01.571809378Z [2024-04-21 00:35:01,566: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:35:01.851148597Z [2024-04-21 00:35:01,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:35:01.921543831Z [2024-04-21 00:35:01,921: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:35:01.939035945Z [2024-04-21 00:35:01,936: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:35:01.988583872Z [2024-04-21 00:35:01,988: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:35:01.992588723Z [2024-04-21 00:35:01,992: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:35:01.992768408Z [2024-04-21 00:35:01,992: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:35:01.992887951Z [2024-04-21 00:35:01,992: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:35:01.993206544Z [2024-04-21 00:35:01,993: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:35:02.066123805Z [2024-04-21 00:35:02,063: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:35:02.167707699Z [2024-04-21 00:35:02,156: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:35:02.170842856Z [2024-04-21 00:35:02,170: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:35:02.966574445Z [2024-04-21 00:35:02,966: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[16f0933c-e6b8-412d-8497-e9a628ade63b] succeeded in 1.768144126000152s: None 2024-04-21T00:35:03.266970875Z [2024-04-21 00:35:03,266: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:35:03.270428565Z [2024-04-21 00:35:03,270: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:35:03.304400363Z [2024-04-21 00:35:03,304: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:35:03.305534233Z [2024-04-21 00:35:03,305: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:35:03.305562616Z [2024-04-21 00:35:03,305: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:35:03.305705536Z [2024-04-21 00:35:03,305: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:35:03.305751227Z [2024-04-21 00:35:03,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:35:03.305941457Z [2024-04-21 00:35:03,305: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:35:03.305979130Z [2024-04-21 00:35:03,305: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:35:03.402093907Z [2024-04-21 00:35:03,401: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:35:03.791955075Z [2024-04-21 00:35:03,788: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:35:03.799452067Z [2024-04-21 00:35:03,796: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:35:03.877881815Z [2024-04-21 00:35:03,877: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:35:03.883747822Z [2024-04-21 00:35:03,881: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:35:03.891845718Z [2024-04-21 00:35:03,888: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:35:03.901850724Z [2024-04-21 00:35:03,899: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:35:03.901857551Z [2024-04-21 00:35:03,899: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:35:03.901861192Z [2024-04-21 00:35:03,900: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:35:03.901875238Z [2024-04-21 00:35:03,900: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:35:03.901878329Z [2024-04-21 00:35:03,900: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:35:03.901923970Z [2024-04-21 00:35:03,900: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:35:03.961860008Z [2024-04-21 00:35:03,961: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:35:03.971293284Z [2024-04-21 00:35:03,971: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:35:03.971349760Z [2024-04-21 00:35:03,971: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:35:03.971406813Z [2024-04-21 00:35:03,971: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:35:03.971443515Z [2024-04-21 00:35:03,971: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:35:03.971640202Z [2024-04-21 00:35:03,971: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:35:03.971697366Z [2024-04-21 00:35:03,971: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:35:04.149224629Z [2024-04-21 00:35:04,149: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:35:04.156302708Z [2024-04-21 00:35:04,156: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:35:04.883362179Z [2024-04-21 00:35:04,882: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5283c09c-2f3e-4bf5-b35e-c59b1f308ed1] succeeded in 3.649029166999753s: None 2024-04-21T00:35:05.126098090Z [2024-04-21 00:35:05,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee24b4c1-85f6-4606-a10e-15d246122545] received 2024-04-21T00:35:05.135088439Z [2024-04-21 00:35:05,134: INFO/ForkPoolWorker-16] [ee24b4c1-85f6-4606-a10e-15d246122545] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:35:05.409060015Z [2024-04-21 00:35:05,406: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:35:06.573462283Z [2024-04-21 00:35:06,572: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8ec8096-e004-443c-977d-0c977206f81c] succeeded in 5.376923367999552s: None 2024-04-21T00:35:06.574543315Z [2024-04-21 00:35:06,574: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:35:06.578095216Z [2024-04-21 00:35:06,577: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:35:06.597737886Z [2024-04-21 00:35:06,597: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:35:06.598735493Z [2024-04-21 00:35:06,598: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:35:06.598752257Z [2024-04-21 00:35:06,598: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:35:06.598901981Z [2024-04-21 00:35:06,598: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:35:06.598913234Z [2024-04-21 00:35:06,598: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:35:06.599108267Z [2024-04-21 00:35:06,598: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:35:06.599123674Z [2024-04-21 00:35:06,599: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:35:06.674230321Z [2024-04-21 00:35:06,674: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:35:06.914485026Z [2024-04-21 00:35:06,913: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4e94a625-d1ce-42c5-9aee-a633a3f7b7ac] succeeded in 5.679800176999379s: None 2024-04-21T00:35:07.377011448Z [2024-04-21 00:35:07,376: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee24b4c1-85f6-4606-a10e-15d246122545] succeeded in 2.249036014000012s: None 2024-04-21T00:35:07.574498221Z [2024-04-21 00:35:07,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7740551b-a362-4183-b026-7aca6d07dc4f] received 2024-04-21T00:35:07.581233473Z [2024-04-21 00:35:07,580: INFO/ForkPoolWorker-15] [7740551b-a362-4183-b026-7aca6d07dc4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:35:07.860852593Z [2024-04-21 00:35:07,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:35:08.889078794Z [2024-04-21 00:35:08,888: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:35:08.892369622Z [2024-04-21 00:35:08,891: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:35:08.912490875Z [2024-04-21 00:35:08,912: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:35:08.913764537Z [2024-04-21 00:35:08,913: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:35:08.913835371Z [2024-04-21 00:35:08,913: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:35:08.914046172Z [2024-04-21 00:35:08,913: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:35:08.914112336Z [2024-04-21 00:35:08,913: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:35:08.914420675Z [2024-04-21 00:35:08,914: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:35:08.914506084Z [2024-04-21 00:35:08,914: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:35:09.003218668Z [2024-04-21 00:35:09,002: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:35:09.634747575Z [2024-04-21 00:35:09,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7740551b-a362-4183-b026-7aca6d07dc4f] succeeded in 2.0592974930004857s: None 2024-04-21T00:35:10.005361385Z [2024-04-21 00:35:10,005: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faed8206-6ff6-494d-abf8-fa3a6c4b6ad9] received 2024-04-21T00:35:10.019498582Z [2024-04-21 00:35:10,019: INFO/ForkPoolWorker-15] [faed8206-6ff6-494d-abf8-fa3a6c4b6ad9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:35:10.314431004Z [2024-04-21 00:35:10,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:35:11.330971677Z [2024-04-21 00:35:11,330: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:35:11.334163443Z [2024-04-21 00:35:11,333: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:35:11.360783012Z [2024-04-21 00:35:11,360: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:35:11.362446401Z [2024-04-21 00:35:11,362: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:35:11.362470309Z [2024-04-21 00:35:11,362: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:35:11.362656454Z [2024-04-21 00:35:11,362: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:35:11.362719541Z [2024-04-21 00:35:11,362: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:35:11.363085272Z [2024-04-21 00:35:11,362: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:35:11.363112217Z [2024-04-21 00:35:11,362: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:35:11.469069508Z [2024-04-21 00:35:11,468: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:35:12.141776011Z [2024-04-21 00:35:12,141: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[faed8206-6ff6-494d-abf8-fa3a6c4b6ad9] succeeded in 2.133682196999871s: None 2024-04-21T00:36:00.618799200Z [2024-04-21 00:36:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29de35ef-cc3d-4b1a-96a7-d6377abfc779] received 2024-04-21T00:36:00.624398188Z [2024-04-21 00:36:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7a65547-2889-470b-bee3-c65572f81ba3] received 2024-04-21T00:36:00.631170358Z [2024-04-21 00:36:00,630: INFO/ForkPoolWorker-15] [29de35ef-cc3d-4b1a-96a7-d6377abfc779] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:36:00.633004702Z [2024-04-21 00:36:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3984264-b97b-40c1-8a53-7439d2808a9a] received 2024-04-21T00:36:00.637274029Z [2024-04-21 00:36:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fb8d1c5-31c9-4ea9-8299-80f821bf8f5c] received 2024-04-21T00:36:00.637890551Z [2024-04-21 00:36:00,637: INFO/ForkPoolWorker-16] [e7a65547-2889-470b-bee3-c65572f81ba3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:36:00.651404495Z [2024-04-21 00:36:00,651: INFO/ForkPoolWorker-1] [f3984264-b97b-40c1-8a53-7439d2808a9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:36:00.655621747Z [2024-04-21 00:36:00,655: INFO/ForkPoolWorker-2] [9fb8d1c5-31c9-4ea9-8299-80f821bf8f5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:36:00.955964319Z [2024-04-21 00:36:00,952: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:36:00.961071315Z [2024-04-21 00:36:00,957: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:36:01.023213196Z [2024-04-21 00:36:01,018: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:36:01.119807098Z [2024-04-21 00:36:01,116: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:36:01.233898459Z [2024-04-21 00:36:01,233: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:36:01.238254230Z [2024-04-21 00:36:01,237: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:36:01.271936319Z [2024-04-21 00:36:01,271: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:36:01.276055501Z [2024-04-21 00:36:01,275: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:36:01.276747799Z [2024-04-21 00:36:01,276: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:36:01.276931005Z [2024-04-21 00:36:01,276: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:36:01.277034469Z [2024-04-21 00:36:01,276: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:36:01.277362611Z [2024-04-21 00:36:01,277: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:36:01.379008508Z [2024-04-21 00:36:01,378: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:36:01.952081022Z [2024-04-21 00:36:01,951: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29de35ef-cc3d-4b1a-96a7-d6377abfc779] succeeded in 1.3300734419999571s: None 2024-04-21T00:36:02.058548602Z [2024-04-21 00:36:02,058: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9fb8d1c5-31c9-4ea9-8299-80f821bf8f5c] succeeded in 1.4175530620004793s: None 2024-04-21T00:36:02.290127336Z [2024-04-21 00:36:02,289: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:36:02.293738177Z [2024-04-21 00:36:02,293: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:36:02.312457720Z [2024-04-21 00:36:02,312: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:36:02.313610483Z [2024-04-21 00:36:02,313: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:36:02.313749459Z [2024-04-21 00:36:02,313: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:36:02.313955882Z [2024-04-21 00:36:02,313: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:36:02.314098587Z [2024-04-21 00:36:02,313: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:36:02.314377259Z [2024-04-21 00:36:02,314: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:36:02.314821458Z [2024-04-21 00:36:02,314: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:36:02.381125052Z [2024-04-21 00:36:02,380: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:36:02.384216860Z [2024-04-21 00:36:02,383: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:36:02.394924328Z [2024-04-21 00:36:02,394: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:36:02.415091349Z [2024-04-21 00:36:02,414: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:36:02.417902330Z [2024-04-21 00:36:02,417: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:36:02.417973836Z [2024-04-21 00:36:02,417: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:36:02.418146256Z [2024-04-21 00:36:02,417: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:36:02.418217354Z [2024-04-21 00:36:02,418: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:36:02.419129661Z [2024-04-21 00:36:02,418: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:36:02.419186218Z [2024-04-21 00:36:02,419: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:36:02.501762784Z [2024-04-21 00:36:02,501: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:36:03.930851282Z [2024-04-21 00:36:03,930: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f3984264-b97b-40c1-8a53-7439d2808a9a] succeeded in 3.2876281469998503s: None 2024-04-21T00:36:04.439177161Z [2024-04-21 00:36:04,438: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7a65547-2889-470b-bee3-c65572f81ba3] succeeded in 3.8108521800004382s: None 2024-04-21T00:37:01.079850292Z [2024-04-21 00:37:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c39e19c7-64d1-46a8-90a0-ec1dfe1d7866] received 2024-04-21T00:37:01.094803346Z [2024-04-21 00:37:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ecf635c-ffa0-4027-879a-b52e6849f12c] received 2024-04-21T00:37:01.096189221Z [2024-04-21 00:37:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e252900-bd53-436e-900f-129238b0bfc6] received 2024-04-21T00:37:01.101851084Z [2024-04-21 00:37:01,101: INFO/ForkPoolWorker-15] [c39e19c7-64d1-46a8-90a0-ec1dfe1d7866] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:37:01.105862765Z [2024-04-21 00:37:01,105: INFO/ForkPoolWorker-16] [8ecf635c-ffa0-4027-879a-b52e6849f12c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:37:01.106644618Z [2024-04-21 00:37:01,106: INFO/ForkPoolWorker-1] [3e252900-bd53-436e-900f-129238b0bfc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:37:01.496810503Z [2024-04-21 00:37:01,486: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:37:01.509148158Z [2024-04-21 00:37:01,494: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:37:01.539764441Z [2024-04-21 00:37:01,536: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:37:01.662353030Z [2024-04-21 00:37:01,661: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:37:01.668105281Z [2024-04-21 00:37:01,667: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:37:01.698826949Z [2024-04-21 00:37:01,698: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:37:01.699803550Z [2024-04-21 00:37:01,699: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:37:01.699998685Z [2024-04-21 00:37:01,699: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:37:01.700126365Z [2024-04-21 00:37:01,700: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:37:01.700377035Z [2024-04-21 00:37:01,700: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:37:01.783512613Z [2024-04-21 00:37:01,783: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:37:02.340919327Z [2024-04-21 00:37:02,340: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3e252900-bd53-436e-900f-129238b0bfc6] succeeded in 1.242350329999681s: None 2024-04-21T00:37:02.680566517Z [2024-04-21 00:37:02,680: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:37:02.684093173Z [2024-04-21 00:37:02,683: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:37:02.706191469Z [2024-04-21 00:37:02,705: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:37:02.707694981Z [2024-04-21 00:37:02,707: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:37:02.707708527Z [2024-04-21 00:37:02,707: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:37:02.707964789Z [2024-04-21 00:37:02,707: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:37:02.708104208Z [2024-04-21 00:37:02,707: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:37:02.708463137Z [2024-04-21 00:37:02,708: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:37:02.708563285Z [2024-04-21 00:37:02,708: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:37:02.789008583Z [2024-04-21 00:37:02,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:37:02.852562424Z [2024-04-21 00:37:02,852: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:37:02.855858050Z [2024-04-21 00:37:02,855: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:37:02.895943798Z [2024-04-21 00:37:02,895: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:37:02.898048967Z [2024-04-21 00:37:02,897: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:37:02.898079459Z [2024-04-21 00:37:02,897: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:37:02.898275572Z [2024-04-21 00:37:02,898: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:37:02.898361072Z [2024-04-21 00:37:02,898: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:37:02.898662523Z [2024-04-21 00:37:02,898: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:37:02.898834063Z [2024-04-21 00:37:02,898: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:37:02.986951150Z [2024-04-21 00:37:02,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:37:04.704883304Z [2024-04-21 00:37:04,704: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ecf635c-ffa0-4027-879a-b52e6849f12c] succeeded in 3.608514631999242s: None 2024-04-21T00:37:05.011070675Z [2024-04-21 00:37:05,010: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c39e19c7-64d1-46a8-90a0-ec1dfe1d7866] succeeded in 3.9199815410001975s: None 2024-04-21T00:38:00.407385115Z [2024-04-21 00:38:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93a553c6-602c-42d1-8fb1-691f8717de44] received 2024-04-21T00:38:00.414189154Z [2024-04-21 00:38:00,413: INFO/ForkPoolWorker-15] [93a553c6-602c-42d1-8fb1-691f8717de44] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:38:00.415174140Z [2024-04-21 00:38:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f4ecc3a-7514-4470-a4bb-ac1a93845a8c] received 2024-04-21T00:38:00.422008144Z [2024-04-21 00:38:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41c8f62d-4855-431d-accf-07ac691ab0a7] received 2024-04-21T00:38:00.425724143Z [2024-04-21 00:38:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0010bf0c-f4c0-47b0-9e0c-514ae6a8b728] received 2024-04-21T00:38:00.428680401Z [2024-04-21 00:38:00,428: INFO/ForkPoolWorker-16] [5f4ecc3a-7514-4470-a4bb-ac1a93845a8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:38:00.432815671Z [2024-04-21 00:38:00,432: INFO/ForkPoolWorker-1] [41c8f62d-4855-431d-accf-07ac691ab0a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:38:00.437319162Z [2024-04-21 00:38:00,436: INFO/ForkPoolWorker-2] [0010bf0c-f4c0-47b0-9e0c-514ae6a8b728] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:38:00.718621673Z [2024-04-21 00:38:00,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:38:00.793226655Z [2024-04-21 00:38:00,790: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:38:00.820413039Z [2024-04-21 00:38:00,817: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:38:00.833874416Z [2024-04-21 00:38:00,831: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:38:00.942402727Z [2024-04-21 00:38:00,942: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:38:00.972404835Z [2024-04-21 00:38:00,972: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:38:00.976051097Z [2024-04-21 00:38:00,975: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:38:01.005831368Z [2024-04-21 00:38:01,005: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:38:01.007099267Z [2024-04-21 00:38:01,006: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:38:01.007217745Z [2024-04-21 00:38:01,007: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:38:01.007291679Z [2024-04-21 00:38:01,007: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:38:01.007538095Z [2024-04-21 00:38:01,007: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:38:01.103852739Z [2024-04-21 00:38:01,090: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:38:01.528926983Z [2024-04-21 00:38:01,528: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93a553c6-602c-42d1-8fb1-691f8717de44] succeeded in 1.1200710350003646s: None 2024-04-21T00:38:01.787553558Z [2024-04-21 00:38:01,787: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0010bf0c-f4c0-47b0-9e0c-514ae6a8b728] succeeded in 1.3603682429993569s: None 2024-04-21T00:38:02.171711182Z [2024-04-21 00:38:02,171: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:38:02.174903259Z [2024-04-21 00:38:02,174: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:38:02.195825758Z [2024-04-21 00:38:02,195: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:38:02.197018482Z [2024-04-21 00:38:02,196: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:38:02.197090849Z [2024-04-21 00:38:02,196: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:38:02.197203827Z [2024-04-21 00:38:02,197: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:38:02.197294294Z [2024-04-21 00:38:02,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:38:02.197546822Z [2024-04-21 00:38:02,197: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:38:02.197604252Z [2024-04-21 00:38:02,197: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:38:02.243095827Z [2024-04-21 00:38:02,242: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:38:02.246989730Z [2024-04-21 00:38:02,246: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:38:02.283497122Z [2024-04-21 00:38:02,283: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:38:02.285411916Z [2024-04-21 00:38:02,285: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:38:02.288672502Z [2024-04-21 00:38:02,288: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:38:02.288969347Z [2024-04-21 00:38:02,288: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:38:02.289244925Z [2024-04-21 00:38:02,289: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:38:02.289524900Z [2024-04-21 00:38:02,289: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:38:02.290010813Z [2024-04-21 00:38:02,289: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:38:02.290217794Z [2024-04-21 00:38:02,290: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:38:02.393589978Z [2024-04-21 00:38:02,393: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:38:04.236691801Z [2024-04-21 00:38:04,236: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41c8f62d-4855-431d-accf-07ac691ab0a7] succeeded in 3.8094819309999366s: None 2024-04-21T00:38:04.761247989Z [2024-04-21 00:38:04,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5f4ecc3a-7514-4470-a4bb-ac1a93845a8c] succeeded in 4.34305014200072s: None 2024-04-21T00:39:00.362436067Z [2024-04-21 00:39:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7af57760-a599-4736-b8dc-8acba15a69e1] received 2024-04-21T00:39:00.369252603Z [2024-04-21 00:39:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab3988fd-c121-4db0-957f-ef97bffa0f9a] received 2024-04-21T00:39:00.377073480Z [2024-04-21 00:39:00,376: INFO/ForkPoolWorker-16] [ab3988fd-c121-4db0-957f-ef97bffa0f9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:39:00.384191342Z [2024-04-21 00:39:00,383: INFO/ForkPoolWorker-15] [7af57760-a599-4736-b8dc-8acba15a69e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:39:00.407155332Z [2024-04-21 00:39:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe898d1b-324c-47a2-8e3e-85f1a1b51b12] received 2024-04-21T00:39:00.435428061Z [2024-04-21 00:39:00,435: INFO/ForkPoolWorker-1] [fe898d1b-324c-47a2-8e3e-85f1a1b51b12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:39:00.782669948Z [2024-04-21 00:39:00,779: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:39:00.824629058Z [2024-04-21 00:39:00,813: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:39:00.975810760Z [2024-04-21 00:39:00,966: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:39:01.108466498Z [2024-04-21 00:39:01,107: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T00:39:01.120748109Z [2024-04-21 00:39:01,112: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:39:01.165954454Z [2024-04-21 00:39:01,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:39:01.168136542Z [2024-04-21 00:39:01,167: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:39:01.168476001Z [2024-04-21 00:39:01,168: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:39:01.168486694Z [2024-04-21 00:39:01,168: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T00:39:01.168893822Z [2024-04-21 00:39:01,168: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:39:01.288962101Z [2024-04-21 00:39:01,288: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:39:02.053697379Z [2024-04-21 00:39:02,053: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7af57760-a599-4736-b8dc-8acba15a69e1] succeeded in 1.68935230399984s: None 2024-04-21T00:39:02.426528517Z [2024-04-21 00:39:02,426: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:39:02.429806612Z [2024-04-21 00:39:02,429: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:39:02.437924442Z [2024-04-21 00:39:02,437: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:39:02.441431772Z [2024-04-21 00:39:02,440: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:39:02.451976070Z [2024-04-21 00:39:02,451: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:39:02.453513463Z [2024-04-21 00:39:02,453: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:39:02.453645648Z [2024-04-21 00:39:02,453: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:39:02.453886580Z [2024-04-21 00:39:02,453: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:39:02.454034851Z [2024-04-21 00:39:02,453: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:39:02.454322667Z [2024-04-21 00:39:02,454: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:39:02.454538448Z [2024-04-21 00:39:02,454: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:39:02.464389446Z [2024-04-21 00:39:02,464: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:39:02.465506952Z [2024-04-21 00:39:02,465: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:39:02.465611804Z [2024-04-21 00:39:02,465: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:39:02.465794207Z [2024-04-21 00:39:02,465: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:39:02.465866820Z [2024-04-21 00:39:02,465: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:39:02.466367160Z [2024-04-21 00:39:02,466: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:39:02.466430125Z [2024-04-21 00:39:02,466: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:39:02.542673771Z [2024-04-21 00:39:02,542: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:39:02.555476935Z [2024-04-21 00:39:02,555: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:39:04.000862140Z [2024-04-21 00:39:04,000: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ab3988fd-c121-4db0-957f-ef97bffa0f9a] succeeded in 3.629669892000493s: None 2024-04-21T00:39:05.576279468Z [2024-04-21 00:39:05,575: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe898d1b-324c-47a2-8e3e-85f1a1b51b12] succeeded in 5.162733539999863s: None 2024-04-21T00:40:00.796958642Z [2024-04-21 00:40:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cc9adec-ae81-4ef1-a0f6-a343f20d30e7] received 2024-04-21T00:40:00.801591417Z [2024-04-21 00:40:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71261522-2f6a-4605-8fab-2a8da635aa2f] received 2024-04-21T00:40:00.805107207Z [2024-04-21 00:40:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9fb2cb7-c8e8-4832-8b73-9441738c8962] received 2024-04-21T00:40:00.807428644Z [2024-04-21 00:40:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2a90d53-a4f7-41f4-b4a0-53592a3b38c4] received 2024-04-21T00:40:00.810068035Z [2024-04-21 00:40:00,809: INFO/ForkPoolWorker-16] [71261522-2f6a-4605-8fab-2a8da635aa2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:40:00.811116544Z [2024-04-21 00:40:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c5b7d8b-c773-4b88-b822-d1f6559d5f5d] received 2024-04-21T00:40:00.814612497Z [2024-04-21 00:40:00,814: INFO/ForkPoolWorker-15] [7cc9adec-ae81-4ef1-a0f6-a343f20d30e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:40:00.823152587Z [2024-04-21 00:40:00,822: INFO/ForkPoolWorker-1] [d9fb2cb7-c8e8-4832-8b73-9441738c8962] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:40:00.833983559Z [2024-04-21 00:40:00,833: INFO/ForkPoolWorker-3] [1c5b7d8b-c773-4b88-b822-d1f6559d5f5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:40:00.845790673Z [2024-04-21 00:40:00,845: INFO/ForkPoolWorker-2] [b2a90d53-a4f7-41f4-b4a0-53592a3b38c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:40:01.149200464Z [2024-04-21 00:40:01,145: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:40:01.246655604Z [2024-04-21 00:40:01,240: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:40:01.323666351Z [2024-04-21 00:40:01,320: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:40:01.345746940Z [2024-04-21 00:40:01,341: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:40:01.418546927Z [2024-04-21 00:40:01,418: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:40:01.563822364Z [2024-04-21 00:40:01,559: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:40:01.998226490Z [2024-04-21 00:40:01,997: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-21T00:40:02.003695255Z [2024-04-21 00:40:02,003: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:40:02.068419225Z [2024-04-21 00:40:02,068: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T00:40:02.071627133Z [2024-04-21 00:40:02,071: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:40:02.073497426Z [2024-04-21 00:40:02,071: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:40:02.073699948Z [2024-04-21 00:40:02,073: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-21T00:40:02.074180631Z [2024-04-21 00:40:02,074: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:40:02.203262172Z [2024-04-21 00:40:02,202: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71261522-2f6a-4605-8fab-2a8da635aa2f] succeeded in 1.3993542690004688s: None 2024-04-21T00:40:02.213891396Z [2024-04-21 00:40:02,213: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:40:02.766116226Z [2024-04-21 00:40:02,765: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:40:02.797496883Z [2024-04-21 00:40:02,797: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:40:02.849401806Z [2024-04-21 00:40:02,849: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:40:02.853582910Z [2024-04-21 00:40:02,853: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:40:02.853778474Z [2024-04-21 00:40:02,853: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:40:02.855655810Z [2024-04-21 00:40:02,855: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:40:02.855830012Z [2024-04-21 00:40:02,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:40:02.856137764Z [2024-04-21 00:40:02,856: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:40:02.856336319Z [2024-04-21 00:40:02,856: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:40:03.040403273Z [2024-04-21 00:40:03,040: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1c5b7d8b-c773-4b88-b822-d1f6559d5f5d] succeeded in 2.225930771000094s: None 2024-04-21T00:40:03.047563416Z [2024-04-21 00:40:03,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:40:03.227979706Z [2024-04-21 00:40:03,227: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:40:03.231354615Z [2024-04-21 00:40:03,230: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:40:03.283164788Z [2024-04-21 00:40:03,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:40:03.286598705Z [2024-04-21 00:40:03,286: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:40:03.286811480Z [2024-04-21 00:40:03,286: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:40:03.287005346Z [2024-04-21 00:40:03,286: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:40:03.287140821Z [2024-04-21 00:40:03,287: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:40:03.287443266Z [2024-04-21 00:40:03,287: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:40:03.287590860Z [2024-04-21 00:40:03,287: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:40:03.417648887Z [2024-04-21 00:40:03,417: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:40:03.730295656Z [2024-04-21 00:40:03,729: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:40:03.733940575Z [2024-04-21 00:40:03,733: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:40:03.867519644Z [2024-04-21 00:40:03,867: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:40:03.872574574Z [2024-04-21 00:40:03,872: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:40:03.872856064Z [2024-04-21 00:40:03,872: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:40:03.873132881Z [2024-04-21 00:40:03,872: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:40:03.873304168Z [2024-04-21 00:40:03,873: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:40:03.874436247Z [2024-04-21 00:40:03,874: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:40:03.877372736Z [2024-04-21 00:40:03,877: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:40:04.041590852Z [2024-04-21 00:40:04,038: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7cc9adec-ae81-4ef1-a0f6-a343f20d30e7] succeeded in 3.2392874110000776s: None 2024-04-21T00:40:04.101855582Z [2024-04-21 00:40:04,101: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:40:04.212490912Z [2024-04-21 00:40:04,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1920a6ec-f9ac-4969-9bc6-4113fed1d3dd] received 2024-04-21T00:40:04.218620441Z [2024-04-21 00:40:04,218: INFO/ForkPoolWorker-15] [1920a6ec-f9ac-4969-9bc6-4113fed1d3dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:40:04.696124881Z [2024-04-21 00:40:04,682: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:40:05.709106422Z [2024-04-21 00:40:05,708: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b2a90d53-a4f7-41f4-b4a0-53592a3b38c4] succeeded in 4.891275609999866s: None 2024-04-21T00:40:05.789350542Z [2024-04-21 00:40:05,788: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9fb2cb7-c8e8-4832-8b73-9441738c8962] succeeded in 4.981363799000064s: None 2024-04-21T00:40:05.854747644Z [2024-04-21 00:40:05,854: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:40:05.857851704Z [2024-04-21 00:40:05,857: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:40:05.877810538Z [2024-04-21 00:40:05,877: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:40:05.879195242Z [2024-04-21 00:40:05,878: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:40:05.879712872Z [2024-04-21 00:40:05,879: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:40:05.879808521Z [2024-04-21 00:40:05,879: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:40:05.879874908Z [2024-04-21 00:40:05,879: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:40:05.880134390Z [2024-04-21 00:40:05,879: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:40:05.880167785Z [2024-04-21 00:40:05,880: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:40:05.995216787Z [2024-04-21 00:40:05,994: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:40:06.764732813Z [2024-04-21 00:40:06,764: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1920a6ec-f9ac-4969-9bc6-4113fed1d3dd] succeeded in 2.5506395490001523s: None 2024-04-21T00:40:06.767318230Z [2024-04-21 00:40:06,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25244d6e-5249-4f1e-8ee4-4fd0b2c47f18] received 2024-04-21T00:40:06.772586499Z [2024-04-21 00:40:06,772: INFO/ForkPoolWorker-15] [25244d6e-5249-4f1e-8ee4-4fd0b2c47f18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:40:07.056093740Z [2024-04-21 00:40:07,052: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:40:08.060669740Z [2024-04-21 00:40:08,060: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:40:08.063823702Z [2024-04-21 00:40:08,063: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:40:08.089007819Z [2024-04-21 00:40:08,088: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:40:08.090589213Z [2024-04-21 00:40:08,090: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:40:08.090641006Z [2024-04-21 00:40:08,090: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:40:08.090652698Z [2024-04-21 00:40:08,090: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:40:08.090748958Z [2024-04-21 00:40:08,090: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:40:08.090948737Z [2024-04-21 00:40:08,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:40:08.090968700Z [2024-04-21 00:40:08,090: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:40:08.191099064Z [2024-04-21 00:40:08,190: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:40:08.782961716Z [2024-04-21 00:40:08,782: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25244d6e-5249-4f1e-8ee4-4fd0b2c47f18] succeeded in 2.0136647640001684s: None 2024-04-21T00:40:09.325504578Z [2024-04-21 00:40:09,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[184bc225-300c-497e-8ca1-dbee4f9bacc6] received 2024-04-21T00:40:09.336747470Z [2024-04-21 00:40:09,336: INFO/ForkPoolWorker-15] [184bc225-300c-497e-8ca1-dbee4f9bacc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:40:09.603627404Z [2024-04-21 00:40:09,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:40:10.633959889Z [2024-04-21 00:40:10,633: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:40:10.637031964Z [2024-04-21 00:40:10,636: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:40:10.658267546Z [2024-04-21 00:40:10,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:40:10.659618857Z [2024-04-21 00:40:10,659: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:40:10.659638355Z [2024-04-21 00:40:10,659: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:40:10.659825628Z [2024-04-21 00:40:10,659: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:40:10.659876008Z [2024-04-21 00:40:10,659: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:40:10.660186862Z [2024-04-21 00:40:10,659: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:40:10.660196856Z [2024-04-21 00:40:10,660: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:40:10.757220223Z [2024-04-21 00:40:10,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:40:11.396970014Z [2024-04-21 00:40:11,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[184bc225-300c-497e-8ca1-dbee4f9bacc6] succeeded in 2.0683704059993033s: None 2024-04-21T00:41:00.341175474Z [2024-04-21 00:41:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf1f01d3-9e11-4ba8-8ec5-8dc4e29d35d2] received 2024-04-21T00:41:00.347106719Z [2024-04-21 00:41:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00f91ba4-bbf6-4d6e-a433-5c4b6712c8de] received 2024-04-21T00:41:00.349545511Z [2024-04-21 00:41:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c36e6ad0-1f33-4242-9e04-d10fbd49013c] received 2024-04-21T00:41:00.358334930Z [2024-04-21 00:41:00,357: INFO/ForkPoolWorker-1] [c36e6ad0-1f33-4242-9e04-d10fbd49013c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:41:00.364623911Z [2024-04-21 00:41:00,364: INFO/ForkPoolWorker-15] [bf1f01d3-9e11-4ba8-8ec5-8dc4e29d35d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:41:00.366230382Z [2024-04-21 00:41:00,365: INFO/ForkPoolWorker-16] [00f91ba4-bbf6-4d6e-a433-5c4b6712c8de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:41:00.650736820Z [2024-04-21 00:41:00,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:41:00.684196536Z [2024-04-21 00:41:00,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:41:00.701233355Z [2024-04-21 00:41:00,694: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:41:00.892234501Z [2024-04-21 00:41:00,891: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:41:00.896339710Z [2024-04-21 00:41:00,895: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:41:00.931664482Z [2024-04-21 00:41:00,931: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:41:00.933115528Z [2024-04-21 00:41:00,932: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:41:00.933327954Z [2024-04-21 00:41:00,933: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:41:00.933472690Z [2024-04-21 00:41:00,933: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:41:00.933785617Z [2024-04-21 00:41:00,933: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:41:01.057423028Z [2024-04-21 00:41:01,057: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:41:01.658668246Z [2024-04-21 00:41:01,658: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c36e6ad0-1f33-4242-9e04-d10fbd49013c] succeeded in 1.3078458859999955s: None 2024-04-21T00:41:01.884496922Z [2024-04-21 00:41:01,883: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:41:01.888198091Z [2024-04-21 00:41:01,887: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:41:01.932958000Z [2024-04-21 00:41:01,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:41:01.936877500Z [2024-04-21 00:41:01,936: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:41:01.936896119Z [2024-04-21 00:41:01,936: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:41:01.937057026Z [2024-04-21 00:41:01,936: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:41:01.937162234Z [2024-04-21 00:41:01,937: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:41:01.937455819Z [2024-04-21 00:41:01,937: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:41:01.937507106Z [2024-04-21 00:41:01,937: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:41:01.942597510Z [2024-04-21 00:41:01,942: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:41:01.945983111Z [2024-04-21 00:41:01,945: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:41:01.964659166Z [2024-04-21 00:41:01,964: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:41:01.965900682Z [2024-04-21 00:41:01,965: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:41:01.966045467Z [2024-04-21 00:41:01,965: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:41:01.966259480Z [2024-04-21 00:41:01,966: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:41:01.966416992Z [2024-04-21 00:41:01,966: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:41:01.966719352Z [2024-04-21 00:41:01,966: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:41:01.967127506Z [2024-04-21 00:41:01,966: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:41:02.037462107Z [2024-04-21 00:41:02,037: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:41:02.088866893Z [2024-04-21 00:41:02,088: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:41:03.772156099Z [2024-04-21 00:41:03,771: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[00f91ba4-bbf6-4d6e-a433-5c4b6712c8de] succeeded in 3.4211785329998747s: None 2024-04-21T00:41:04.141230989Z [2024-04-21 00:41:04,140: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf1f01d3-9e11-4ba8-8ec5-8dc4e29d35d2] succeeded in 3.7935563490000277s: None 2024-04-21T00:42:00.397560875Z [2024-04-21 00:42:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34fa8d36-7e6e-4b78-bf90-866304dddd1f] received 2024-04-21T00:42:00.401789043Z [2024-04-21 00:42:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a6fec8f-0d4c-4c52-8237-f3955b93f3a3] received 2024-04-21T00:42:00.405889268Z [2024-04-21 00:42:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29b5738b-cad8-4a82-8651-5009ce4c3dce] received 2024-04-21T00:42:00.408296912Z [2024-04-21 00:42:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95314f9c-5c90-4c40-93a1-3ace36b79767] received 2024-04-21T00:42:00.411301590Z [2024-04-21 00:42:00,411: INFO/ForkPoolWorker-16] [7a6fec8f-0d4c-4c52-8237-f3955b93f3a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:42:00.422419260Z [2024-04-21 00:42:00,422: INFO/ForkPoolWorker-2] [95314f9c-5c90-4c40-93a1-3ace36b79767] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:42:00.427108511Z [2024-04-21 00:42:00,426: INFO/ForkPoolWorker-15] [34fa8d36-7e6e-4b78-bf90-866304dddd1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:42:00.434265149Z [2024-04-21 00:42:00,433: INFO/ForkPoolWorker-1] [29b5738b-cad8-4a82-8651-5009ce4c3dce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:42:00.737683752Z [2024-04-21 00:42:00,734: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:42:00.741145231Z [2024-04-21 00:42:00,737: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:42:00.794073559Z [2024-04-21 00:42:00,790: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:42:00.856083042Z [2024-04-21 00:42:00,844: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:42:00.918057682Z [2024-04-21 00:42:00,917: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:42:00.922208657Z [2024-04-21 00:42:00,921: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:42:00.944542700Z [2024-04-21 00:42:00,944: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:42:00.946185010Z [2024-04-21 00:42:00,946: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:42:00.946381944Z [2024-04-21 00:42:00,946: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:42:00.946526315Z [2024-04-21 00:42:00,946: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:42:00.946789348Z [2024-04-21 00:42:00,946: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:42:01.025981966Z [2024-04-21 00:42:01,025: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:42:01.075751699Z [2024-04-21 00:42:01,074: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:42:01.675653380Z [2024-04-21 00:42:01,675: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7a6fec8f-0d4c-4c52-8237-f3955b93f3a3] succeeded in 1.2724921429999085s: None 2024-04-21T00:42:01.765194406Z [2024-04-21 00:42:01,764: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29b5738b-cad8-4a82-8651-5009ce4c3dce] succeeded in 1.3545572909997645s: None 2024-04-21T00:42:02.110613392Z [2024-04-21 00:42:02,110: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:42:02.118666386Z [2024-04-21 00:42:02,118: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:42:02.136240016Z [2024-04-21 00:42:02,136: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:42:02.137307465Z [2024-04-21 00:42:02,137: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:42:02.137364747Z [2024-04-21 00:42:02,137: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:42:02.137483936Z [2024-04-21 00:42:02,137: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:42:02.137576514Z [2024-04-21 00:42:02,137: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:42:02.137832196Z [2024-04-21 00:42:02,137: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:42:02.138120778Z [2024-04-21 00:42:02,137: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:42:02.169811234Z [2024-04-21 00:42:02,169: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:42:02.172875823Z [2024-04-21 00:42:02,172: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:42:02.195859279Z [2024-04-21 00:42:02,195: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:42:02.197257406Z [2024-04-21 00:42:02,197: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:42:02.197269386Z [2024-04-21 00:42:02,197: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:42:02.197350513Z [2024-04-21 00:42:02,197: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:42:02.197375376Z [2024-04-21 00:42:02,197: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:42:02.197564783Z [2024-04-21 00:42:02,197: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:42:02.197588684Z [2024-04-21 00:42:02,197: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:42:02.220926632Z [2024-04-21 00:42:02,220: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:42:02.279563243Z [2024-04-21 00:42:02,279: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:42:03.797701050Z [2024-04-21 00:42:03,797: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34fa8d36-7e6e-4b78-bf90-866304dddd1f] succeeded in 3.394716239000445s: None 2024-04-21T00:42:04.125080720Z [2024-04-21 00:42:04,124: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95314f9c-5c90-4c40-93a1-3ace36b79767] succeeded in 3.7125552170000446s: None 2024-04-21T00:43:00.409784333Z [2024-04-21 00:43:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82b897c8-84b9-439d-824d-e9bf21921c8f] received 2024-04-21T00:43:00.412686795Z [2024-04-21 00:43:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23fdb207-f9ad-4b40-8d8b-c7f10d3bb46a] received 2024-04-21T00:43:00.420874926Z [2024-04-21 00:43:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68c0f81f-66d0-495e-8e25-69decd433373] received 2024-04-21T00:43:00.426596372Z [2024-04-21 00:43:00,426: INFO/ForkPoolWorker-15] [82b897c8-84b9-439d-824d-e9bf21921c8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:43:00.428550136Z [2024-04-21 00:43:00,428: INFO/ForkPoolWorker-16] [23fdb207-f9ad-4b40-8d8b-c7f10d3bb46a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:43:00.433530383Z [2024-04-21 00:43:00,433: INFO/ForkPoolWorker-1] [68c0f81f-66d0-495e-8e25-69decd433373] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:43:00.702608546Z [2024-04-21 00:43:00,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:43:00.719318435Z [2024-04-21 00:43:00,716: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:43:00.783198654Z [2024-04-21 00:43:00,780: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:43:00.880850580Z [2024-04-21 00:43:00,880: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T00:43:00.886728460Z [2024-04-21 00:43:00,886: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:43:00.952559205Z [2024-04-21 00:43:00,952: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:43:00.955660671Z [2024-04-21 00:43:00,955: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:43:00.955955933Z [2024-04-21 00:43:00,955: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:43:00.956083038Z [2024-04-21 00:43:00,955: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T00:43:00.956332731Z [2024-04-21 00:43:00,956: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:43:01.147865168Z [2024-04-21 00:43:01,146: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:43:02.031308506Z [2024-04-21 00:43:02,030: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82b897c8-84b9-439d-824d-e9bf21921c8f] succeeded in 1.6166295270004412s: None 2024-04-21T00:43:02.169385387Z [2024-04-21 00:43:02,168: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:43:02.174437862Z [2024-04-21 00:43:02,173: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:43:02.209351843Z [2024-04-21 00:43:02,209: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:43:02.210333264Z [2024-04-21 00:43:02,210: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:43:02.210356721Z [2024-04-21 00:43:02,210: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:43:02.210467233Z [2024-04-21 00:43:02,210: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:43:02.210477797Z [2024-04-21 00:43:02,210: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:43:02.210667771Z [2024-04-21 00:43:02,210: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:43:02.210696420Z [2024-04-21 00:43:02,210: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:43:02.280747814Z [2024-04-21 00:43:02,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:43:02.351957868Z [2024-04-21 00:43:02,351: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:43:02.355068359Z [2024-04-21 00:43:02,354: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:43:02.378199677Z [2024-04-21 00:43:02,377: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:43:02.379627823Z [2024-04-21 00:43:02,379: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:43:02.379807219Z [2024-04-21 00:43:02,379: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:43:02.380039368Z [2024-04-21 00:43:02,379: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:43:02.380176609Z [2024-04-21 00:43:02,380: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:43:02.380472245Z [2024-04-21 00:43:02,380: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:43:02.380602120Z [2024-04-21 00:43:02,380: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:43:02.451249409Z [2024-04-21 00:43:02,450: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:43:04.016407300Z [2024-04-21 00:43:04,016: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[68c0f81f-66d0-495e-8e25-69decd433373] succeeded in 3.590305740000076s: None 2024-04-21T00:43:04.388807434Z [2024-04-21 00:43:04,388: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23fdb207-f9ad-4b40-8d8b-c7f10d3bb46a] succeeded in 3.9729129419993114s: None 2024-04-21T00:44:00.676010438Z [2024-04-21 00:44:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c50e50a-4cbb-4d2c-aa4c-35e83b0e62b7] received 2024-04-21T00:44:00.680283668Z [2024-04-21 00:44:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaa249a3-6889-4420-b0e4-6a3011e30d40] received 2024-04-21T00:44:00.687134579Z [2024-04-21 00:44:00,686: INFO/ForkPoolWorker-15] [7c50e50a-4cbb-4d2c-aa4c-35e83b0e62b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:44:00.690038912Z [2024-04-21 00:44:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ae2bf30-b423-4b7e-a5d9-2686e387bb0c] received 2024-04-21T00:44:00.696006107Z [2024-04-21 00:44:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[878500ed-9a33-42a7-bd53-5f986a55ea83] received 2024-04-21T00:44:00.704354370Z [2024-04-21 00:44:00,704: INFO/ForkPoolWorker-2] [878500ed-9a33-42a7-bd53-5f986a55ea83] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:44:00.704604768Z [2024-04-21 00:44:00,704: INFO/ForkPoolWorker-1] [8ae2bf30-b423-4b7e-a5d9-2686e387bb0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:44:00.707289264Z [2024-04-21 00:44:00,707: INFO/ForkPoolWorker-16] [aaa249a3-6889-4420-b0e4-6a3011e30d40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:44:00.999060965Z [2024-04-21 00:44:00,992: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:44:01.063455221Z [2024-04-21 00:44:01,060: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:44:01.115750038Z [2024-04-21 00:44:01,112: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:44:01.139964317Z [2024-04-21 00:44:01,136: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:44:01.248892194Z [2024-04-21 00:44:01,248: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:44:01.368904979Z [2024-04-21 00:44:01,368: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:44:01.382430097Z [2024-04-21 00:44:01,381: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:44:01.425628030Z [2024-04-21 00:44:01,425: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:44:01.426881210Z [2024-04-21 00:44:01,426: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:44:01.426938767Z [2024-04-21 00:44:01,426: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:44:01.427107220Z [2024-04-21 00:44:01,426: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:44:01.427296033Z [2024-04-21 00:44:01,427: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:44:01.613141161Z [2024-04-21 00:44:01,612: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:44:02.016039168Z [2024-04-21 00:44:02,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c50e50a-4cbb-4d2c-aa4c-35e83b0e62b7] succeeded in 1.3347376010005974s: None 2024-04-21T00:44:02.437199815Z [2024-04-21 00:44:02,436: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[878500ed-9a33-42a7-bd53-5f986a55ea83] succeeded in 1.7386002109997207s: None 2024-04-21T00:44:02.503213402Z [2024-04-21 00:44:02,502: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:44:02.506583102Z [2024-04-21 00:44:02,506: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:44:02.545995372Z [2024-04-21 00:44:02,545: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:44:02.548248042Z [2024-04-21 00:44:02,547: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:44:02.548500634Z [2024-04-21 00:44:02,548: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:44:02.548848554Z [2024-04-21 00:44:02,548: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:44:02.549157139Z [2024-04-21 00:44:02,548: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:44:02.549633752Z [2024-04-21 00:44:02,549: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:44:02.549880746Z [2024-04-21 00:44:02,549: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:44:02.600753980Z [2024-04-21 00:44:02,600: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:44:02.604234367Z [2024-04-21 00:44:02,603: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:44:02.628177843Z [2024-04-21 00:44:02,627: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:44:02.663112141Z [2024-04-21 00:44:02,662: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:44:02.664326267Z [2024-04-21 00:44:02,664: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:44:02.664398673Z [2024-04-21 00:44:02,664: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:44:02.664540300Z [2024-04-21 00:44:02,664: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:44:02.664606792Z [2024-04-21 00:44:02,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:44:02.664881494Z [2024-04-21 00:44:02,664: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:44:02.664943037Z [2024-04-21 00:44:02,664: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:44:02.737518950Z [2024-04-21 00:44:02,737: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:44:04.539408222Z [2024-04-21 00:44:04,538: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ae2bf30-b423-4b7e-a5d9-2686e387bb0c] succeeded in 3.8451296690000163s: None 2024-04-21T00:44:05.302815714Z [2024-04-21 00:44:05,302: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aaa249a3-6889-4420-b0e4-6a3011e30d40] succeeded in 4.613584583999909s: None 2024-04-21T00:45:01.045633772Z [2024-04-21 00:45:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d54fa980-f9a7-4385-8fa8-56a43a9e08aa] received 2024-04-21T00:45:01.053409081Z [2024-04-21 00:45:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90a51fb9-3d1e-4c28-955a-9beb7d21e624] received 2024-04-21T00:45:01.057181710Z [2024-04-21 00:45:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9532340-1cd8-4742-b575-6de3a4622d7d] received 2024-04-21T00:45:01.058574045Z [2024-04-21 00:45:01,058: INFO/ForkPoolWorker-15] [d54fa980-f9a7-4385-8fa8-56a43a9e08aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:45:01.061926244Z [2024-04-21 00:45:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[025eece0-b41d-4e1b-82d7-23f994eef995] received 2024-04-21T00:45:01.083889682Z [2024-04-21 00:45:01,082: INFO/ForkPoolWorker-2] [025eece0-b41d-4e1b-82d7-23f994eef995] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:45:01.091821729Z [2024-04-21 00:45:01,088: INFO/ForkPoolWorker-16] [90a51fb9-3d1e-4c28-955a-9beb7d21e624] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:45:01.117750208Z [2024-04-21 00:45:01,112: INFO/ForkPoolWorker-1] [c9532340-1cd8-4742-b575-6de3a4622d7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:45:01.453368378Z [2024-04-21 00:45:01,450: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:45:01.488917738Z [2024-04-21 00:45:01,485: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:45:01.532922517Z [2024-04-21 00:45:01,525: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:45:01.680683632Z [2024-04-21 00:45:01,680: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:45:01.685208923Z [2024-04-21 00:45:01,684: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:45:01.711178114Z [2024-04-21 00:45:01,710: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:45:01.712302951Z [2024-04-21 00:45:01,712: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:45:01.712454676Z [2024-04-21 00:45:01,712: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:45:01.712545895Z [2024-04-21 00:45:01,712: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:45:01.712873247Z [2024-04-21 00:45:01,712: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:45:01.806591501Z [2024-04-21 00:45:01,802: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:45:01.858256085Z [2024-04-21 00:45:01,858: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:45:02.414418733Z [2024-04-21 00:45:02,413: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[025eece0-b41d-4e1b-82d7-23f994eef995] succeeded in 1.3493836739999097s: None 2024-04-21T00:45:02.869396715Z [2024-04-21 00:45:02,869: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:45:02.872436712Z [2024-04-21 00:45:02,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:45:02.909164737Z [2024-04-21 00:45:02,908: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:45:02.910448085Z [2024-04-21 00:45:02,910: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:45:02.910487446Z [2024-04-21 00:45:02,910: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:45:02.910573703Z [2024-04-21 00:45:02,910: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:45:02.910605605Z [2024-04-21 00:45:02,910: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:45:02.910873971Z [2024-04-21 00:45:02,910: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:45:02.910905562Z [2024-04-21 00:45:02,910: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:45:03.021245129Z [2024-04-21 00:45:03,021: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:45:03.084350473Z [2024-04-21 00:45:03,084: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:45:03.087740457Z [2024-04-21 00:45:03,087: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:45:03.099032963Z [2024-04-21 00:45:03,098: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:45:03.102656882Z [2024-04-21 00:45:03,102: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:45:03.117534464Z [2024-04-21 00:45:03,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:45:03.118985463Z [2024-04-21 00:45:03,118: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:45:03.119033902Z [2024-04-21 00:45:03,118: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:45:03.119210196Z [2024-04-21 00:45:03,119: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:45:03.119279162Z [2024-04-21 00:45:03,119: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:45:03.119606321Z [2024-04-21 00:45:03,119: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:45:03.119701265Z [2024-04-21 00:45:03,119: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:45:03.132531989Z [2024-04-21 00:45:03,132: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:45:03.134102810Z [2024-04-21 00:45:03,133: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:45:03.134209829Z [2024-04-21 00:45:03,134: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:45:03.134385959Z [2024-04-21 00:45:03,134: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:45:03.134441797Z [2024-04-21 00:45:03,134: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:45:03.134758088Z [2024-04-21 00:45:03,134: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:45:03.134836829Z [2024-04-21 00:45:03,134: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:45:03.222158070Z [2024-04-21 00:45:03,221: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:45:03.276481081Z [2024-04-21 00:45:03,276: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:45:03.609676562Z [2024-04-21 00:45:03,609: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d54fa980-f9a7-4385-8fa8-56a43a9e08aa] succeeded in 2.5614439989994935s: None 2024-04-21T00:45:04.085686398Z [2024-04-21 00:45:04,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5b7a05f-d070-40b9-91da-400b4675f602] received 2024-04-21T00:45:04.092698733Z [2024-04-21 00:45:04,092: INFO/ForkPoolWorker-15] [a5b7a05f-d070-40b9-91da-400b4675f602] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:45:04.409061251Z [2024-04-21 00:45:04,405: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:45:04.912995165Z [2024-04-21 00:45:04,912: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c9532340-1cd8-4742-b575-6de3a4622d7d] succeeded in 3.852983294999831s: None 2024-04-21T00:45:05.418478772Z [2024-04-21 00:45:05,417: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90a51fb9-3d1e-4c28-955a-9beb7d21e624] succeeded in 4.3575337389993365s: None 2024-04-21T00:45:05.439255974Z [2024-04-21 00:45:05,438: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:45:05.442336658Z [2024-04-21 00:45:05,441: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:45:05.464130894Z [2024-04-21 00:45:05,463: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:45:05.465540778Z [2024-04-21 00:45:05,465: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:45:05.465682345Z [2024-04-21 00:45:05,465: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:45:05.465975623Z [2024-04-21 00:45:05,465: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:45:05.466036294Z [2024-04-21 00:45:05,465: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:45:05.466263116Z [2024-04-21 00:45:05,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:45:05.466367063Z [2024-04-21 00:45:05,466: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:45:05.552301716Z [2024-04-21 00:45:05,551: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:45:06.280097829Z [2024-04-21 00:45:06,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5b7a05f-d070-40b9-91da-400b4675f602] succeeded in 2.1897836489997644s: None 2024-04-21T00:45:06.529056664Z [2024-04-21 00:45:06,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa1d4443-0240-44df-a282-b4b0ad95ea00] received 2024-04-21T00:45:06.543281976Z [2024-04-21 00:45:06,542: INFO/ForkPoolWorker-15] [aa1d4443-0240-44df-a282-b4b0ad95ea00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:45:06.827814540Z [2024-04-21 00:45:06,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:45:07.875654028Z [2024-04-21 00:45:07,875: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:45:07.878520454Z [2024-04-21 00:45:07,878: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:45:07.902859547Z [2024-04-21 00:45:07,902: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:45:07.904645244Z [2024-04-21 00:45:07,904: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:45:07.904715282Z [2024-04-21 00:45:07,904: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:45:07.904886638Z [2024-04-21 00:45:07,904: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:45:07.904961392Z [2024-04-21 00:45:07,904: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:45:07.905276757Z [2024-04-21 00:45:07,905: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:45:07.905298685Z [2024-04-21 00:45:07,905: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:45:07.997791275Z [2024-04-21 00:45:07,997: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:45:08.641401392Z [2024-04-21 00:45:08,640: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa1d4443-0240-44df-a282-b4b0ad95ea00] succeeded in 2.108708439000111s: None 2024-04-21T00:45:08.914493126Z [2024-04-21 00:45:08,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7625ad5b-db9d-431a-9ff2-c8d2eefe7937] received 2024-04-21T00:45:08.926315727Z [2024-04-21 00:45:08,925: INFO/ForkPoolWorker-15] [7625ad5b-db9d-431a-9ff2-c8d2eefe7937] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:45:09.232278942Z [2024-04-21 00:45:09,229: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:45:10.346557223Z [2024-04-21 00:45:10,346: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:45:10.349825059Z [2024-04-21 00:45:10,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:45:10.369258386Z [2024-04-21 00:45:10,369: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:45:10.370264761Z [2024-04-21 00:45:10,370: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:45:10.370280481Z [2024-04-21 00:45:10,370: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:45:10.370400205Z [2024-04-21 00:45:10,370: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:45:10.370410926Z [2024-04-21 00:45:10,370: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:45:10.370667169Z [2024-04-21 00:45:10,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:45:10.370693074Z [2024-04-21 00:45:10,370: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:45:10.448924296Z [2024-04-21 00:45:10,448: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:45:11.086272093Z [2024-04-21 00:45:11,085: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7625ad5b-db9d-431a-9ff2-c8d2eefe7937] succeeded in 2.1680092169999625s: None 2024-04-21T00:46:00.316108575Z [2024-04-21 00:46:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9788a62-b508-4e9b-8714-9b68c9a54b0f] received 2024-04-21T00:46:00.323534587Z [2024-04-21 00:46:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69b12a1b-21ad-489c-9ef3-a764dbc50725] received 2024-04-21T00:46:00.327402087Z [2024-04-21 00:46:00,327: INFO/ForkPoolWorker-15] [a9788a62-b508-4e9b-8714-9b68c9a54b0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:46:00.330941987Z [2024-04-21 00:46:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4f024c8-4832-4fbe-b65d-f95165aaa554] received 2024-04-21T00:46:00.335379027Z [2024-04-21 00:46:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbe2db22-c2ef-42f0-baa8-628c58638695] received 2024-04-21T00:46:00.337216806Z [2024-04-21 00:46:00,336: INFO/ForkPoolWorker-16] [69b12a1b-21ad-489c-9ef3-a764dbc50725] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:46:00.353262161Z [2024-04-21 00:46:00,352: INFO/ForkPoolWorker-1] [d4f024c8-4832-4fbe-b65d-f95165aaa554] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:46:00.356496053Z [2024-04-21 00:46:00,356: INFO/ForkPoolWorker-2] [cbe2db22-c2ef-42f0-baa8-628c58638695] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:46:00.664324659Z [2024-04-21 00:46:00,661: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:46:00.669432845Z [2024-04-21 00:46:00,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:46:00.702435503Z [2024-04-21 00:46:00,699: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:46:00.702459161Z [2024-04-21 00:46:00,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:46:00.884655806Z [2024-04-21 00:46:00,884: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:46:00.888435843Z [2024-04-21 00:46:00,888: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:46:00.909715592Z [2024-04-21 00:46:00,909: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:46:00.910575635Z [2024-04-21 00:46:00,910: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:46:00.910619222Z [2024-04-21 00:46:00,910: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:46:00.910676389Z [2024-04-21 00:46:00,910: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:46:00.910876376Z [2024-04-21 00:46:00,910: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:46:00.952423299Z [2024-04-21 00:46:00,952: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:46:01.037220711Z [2024-04-21 00:46:01,036: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:46:01.647914527Z [2024-04-21 00:46:01,647: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4f024c8-4832-4fbe-b65d-f95165aaa554] succeeded in 1.3142011509999065s: None 2024-04-21T00:46:01.837615540Z [2024-04-21 00:46:01,837: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69b12a1b-21ad-489c-9ef3-a764dbc50725] succeeded in 1.5122320640002727s: None 2024-04-21T00:46:02.072659581Z [2024-04-21 00:46:02,072: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:46:02.075764813Z [2024-04-21 00:46:02,075: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:46:02.093443854Z [2024-04-21 00:46:02,093: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:46:02.096637954Z [2024-04-21 00:46:02,096: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:46:02.101381539Z [2024-04-21 00:46:02,101: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:46:02.103127563Z [2024-04-21 00:46:02,102: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:46:02.103279024Z [2024-04-21 00:46:02,103: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:46:02.103506684Z [2024-04-21 00:46:02,103: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:46:02.103699442Z [2024-04-21 00:46:02,103: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:46:02.104405621Z [2024-04-21 00:46:02,104: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:46:02.104556334Z [2024-04-21 00:46:02,104: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:46:02.117167520Z [2024-04-21 00:46:02,116: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:46:02.120975593Z [2024-04-21 00:46:02,120: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:46:02.120993771Z [2024-04-21 00:46:02,120: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:46:02.121177901Z [2024-04-21 00:46:02,121: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:46:02.121240891Z [2024-04-21 00:46:02,121: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:46:02.121790577Z [2024-04-21 00:46:02,121: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:46:02.121853444Z [2024-04-21 00:46:02,121: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:46:02.190118288Z [2024-04-21 00:46:02,189: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:46:02.195170540Z [2024-04-21 00:46:02,194: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:46:03.746801035Z [2024-04-21 00:46:03,746: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9788a62-b508-4e9b-8714-9b68c9a54b0f] succeeded in 3.428417632999299s: None 2024-04-21T00:46:04.188788519Z [2024-04-21 00:46:04,188: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cbe2db22-c2ef-42f0-baa8-628c58638695] succeeded in 3.848198714999853s: None 2024-04-21T00:47:00.443120929Z [2024-04-21 00:47:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf16c9b9-392c-415d-a50d-801a236408aa] received 2024-04-21T00:47:00.448296962Z [2024-04-21 00:47:00,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1cf9bbe-601b-40de-8d5e-530bdbcd6ab5] received 2024-04-21T00:47:00.450189215Z [2024-04-21 00:47:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ff846e2-9f52-4ce1-88fd-daa875543f03] received 2024-04-21T00:47:00.460920430Z [2024-04-21 00:47:00,460: INFO/ForkPoolWorker-15] [cf16c9b9-392c-415d-a50d-801a236408aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:47:00.462487212Z [2024-04-21 00:47:00,462: INFO/ForkPoolWorker-1] [9ff846e2-9f52-4ce1-88fd-daa875543f03] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:47:00.463983466Z [2024-04-21 00:47:00,463: INFO/ForkPoolWorker-16] [c1cf9bbe-601b-40de-8d5e-530bdbcd6ab5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:47:00.754598639Z [2024-04-21 00:47:00,751: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:47:00.785754991Z [2024-04-21 00:47:00,782: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:47:00.928517958Z [2024-04-21 00:47:00,924: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:47:00.939588578Z [2024-04-21 00:47:00,939: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:47:00.943784088Z [2024-04-21 00:47:00,943: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:47:00.971354972Z [2024-04-21 00:47:00,971: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:47:00.976585001Z [2024-04-21 00:47:00,976: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:47:00.976736145Z [2024-04-21 00:47:00,976: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:47:00.976886778Z [2024-04-21 00:47:00,976: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:47:00.977200319Z [2024-04-21 00:47:00,977: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:47:01.074480521Z [2024-04-21 00:47:01,072: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:47:01.581622017Z [2024-04-21 00:47:01,581: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9ff846e2-9f52-4ce1-88fd-daa875543f03] succeeded in 1.1289758049997545s: None 2024-04-21T00:47:01.934303026Z [2024-04-21 00:47:01,933: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:47:01.938026827Z [2024-04-21 00:47:01,937: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:47:01.966097865Z [2024-04-21 00:47:01,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:47:01.967448690Z [2024-04-21 00:47:01,967: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:47:01.967668311Z [2024-04-21 00:47:01,967: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:47:01.967973796Z [2024-04-21 00:47:01,967: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:47:01.968021880Z [2024-04-21 00:47:01,967: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:47:01.968890492Z [2024-04-21 00:47:01,968: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:47:01.968993793Z [2024-04-21 00:47:01,968: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:47:02.091742398Z [2024-04-21 00:47:02,091: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:47:02.294762327Z [2024-04-21 00:47:02,294: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:47:02.298932321Z [2024-04-21 00:47:02,298: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:47:02.330892622Z [2024-04-21 00:47:02,330: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:47:02.333969534Z [2024-04-21 00:47:02,333: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:47:02.334173450Z [2024-04-21 00:47:02,334: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:47:02.335999378Z [2024-04-21 00:47:02,335: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:47:02.336225778Z [2024-04-21 00:47:02,336: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:47:02.336653838Z [2024-04-21 00:47:02,336: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:47:02.336851035Z [2024-04-21 00:47:02,336: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:47:02.420785674Z [2024-04-21 00:47:02,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:47:03.778436736Z [2024-04-21 00:47:03,777: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1cf9bbe-601b-40de-8d5e-530bdbcd6ab5] succeeded in 3.3266621679995296s: None 2024-04-21T00:47:04.216673728Z [2024-04-21 00:47:04,216: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf16c9b9-392c-415d-a50d-801a236408aa] succeeded in 3.771615675999783s: None 2024-04-21T00:48:00.913086004Z [2024-04-21 00:48:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c5a919c-9020-4244-bc4a-7464f75d99d4] received 2024-04-21T00:48:00.914774979Z [2024-04-21 00:48:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15aee79f-1fac-453b-9318-c54f225a1796] received 2024-04-21T00:48:00.921616651Z [2024-04-21 00:48:00,921: INFO/ForkPoolWorker-15] [4c5a919c-9020-4244-bc4a-7464f75d99d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:48:00.922982391Z [2024-04-21 00:48:00,922: INFO/ForkPoolWorker-16] [15aee79f-1fac-453b-9318-c54f225a1796] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:48:00.924253112Z [2024-04-21 00:48:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[999a699d-7a82-4e64-9715-7bd0af363bbf] received 2024-04-21T00:48:00.936955717Z [2024-04-21 00:48:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd9b6c42-6fdb-4d55-a965-1cb597978843] received 2024-04-21T00:48:00.949251373Z [2024-04-21 00:48:00,943: INFO/ForkPoolWorker-1] [999a699d-7a82-4e64-9715-7bd0af363bbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:48:00.956562199Z [2024-04-21 00:48:00,956: INFO/ForkPoolWorker-2] [cd9b6c42-6fdb-4d55-a965-1cb597978843] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:48:01.320912707Z [2024-04-21 00:48:01,317: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:48:01.375257079Z [2024-04-21 00:48:01,371: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:48:01.380460029Z [2024-04-21 00:48:01,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:48:01.479762445Z [2024-04-21 00:48:01,470: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:48:01.483820568Z [2024-04-21 00:48:01,482: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:48:01.489143173Z [2024-04-21 00:48:01,487: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:48:01.556557667Z [2024-04-21 00:48:01,556: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:48:01.560555167Z [2024-04-21 00:48:01,560: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:48:01.561284200Z [2024-04-21 00:48:01,560: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:48:01.561401707Z [2024-04-21 00:48:01,561: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:48:01.561642529Z [2024-04-21 00:48:01,561: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:48:01.651947095Z [2024-04-21 00:48:01,651: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:48:01.755222968Z [2024-04-21 00:48:01,755: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:48:02.397544700Z [2024-04-21 00:48:02,397: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cd9b6c42-6fdb-4d55-a965-1cb597978843] succeeded in 1.4563463459999184s: None 2024-04-21T00:48:02.442971613Z [2024-04-21 00:48:02,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c5a919c-9020-4244-bc4a-7464f75d99d4] succeeded in 1.5283036780001567s: None 2024-04-21T00:48:02.869340530Z [2024-04-21 00:48:02,868: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:48:02.872634217Z [2024-04-21 00:48:02,872: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:48:02.898331732Z [2024-04-21 00:48:02,898: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:48:02.900700038Z [2024-04-21 00:48:02,900: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:48:02.900890725Z [2024-04-21 00:48:02,900: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:48:02.901206801Z [2024-04-21 00:48:02,900: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:48:02.901456809Z [2024-04-21 00:48:02,901: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:48:02.901910788Z [2024-04-21 00:48:02,901: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:48:02.902488347Z [2024-04-21 00:48:02,902: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:48:02.980212118Z [2024-04-21 00:48:02,979: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:48:03.337625386Z [2024-04-21 00:48:03,334: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:48:03.343493322Z [2024-04-21 00:48:03,343: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:48:03.417636795Z [2024-04-21 00:48:03,417: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:48:03.418992661Z [2024-04-21 00:48:03,418: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:48:03.419158051Z [2024-04-21 00:48:03,419: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:48:03.419370640Z [2024-04-21 00:48:03,419: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:48:03.419504957Z [2024-04-21 00:48:03,419: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:48:03.419846627Z [2024-04-21 00:48:03,419: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:48:03.419998057Z [2024-04-21 00:48:03,419: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:48:03.493479596Z [2024-04-21 00:48:03,493: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:48:04.531076951Z [2024-04-21 00:48:04,530: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15aee79f-1fac-453b-9318-c54f225a1796] succeeded in 3.614323298000272s: None 2024-04-21T00:48:06.412470151Z [2024-04-21 00:48:06,411: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[999a699d-7a82-4e64-9715-7bd0af363bbf] succeeded in 5.483781731999443s: None 2024-04-21T00:49:00.878045311Z [2024-04-21 00:49:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1d9ef13-1f58-4f37-b943-99da13f07fec] received 2024-04-21T00:49:00.882148290Z [2024-04-21 00:49:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a378067c-935e-4f79-91c7-68be3a9c300d] received 2024-04-21T00:49:00.886048916Z [2024-04-21 00:49:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a618ffb0-f42a-479b-a988-f0880fb08a09] received 2024-04-21T00:49:00.892546632Z [2024-04-21 00:49:00,891: INFO/ForkPoolWorker-16] [a378067c-935e-4f79-91c7-68be3a9c300d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:49:00.897296225Z [2024-04-21 00:49:00,895: INFO/ForkPoolWorker-15] [f1d9ef13-1f58-4f37-b943-99da13f07fec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:49:00.901720374Z [2024-04-21 00:49:00,901: INFO/ForkPoolWorker-1] [a618ffb0-f42a-479b-a988-f0880fb08a09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:49:01.204269699Z [2024-04-21 00:49:01,200: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:49:01.239827551Z [2024-04-21 00:49:01,234: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:49:01.254791482Z [2024-04-21 00:49:01,251: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:49:01.421564219Z [2024-04-21 00:49:01,421: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T00:49:01.425454404Z [2024-04-21 00:49:01,424: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:49:01.448990210Z [2024-04-21 00:49:01,448: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:49:01.450345772Z [2024-04-21 00:49:01,450: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:49:01.450447272Z [2024-04-21 00:49:01,450: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:49:01.450613904Z [2024-04-21 00:49:01,450: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T00:49:01.450874928Z [2024-04-21 00:49:01,450: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:49:01.597139435Z [2024-04-21 00:49:01,596: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:49:02.127152412Z [2024-04-21 00:49:02,126: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1d9ef13-1f58-4f37-b943-99da13f07fec] succeeded in 1.2428043370000523s: None 2024-04-21T00:49:02.555484596Z [2024-04-21 00:49:02,555: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:49:02.558625192Z [2024-04-21 00:49:02,558: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:49:02.583927588Z [2024-04-21 00:49:02,580: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:49:02.585368313Z [2024-04-21 00:49:02,585: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:49:02.585387059Z [2024-04-21 00:49:02,585: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:49:02.585499231Z [2024-04-21 00:49:02,585: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:49:02.585535775Z [2024-04-21 00:49:02,585: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:49:02.585936358Z [2024-04-21 00:49:02,585: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:49:02.586181120Z [2024-04-21 00:49:02,586: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:49:02.638604209Z [2024-04-21 00:49:02,638: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:49:02.641898032Z [2024-04-21 00:49:02,641: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:49:02.667057450Z [2024-04-21 00:49:02,666: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:49:02.668216206Z [2024-04-21 00:49:02,668: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:49:02.668428617Z [2024-04-21 00:49:02,668: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:49:02.668626068Z [2024-04-21 00:49:02,668: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:49:02.668826330Z [2024-04-21 00:49:02,668: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:49:02.669120772Z [2024-04-21 00:49:02,668: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:49:02.669331222Z [2024-04-21 00:49:02,669: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:49:02.724677788Z [2024-04-21 00:49:02,724: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:49:02.742801056Z [2024-04-21 00:49:02,742: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:49:04.508482773Z [2024-04-21 00:49:04,508: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a618ffb0-f42a-479b-a988-f0880fb08a09] succeeded in 3.6185698239987687s: None 2024-04-21T00:49:05.261903434Z [2024-04-21 00:49:05,261: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a378067c-935e-4f79-91c7-68be3a9c300d] succeeded in 4.375009030000001s: None 2024-04-21T00:50:00.851076111Z [2024-04-21 00:50:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f023115-7155-4ba8-bb7b-017b0bc8d17f] received 2024-04-21T00:50:00.853458593Z [2024-04-21 00:50:00,853: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad843f8e-480b-4188-b758-a6c82abc690d] received 2024-04-21T00:50:00.859201400Z [2024-04-21 00:50:00,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66af71ff-37c5-4f1a-8626-b142c525d8a9] received 2024-04-21T00:50:00.860703198Z [2024-04-21 00:50:00,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcc3cb8a-46e8-437d-a92b-e00cd8266bc4] received 2024-04-21T00:50:00.862385026Z [2024-04-21 00:50:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82729930-09b8-4895-9116-3570cae8d233] received 2024-04-21T00:50:00.862695335Z [2024-04-21 00:50:00,862: INFO/ForkPoolWorker-15] [8f023115-7155-4ba8-bb7b-017b0bc8d17f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:50:00.864944429Z [2024-04-21 00:50:00,864: INFO/ForkPoolWorker-16] [ad843f8e-480b-4188-b758-a6c82abc690d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:50:00.877255514Z [2024-04-21 00:50:00,877: INFO/ForkPoolWorker-1] [66af71ff-37c5-4f1a-8626-b142c525d8a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:50:00.888767158Z [2024-04-21 00:50:00,888: INFO/ForkPoolWorker-2] [dcc3cb8a-46e8-437d-a92b-e00cd8266bc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:50:00.893230887Z [2024-04-21 00:50:00,892: INFO/ForkPoolWorker-3] [82729930-09b8-4895-9116-3570cae8d233] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:50:01.442533067Z [2024-04-21 00:50:01,439: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:50:01.501939965Z [2024-04-21 00:50:01,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:50:01.618026264Z [2024-04-21 00:50:01,614: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:50:01.748385821Z [2024-04-21 00:50:01,729: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:50:01.766087683Z [2024-04-21 00:50:01,745: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:50:01.795585725Z [2024-04-21 00:50:01,795: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:50:01.798551606Z [2024-04-21 00:50:01,798: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:50:01.803571269Z [2024-04-21 00:50:01,803: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:50:01.862481607Z [2024-04-21 00:50:01,862: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:50:01.864506332Z [2024-04-21 00:50:01,864: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:50:01.864668495Z [2024-04-21 00:50:01,864: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:50:01.864739772Z [2024-04-21 00:50:01,864: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:50:01.865047478Z [2024-04-21 00:50:01,864: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:50:02.060374665Z [2024-04-21 00:50:02,060: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:50:02.837078987Z [2024-04-21 00:50:02,836: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad843f8e-480b-4188-b758-a6c82abc690d] succeeded in 1.9813898679985869s: None 2024-04-21T00:50:02.858074215Z [2024-04-21 00:50:02,857: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dcc3cb8a-46e8-437d-a92b-e00cd8266bc4] succeeded in 1.9939808500002982s: None 2024-04-21T00:50:03.706135219Z [2024-04-21 00:50:03,705: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T00:50:03.709733624Z [2024-04-21 00:50:03,709: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:50:03.754596409Z [2024-04-21 00:50:03,754: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T00:50:03.759932662Z [2024-04-21 00:50:03,756: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:50:03.764075460Z [2024-04-21 00:50:03,763: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:50:03.764443624Z [2024-04-21 00:50:03,764: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:50:03.764889615Z [2024-04-21 00:50:03,764: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T00:50:03.766115630Z [2024-04-21 00:50:03,765: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:50:03.766429058Z [2024-04-21 00:50:03,766: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:50:03.788270730Z [2024-04-21 00:50:03,787: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:50:03.792688449Z [2024-04-21 00:50:03,792: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:50:03.867864632Z [2024-04-21 00:50:03,862: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:50:03.867888133Z [2024-04-21 00:50:03,863: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:50:03.867893693Z [2024-04-21 00:50:03,864: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:50:03.867900416Z [2024-04-21 00:50:03,864: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:50:03.867906082Z [2024-04-21 00:50:03,864: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:50:03.867910509Z [2024-04-21 00:50:03,864: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:50:03.867914745Z [2024-04-21 00:50:03,864: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:50:03.911162845Z [2024-04-21 00:50:03,910: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:50:03.939871485Z [2024-04-21 00:50:03,939: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:50:03.943099725Z [2024-04-21 00:50:03,942: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:50:04.009979411Z [2024-04-21 00:50:04,009: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:50:04.014983547Z [2024-04-21 00:50:04,014: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:50:04.015003178Z [2024-04-21 00:50:04,014: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:50:04.015077357Z [2024-04-21 00:50:04,014: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:50:04.015129623Z [2024-04-21 00:50:04,015: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:50:04.017623933Z [2024-04-21 00:50:04,017: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:50:04.017640302Z [2024-04-21 00:50:04,017: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:50:04.019064010Z [2024-04-21 00:50:04,018: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:50:04.138666533Z [2024-04-21 00:50:04,138: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:50:04.856293259Z [2024-04-21 00:50:04,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f023115-7155-4ba8-bb7b-017b0bc8d17f] succeeded in 4.00213714200072s: None 2024-04-21T00:50:05.515062237Z [2024-04-21 00:50:05,514: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[82729930-09b8-4895-9116-3570cae8d233] succeeded in 4.648428618000253s: None 2024-04-21T00:50:05.787634957Z [2024-04-21 00:50:05,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81e48651-b13b-498b-ad8a-5a4e5921e1b2] received 2024-04-21T00:50:05.796096375Z [2024-04-21 00:50:05,795: INFO/ForkPoolWorker-15] [81e48651-b13b-498b-ad8a-5a4e5921e1b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:50:06.065413791Z [2024-04-21 00:50:06,064: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66af71ff-37c5-4f1a-8626-b142c525d8a9] succeeded in 5.202526153998406s: None 2024-04-21T00:50:06.151021909Z [2024-04-21 00:50:06,147: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:50:07.283171696Z [2024-04-21 00:50:07,282: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:50:07.286378882Z [2024-04-21 00:50:07,285: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:50:07.306869735Z [2024-04-21 00:50:07,306: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:50:07.308267591Z [2024-04-21 00:50:07,308: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:50:07.308370003Z [2024-04-21 00:50:07,308: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:50:07.308600051Z [2024-04-21 00:50:07,308: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:50:07.308681954Z [2024-04-21 00:50:07,308: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:50:07.309206331Z [2024-04-21 00:50:07,309: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:50:07.309315070Z [2024-04-21 00:50:07,309: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:50:07.410516011Z [2024-04-21 00:50:07,410: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:50:08.215238680Z [2024-04-21 00:50:08,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81e48651-b13b-498b-ad8a-5a4e5921e1b2] succeeded in 2.4244194149996474s: None 2024-04-21T00:50:08.887525404Z [2024-04-21 00:50:08,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e6e3e41-e479-40f0-839f-616903c91fb3] received 2024-04-21T00:50:08.897020442Z [2024-04-21 00:50:08,896: INFO/ForkPoolWorker-15] [2e6e3e41-e479-40f0-839f-616903c91fb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:50:09.177313147Z [2024-04-21 00:50:09,174: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:50:10.241253981Z [2024-04-21 00:50:10,240: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:50:10.244530783Z [2024-04-21 00:50:10,244: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:50:10.269299277Z [2024-04-21 00:50:10,268: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:50:10.270720845Z [2024-04-21 00:50:10,270: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:50:10.270893009Z [2024-04-21 00:50:10,270: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:50:10.271124798Z [2024-04-21 00:50:10,270: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:50:10.271288489Z [2024-04-21 00:50:10,271: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:50:10.271610910Z [2024-04-21 00:50:10,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:50:10.271875833Z [2024-04-21 00:50:10,271: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:50:10.379908532Z [2024-04-21 00:50:10,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:50:10.908577756Z [2024-04-21 00:50:10,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd0f883c-bd2d-4d2e-8981-e3b97e01bfca] received 2024-04-21T00:50:10.916945771Z [2024-04-21 00:50:10,916: INFO/ForkPoolWorker-16] [dd0f883c-bd2d-4d2e-8981-e3b97e01bfca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:50:10.973883422Z [2024-04-21 00:50:10,973: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e6e3e41-e479-40f0-839f-616903c91fb3] succeeded in 2.084715369999685s: None 2024-04-21T00:50:11.189300246Z [2024-04-21 00:50:11,186: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:50:12.246819505Z [2024-04-21 00:50:12,246: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:50:12.250016838Z [2024-04-21 00:50:12,249: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:50:12.275226972Z [2024-04-21 00:50:12,274: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:50:12.277378692Z [2024-04-21 00:50:12,277: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:50:12.277573346Z [2024-04-21 00:50:12,277: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:50:12.277913890Z [2024-04-21 00:50:12,277: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:50:12.278120272Z [2024-04-21 00:50:12,277: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:50:12.278615602Z [2024-04-21 00:50:12,278: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:50:12.278766045Z [2024-04-21 00:50:12,278: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:50:12.377026050Z [2024-04-21 00:50:12,376: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:50:13.049169458Z [2024-04-21 00:50:13,048: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd0f883c-bd2d-4d2e-8981-e3b97e01bfca] succeeded in 2.138419299000816s: None 2024-04-21T00:51:00.376103004Z [2024-04-21 00:51:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d85feea6-e28c-4fed-a915-7b9516c95d64] received 2024-04-21T00:51:00.381684903Z [2024-04-21 00:51:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc5d7c3b-a9f6-476d-b8d5-d7be39cf34c2] received 2024-04-21T00:51:00.382799758Z [2024-04-21 00:51:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f893550-5465-44c9-ad4a-54f9fa9483eb] received 2024-04-21T00:51:00.389594732Z [2024-04-21 00:51:00,389: INFO/ForkPoolWorker-1] [4f893550-5465-44c9-ad4a-54f9fa9483eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:51:00.395796398Z [2024-04-21 00:51:00,394: INFO/ForkPoolWorker-16] [cc5d7c3b-a9f6-476d-b8d5-d7be39cf34c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:51:00.395827913Z [2024-04-21 00:51:00,395: INFO/ForkPoolWorker-15] [d85feea6-e28c-4fed-a915-7b9516c95d64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:51:00.676485457Z [2024-04-21 00:51:00,673: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:51:00.709522078Z [2024-04-21 00:51:00,706: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:51:00.719900562Z [2024-04-21 00:51:00,716: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:51:00.866249925Z [2024-04-21 00:51:00,865: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:51:00.870027310Z [2024-04-21 00:51:00,869: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:51:00.892474365Z [2024-04-21 00:51:00,892: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:51:00.893606029Z [2024-04-21 00:51:00,893: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:51:00.893787408Z [2024-04-21 00:51:00,893: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:51:00.893925872Z [2024-04-21 00:51:00,893: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:51:00.894235799Z [2024-04-21 00:51:00,894: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:51:01.006066669Z [2024-04-21 00:51:01,005: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:51:01.668765704Z [2024-04-21 00:51:01,668: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc5d7c3b-a9f6-476d-b8d5-d7be39cf34c2] succeeded in 1.284612608000316s: None 2024-04-21T00:51:01.795193471Z [2024-04-21 00:51:01,794: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:51:01.798473018Z [2024-04-21 00:51:01,798: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:51:01.818978638Z [2024-04-21 00:51:01,818: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:51:01.820564123Z [2024-04-21 00:51:01,820: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:51:01.820659201Z [2024-04-21 00:51:01,820: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:51:01.820854306Z [2024-04-21 00:51:01,820: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:51:01.820929038Z [2024-04-21 00:51:01,820: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:51:01.821204340Z [2024-04-21 00:51:01,821: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:51:01.821274227Z [2024-04-21 00:51:01,821: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:51:01.912386832Z [2024-04-21 00:51:01,912: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:51:01.914356414Z [2024-04-21 00:51:01,914: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:51:01.917401635Z [2024-04-21 00:51:01,917: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:51:01.953762626Z [2024-04-21 00:51:01,953: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:51:01.956602646Z [2024-04-21 00:51:01,956: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:51:01.956641884Z [2024-04-21 00:51:01,956: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:51:01.956759785Z [2024-04-21 00:51:01,956: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:51:01.956796080Z [2024-04-21 00:51:01,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:51:01.957015633Z [2024-04-21 00:51:01,956: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:51:01.957056252Z [2024-04-21 00:51:01,956: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:51:02.035056282Z [2024-04-21 00:51:02,034: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:51:03.534006802Z [2024-04-21 00:51:03,533: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4f893550-5465-44c9-ad4a-54f9fa9483eb] succeeded in 3.149702217000595s: None 2024-04-21T00:51:03.800925929Z [2024-04-21 00:51:03,800: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d85feea6-e28c-4fed-a915-7b9516c95d64] succeeded in 3.4223355670001183s: None 2024-04-21T00:52:00.811370432Z [2024-04-21 00:52:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55637544-965a-48f8-9f08-780d2b505789] received 2024-04-21T00:52:00.814984920Z [2024-04-21 00:52:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1921d48b-5d52-424a-b159-7c484da56b7f] received 2024-04-21T00:52:00.823283800Z [2024-04-21 00:52:00,822: INFO/ForkPoolWorker-16] [1921d48b-5d52-424a-b159-7c484da56b7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:52:00.824000590Z [2024-04-21 00:52:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61847d6e-14db-44c2-a80d-3e6a9f32d520] received 2024-04-21T00:52:00.828507515Z [2024-04-21 00:52:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e24fa79-2653-4d52-ba63-407ef851316b] received 2024-04-21T00:52:00.833012058Z [2024-04-21 00:52:00,832: INFO/ForkPoolWorker-15] [55637544-965a-48f8-9f08-780d2b505789] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:52:00.837973102Z [2024-04-21 00:52:00,837: INFO/ForkPoolWorker-1] [61847d6e-14db-44c2-a80d-3e6a9f32d520] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:52:00.847356390Z [2024-04-21 00:52:00,846: INFO/ForkPoolWorker-2] [8e24fa79-2653-4d52-ba63-407ef851316b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:52:01.285531067Z [2024-04-21 00:52:01,282: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:52:01.288169909Z [2024-04-21 00:52:01,279: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:52:01.308331088Z [2024-04-21 00:52:01,304: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:52:01.455924610Z [2024-04-21 00:52:01,455: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:52:01.460451129Z [2024-04-21 00:52:01,460: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:52:01.555743772Z [2024-04-21 00:52:01,549: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:52:01.611741610Z [2024-04-21 00:52:01,610: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:52:01.615762331Z [2024-04-21 00:52:01,612: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:52:01.615778071Z [2024-04-21 00:52:01,612: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:52:01.615783046Z [2024-04-21 00:52:01,612: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:52:01.615786429Z [2024-04-21 00:52:01,612: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:52:01.619300577Z [2024-04-21 00:52:01,617: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:52:01.894276195Z [2024-04-21 00:52:01,894: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:52:02.640014778Z [2024-04-21 00:52:02,639: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[61847d6e-14db-44c2-a80d-3e6a9f32d520] succeeded in 1.8138938490010332s: None 2024-04-21T00:52:02.806660540Z [2024-04-21 00:52:02,806: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1921d48b-5d52-424a-b159-7c484da56b7f] succeeded in 1.989841864000482s: None 2024-04-21T00:52:02.919569809Z [2024-04-21 00:52:02,919: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:52:02.922864056Z [2024-04-21 00:52:02,922: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:52:02.943550844Z [2024-04-21 00:52:02,943: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:52:02.945604219Z [2024-04-21 00:52:02,945: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:52:02.945652382Z [2024-04-21 00:52:02,945: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:52:02.945834107Z [2024-04-21 00:52:02,945: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:52:02.945874853Z [2024-04-21 00:52:02,945: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:52:02.946296808Z [2024-04-21 00:52:02,946: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:52:02.946353710Z [2024-04-21 00:52:02,946: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:52:03.039405594Z [2024-04-21 00:52:03,039: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:52:03.358670877Z [2024-04-21 00:52:03,358: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:52:03.362057813Z [2024-04-21 00:52:03,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:52:03.390337496Z [2024-04-21 00:52:03,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:52:03.392046317Z [2024-04-21 00:52:03,391: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:52:03.392098772Z [2024-04-21 00:52:03,391: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:52:03.392273547Z [2024-04-21 00:52:03,392: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:52:03.392335529Z [2024-04-21 00:52:03,392: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:52:03.392630191Z [2024-04-21 00:52:03,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:52:03.392684703Z [2024-04-21 00:52:03,392: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:52:03.497730017Z [2024-04-21 00:52:03,497: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:52:05.295939966Z [2024-04-21 00:52:05,295: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55637544-965a-48f8-9f08-780d2b505789] succeeded in 4.479386937000527s: None 2024-04-21T00:52:05.328822066Z [2024-04-21 00:52:05,328: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e24fa79-2653-4d52-ba63-407ef851316b] succeeded in 4.494979217000946s: None 2024-04-21T00:53:00.267567746Z [2024-04-21 00:53:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e463bc9-ddaf-4df5-a8f7-8152d5500f1d] received 2024-04-21T00:53:00.272652382Z [2024-04-21 00:53:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3fc5dff-cf6d-410c-a584-1911f0a96d60] received 2024-04-21T00:53:00.279413113Z [2024-04-21 00:53:00,279: INFO/ForkPoolWorker-15] [8e463bc9-ddaf-4df5-a8f7-8152d5500f1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:53:00.283356933Z [2024-04-21 00:53:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7fa1849-7031-4818-80d9-24094be33159] received 2024-04-21T00:53:00.285700866Z [2024-04-21 00:53:00,284: INFO/ForkPoolWorker-16] [e3fc5dff-cf6d-410c-a584-1911f0a96d60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:53:00.291153315Z [2024-04-21 00:53:00,290: INFO/ForkPoolWorker-1] [b7fa1849-7031-4818-80d9-24094be33159] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:53:00.575369610Z [2024-04-21 00:53:00,571: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:53:00.583953493Z [2024-04-21 00:53:00,580: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:53:00.616897821Z [2024-04-21 00:53:00,612: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:53:00.798037747Z [2024-04-21 00:53:00,797: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:53:00.801864842Z [2024-04-21 00:53:00,801: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:53:00.826187251Z [2024-04-21 00:53:00,825: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:53:00.827243413Z [2024-04-21 00:53:00,827: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:53:00.827355289Z [2024-04-21 00:53:00,827: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:53:00.827361699Z [2024-04-21 00:53:00,827: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:53:00.827695939Z [2024-04-21 00:53:00,827: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:53:00.921165547Z [2024-04-21 00:53:00,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:53:01.762898521Z [2024-04-21 00:53:01,762: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3fc5dff-cf6d-410c-a584-1911f0a96d60] succeeded in 1.4870727039997291s: None 2024-04-21T00:53:01.930663331Z [2024-04-21 00:53:01,930: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:53:01.933987321Z [2024-04-21 00:53:01,933: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:53:01.967886380Z [2024-04-21 00:53:01,967: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:53:01.969192494Z [2024-04-21 00:53:01,968: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:53:01.969326466Z [2024-04-21 00:53:01,969: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:53:01.969526469Z [2024-04-21 00:53:01,969: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:53:01.969543122Z [2024-04-21 00:53:01,969: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:53:01.969744518Z [2024-04-21 00:53:01,969: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:53:01.969783530Z [2024-04-21 00:53:01,969: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:53:02.039587520Z [2024-04-21 00:53:02,038: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:53:02.043822411Z [2024-04-21 00:53:02,043: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:53:02.106178308Z [2024-04-21 00:53:02,105: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:53:02.109815864Z [2024-04-21 00:53:02,109: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:53:02.111309333Z [2024-04-21 00:53:02,110: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:53:02.111515896Z [2024-04-21 00:53:02,111: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:53:02.111851877Z [2024-04-21 00:53:02,111: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:53:02.112020878Z [2024-04-21 00:53:02,111: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:53:02.112626338Z [2024-04-21 00:53:02,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:53:02.112903676Z [2024-04-21 00:53:02,112: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:53:02.270271927Z [2024-04-21 00:53:02,269: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:53:04.619310102Z [2024-04-21 00:53:04,618: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b7fa1849-7031-4818-80d9-24094be33159] succeeded in 4.334263425000245s: None 2024-04-21T00:53:05.162388229Z [2024-04-21 00:53:05,161: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e463bc9-ddaf-4df5-a8f7-8152d5500f1d] succeeded in 4.891625162001219s: None 2024-04-21T00:54:01.073349358Z [2024-04-21 00:54:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bfce443-53b6-4280-aca4-516f07452469] received 2024-04-21T00:54:01.075384356Z [2024-04-21 00:54:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e882d9f-5367-4a51-8a44-5fa27b8bec60] received 2024-04-21T00:54:01.081075016Z [2024-04-21 00:54:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c2c6e58-917a-4328-97db-4ea2031af854] received 2024-04-21T00:54:01.083128950Z [2024-04-21 00:54:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50806d2c-ddb9-43e0-bf85-ca4e6808dc7d] received 2024-04-21T00:54:01.090801819Z [2024-04-21 00:54:01,089: INFO/ForkPoolWorker-2] [50806d2c-ddb9-43e0-bf85-ca4e6808dc7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:54:01.091892563Z [2024-04-21 00:54:01,091: INFO/ForkPoolWorker-16] [0e882d9f-5367-4a51-8a44-5fa27b8bec60] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:54:01.095096303Z [2024-04-21 00:54:01,094: INFO/ForkPoolWorker-15] [9bfce443-53b6-4280-aca4-516f07452469] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:54:01.096699076Z [2024-04-21 00:54:01,096: INFO/ForkPoolWorker-1] [7c2c6e58-917a-4328-97db-4ea2031af854] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:54:01.409873175Z [2024-04-21 00:54:01,406: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:54:01.519819143Z [2024-04-21 00:54:01,506: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:54:01.667699232Z [2024-04-21 00:54:01,664: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:54:01.711189259Z [2024-04-21 00:54:01,707: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:54:01.723914178Z [2024-04-21 00:54:01,723: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:54:01.761495792Z [2024-04-21 00:54:01,761: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:54:01.769424777Z [2024-04-21 00:54:01,769: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:54:01.828544486Z [2024-04-21 00:54:01,828: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:54:01.829504606Z [2024-04-21 00:54:01,829: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:54:01.829761173Z [2024-04-21 00:54:01,829: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:54:01.829787817Z [2024-04-21 00:54:01,829: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:54:01.830089102Z [2024-04-21 00:54:01,829: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:54:01.911475106Z [2024-04-21 00:54:01,911: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:54:02.335607981Z [2024-04-21 00:54:02,335: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e882d9f-5367-4a51-8a44-5fa27b8bec60] succeeded in 1.2583192370002507s: None 2024-04-21T00:54:02.519984176Z [2024-04-21 00:54:02,519: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[50806d2c-ddb9-43e0-bf85-ca4e6808dc7d] succeeded in 1.436064688999977s: None 2024-04-21T00:54:03.015947832Z [2024-04-21 00:54:03,015: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:54:03.019490462Z [2024-04-21 00:54:03,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:54:03.048537721Z [2024-04-21 00:54:03,048: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:54:03.052371489Z [2024-04-21 00:54:03,052: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:54:03.052390477Z [2024-04-21 00:54:03,052: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:54:03.052538386Z [2024-04-21 00:54:03,052: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:54:03.052588499Z [2024-04-21 00:54:03,052: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:54:03.052879121Z [2024-04-21 00:54:03,052: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:54:03.052890263Z [2024-04-21 00:54:03,052: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:54:03.129652631Z [2024-04-21 00:54:03,129: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:54:03.318832627Z [2024-04-21 00:54:03,318: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:54:03.322341207Z [2024-04-21 00:54:03,321: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:54:03.353444410Z [2024-04-21 00:54:03,351: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:54:03.354993369Z [2024-04-21 00:54:03,354: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:54:03.355127698Z [2024-04-21 00:54:03,355: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:54:03.355372345Z [2024-04-21 00:54:03,355: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:54:03.355501910Z [2024-04-21 00:54:03,355: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:54:03.355815123Z [2024-04-21 00:54:03,355: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:54:03.355940194Z [2024-04-21 00:54:03,355: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:54:03.522118813Z [2024-04-21 00:54:03,521: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:54:05.075213371Z [2024-04-21 00:54:05,074: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bfce443-53b6-4280-aca4-516f07452469] succeeded in 3.9977678200011724s: None 2024-04-21T00:54:06.701577413Z [2024-04-21 00:54:06,700: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c2c6e58-917a-4328-97db-4ea2031af854] succeeded in 5.617434877000051s: None 2024-04-21T00:55:01.118863460Z [2024-04-21 00:55:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5240f98-69c5-49fa-9724-990a65939e2d] received 2024-04-21T00:55:01.122152572Z [2024-04-21 00:55:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98740900-915f-4bd0-a334-fb43d8e3d950] received 2024-04-21T00:55:01.138455990Z [2024-04-21 00:55:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95717788-88e4-4136-9508-e1205952d5f4] received 2024-04-21T00:55:01.143511450Z [2024-04-21 00:55:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2efcebba-1a66-4dd7-b940-01ce295ee852] received 2024-04-21T00:55:01.152663380Z [2024-04-21 00:55:01,152: INFO/ForkPoolWorker-16] [98740900-915f-4bd0-a334-fb43d8e3d950] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:55:01.153764728Z [2024-04-21 00:55:01,153: INFO/ForkPoolWorker-15] [a5240f98-69c5-49fa-9724-990a65939e2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:55:01.156003359Z [2024-04-21 00:55:01,155: INFO/ForkPoolWorker-1] [95717788-88e4-4136-9508-e1205952d5f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:55:01.167913637Z [2024-04-21 00:55:01,167: INFO/ForkPoolWorker-2] [2efcebba-1a66-4dd7-b940-01ce295ee852] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:55:01.657316697Z [2024-04-21 00:55:01,650: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:55:01.677652057Z [2024-04-21 00:55:01,672: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:55:01.721574600Z [2024-04-21 00:55:01,714: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:55:01.789805347Z [2024-04-21 00:55:01,786: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:55:01.989902712Z [2024-04-21 00:55:01,989: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:55:01.993854638Z [2024-04-21 00:55:01,993: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:55:02.033741867Z [2024-04-21 00:55:02,033: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:55:02.035064915Z [2024-04-21 00:55:02,034: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:55:02.035274704Z [2024-04-21 00:55:02,035: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:55:02.035418954Z [2024-04-21 00:55:02,035: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:55:02.035859486Z [2024-04-21 00:55:02,035: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:55:02.146538488Z [2024-04-21 00:55:02,146: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:55:02.862085866Z [2024-04-21 00:55:02,861: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[98740900-915f-4bd0-a334-fb43d8e3d950] succeeded in 1.7378878230010741s: None 2024-04-21T00:55:03.279296443Z [2024-04-21 00:55:03,278: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T00:55:03.282550288Z [2024-04-21 00:55:03,282: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:55:03.304581026Z [2024-04-21 00:55:03,304: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:55:03.308695326Z [2024-04-21 00:55:03,308: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:55:03.324608570Z [2024-04-21 00:55:03,324: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:55:03.326181075Z [2024-04-21 00:55:03,325: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:55:03.326232990Z [2024-04-21 00:55:03,326: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:55:03.326341051Z [2024-04-21 00:55:03,326: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:55:03.326376887Z [2024-04-21 00:55:03,326: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T00:55:03.326566375Z [2024-04-21 00:55:03,326: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:55:03.326602737Z [2024-04-21 00:55:03,326: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:55:03.345546197Z [2024-04-21 00:55:03,345: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:55:03.346655168Z [2024-04-21 00:55:03,346: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:55:03.346678047Z [2024-04-21 00:55:03,346: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:55:03.346748361Z [2024-04-21 00:55:03,346: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:55:03.346827705Z [2024-04-21 00:55:03,346: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:55:03.347085971Z [2024-04-21 00:55:03,346: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:55:03.347158530Z [2024-04-21 00:55:03,347: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:55:03.421306910Z [2024-04-21 00:55:03,421: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:55:03.492792788Z [2024-04-21 00:55:03,492: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:55:03.496055088Z [2024-04-21 00:55:03,495: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:55:03.526355052Z [2024-04-21 00:55:03,526: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:55:03.531351581Z [2024-04-21 00:55:03,531: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:55:03.532953802Z [2024-04-21 00:55:03,532: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:55:03.532967393Z [2024-04-21 00:55:03,532: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:55:03.533108974Z [2024-04-21 00:55:03,532: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:55:03.533121746Z [2024-04-21 00:55:03,533: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:55:03.533330932Z [2024-04-21 00:55:03,533: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:55:03.533339864Z [2024-04-21 00:55:03,533: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:55:03.639018934Z [2024-04-21 00:55:03,638: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:55:04.444998784Z [2024-04-21 00:55:04,444: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[95717788-88e4-4136-9508-e1205952d5f4] succeeded in 3.30272649699873s: None 2024-04-21T00:55:05.025415185Z [2024-04-21 00:55:05,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c04b4871-1c03-44c1-b0b6-b50d53c018e2] received 2024-04-21T00:55:05.035378104Z [2024-04-21 00:55:05,034: INFO/ForkPoolWorker-16] [c04b4871-1c03-44c1-b0b6-b50d53c018e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:55:05.320417488Z [2024-04-21 00:55:05,317: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:55:05.360227161Z [2024-04-21 00:55:05,359: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5240f98-69c5-49fa-9724-990a65939e2d] succeeded in 4.23609395099993s: None 2024-04-21T00:55:05.502712290Z [2024-04-21 00:55:05,502: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2efcebba-1a66-4dd7-b940-01ce295ee852] succeeded in 4.356457964999208s: None 2024-04-21T00:55:06.452625187Z [2024-04-21 00:55:06,452: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:55:06.456359049Z [2024-04-21 00:55:06,455: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:55:06.482745711Z [2024-04-21 00:55:06,482: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:55:06.484413385Z [2024-04-21 00:55:06,484: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:55:06.484575863Z [2024-04-21 00:55:06,484: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:55:06.484878720Z [2024-04-21 00:55:06,484: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:55:06.485052479Z [2024-04-21 00:55:06,484: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:55:06.485402327Z [2024-04-21 00:55:06,485: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:55:06.485617136Z [2024-04-21 00:55:06,485: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:55:06.586341237Z [2024-04-21 00:55:06,586: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:55:07.279284487Z [2024-04-21 00:55:07,278: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c04b4871-1c03-44c1-b0b6-b50d53c018e2] succeeded in 2.2511564750002435s: None 2024-04-21T00:55:07.752091010Z [2024-04-21 00:55:07,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[401424d3-22bf-4108-8534-0a5317d4c1f6] received 2024-04-21T00:55:07.784869432Z [2024-04-21 00:55:07,784: INFO/ForkPoolWorker-15] [401424d3-22bf-4108-8534-0a5317d4c1f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T00:55:08.103432778Z [2024-04-21 00:55:08,100: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:55:09.120624021Z [2024-04-21 00:55:09,120: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:55:09.123760441Z [2024-04-21 00:55:09,123: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:55:09.150598039Z [2024-04-21 00:55:09,150: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:55:09.151912597Z [2024-04-21 00:55:09,151: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:55:09.152117961Z [2024-04-21 00:55:09,151: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:55:09.152303123Z [2024-04-21 00:55:09,152: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:55:09.152755190Z [2024-04-21 00:55:09,152: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:55:09.153493313Z [2024-04-21 00:55:09,153: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:55:09.153624831Z [2024-04-21 00:55:09,153: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:55:09.243598833Z [2024-04-21 00:55:09,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:55:09.934274220Z [2024-04-21 00:55:09,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[401424d3-22bf-4108-8534-0a5317d4c1f6] succeeded in 2.179591234000327s: None 2024-04-21T00:55:10.081285427Z [2024-04-21 00:55:10,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd9a0328-192e-420f-85a4-846ce2dd229e] received 2024-04-21T00:55:10.129321644Z [2024-04-21 00:55:10,128: INFO/ForkPoolWorker-15] [bd9a0328-192e-420f-85a4-846ce2dd229e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T00:55:10.405231999Z [2024-04-21 00:55:10,402: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T00:55:11.471811374Z [2024-04-21 00:55:11,470: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:55:11.474515910Z [2024-04-21 00:55:11,474: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:55:11.518342593Z [2024-04-21 00:55:11,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:55:11.518377965Z [2024-04-21 00:55:11,517: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:55:11.518383148Z [2024-04-21 00:55:11,517: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:55:11.518386859Z [2024-04-21 00:55:11,517: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:55:11.518391282Z [2024-04-21 00:55:11,517: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:55:11.518395110Z [2024-04-21 00:55:11,517: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T00:55:11.518398554Z [2024-04-21 00:55:11,517: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:55:11.602398171Z [2024-04-21 00:55:11,602: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:55:12.176941603Z [2024-04-21 00:55:12,176: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd9a0328-192e-420f-85a4-846ce2dd229e] succeeded in 2.083896484999059s: None 2024-04-21T00:56:00.661692790Z [2024-04-21 00:56:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81521cdb-0313-45de-94dc-0144e69712b8] received 2024-04-21T00:56:00.665560560Z [2024-04-21 00:56:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a37b350-bf83-4f25-9ddd-c06f99c2fd3f] received 2024-04-21T00:56:00.672948616Z [2024-04-21 00:56:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a7d27f6-1c2b-433d-9bb5-e48c2825f984] received 2024-04-21T00:56:00.673375187Z [2024-04-21 00:56:00,672: INFO/ForkPoolWorker-16] [6a37b350-bf83-4f25-9ddd-c06f99c2fd3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:56:00.674772702Z [2024-04-21 00:56:00,674: INFO/ForkPoolWorker-15] [81521cdb-0313-45de-94dc-0144e69712b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:56:00.677219275Z [2024-04-21 00:56:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87af9346-ccf0-4122-b643-65efe7052ae0] received 2024-04-21T00:56:00.685504426Z [2024-04-21 00:56:00,685: INFO/ForkPoolWorker-1] [3a7d27f6-1c2b-433d-9bb5-e48c2825f984] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:56:00.696260412Z [2024-04-21 00:56:00,696: INFO/ForkPoolWorker-2] [87af9346-ccf0-4122-b643-65efe7052ae0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:56:01.008788532Z [2024-04-21 00:56:01,002: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:56:01.029756127Z [2024-04-21 00:56:01,024: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:56:01.133436576Z [2024-04-21 00:56:01,129: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:56:01.144404886Z [2024-04-21 00:56:01,141: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:56:01.191884200Z [2024-04-21 00:56:01,190: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:56:01.195777370Z [2024-04-21 00:56:01,194: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:56:01.253276922Z [2024-04-21 00:56:01,253: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:56:01.256079049Z [2024-04-21 00:56:01,255: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:56:01.256258010Z [2024-04-21 00:56:01,256: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:56:01.256380483Z [2024-04-21 00:56:01,256: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:56:01.256623487Z [2024-04-21 00:56:01,256: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:56:01.381146146Z [2024-04-21 00:56:01,380: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:56:01.485873607Z [2024-04-21 00:56:01,483: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:56:02.170129974Z [2024-04-21 00:56:02,169: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[87af9346-ccf0-4122-b643-65efe7052ae0] succeeded in 1.4890161180010182s: None 2024-04-21T00:56:02.178405450Z [2024-04-21 00:56:02,177: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81521cdb-0313-45de-94dc-0144e69712b8] succeeded in 1.5135696550005378s: None 2024-04-21T00:56:02.521223498Z [2024-04-21 00:56:02,520: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:56:02.524581241Z [2024-04-21 00:56:02,524: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:56:02.547481966Z [2024-04-21 00:56:02,547: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:56:02.549097930Z [2024-04-21 00:56:02,548: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:56:02.549134704Z [2024-04-21 00:56:02,549: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:56:02.549313434Z [2024-04-21 00:56:02,549: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:56:02.549485093Z [2024-04-21 00:56:02,549: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:56:02.549684320Z [2024-04-21 00:56:02,549: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:56:02.549728644Z [2024-04-21 00:56:02,549: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:56:02.646626919Z [2024-04-21 00:56:02,646: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:56:02.648046887Z [2024-04-21 00:56:02,647: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:56:02.651363312Z [2024-04-21 00:56:02,650: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:56:02.677993179Z [2024-04-21 00:56:02,677: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:56:02.680239901Z [2024-04-21 00:56:02,680: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:56:02.680262943Z [2024-04-21 00:56:02,680: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:56:02.680415557Z [2024-04-21 00:56:02,680: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:56:02.680670761Z [2024-04-21 00:56:02,680: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:56:02.681174739Z [2024-04-21 00:56:02,680: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:56:02.681227550Z [2024-04-21 00:56:02,681: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:56:02.777131050Z [2024-04-21 00:56:02,776: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:56:04.845885368Z [2024-04-21 00:56:04,845: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3a7d27f6-1c2b-433d-9bb5-e48c2825f984] succeeded in 4.170811920001142s: None 2024-04-21T00:56:05.482976799Z [2024-04-21 00:56:05,482: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a37b350-bf83-4f25-9ddd-c06f99c2fd3f] succeeded in 4.814749492999908s: None 2024-04-21T00:57:01.029942446Z [2024-04-21 00:57:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e95979b-699c-4b4c-828a-076d595b2199] received 2024-04-21T00:57:01.038357999Z [2024-04-21 00:57:01,038: INFO/ForkPoolWorker-15] [1e95979b-699c-4b4c-828a-076d595b2199] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:57:01.042137488Z [2024-04-21 00:57:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e455405-0b4e-48d2-afba-551803653a01] received 2024-04-21T00:57:01.043771339Z [2024-04-21 00:57:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[705e1b56-160b-4209-9aab-05fc72c0c401] received 2024-04-21T00:57:01.048997398Z [2024-04-21 00:57:01,048: INFO/ForkPoolWorker-16] [4e455405-0b4e-48d2-afba-551803653a01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:57:01.055439020Z [2024-04-21 00:57:01,055: INFO/ForkPoolWorker-1] [705e1b56-160b-4209-9aab-05fc72c0c401] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:57:01.340876120Z [2024-04-21 00:57:01,337: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:57:01.384355612Z [2024-04-21 00:57:01,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:57:01.427211221Z [2024-04-21 00:57:01,423: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:57:01.587944742Z [2024-04-21 00:57:01,587: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T00:57:01.594502290Z [2024-04-21 00:57:01,593: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:57:01.633107453Z [2024-04-21 00:57:01,632: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:57:01.637608344Z [2024-04-21 00:57:01,634: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:57:01.638032686Z [2024-04-21 00:57:01,637: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:57:01.638813895Z [2024-04-21 00:57:01,638: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T00:57:01.640541908Z [2024-04-21 00:57:01,640: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:57:01.773275249Z [2024-04-21 00:57:01,773: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:57:02.350026673Z [2024-04-21 00:57:02,349: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4e455405-0b4e-48d2-afba-551803653a01] succeeded in 1.3064827920006792s: None 2024-04-21T00:57:02.593945036Z [2024-04-21 00:57:02,593: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:57:02.597556653Z [2024-04-21 00:57:02,597: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:57:02.625970333Z [2024-04-21 00:57:02,625: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:57:02.627429144Z [2024-04-21 00:57:02,627: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:57:02.627575492Z [2024-04-21 00:57:02,627: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:57:02.627818082Z [2024-04-21 00:57:02,627: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:57:02.627962387Z [2024-04-21 00:57:02,627: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:57:02.628260631Z [2024-04-21 00:57:02,628: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:57:02.628410886Z [2024-04-21 00:57:02,628: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:57:02.710923086Z [2024-04-21 00:57:02,710: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:57:02.714134206Z [2024-04-21 00:57:02,713: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:57:02.715051519Z [2024-04-21 00:57:02,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:57:02.744313085Z [2024-04-21 00:57:02,744: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:57:02.745827701Z [2024-04-21 00:57:02,745: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:57:02.746198290Z [2024-04-21 00:57:02,746: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:57:02.746357303Z [2024-04-21 00:57:02,746: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:57:02.746436462Z [2024-04-21 00:57:02,746: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:57:02.746880713Z [2024-04-21 00:57:02,746: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:57:02.747195306Z [2024-04-21 00:57:02,747: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:57:02.823270258Z [2024-04-21 00:57:02,823: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:57:04.432219050Z [2024-04-21 00:57:04,431: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[705e1b56-160b-4209-9aab-05fc72c0c401] succeeded in 3.3860944059997564s: None 2024-04-21T00:57:05.240175259Z [2024-04-21 00:57:05,239: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e95979b-699c-4b4c-828a-076d595b2199] succeeded in 4.206408580001153s: None 2024-04-21T00:58:00.386173482Z [2024-04-21 00:58:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7aa5fc53-63d9-4479-92d2-8b01d820f8e5] received 2024-04-21T00:58:00.390342067Z [2024-04-21 00:58:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85fe531d-efe3-4c31-b733-a9c1cc4b7bc9] received 2024-04-21T00:58:00.395979062Z [2024-04-21 00:58:00,395: INFO/ForkPoolWorker-15] [7aa5fc53-63d9-4479-92d2-8b01d820f8e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T00:58:00.402231751Z [2024-04-21 00:58:00,401: INFO/ForkPoolWorker-16] [85fe531d-efe3-4c31-b733-a9c1cc4b7bc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:58:00.403812113Z [2024-04-21 00:58:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc4c97dc-b2dd-4d34-86b1-97f4991ee817] received 2024-04-21T00:58:00.407475915Z [2024-04-21 00:58:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[010af792-61e4-4ed8-944d-1d559d9bf7b9] received 2024-04-21T00:58:00.426933209Z [2024-04-21 00:58:00,426: INFO/ForkPoolWorker-2] [010af792-61e4-4ed8-944d-1d559d9bf7b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:58:00.427220106Z [2024-04-21 00:58:00,426: INFO/ForkPoolWorker-1] [fc4c97dc-b2dd-4d34-86b1-97f4991ee817] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:58:00.710073368Z [2024-04-21 00:58:00,707: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T00:58:00.768674828Z [2024-04-21 00:58:00,764: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:58:00.795633415Z [2024-04-21 00:58:00,792: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:58:00.898298972Z [2024-04-21 00:58:00,895: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:58:01.052231295Z [2024-04-21 00:58:01,051: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T00:58:01.056637696Z [2024-04-21 00:58:01,056: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:58:01.079107015Z [2024-04-21 00:58:01,078: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:58:01.099777267Z [2024-04-21 00:58:01,096: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T00:58:01.103733880Z [2024-04-21 00:58:01,100: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:58:01.103751871Z [2024-04-21 00:58:01,100: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:58:01.103756564Z [2024-04-21 00:58:01,100: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T00:58:01.103760066Z [2024-04-21 00:58:01,100: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:58:01.234416727Z [2024-04-21 00:58:01,234: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:58:01.762256376Z [2024-04-21 00:58:01,761: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7aa5fc53-63d9-4479-92d2-8b01d820f8e5] succeeded in 1.3741548230009357s: None 2024-04-21T00:58:01.978001419Z [2024-04-21 00:58:01,977: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[010af792-61e4-4ed8-944d-1d559d9bf7b9] succeeded in 1.5664848429987615s: None 2024-04-21T00:58:02.269820155Z [2024-04-21 00:58:02,269: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T00:58:02.273119421Z [2024-04-21 00:58:02,272: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:58:02.313372712Z [2024-04-21 00:58:02,313: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:58:02.315835638Z [2024-04-21 00:58:02,315: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:58:02.316122694Z [2024-04-21 00:58:02,315: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:58:02.316449777Z [2024-04-21 00:58:02,316: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:58:02.316683003Z [2024-04-21 00:58:02,316: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T00:58:02.317171339Z [2024-04-21 00:58:02,316: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:58:02.317421449Z [2024-04-21 00:58:02,317: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:58:02.326224889Z [2024-04-21 00:58:02,325: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:58:02.329449801Z [2024-04-21 00:58:02,329: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:58:02.373103209Z [2024-04-21 00:58:02,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:58:02.377132752Z [2024-04-21 00:58:02,376: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:58:02.377155323Z [2024-04-21 00:58:02,377: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:58:02.377311946Z [2024-04-21 00:58:02,377: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:58:02.377369866Z [2024-04-21 00:58:02,377: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:58:02.377645075Z [2024-04-21 00:58:02,377: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:58:02.377697149Z [2024-04-21 00:58:02,377: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:58:02.418483020Z [2024-04-21 00:58:02,418: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:58:02.482064939Z [2024-04-21 00:58:02,481: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:58:04.040775957Z [2024-04-21 00:58:04,040: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc4c97dc-b2dd-4d34-86b1-97f4991ee817] succeeded in 3.6323040679999394s: None 2024-04-21T00:58:04.395776574Z [2024-04-21 00:58:04,395: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85fe531d-efe3-4c31-b733-a9c1cc4b7bc9] succeeded in 4.002524310000808s: None 2024-04-21T00:59:00.383086273Z [2024-04-21 00:59:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9394894-b4ca-4aca-b262-8277d8d96490] received 2024-04-21T00:59:00.390315929Z [2024-04-21 00:59:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae4fd94b-027a-4e0a-a68d-891fa601ae8a] received 2024-04-21T00:59:00.392421375Z [2024-04-21 00:59:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[888f5b7d-f316-4e7b-bbe3-07995e38af32] received 2024-04-21T00:59:00.397957049Z [2024-04-21 00:59:00,397: INFO/ForkPoolWorker-15] [d9394894-b4ca-4aca-b262-8277d8d96490] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T00:59:00.405917203Z [2024-04-21 00:59:00,405: INFO/ForkPoolWorker-16] [ae4fd94b-027a-4e0a-a68d-891fa601ae8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T00:59:00.408245915Z [2024-04-21 00:59:00,407: INFO/ForkPoolWorker-1] [888f5b7d-f316-4e7b-bbe3-07995e38af32] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T00:59:00.669975261Z [2024-04-21 00:59:00,666: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T00:59:00.673596688Z [2024-04-21 00:59:00,670: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T00:59:00.721310128Z [2024-04-21 00:59:00,718: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T00:59:00.840502078Z [2024-04-21 00:59:00,840: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T00:59:00.844447686Z [2024-04-21 00:59:00,844: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:59:00.875496759Z [2024-04-21 00:59:00,875: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T00:59:00.876673873Z [2024-04-21 00:59:00,876: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T00:59:00.876890060Z [2024-04-21 00:59:00,876: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T00:59:00.877034763Z [2024-04-21 00:59:00,876: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T00:59:00.877392693Z [2024-04-21 00:59:00,877: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T00:59:00.984570838Z [2024-04-21 00:59:00,984: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:59:01.833713561Z [2024-04-21 00:59:01,833: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[888f5b7d-f316-4e7b-bbe3-07995e38af32] succeeded in 1.437016235999181s: None 2024-04-21T00:59:01.854699575Z [2024-04-21 00:59:01,854: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T00:59:01.859038438Z [2024-04-21 00:59:01,858: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:59:01.894888348Z [2024-04-21 00:59:01,894: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T00:59:01.896469334Z [2024-04-21 00:59:01,896: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:59:01.896486597Z [2024-04-21 00:59:01,896: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:59:01.896632108Z [2024-04-21 00:59:01,896: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:59:01.896677328Z [2024-04-21 00:59:01,896: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T00:59:01.896994772Z [2024-04-21 00:59:01,896: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T00:59:01.897022528Z [2024-04-21 00:59:01,896: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:59:01.959416794Z [2024-04-21 00:59:01,958: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T00:59:01.962782257Z [2024-04-21 00:59:01,962: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T00:59:02.021139086Z [2024-04-21 00:59:02,020: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T00:59:02.022617198Z [2024-04-21 00:59:02,022: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:59:02.023033596Z [2024-04-21 00:59:02,022: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T00:59:02.023237526Z [2024-04-21 00:59:02,023: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T00:59:02.023545223Z [2024-04-21 00:59:02,023: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T00:59:02.023721010Z [2024-04-21 00:59:02,023: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T00:59:02.024398628Z [2024-04-21 00:59:02,024: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T00:59:02.024553307Z [2024-04-21 00:59:02,024: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T00:59:02.127606985Z [2024-04-21 00:59:02,127: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T00:59:03.876402966Z [2024-04-21 00:59:03,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9394894-b4ca-4aca-b262-8277d8d96490] succeeded in 3.490755734999766s: None 2024-04-21T00:59:03.922300461Z [2024-04-21 00:59:03,921: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae4fd94b-027a-4e0a-a68d-891fa601ae8a] succeeded in 3.5294284209994657s: None 2024-04-21T01:00:00.400924379Z [2024-04-21 01:00:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b82227f-3da2-48c8-ad76-9aa9858a10fb] received 2024-04-21T01:00:00.408228243Z [2024-04-21 01:00:00,407: INFO/ForkPoolWorker-15] [3b82227f-3da2-48c8-ad76-9aa9858a10fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:00:00.414242401Z [2024-04-21 01:00:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61c2711c-2cfd-4064-ae37-7974c03ec1b2] received 2024-04-21T01:00:00.415968095Z [2024-04-21 01:00:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f521d7cf-e664-4689-91df-46577a7b1309] received 2024-04-21T01:00:00.417491311Z [2024-04-21 01:00:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3093235-4660-446e-87fd-6200922e22c7] received 2024-04-21T01:00:00.418971106Z [2024-04-21 01:00:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d15a81c-2af9-48cf-87c6-0fdd6d5d08a3] received 2024-04-21T01:00:00.425373905Z [2024-04-21 01:00:00,425: INFO/ForkPoolWorker-1] [f521d7cf-e664-4689-91df-46577a7b1309] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:00:00.430285204Z [2024-04-21 01:00:00,430: INFO/ForkPoolWorker-16] [61c2711c-2cfd-4064-ae37-7974c03ec1b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:00:00.430422785Z [2024-04-21 01:00:00,429: INFO/ForkPoolWorker-3] [3d15a81c-2af9-48cf-87c6-0fdd6d5d08a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:00:00.432203905Z [2024-04-21 01:00:00,431: INFO/ForkPoolWorker-2] [a3093235-4660-446e-87fd-6200922e22c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:00:00.711909773Z [2024-04-21 01:00:00,709: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:00:00.763374081Z [2024-04-21 01:00:00,760: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:00:00.954416929Z [2024-04-21 01:00:00,951: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:00:01.045871865Z [2024-04-21 01:00:01,045: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:00:01.098001961Z [2024-04-21 01:00:01,093: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:00:01.258036933Z [2024-04-21 01:00:01,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:00:01.718594922Z [2024-04-21 01:00:01,716: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:00:01.733586939Z [2024-04-21 01:00:01,733: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:00:01.797863895Z [2024-04-21 01:00:01,797: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:00:01.800616344Z [2024-04-21 01:00:01,800: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:00:01.800860499Z [2024-04-21 01:00:01,800: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:00:01.801025969Z [2024-04-21 01:00:01,800: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:00:01.801284626Z [2024-04-21 01:00:01,801: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:00:01.943971756Z [2024-04-21 01:00:01,943: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:00:02.006376206Z [2024-04-21 01:00:02,005: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f521d7cf-e664-4689-91df-46577a7b1309] succeeded in 1.5880298700012645s: None 2024-04-21T01:00:02.595731767Z [2024-04-21 01:00:02,595: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61c2711c-2cfd-4064-ae37-7974c03ec1b2] succeeded in 2.179809743000078s: None 2024-04-21T01:00:02.636166250Z [2024-04-21 01:00:02,635: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:00:02.639552042Z [2024-04-21 01:00:02,639: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:00:02.662758681Z [2024-04-21 01:00:02,662: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:00:02.663997502Z [2024-04-21 01:00:02,663: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:00:02.664075161Z [2024-04-21 01:00:02,663: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:00:02.664302352Z [2024-04-21 01:00:02,664: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:00:02.664549597Z [2024-04-21 01:00:02,664: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:00:02.664826410Z [2024-04-21 01:00:02,664: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:00:02.665276621Z [2024-04-21 01:00:02,665: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:00:02.701943660Z [2024-04-21 01:00:02,701: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T01:00:02.705216764Z [2024-04-21 01:00:02,704: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:00:02.766968424Z [2024-04-21 01:00:02,766: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:00:02.781668031Z [2024-04-21 01:00:02,780: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T01:00:02.796625851Z [2024-04-21 01:00:02,795: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:00:02.802202025Z [2024-04-21 01:00:02,797: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:00:02.802223091Z [2024-04-21 01:00:02,800: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:00:02.803473856Z [2024-04-21 01:00:02,802: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T01:00:02.805877579Z [2024-04-21 01:00:02,805: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:00:02.805890421Z [2024-04-21 01:00:02,805: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:00:02.930083931Z [2024-04-21 01:00:02,929: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:00:03.131282750Z [2024-04-21 01:00:03,130: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:00:03.135766879Z [2024-04-21 01:00:03,135: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:00:03.172360151Z [2024-04-21 01:00:03,172: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:00:03.174603491Z [2024-04-21 01:00:03,174: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:00:03.174704114Z [2024-04-21 01:00:03,174: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:00:03.174889200Z [2024-04-21 01:00:03,174: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:00:03.174990778Z [2024-04-21 01:00:03,174: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:00:03.175286126Z [2024-04-21 01:00:03,175: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:00:03.175385648Z [2024-04-21 01:00:03,175: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:00:03.285275409Z [2024-04-21 01:00:03,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:00:03.904137881Z [2024-04-21 01:00:03,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b82227f-3da2-48c8-ad76-9aa9858a10fb] succeeded in 3.499605946999509s: None 2024-04-21T01:00:03.975871606Z [2024-04-21 01:00:03,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a769cee1-c7a2-4756-bcd2-f4ece692faa4] received 2024-04-21T01:00:03.991780332Z [2024-04-21 01:00:03,991: INFO/ForkPoolWorker-15] [a769cee1-c7a2-4756-bcd2-f4ece692faa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:00:04.344918390Z [2024-04-21 01:00:04,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:00:04.555910614Z [2024-04-21 01:00:04,555: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3d15a81c-2af9-48cf-87c6-0fdd6d5d08a3] succeeded in 4.134191064998959s: None 2024-04-21T01:00:04.860791256Z [2024-04-21 01:00:04,860: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a3093235-4660-446e-87fd-6200922e22c7] succeeded in 4.440441044000181s: None 2024-04-21T01:00:05.421757634Z [2024-04-21 01:00:05,421: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:00:05.424855633Z [2024-04-21 01:00:05,424: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:00:05.448663280Z [2024-04-21 01:00:05,448: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:00:05.450843999Z [2024-04-21 01:00:05,450: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:00:05.451157709Z [2024-04-21 01:00:05,450: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:00:05.451600576Z [2024-04-21 01:00:05,451: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:00:05.451993169Z [2024-04-21 01:00:05,451: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:00:05.452635621Z [2024-04-21 01:00:05,452: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:00:05.452962291Z [2024-04-21 01:00:05,452: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:00:05.551026320Z [2024-04-21 01:00:05,550: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:00:06.138160325Z [2024-04-21 01:00:06,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31311879-46d5-49d3-9616-85f6fa3f5cc8] received 2024-04-21T01:00:06.146692079Z [2024-04-21 01:00:06,146: INFO/ForkPoolWorker-16] [31311879-46d5-49d3-9616-85f6fa3f5cc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:00:06.224639903Z [2024-04-21 01:00:06,222: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a769cee1-c7a2-4756-bcd2-f4ece692faa4] succeeded in 2.245245353999053s: None 2024-04-21T01:00:06.527173861Z [2024-04-21 01:00:06,524: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:00:07.564308183Z [2024-04-21 01:00:07,563: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:00:07.567475288Z [2024-04-21 01:00:07,567: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:00:07.592542252Z [2024-04-21 01:00:07,592: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:00:07.593936025Z [2024-04-21 01:00:07,593: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:00:07.593948368Z [2024-04-21 01:00:07,593: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:00:07.593988264Z [2024-04-21 01:00:07,593: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:00:07.594133288Z [2024-04-21 01:00:07,593: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:00:07.594460104Z [2024-04-21 01:00:07,594: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:00:07.594477273Z [2024-04-21 01:00:07,594: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:00:07.713401546Z [2024-04-21 01:00:07,712: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:00:08.316506914Z [2024-04-21 01:00:08,315: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31311879-46d5-49d3-9616-85f6fa3f5cc8] succeeded in 2.1749468999987585s: None 2024-04-21T01:00:08.567900755Z [2024-04-21 01:00:08,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ce51391-110e-4b5f-9d58-d370a69e928b] received 2024-04-21T01:00:08.582158161Z [2024-04-21 01:00:08,581: INFO/ForkPoolWorker-15] [5ce51391-110e-4b5f-9d58-d370a69e928b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:00:08.927089259Z [2024-04-21 01:00:08,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:00:10.079198823Z [2024-04-21 01:00:10,078: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:00:10.082390588Z [2024-04-21 01:00:10,081: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:00:10.118362543Z [2024-04-21 01:00:10,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:00:10.121244590Z [2024-04-21 01:00:10,120: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:00:10.121279501Z [2024-04-21 01:00:10,121: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:00:10.121450590Z [2024-04-21 01:00:10,121: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:00:10.121482432Z [2024-04-21 01:00:10,121: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:00:10.122125148Z [2024-04-21 01:00:10,121: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:00:10.122153789Z [2024-04-21 01:00:10,122: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:00:10.255358576Z [2024-04-21 01:00:10,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:00:10.885165132Z [2024-04-21 01:00:10,884: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ce51391-110e-4b5f-9d58-d370a69e928b] succeeded in 2.3131024109989085s: None 2024-04-21T01:01:00.299838814Z [2024-04-21 01:01:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d27c5cd7-08f7-4fd5-99e6-cc740fb00304] received 2024-04-21T01:01:00.307371357Z [2024-04-21 01:01:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9fd063a-4287-44c7-8ccc-aed98f57cb5d] received 2024-04-21T01:01:00.308502161Z [2024-04-21 01:01:00,308: INFO/ForkPoolWorker-15] [d27c5cd7-08f7-4fd5-99e6-cc740fb00304] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:01:00.322385361Z [2024-04-21 01:01:00,322: INFO/ForkPoolWorker-16] [e9fd063a-4287-44c7-8ccc-aed98f57cb5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:01:00.327778643Z [2024-04-21 01:01:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02043ee4-9080-4a7f-a8fd-95968f304486] received 2024-04-21T01:01:00.342611477Z [2024-04-21 01:01:00,342: INFO/ForkPoolWorker-1] [02043ee4-9080-4a7f-a8fd-95968f304486] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:01:00.623607602Z [2024-04-21 01:01:00,620: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:01:00.700281982Z [2024-04-21 01:01:00,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:01:00.776716368Z [2024-04-21 01:01:00,773: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:01:00.944286054Z [2024-04-21 01:01:00,943: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:01:00.948513201Z [2024-04-21 01:01:00,948: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:01:00.980991895Z [2024-04-21 01:01:00,980: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:01:00.982001023Z [2024-04-21 01:01:00,981: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:01:00.982132725Z [2024-04-21 01:01:00,981: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:01:00.982333128Z [2024-04-21 01:01:00,982: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:01:00.982583742Z [2024-04-21 01:01:00,982: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:01:01.127047521Z [2024-04-21 01:01:01,125: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:01:01.845525592Z [2024-04-21 01:01:01,845: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[02043ee4-9080-4a7f-a8fd-95968f304486] succeeded in 1.5126226739994308s: None 2024-04-21T01:01:01.944069330Z [2024-04-21 01:01:01,943: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:01:01.949340625Z [2024-04-21 01:01:01,948: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:01:01.993943757Z [2024-04-21 01:01:01,993: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:01:01.995537773Z [2024-04-21 01:01:01,995: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:01:01.995770279Z [2024-04-21 01:01:01,995: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:01:01.995941382Z [2024-04-21 01:01:01,995: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:01:01.996052164Z [2024-04-21 01:01:01,995: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:01:01.996384005Z [2024-04-21 01:01:01,996: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:01:01.996478098Z [2024-04-21 01:01:01,996: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:01:02.070049987Z [2024-04-21 01:01:02,069: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:01:02.073309762Z [2024-04-21 01:01:02,072: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:01:02.082591525Z [2024-04-21 01:01:02,082: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:01:02.093041308Z [2024-04-21 01:01:02,092: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:01:02.094159390Z [2024-04-21 01:01:02,093: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:01:02.094178864Z [2024-04-21 01:01:02,094: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:01:02.094348598Z [2024-04-21 01:01:02,094: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:01:02.094405085Z [2024-04-21 01:01:02,094: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:01:02.094692604Z [2024-04-21 01:01:02,094: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:01:02.094822723Z [2024-04-21 01:01:02,094: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:01:02.177224551Z [2024-04-21 01:01:02,176: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:01:03.856271083Z [2024-04-21 01:01:03,854: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9fd063a-4287-44c7-8ccc-aed98f57cb5d] succeeded in 3.5396868040006666s: None 2024-04-21T01:01:04.061340178Z [2024-04-21 01:01:04,060: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d27c5cd7-08f7-4fd5-99e6-cc740fb00304] succeeded in 3.7589711399996304s: None 2024-04-21T01:02:00.248286075Z [2024-04-21 01:02:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[648401bb-904d-4c4c-9699-efd0a125bd00] received 2024-04-21T01:02:00.256076771Z [2024-04-21 01:02:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60b04405-7ba0-45d6-8178-1494af24da62] received 2024-04-21T01:02:00.266352031Z [2024-04-21 01:02:00,265: INFO/ForkPoolWorker-15] [648401bb-904d-4c4c-9699-efd0a125bd00] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:02:00.269144818Z [2024-04-21 01:02:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aade7640-d7fa-40d8-9dad-133186b300ba] received 2024-04-21T01:02:00.269800052Z [2024-04-21 01:02:00,269: INFO/ForkPoolWorker-16] [60b04405-7ba0-45d6-8178-1494af24da62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:02:00.280023491Z [2024-04-21 01:02:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd0a9d60-ac60-408f-9060-24be61d141af] received 2024-04-21T01:02:00.282061684Z [2024-04-21 01:02:00,281: INFO/ForkPoolWorker-1] [aade7640-d7fa-40d8-9dad-133186b300ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:02:00.295255060Z [2024-04-21 01:02:00,294: INFO/ForkPoolWorker-2] [cd0a9d60-ac60-408f-9060-24be61d141af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:02:00.589600105Z [2024-04-21 01:02:00,586: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:02:00.604436505Z [2024-04-21 01:02:00,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:02:00.609922979Z [2024-04-21 01:02:00,606: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:02:00.689132996Z [2024-04-21 01:02:00,685: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:02:00.848959779Z [2024-04-21 01:02:00,848: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:02:00.861949978Z [2024-04-21 01:02:00,861: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:02:00.865866765Z [2024-04-21 01:02:00,865: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:02:00.904860640Z [2024-04-21 01:02:00,904: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:02:00.907960686Z [2024-04-21 01:02:00,907: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:02:00.907989353Z [2024-04-21 01:02:00,907: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:02:00.907994887Z [2024-04-21 01:02:00,907: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:02:00.908154150Z [2024-04-21 01:02:00,908: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:02:00.997467762Z [2024-04-21 01:02:00,997: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:02:01.770106700Z [2024-04-21 01:02:01,769: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cd0a9d60-ac60-408f-9060-24be61d141af] succeeded in 1.488175553999099s: None 2024-04-21T01:02:01.798429081Z [2024-04-21 01:02:01,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[648401bb-904d-4c4c-9699-efd0a125bd00] succeeded in 1.5467903789995034s: None 2024-04-21T01:02:02.005585860Z [2024-04-21 01:02:02,005: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:02:02.008878553Z [2024-04-21 01:02:02,008: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:02:02.019148085Z [2024-04-21 01:02:02,018: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:02:02.023286985Z [2024-04-21 01:02:02,022: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:02:02.043169792Z [2024-04-21 01:02:02,042: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:02:02.048691623Z [2024-04-21 01:02:02,048: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:02:02.048748556Z [2024-04-21 01:02:02,048: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:02:02.050728131Z [2024-04-21 01:02:02,048: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:02:02.050822663Z [2024-04-21 01:02:02,050: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:02:02.051561898Z [2024-04-21 01:02:02,051: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:02:02.051601564Z [2024-04-21 01:02:02,051: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:02:02.056705782Z [2024-04-21 01:02:02,056: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:02:02.060640637Z [2024-04-21 01:02:02,060: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:02:02.060786077Z [2024-04-21 01:02:02,060: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:02:02.061021016Z [2024-04-21 01:02:02,060: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:02:02.061167368Z [2024-04-21 01:02:02,060: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:02:02.061437367Z [2024-04-21 01:02:02,061: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:02:02.061504465Z [2024-04-21 01:02:02,061: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:02:02.181042196Z [2024-04-21 01:02:02,180: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:02:02.209821968Z [2024-04-21 01:02:02,209: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:02:03.775356319Z [2024-04-21 01:02:03,774: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aade7640-d7fa-40d8-9dad-133186b300ba] succeeded in 3.500366372998542s: None 2024-04-21T01:02:04.121434731Z [2024-04-21 01:02:04,119: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60b04405-7ba0-45d6-8178-1494af24da62] succeeded in 3.860531791999165s: None 2024-04-21T01:03:01.206796733Z [2024-04-21 01:03:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56919abb-2866-4fe8-96a5-aad174406f4d] received 2024-04-21T01:03:01.209946177Z [2024-04-21 01:03:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a619267e-3217-4484-bab6-9cadb6eee70c] received 2024-04-21T01:03:01.218821632Z [2024-04-21 01:03:01,218: INFO/ForkPoolWorker-16] [a619267e-3217-4484-bab6-9cadb6eee70c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:03:01.219024266Z [2024-04-21 01:03:01,218: INFO/ForkPoolWorker-15] [56919abb-2866-4fe8-96a5-aad174406f4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:03:01.220776179Z [2024-04-21 01:03:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95627fc5-049f-4c00-9d79-2cc11f747d01] received 2024-04-21T01:03:01.230474643Z [2024-04-21 01:03:01,230: INFO/ForkPoolWorker-1] [95627fc5-049f-4c00-9d79-2cc11f747d01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:03:01.617680380Z [2024-04-21 01:03:01,614: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:03:01.656755994Z [2024-04-21 01:03:01,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:03:01.705848097Z [2024-04-21 01:03:01,700: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:03:01.878929518Z [2024-04-21 01:03:01,878: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:03:01.883689354Z [2024-04-21 01:03:01,883: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:03:01.914074466Z [2024-04-21 01:03:01,913: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:03:01.915061504Z [2024-04-21 01:03:01,914: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:03:01.915123337Z [2024-04-21 01:03:01,915: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:03:01.915161599Z [2024-04-21 01:03:01,915: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:03:01.915343875Z [2024-04-21 01:03:01,915: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:03:02.012065769Z [2024-04-21 01:03:02,011: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:03:02.707267556Z [2024-04-21 01:03:02,706: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[95627fc5-049f-4c00-9d79-2cc11f747d01] succeeded in 1.4851289220005128s: None 2024-04-21T01:03:02.928034909Z [2024-04-21 01:03:02,927: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:03:02.931968486Z [2024-04-21 01:03:02,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:03:02.953019466Z [2024-04-21 01:03:02,952: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:03:02.954586087Z [2024-04-21 01:03:02,954: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:03:02.954636765Z [2024-04-21 01:03:02,954: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:03:02.954768034Z [2024-04-21 01:03:02,954: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:03:02.954814469Z [2024-04-21 01:03:02,954: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:03:02.955082822Z [2024-04-21 01:03:02,954: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:03:02.955148051Z [2024-04-21 01:03:02,955: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:03:02.970346985Z [2024-04-21 01:03:02,969: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:03:02.973986037Z [2024-04-21 01:03:02,973: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:03:02.999484077Z [2024-04-21 01:03:02,999: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:03:03.001275440Z [2024-04-21 01:03:03,001: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:03:03.001309728Z [2024-04-21 01:03:03,001: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:03:03.001504880Z [2024-04-21 01:03:03,001: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:03:03.001560709Z [2024-04-21 01:03:03,001: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:03:03.001817953Z [2024-04-21 01:03:03,001: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:03:03.001887165Z [2024-04-21 01:03:03,001: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:03:03.076636325Z [2024-04-21 01:03:03,076: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:03:03.119997495Z [2024-04-21 01:03:03,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:03:05.286796083Z [2024-04-21 01:03:05,286: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a619267e-3217-4484-bab6-9cadb6eee70c] succeeded in 4.074527998000121s: None 2024-04-21T01:03:05.650399037Z [2024-04-21 01:03:05,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56919abb-2866-4fe8-96a5-aad174406f4d] succeeded in 4.4368620780005585s: None 2024-04-21T01:04:01.063171749Z [2024-04-21 01:04:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fa6577d-9351-44c5-a5bf-2a578f1b0e89] received 2024-04-21T01:04:01.083841621Z [2024-04-21 01:04:01,083: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e48b9ad-3f7a-4490-a339-3b2108aa2c15] received 2024-04-21T01:04:01.085997892Z [2024-04-21 01:04:01,085: INFO/ForkPoolWorker-15] [7fa6577d-9351-44c5-a5bf-2a578f1b0e89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:04:01.103541815Z [2024-04-21 01:04:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbf24096-c0d8-437b-ae86-bf7d80cd2caf] received 2024-04-21T01:04:01.106206662Z [2024-04-21 01:04:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76a70e5b-bec0-42c6-806e-39c3649e69bf] received 2024-04-21T01:04:01.107648174Z [2024-04-21 01:04:01,106: INFO/ForkPoolWorker-16] [6e48b9ad-3f7a-4490-a339-3b2108aa2c15] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:04:01.107754378Z [2024-04-21 01:04:01,107: INFO/ForkPoolWorker-1] [dbf24096-c0d8-437b-ae86-bf7d80cd2caf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:04:01.123878952Z [2024-04-21 01:04:01,120: INFO/ForkPoolWorker-2] [76a70e5b-bec0-42c6-806e-39c3649e69bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:04:01.507877668Z [2024-04-21 01:04:01,502: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:04:01.527835580Z [2024-04-21 01:04:01,521: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:04:01.692997895Z [2024-04-21 01:04:01,689: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:04:01.770773245Z [2024-04-21 01:04:01,770: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:04:01.771217045Z [2024-04-21 01:04:01,767: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:04:01.775022273Z [2024-04-21 01:04:01,774: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:04:01.825086093Z [2024-04-21 01:04:01,824: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:04:01.826954873Z [2024-04-21 01:04:01,826: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:04:01.827144470Z [2024-04-21 01:04:01,826: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:04:01.827270210Z [2024-04-21 01:04:01,827: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:04:01.827548913Z [2024-04-21 01:04:01,827: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:04:01.937542143Z [2024-04-21 01:04:01,937: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:04:02.169854082Z [2024-04-21 01:04:02,169: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:04:02.585068515Z [2024-04-21 01:04:02,584: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[76a70e5b-bec0-42c6-806e-39c3649e69bf] succeeded in 1.471272372000385s: None 2024-04-21T01:04:02.837446184Z [2024-04-21 01:04:02,836: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e48b9ad-3f7a-4490-a339-3b2108aa2c15] succeeded in 1.7506696750006085s: None 2024-04-21T01:04:02.974310850Z [2024-04-21 01:04:02,973: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:04:02.976367090Z [2024-04-21 01:04:02,976: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:04:02.977310418Z [2024-04-21 01:04:02,976: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:04:02.979817294Z [2024-04-21 01:04:02,979: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:04:03.004417783Z [2024-04-21 01:04:03,004: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:04:03.005522406Z [2024-04-21 01:04:03,005: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:04:03.005540353Z [2024-04-21 01:04:03,005: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:04:03.005663788Z [2024-04-21 01:04:03,005: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:04:03.005694962Z [2024-04-21 01:04:03,005: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:04:03.005928967Z [2024-04-21 01:04:03,005: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:04:03.006297452Z [2024-04-21 01:04:03,005: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:04:03.006591474Z [2024-04-21 01:04:03,006: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:04:03.007968264Z [2024-04-21 01:04:03,007: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:04:03.008053663Z [2024-04-21 01:04:03,007: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:04:03.008349128Z [2024-04-21 01:04:03,008: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:04:03.008377111Z [2024-04-21 01:04:03,008: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:04:03.008675726Z [2024-04-21 01:04:03,008: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:04:03.008687458Z [2024-04-21 01:04:03,008: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:04:03.098107188Z [2024-04-21 01:04:03,097: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:04:03.129627946Z [2024-04-21 01:04:03,129: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:04:05.322485166Z [2024-04-21 01:04:05,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7fa6577d-9351-44c5-a5bf-2a578f1b0e89] succeeded in 4.248730094999701s: None 2024-04-21T01:04:05.822153776Z [2024-04-21 01:04:05,821: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dbf24096-c0d8-437b-ae86-bf7d80cd2caf] succeeded in 4.721466855000472s: None 2024-04-21T01:05:01.100683712Z [2024-04-21 01:05:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50ca93f4-ee2e-43cd-bec5-af153ba40777] received 2024-04-21T01:05:01.109109784Z [2024-04-21 01:05:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5957b9b-1454-4a9a-a1c4-659fa9ef7bda] received 2024-04-21T01:05:01.117111545Z [2024-04-21 01:05:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa2f2847-2828-4f53-8e80-bda339ca7ed8] received 2024-04-21T01:05:01.131762703Z [2024-04-21 01:05:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae78fe09-73c5-4d78-afc6-b4b25f24ab0c] received 2024-04-21T01:05:01.146412638Z [2024-04-21 01:05:01,145: INFO/ForkPoolWorker-16] [f5957b9b-1454-4a9a-a1c4-659fa9ef7bda] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:05:01.150651735Z [2024-04-21 01:05:01,148: INFO/ForkPoolWorker-1] [aa2f2847-2828-4f53-8e80-bda339ca7ed8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:05:01.155241884Z [2024-04-21 01:05:01,151: INFO/ForkPoolWorker-15] [50ca93f4-ee2e-43cd-bec5-af153ba40777] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:05:01.162497794Z [2024-04-21 01:05:01,159: INFO/ForkPoolWorker-2] [ae78fe09-73c5-4d78-afc6-b4b25f24ab0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:05:01.560376077Z [2024-04-21 01:05:01,553: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:05:01.621953395Z [2024-04-21 01:05:01,617: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:05:01.720924846Z [2024-04-21 01:05:01,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:05:01.731897050Z [2024-04-21 01:05:01,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:05:02.019266890Z [2024-04-21 01:05:02,018: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:05:02.023274519Z [2024-04-21 01:05:02,022: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:05:02.065036496Z [2024-04-21 01:05:02,064: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:05:02.066205854Z [2024-04-21 01:05:02,065: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:05:02.066251890Z [2024-04-21 01:05:02,066: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:05:02.066306536Z [2024-04-21 01:05:02,066: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:05:02.066510451Z [2024-04-21 01:05:02,066: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:05:02.202741583Z [2024-04-21 01:05:02,202: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:05:02.916322757Z [2024-04-21 01:05:02,915: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5957b9b-1454-4a9a-a1c4-659fa9ef7bda] succeeded in 1.8071292260010523s: None 2024-04-21T01:05:03.206080139Z [2024-04-21 01:05:03,205: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:05:03.209635003Z [2024-04-21 01:05:03,209: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:05:03.242130799Z [2024-04-21 01:05:03,241: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:05:03.243459908Z [2024-04-21 01:05:03,243: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:05:03.243474881Z [2024-04-21 01:05:03,243: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:05:03.243634466Z [2024-04-21 01:05:03,243: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:05:03.243667741Z [2024-04-21 01:05:03,243: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:05:03.243930938Z [2024-04-21 01:05:03,243: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:05:03.243996428Z [2024-04-21 01:05:03,243: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:05:03.268033351Z [2024-04-21 01:05:03,267: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:05:03.273224145Z [2024-04-21 01:05:03,272: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:05:03.296170079Z [2024-04-21 01:05:03,295: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:05:03.299138543Z [2024-04-21 01:05:03,298: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:05:03.299255726Z [2024-04-21 01:05:03,299: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:05:03.299554843Z [2024-04-21 01:05:03,299: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:05:03.299668842Z [2024-04-21 01:05:03,299: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:05:03.299985584Z [2024-04-21 01:05:03,299: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:05:03.300098908Z [2024-04-21 01:05:03,299: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:05:03.319193472Z [2024-04-21 01:05:03,318: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:05:03.323378222Z [2024-04-21 01:05:03,322: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:05:03.351160684Z [2024-04-21 01:05:03,350: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:05:03.351979112Z [2024-04-21 01:05:03,351: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:05:03.352292627Z [2024-04-21 01:05:03,352: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:05:03.352375275Z [2024-04-21 01:05:03,352: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:05:03.352510987Z [2024-04-21 01:05:03,352: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:05:03.352576048Z [2024-04-21 01:05:03,352: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:05:03.352821849Z [2024-04-21 01:05:03,352: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:05:03.352911122Z [2024-04-21 01:05:03,352: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:05:03.431870408Z [2024-04-21 01:05:03,431: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:05:03.481704337Z [2024-04-21 01:05:03,481: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:05:04.371668288Z [2024-04-21 01:05:04,371: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa2f2847-2828-4f53-8e80-bda339ca7ed8] succeeded in 3.2469393650007987s: None 2024-04-21T01:05:05.338578197Z [2024-04-21 01:05:05,338: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50ca93f4-ee2e-43cd-bec5-af153ba40777] succeeded in 4.233879089999391s: None 2024-04-21T01:05:05.421387839Z [2024-04-21 01:05:05,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eb41337-6f11-4f98-a563-01cccfff66b9] received 2024-04-21T01:05:05.432973034Z [2024-04-21 01:05:05,432: INFO/ForkPoolWorker-15] [0eb41337-6f11-4f98-a563-01cccfff66b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:05:05.735259959Z [2024-04-21 01:05:05,732: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:05:06.508205992Z [2024-04-21 01:05:06,507: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ae78fe09-73c5-4d78-afc6-b4b25f24ab0c] succeeded in 5.3827336200010905s: None 2024-04-21T01:05:06.900594678Z [2024-04-21 01:05:06,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:05:06.903753039Z [2024-04-21 01:05:06,903: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:05:06.927859597Z [2024-04-21 01:05:06,927: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:05:06.930000529Z [2024-04-21 01:05:06,929: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:05:06.930213111Z [2024-04-21 01:05:06,929: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:05:06.930552378Z [2024-04-21 01:05:06,930: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:05:06.930761530Z [2024-04-21 01:05:06,930: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:05:06.931464136Z [2024-04-21 01:05:06,931: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:05:06.931664840Z [2024-04-21 01:05:06,931: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:05:07.025854169Z [2024-04-21 01:05:07,025: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:05:07.585564512Z [2024-04-21 01:05:07,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0eb41337-6f11-4f98-a563-01cccfff66b9] succeeded in 2.160193215999243s: None 2024-04-21T01:05:07.943115973Z [2024-04-21 01:05:07,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34b593ae-1755-4a75-bd36-2769122a9a78] received 2024-04-21T01:05:07.953819333Z [2024-04-21 01:05:07,953: INFO/ForkPoolWorker-15] [34b593ae-1755-4a75-bd36-2769122a9a78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:05:08.231401605Z [2024-04-21 01:05:08,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:05:09.286156305Z [2024-04-21 01:05:09,285: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:05:09.289373739Z [2024-04-21 01:05:09,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:05:09.316309618Z [2024-04-21 01:05:09,315: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:05:09.317621662Z [2024-04-21 01:05:09,317: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:05:09.317704681Z [2024-04-21 01:05:09,317: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:05:09.317872908Z [2024-04-21 01:05:09,317: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:05:09.317908483Z [2024-04-21 01:05:09,317: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:05:09.318200417Z [2024-04-21 01:05:09,318: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:05:09.318324814Z [2024-04-21 01:05:09,318: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:05:09.419534195Z [2024-04-21 01:05:09,419: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:05:10.080460967Z [2024-04-21 01:05:10,080: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34b593ae-1755-4a75-bd36-2769122a9a78] succeeded in 2.1343165910002426s: None 2024-04-21T01:05:10.293626542Z [2024-04-21 01:05:10,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[871ad5dc-d728-41ac-8992-33c2cadcc9e8] received 2024-04-21T01:05:10.303861224Z [2024-04-21 01:05:10,303: INFO/ForkPoolWorker-15] [871ad5dc-d728-41ac-8992-33c2cadcc9e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:05:10.584550319Z [2024-04-21 01:05:10,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:05:11.621963929Z [2024-04-21 01:05:11,621: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:05:11.624956858Z [2024-04-21 01:05:11,624: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:05:11.654216965Z [2024-04-21 01:05:11,653: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:05:11.655336762Z [2024-04-21 01:05:11,655: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:05:11.655358793Z [2024-04-21 01:05:11,655: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:05:11.655377203Z [2024-04-21 01:05:11,655: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:05:11.655410458Z [2024-04-21 01:05:11,655: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:05:11.655625125Z [2024-04-21 01:05:11,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:05:11.655649501Z [2024-04-21 01:05:11,655: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:05:11.743640761Z [2024-04-21 01:05:11,743: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:05:12.325469807Z [2024-04-21 01:05:12,324: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[871ad5dc-d728-41ac-8992-33c2cadcc9e8] succeeded in 2.0287149800005864s: None 2024-04-21T01:06:00.794620945Z [2024-04-21 01:06:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08333489-31a6-4e68-bfbe-21f6ad26f02c] received 2024-04-21T01:06:00.804150489Z [2024-04-21 01:06:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[090749d8-d5e3-45df-ba99-443d5d2bc2df] received 2024-04-21T01:06:00.809170761Z [2024-04-21 01:06:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2dcff92-8e62-43dc-831a-acddddd30966] received 2024-04-21T01:06:00.813086655Z [2024-04-21 01:06:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52cf3c94-e100-4eac-a1cf-664a0ba99c4f] received 2024-04-21T01:06:00.813590126Z [2024-04-21 01:06:00,813: INFO/ForkPoolWorker-16] [090749d8-d5e3-45df-ba99-443d5d2bc2df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:06:00.816260436Z [2024-04-21 01:06:00,816: INFO/ForkPoolWorker-1] [d2dcff92-8e62-43dc-831a-acddddd30966] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:06:00.818494757Z [2024-04-21 01:06:00,818: INFO/ForkPoolWorker-2] [52cf3c94-e100-4eac-a1cf-664a0ba99c4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:06:00.818917192Z [2024-04-21 01:06:00,818: INFO/ForkPoolWorker-15] [08333489-31a6-4e68-bfbe-21f6ad26f02c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:06:01.162922466Z [2024-04-21 01:06:01,159: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:06:01.192674303Z [2024-04-21 01:06:01,189: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:06:01.218512467Z [2024-04-21 01:06:01,214: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:06:01.411752056Z [2024-04-21 01:06:01,408: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:06:01.458341402Z [2024-04-21 01:06:01,457: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:06:01.465990233Z [2024-04-21 01:06:01,465: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:06:01.540041988Z [2024-04-21 01:06:01,539: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:06:01.545868915Z [2024-04-21 01:06:01,545: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:06:01.546167441Z [2024-04-21 01:06:01,545: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:06:01.546443211Z [2024-04-21 01:06:01,546: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:06:01.546738968Z [2024-04-21 01:06:01,546: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:06:01.661547828Z [2024-04-21 01:06:01,661: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:06:01.706587827Z [2024-04-21 01:06:01,706: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:06:02.350445815Z [2024-04-21 01:06:02,350: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08333489-31a6-4e68-bfbe-21f6ad26f02c] succeeded in 1.5514254589998018s: None 2024-04-21T01:06:02.444710571Z [2024-04-21 01:06:02,443: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[52cf3c94-e100-4eac-a1cf-664a0ba99c4f] succeeded in 1.629660036000132s: None 2024-04-21T01:06:02.661785197Z [2024-04-21 01:06:02,661: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:06:02.665501990Z [2024-04-21 01:06:02,665: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:06:02.692468648Z [2024-04-21 01:06:02,692: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:06:02.694118064Z [2024-04-21 01:06:02,693: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:06:02.694220348Z [2024-04-21 01:06:02,694: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:06:02.694373616Z [2024-04-21 01:06:02,694: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:06:02.694453750Z [2024-04-21 01:06:02,694: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:06:02.694756488Z [2024-04-21 01:06:02,694: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:06:02.695135809Z [2024-04-21 01:06:02,695: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:06:02.732747473Z [2024-04-21 01:06:02,732: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:06:02.738097229Z [2024-04-21 01:06:02,737: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:06:02.768890529Z [2024-04-21 01:06:02,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:06:02.771814509Z [2024-04-21 01:06:02,771: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:06:02.772023057Z [2024-04-21 01:06:02,771: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:06:02.772306237Z [2024-04-21 01:06:02,772: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:06:02.772473176Z [2024-04-21 01:06:02,772: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:06:02.772807679Z [2024-04-21 01:06:02,772: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:06:02.772978636Z [2024-04-21 01:06:02,772: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:06:02.807569238Z [2024-04-21 01:06:02,807: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:06:02.858530882Z [2024-04-21 01:06:02,858: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:06:04.333237834Z [2024-04-21 01:06:04,332: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[090749d8-d5e3-45df-ba99-443d5d2bc2df] succeeded in 3.5266905120006413s: None 2024-04-21T01:06:05.301479367Z [2024-04-21 01:06:05,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2dcff92-8e62-43dc-831a-acddddd30966] succeeded in 4.49040853400038s: None 2024-04-21T01:07:00.615767961Z [2024-04-21 01:07:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d5746cf-72ea-4a5b-b45b-bc4334d90766] received 2024-04-21T01:07:00.624570767Z [2024-04-21 01:07:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[194fc669-b0ae-4238-9c3a-e85d9a00ebb6] received 2024-04-21T01:07:00.625705737Z [2024-04-21 01:07:00,625: INFO/ForkPoolWorker-15] [6d5746cf-72ea-4a5b-b45b-bc4334d90766] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:07:00.626390011Z [2024-04-21 01:07:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[881d7d66-280e-4d36-a402-068987657a5a] received 2024-04-21T01:07:00.634691003Z [2024-04-21 01:07:00,634: INFO/ForkPoolWorker-16] [194fc669-b0ae-4238-9c3a-e85d9a00ebb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:07:00.638212884Z [2024-04-21 01:07:00,637: INFO/ForkPoolWorker-1] [881d7d66-280e-4d36-a402-068987657a5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:07:00.913342154Z [2024-04-21 01:07:00,909: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:07:00.916766561Z [2024-04-21 01:07:00,913: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:07:00.920656517Z [2024-04-21 01:07:00,917: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:07:01.098531902Z [2024-04-21 01:07:01,098: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:07:01.107767769Z [2024-04-21 01:07:01,102: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:07:01.166141708Z [2024-04-21 01:07:01,164: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:07:01.171848056Z [2024-04-21 01:07:01,167: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:07:01.171934231Z [2024-04-21 01:07:01,167: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:07:01.171938924Z [2024-04-21 01:07:01,167: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:07:01.171942123Z [2024-04-21 01:07:01,169: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:07:01.311873380Z [2024-04-21 01:07:01,311: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:07:02.042396324Z [2024-04-21 01:07:02,041: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[881d7d66-280e-4d36-a402-068987657a5a] succeeded in 1.4143152439992264s: None 2024-04-21T01:07:02.504226908Z [2024-04-21 01:07:02,503: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:07:02.512144244Z [2024-04-21 01:07:02,511: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:07:02.548166329Z [2024-04-21 01:07:02,547: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:07:02.549838622Z [2024-04-21 01:07:02,549: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:07:02.550118550Z [2024-04-21 01:07:02,549: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:07:02.550504265Z [2024-04-21 01:07:02,550: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:07:02.550691435Z [2024-04-21 01:07:02,550: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:07:02.551139190Z [2024-04-21 01:07:02,550: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:07:02.551878374Z [2024-04-21 01:07:02,551: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:07:02.657957095Z [2024-04-21 01:07:02,657: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:07:02.681243867Z [2024-04-21 01:07:02,680: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:07:02.684798739Z [2024-04-21 01:07:02,684: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:07:02.711300105Z [2024-04-21 01:07:02,710: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:07:02.712505215Z [2024-04-21 01:07:02,712: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:07:02.712519490Z [2024-04-21 01:07:02,712: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:07:02.714106948Z [2024-04-21 01:07:02,713: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:07:02.714122335Z [2024-04-21 01:07:02,714: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:07:02.714326480Z [2024-04-21 01:07:02,714: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:07:02.714353879Z [2024-04-21 01:07:02,714: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:07:02.811719094Z [2024-04-21 01:07:02,811: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:07:04.635650157Z [2024-04-21 01:07:04,635: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[194fc669-b0ae-4238-9c3a-e85d9a00ebb6] succeeded in 4.008078390001174s: None 2024-04-21T01:07:05.769144980Z [2024-04-21 01:07:05,768: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d5746cf-72ea-4a5b-b45b-bc4334d90766] succeeded in 5.150047659999473s: None 2024-04-21T01:08:00.520148951Z [2024-04-21 01:08:00,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3046c849-4fa3-4ed9-a34c-043e40113cae] received 2024-04-21T01:08:00.521819054Z [2024-04-21 01:08:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86601a8d-5a3a-4d8a-9b4f-88a5c84a7ac8] received 2024-04-21T01:08:00.523324232Z [2024-04-21 01:08:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60cb3f31-215e-4bf4-aad8-214c5b9a2184] received 2024-04-21T01:08:00.525184946Z [2024-04-21 01:08:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24964e9f-4ae7-4be3-8c2f-f2b0feeadd25] received 2024-04-21T01:08:00.536706519Z [2024-04-21 01:08:00,535: INFO/ForkPoolWorker-15] [3046c849-4fa3-4ed9-a34c-043e40113cae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:08:00.558203830Z [2024-04-21 01:08:00,557: INFO/ForkPoolWorker-16] [86601a8d-5a3a-4d8a-9b4f-88a5c84a7ac8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:08:00.559042189Z [2024-04-21 01:08:00,558: INFO/ForkPoolWorker-2] [24964e9f-4ae7-4be3-8c2f-f2b0feeadd25] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:08:00.561327476Z [2024-04-21 01:08:00,561: INFO/ForkPoolWorker-1] [60cb3f31-215e-4bf4-aad8-214c5b9a2184] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:08:00.890103102Z [2024-04-21 01:08:00,887: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:08:00.943310838Z [2024-04-21 01:08:00,938: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:08:01.027572199Z [2024-04-21 01:08:01,024: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:08:01.036364498Z [2024-04-21 01:08:01,033: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:08:01.225181202Z [2024-04-21 01:08:01,224: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:08:01.354124827Z [2024-04-21 01:08:01,353: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:08:01.368318392Z [2024-04-21 01:08:01,363: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:08:01.446994053Z [2024-04-21 01:08:01,444: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:08:01.449610527Z [2024-04-21 01:08:01,448: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:08:01.450020540Z [2024-04-21 01:08:01,449: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:08:01.450035183Z [2024-04-21 01:08:01,449: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:08:01.450602524Z [2024-04-21 01:08:01,450: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:08:01.630430755Z [2024-04-21 01:08:01,630: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:08:01.817174058Z [2024-04-21 01:08:01,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3046c849-4fa3-4ed9-a34c-043e40113cae] succeeded in 1.2934274510007526s: None 2024-04-21T01:08:02.229983137Z [2024-04-21 01:08:02,229: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[24964e9f-4ae7-4be3-8c2f-f2b0feeadd25] succeeded in 1.6983255169998301s: None 2024-04-21T01:08:02.557214156Z [2024-04-21 01:08:02,556: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:08:02.560425600Z [2024-04-21 01:08:02,560: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:08:02.589505970Z [2024-04-21 01:08:02,589: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:08:02.592901700Z [2024-04-21 01:08:02,592: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:08:02.592959653Z [2024-04-21 01:08:02,592: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:08:02.593036585Z [2024-04-21 01:08:02,592: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:08:02.593079201Z [2024-04-21 01:08:02,593: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:08:02.593318914Z [2024-04-21 01:08:02,593: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:08:02.593323621Z [2024-04-21 01:08:02,593: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:08:02.623040456Z [2024-04-21 01:08:02,622: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:08:02.626572910Z [2024-04-21 01:08:02,626: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:08:02.659899342Z [2024-04-21 01:08:02,656: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:08:02.664413804Z [2024-04-21 01:08:02,664: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:08:02.664457152Z [2024-04-21 01:08:02,664: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:08:02.664472003Z [2024-04-21 01:08:02,664: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:08:02.664477780Z [2024-04-21 01:08:02,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:08:02.664778782Z [2024-04-21 01:08:02,664: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:08:02.664790547Z [2024-04-21 01:08:02,664: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:08:02.673547182Z [2024-04-21 01:08:02,673: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:08:02.756883765Z [2024-04-21 01:08:02,756: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:08:05.185085309Z [2024-04-21 01:08:05,184: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86601a8d-5a3a-4d8a-9b4f-88a5c84a7ac8] succeeded in 4.661481310999079s: None 2024-04-21T01:08:05.893537810Z [2024-04-21 01:08:05,892: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60cb3f31-215e-4bf4-aad8-214c5b9a2184] succeeded in 5.366068403000099s: None 2024-04-21T01:09:00.435640665Z [2024-04-21 01:09:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48f724a8-75da-46aa-8f89-cb92b2c54ff6] received 2024-04-21T01:09:00.441831550Z [2024-04-21 01:09:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32148872-d9ad-414a-808f-7f3ca00d6a11] received 2024-04-21T01:09:00.445937634Z [2024-04-21 01:09:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1de6df19-a969-4e7b-b5b1-5083156fad39] received 2024-04-21T01:09:00.449378184Z [2024-04-21 01:09:00,448: INFO/ForkPoolWorker-15] [48f724a8-75da-46aa-8f89-cb92b2c54ff6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:09:00.450696437Z [2024-04-21 01:09:00,450: INFO/ForkPoolWorker-16] [32148872-d9ad-414a-808f-7f3ca00d6a11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:09:00.460035965Z [2024-04-21 01:09:00,459: INFO/ForkPoolWorker-1] [1de6df19-a969-4e7b-b5b1-5083156fad39] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:09:00.738960737Z [2024-04-21 01:09:00,735: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:09:00.757857210Z [2024-04-21 01:09:00,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:09:00.781712534Z [2024-04-21 01:09:00,778: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:09:00.961889033Z [2024-04-21 01:09:00,961: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:09:00.967824464Z [2024-04-21 01:09:00,967: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:09:00.994953095Z [2024-04-21 01:09:00,994: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:09:00.996105880Z [2024-04-21 01:09:00,995: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:09:00.996254002Z [2024-04-21 01:09:00,996: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:09:00.996371779Z [2024-04-21 01:09:00,996: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:09:00.996593695Z [2024-04-21 01:09:00,996: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:09:01.111822961Z [2024-04-21 01:09:01,109: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:09:01.699334853Z [2024-04-21 01:09:01,698: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1de6df19-a969-4e7b-b5b1-5083156fad39] succeeded in 1.2515069769997353s: None 2024-04-21T01:09:02.043185170Z [2024-04-21 01:09:02,042: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:09:02.046415375Z [2024-04-21 01:09:02,046: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:09:02.092035387Z [2024-04-21 01:09:02,091: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:09:02.092050308Z [2024-04-21 01:09:02,091: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:09:02.093273576Z [2024-04-21 01:09:02,093: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:09:02.093324240Z [2024-04-21 01:09:02,093: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:09:02.093479771Z [2024-04-21 01:09:02,093: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:09:02.093540656Z [2024-04-21 01:09:02,093: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:09:02.093760751Z [2024-04-21 01:09:02,093: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:09:02.093853594Z [2024-04-21 01:09:02,093: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:09:02.095060896Z [2024-04-21 01:09:02,094: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:09:02.128598780Z [2024-04-21 01:09:02,128: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:09:02.132906253Z [2024-04-21 01:09:02,132: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:09:02.132986543Z [2024-04-21 01:09:02,132: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:09:02.133405076Z [2024-04-21 01:09:02,132: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:09:02.133534726Z [2024-04-21 01:09:02,133: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:09:02.133825918Z [2024-04-21 01:09:02,133: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:09:02.133888260Z [2024-04-21 01:09:02,133: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:09:02.174094478Z [2024-04-21 01:09:02,173: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:09:02.246009020Z [2024-04-21 01:09:02,245: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:09:04.018574545Z [2024-04-21 01:09:04,018: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32148872-d9ad-414a-808f-7f3ca00d6a11] succeeded in 3.5749521189991356s: None 2024-04-21T01:09:05.276183013Z [2024-04-21 01:09:05,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48f724a8-75da-46aa-8f89-cb92b2c54ff6] succeeded in 4.837946233999901s: None 2024-04-21T01:10:01.027424595Z [2024-04-21 01:10:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90379ef5-3548-47eb-ad50-7224fdbc7b40] received 2024-04-21T01:10:01.031287121Z [2024-04-21 01:10:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8c3fe13-711d-4ce5-bd14-7ec71db58672] received 2024-04-21T01:10:01.034529976Z [2024-04-21 01:10:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[055a30de-703e-4625-af56-40e9bf5c466a] received 2024-04-21T01:10:01.035801400Z [2024-04-21 01:10:01,035: INFO/ForkPoolWorker-15] [90379ef5-3548-47eb-ad50-7224fdbc7b40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:10:01.037291842Z [2024-04-21 01:10:01,037: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afd62227-dbf2-4d18-b99c-928d229657c0] received 2024-04-21T01:10:01.044168563Z [2024-04-21 01:10:01,043: INFO/ForkPoolWorker-16] [a8c3fe13-711d-4ce5-bd14-7ec71db58672] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:10:01.044567396Z [2024-04-21 01:10:01,044: INFO/ForkPoolWorker-1] [055a30de-703e-4625-af56-40e9bf5c466a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:10:01.045974105Z [2024-04-21 01:10:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[792465c5-f6c2-4be8-a50e-206e2f9ca15e] received 2024-04-21T01:10:01.048044653Z [2024-04-21 01:10:01,047: INFO/ForkPoolWorker-2] [afd62227-dbf2-4d18-b99c-928d229657c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:10:01.064615850Z [2024-04-21 01:10:01,064: INFO/ForkPoolWorker-3] [792465c5-f6c2-4be8-a50e-206e2f9ca15e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:10:01.617670402Z [2024-04-21 01:10:01,607: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:10:01.670168270Z [2024-04-21 01:10:01,667: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:10:01.708672851Z [2024-04-21 01:10:01,704: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:10:01.817515457Z [2024-04-21 01:10:01,809: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:10:02.012985214Z [2024-04-21 01:10:02,012: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-21T01:10:02.017206919Z [2024-04-21 01:10:02,016: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:10:02.064345914Z [2024-04-21 01:10:02,064: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T01:10:02.065612657Z [2024-04-21 01:10:02,065: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:10:02.073060147Z [2024-04-21 01:10:02,072: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:10:02.073114575Z [2024-04-21 01:10:02,072: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:10:02.073193975Z [2024-04-21 01:10:02,073: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-21T01:10:02.073455510Z [2024-04-21 01:10:02,073: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:10:02.124720728Z [2024-04-21 01:10:02,121: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:10:02.218328124Z [2024-04-21 01:10:02,218: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:10:02.811357773Z [2024-04-21 01:10:02,810: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a8c3fe13-711d-4ce5-bd14-7ec71db58672] succeeded in 1.7745570589995623s: None 2024-04-21T01:10:02.990691772Z [2024-04-21 01:10:02,990: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[792465c5-f6c2-4be8-a50e-206e2f9ca15e] succeeded in 1.9409733499996946s: None 2024-04-21T01:10:03.263150370Z [2024-04-21 01:10:03,262: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:10:03.267323557Z [2024-04-21 01:10:03,266: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:10:03.301416941Z [2024-04-21 01:10:03,301: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:10:03.305081398Z [2024-04-21 01:10:03,304: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:10:03.305431542Z [2024-04-21 01:10:03,305: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:10:03.305717923Z [2024-04-21 01:10:03,305: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:10:03.305878266Z [2024-04-21 01:10:03,305: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:10:03.306302574Z [2024-04-21 01:10:03,306: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:10:03.306526447Z [2024-04-21 01:10:03,306: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:10:03.455861096Z [2024-04-21 01:10:03,454: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:10:03.581191884Z [2024-04-21 01:10:03,580: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:10:03.584835049Z [2024-04-21 01:10:03,584: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:10:03.624961693Z [2024-04-21 01:10:03,624: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:10:03.627130607Z [2024-04-21 01:10:03,626: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:10:03.627199321Z [2024-04-21 01:10:03,627: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:10:03.627644714Z [2024-04-21 01:10:03,627: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:10:03.632120036Z [2024-04-21 01:10:03,631: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:10:03.632657178Z [2024-04-21 01:10:03,632: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:10:03.633180804Z [2024-04-21 01:10:03,633: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:10:03.778530124Z [2024-04-21 01:10:03,778: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:10:03.967616525Z [2024-04-21 01:10:03,967: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:10:03.972999927Z [2024-04-21 01:10:03,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:10:04.027165828Z [2024-04-21 01:10:04,026: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:10:04.035805516Z [2024-04-21 01:10:04,035: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:10:04.036017329Z [2024-04-21 01:10:04,035: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:10:04.036222506Z [2024-04-21 01:10:04,036: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:10:04.039766525Z [2024-04-21 01:10:04,036: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:10:04.039779587Z [2024-04-21 01:10:04,036: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:10:04.039784742Z [2024-04-21 01:10:04,036: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:10:04.222317533Z [2024-04-21 01:10:04,221: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:10:04.842267894Z [2024-04-21 01:10:04,841: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90379ef5-3548-47eb-ad50-7224fdbc7b40] succeeded in 3.8132481840002583s: None 2024-04-21T01:10:05.331173965Z [2024-04-21 01:10:05,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a4b58d5-7fa6-400c-8957-17f503aa7e33] received 2024-04-21T01:10:05.339018003Z [2024-04-21 01:10:05,338: INFO/ForkPoolWorker-15] [9a4b58d5-7fa6-400c-8957-17f503aa7e33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:10:05.497295997Z [2024-04-21 01:10:05,496: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[afd62227-dbf2-4d18-b99c-928d229657c0] succeeded in 4.456511148000573s: None 2024-04-21T01:10:05.666007189Z [2024-04-21 01:10:05,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:10:05.771962163Z [2024-04-21 01:10:05,771: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[055a30de-703e-4625-af56-40e9bf5c466a] succeeded in 4.735735321000902s: None 2024-04-21T01:10:06.871472929Z [2024-04-21 01:10:06,870: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:10:06.874547240Z [2024-04-21 01:10:06,874: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:10:06.898642020Z [2024-04-21 01:10:06,898: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:10:06.900391001Z [2024-04-21 01:10:06,900: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:10:06.900452805Z [2024-04-21 01:10:06,900: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:10:06.900630679Z [2024-04-21 01:10:06,900: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:10:06.900683532Z [2024-04-21 01:10:06,900: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:10:06.901141093Z [2024-04-21 01:10:06,900: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:10:06.901196967Z [2024-04-21 01:10:06,901: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:10:07.022697092Z [2024-04-21 01:10:07,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:10:07.679200627Z [2024-04-21 01:10:07,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a4b58d5-7fa6-400c-8957-17f503aa7e33] succeeded in 2.346268956000131s: None 2024-04-21T01:10:07.803316235Z [2024-04-21 01:10:07,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e28c4a3-3605-482f-9045-cdfb1ef405ab] received 2024-04-21T01:10:07.813207572Z [2024-04-21 01:10:07,812: INFO/ForkPoolWorker-15] [2e28c4a3-3605-482f-9045-cdfb1ef405ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:10:08.101902854Z [2024-04-21 01:10:08,098: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:10:09.144096272Z [2024-04-21 01:10:09,143: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:10:09.146967224Z [2024-04-21 01:10:09,146: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:10:09.168458360Z [2024-04-21 01:10:09,168: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:10:09.169938547Z [2024-04-21 01:10:09,169: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:10:09.169965299Z [2024-04-21 01:10:09,169: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:10:09.169987887Z [2024-04-21 01:10:09,169: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:10:09.170410327Z [2024-04-21 01:10:09,169: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:10:09.170434915Z [2024-04-21 01:10:09,170: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:10:09.170444170Z [2024-04-21 01:10:09,170: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:10:09.272645947Z [2024-04-21 01:10:09,272: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:10:09.886372222Z [2024-04-21 01:10:09,885: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e28c4a3-3605-482f-9045-cdfb1ef405ab] succeeded in 2.08020063100048s: None 2024-04-21T01:10:10.493400425Z [2024-04-21 01:10:10,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67b6bb26-92ab-4f7d-b20c-8c3c22aae88b] received 2024-04-21T01:10:10.499243048Z [2024-04-21 01:10:10,498: INFO/ForkPoolWorker-15] [67b6bb26-92ab-4f7d-b20c-8c3c22aae88b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:10:10.807885115Z [2024-04-21 01:10:10,804: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:10:11.878015376Z [2024-04-21 01:10:11,877: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:10:11.882837232Z [2024-04-21 01:10:11,882: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:10:11.904116016Z [2024-04-21 01:10:11,903: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:10:11.905871184Z [2024-04-21 01:10:11,905: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:10:11.905882165Z [2024-04-21 01:10:11,905: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:10:11.905887144Z [2024-04-21 01:10:11,905: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:10:11.905890977Z [2024-04-21 01:10:11,905: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:10:11.905893939Z [2024-04-21 01:10:11,905: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:10:11.905996252Z [2024-04-21 01:10:11,905: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:10:11.998261095Z [2024-04-21 01:10:11,997: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:10:12.640149322Z [2024-04-21 01:10:12,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67b6bb26-92ab-4f7d-b20c-8c3c22aae88b] succeeded in 2.1445079449986224s: None 2024-04-21T01:11:00.841131977Z [2024-04-21 01:11:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28d2948b-ec0a-437a-846d-d1abf1dd554f] received 2024-04-21T01:11:00.845758245Z [2024-04-21 01:11:00,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13e0647a-e9ac-4211-aa33-3d6c6767675e] received 2024-04-21T01:11:00.848127239Z [2024-04-21 01:11:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f4b0c55-afd2-4929-a572-b8a28a01dbdb] received 2024-04-21T01:11:00.850585555Z [2024-04-21 01:11:00,850: INFO/ForkPoolWorker-15] [28d2948b-ec0a-437a-846d-d1abf1dd554f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:11:00.855505178Z [2024-04-21 01:11:00,855: INFO/ForkPoolWorker-16] [13e0647a-e9ac-4211-aa33-3d6c6767675e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:11:00.858866195Z [2024-04-21 01:11:00,858: INFO/ForkPoolWorker-1] [2f4b0c55-afd2-4929-a572-b8a28a01dbdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:11:01.187473583Z [2024-04-21 01:11:01,183: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:11:01.224159713Z [2024-04-21 01:11:01,221: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:11:01.265062415Z [2024-04-21 01:11:01,261: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:11:01.379564515Z [2024-04-21 01:11:01,379: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:11:01.383687899Z [2024-04-21 01:11:01,383: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:11:01.411099306Z [2024-04-21 01:11:01,410: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:11:01.412301033Z [2024-04-21 01:11:01,412: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:11:01.412498931Z [2024-04-21 01:11:01,412: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:11:01.412628605Z [2024-04-21 01:11:01,412: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:11:01.412891792Z [2024-04-21 01:11:01,412: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:11:01.571019116Z [2024-04-21 01:11:01,570: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:11:02.208206128Z [2024-04-21 01:11:02,207: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f4b0c55-afd2-4929-a572-b8a28a01dbdb] succeeded in 1.3555375790001563s: None 2024-04-21T01:11:02.632562263Z [2024-04-21 01:11:02,632: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:11:02.637129059Z [2024-04-21 01:11:02,636: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:11:02.659629077Z [2024-04-21 01:11:02,659: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:11:02.663301749Z [2024-04-21 01:11:02,663: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:11:02.663319748Z [2024-04-21 01:11:02,663: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:11:02.663420587Z [2024-04-21 01:11:02,663: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:11:02.663454172Z [2024-04-21 01:11:02,663: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:11:02.663641583Z [2024-04-21 01:11:02,663: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:11:02.663701794Z [2024-04-21 01:11:02,663: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:11:02.760918558Z [2024-04-21 01:11:02,760: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:11:02.844628534Z [2024-04-21 01:11:02,843: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:11:02.851131289Z [2024-04-21 01:11:02,850: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:11:02.870835344Z [2024-04-21 01:11:02,870: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:11:02.872407570Z [2024-04-21 01:11:02,872: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:11:02.872447779Z [2024-04-21 01:11:02,872: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:11:02.872640687Z [2024-04-21 01:11:02,872: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:11:02.872720649Z [2024-04-21 01:11:02,872: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:11:02.873182141Z [2024-04-21 01:11:02,873: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:11:02.873370427Z [2024-04-21 01:11:02,873: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:11:03.012407870Z [2024-04-21 01:11:03,012: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:11:05.083219568Z [2024-04-21 01:11:05,082: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28d2948b-ec0a-437a-846d-d1abf1dd554f] succeeded in 4.238966978999088s: None 2024-04-21T01:11:05.228542126Z [2024-04-21 01:11:05,228: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[13e0647a-e9ac-4211-aa33-3d6c6767675e] succeeded in 4.381011034000039s: None 2024-04-21T01:12:00.852004635Z [2024-04-21 01:12:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5353354c-0848-4ec4-8e7d-9b08389c4f93] received 2024-04-21T01:12:00.853825275Z [2024-04-21 01:12:00,853: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4da118da-ec71-431c-979a-f7ba19253e02] received 2024-04-21T01:12:00.856095863Z [2024-04-21 01:12:00,855: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7f83cc2-faa8-4a96-b632-1ac46683178f] received 2024-04-21T01:12:00.858134244Z [2024-04-21 01:12:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7be446d8-0f1a-43fb-92fb-39ae802785ae] received 2024-04-21T01:12:00.865932559Z [2024-04-21 01:12:00,865: INFO/ForkPoolWorker-16] [4da118da-ec71-431c-979a-f7ba19253e02] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:12:00.870718937Z [2024-04-21 01:12:00,870: INFO/ForkPoolWorker-1] [e7f83cc2-faa8-4a96-b632-1ac46683178f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:12:00.877337262Z [2024-04-21 01:12:00,876: INFO/ForkPoolWorker-2] [7be446d8-0f1a-43fb-92fb-39ae802785ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:12:00.879130316Z [2024-04-21 01:12:00,878: INFO/ForkPoolWorker-15] [5353354c-0848-4ec4-8e7d-9b08389c4f93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:12:01.253764650Z [2024-04-21 01:12:01,250: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:12:01.287240321Z [2024-04-21 01:12:01,283: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:12:01.446857756Z [2024-04-21 01:12:01,443: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:12:01.469735258Z [2024-04-21 01:12:01,469: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:12:01.475565781Z [2024-04-21 01:12:01,475: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:12:01.521035944Z [2024-04-21 01:12:01,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:12:01.552448409Z [2024-04-21 01:12:01,552: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:12:01.556716114Z [2024-04-21 01:12:01,556: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:12:01.556743039Z [2024-04-21 01:12:01,556: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:12:01.556803255Z [2024-04-21 01:12:01,556: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:12:01.557202023Z [2024-04-21 01:12:01,556: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:12:01.580005801Z [2024-04-21 01:12:01,573: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:12:01.684897524Z [2024-04-21 01:12:01,684: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:12:02.370739687Z [2024-04-21 01:12:02,370: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4da118da-ec71-431c-979a-f7ba19253e02] succeeded in 1.5155021800001123s: None 2024-04-21T01:12:02.446130053Z [2024-04-21 01:12:02,445: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e7f83cc2-faa8-4a96-b632-1ac46683178f] succeeded in 1.5847147229997063s: None 2024-04-21T01:12:02.924991297Z [2024-04-21 01:12:02,924: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:12:02.928218120Z [2024-04-21 01:12:02,927: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:12:02.943849688Z [2024-04-21 01:12:02,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:12:02.946652108Z [2024-04-21 01:12:02,946: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:12:02.947323919Z [2024-04-21 01:12:02,946: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:12:02.948018069Z [2024-04-21 01:12:02,947: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:12:02.948410250Z [2024-04-21 01:12:02,948: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:12:02.949034964Z [2024-04-21 01:12:02,948: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:12:02.949425377Z [2024-04-21 01:12:02,949: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:12:02.983580471Z [2024-04-21 01:12:02,983: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:12:02.987009791Z [2024-04-21 01:12:02,986: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:12:03.016221082Z [2024-04-21 01:12:03,016: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:12:03.018411046Z [2024-04-21 01:12:03,018: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:12:03.018591341Z [2024-04-21 01:12:03,018: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:12:03.018806107Z [2024-04-21 01:12:03,018: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:12:03.018954083Z [2024-04-21 01:12:03,018: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:12:03.019292474Z [2024-04-21 01:12:03,019: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:12:03.019427600Z [2024-04-21 01:12:03,019: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:12:03.051897538Z [2024-04-21 01:12:03,051: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:12:03.099248977Z [2024-04-21 01:12:03,099: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:12:04.851829564Z [2024-04-21 01:12:04,851: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5353354c-0848-4ec4-8e7d-9b08389c4f93] succeeded in 3.9963172340012534s: None 2024-04-21T01:12:05.201083076Z [2024-04-21 01:12:05,200: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7be446d8-0f1a-43fb-92fb-39ae802785ae] succeeded in 4.332370067000738s: None 2024-04-21T01:13:00.866181150Z [2024-04-21 01:13:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d928f12-e9c2-457d-8c29-4a27f559f0de] received 2024-04-21T01:13:00.872484002Z [2024-04-21 01:13:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19c2c685-a14c-48a8-84cb-bcc152add749] received 2024-04-21T01:13:00.881209947Z [2024-04-21 01:13:00,880: INFO/ForkPoolWorker-16] [19c2c685-a14c-48a8-84cb-bcc152add749] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:13:00.881229232Z [2024-04-21 01:13:00,880: INFO/ForkPoolWorker-15] [6d928f12-e9c2-457d-8c29-4a27f559f0de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:13:00.908041550Z [2024-04-21 01:13:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac78edf1-e578-4eb8-8588-8536ee2712c5] received 2024-04-21T01:13:00.916970812Z [2024-04-21 01:13:00,916: INFO/ForkPoolWorker-1] [ac78edf1-e578-4eb8-8588-8536ee2712c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:13:01.216925385Z [2024-04-21 01:13:01,212: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:13:01.255736992Z [2024-04-21 01:13:01,251: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:13:01.255887541Z [2024-04-21 01:13:01,252: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:13:01.422925994Z [2024-04-21 01:13:01,422: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:13:01.427641882Z [2024-04-21 01:13:01,427: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:13:01.483891014Z [2024-04-21 01:13:01,480: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:13:01.483903796Z [2024-04-21 01:13:01,482: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:13:01.483908426Z [2024-04-21 01:13:01,482: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:13:01.483926023Z [2024-04-21 01:13:01,482: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:13:01.483929564Z [2024-04-21 01:13:01,482: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:13:01.585972863Z [2024-04-21 01:13:01,585: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:13:02.186893673Z [2024-04-21 01:13:02,186: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19c2c685-a14c-48a8-84cb-bcc152add749] succeeded in 1.3125470849990961s: None 2024-04-21T01:13:02.683771043Z [2024-04-21 01:13:02,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:13:02.687256663Z [2024-04-21 01:13:02,686: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:13:02.736679711Z [2024-04-21 01:13:02,736: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:13:02.738134665Z [2024-04-21 01:13:02,737: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:13:02.738149497Z [2024-04-21 01:13:02,737: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:13:02.738160278Z [2024-04-21 01:13:02,738: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:13:02.738256157Z [2024-04-21 01:13:02,738: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:13:02.738510287Z [2024-04-21 01:13:02,738: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:13:02.738559391Z [2024-04-21 01:13:02,738: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:13:02.786797615Z [2024-04-21 01:13:02,786: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:13:02.796183354Z [2024-04-21 01:13:02,795: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:13:02.840491032Z [2024-04-21 01:13:02,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:13:02.848994132Z [2024-04-21 01:13:02,848: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:13:02.850244858Z [2024-04-21 01:13:02,850: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:13:02.850299435Z [2024-04-21 01:13:02,850: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:13:02.850501901Z [2024-04-21 01:13:02,850: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:13:02.850555075Z [2024-04-21 01:13:02,850: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:13:02.850939860Z [2024-04-21 01:13:02,850: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:13:02.850991058Z [2024-04-21 01:13:02,850: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:13:03.097631633Z [2024-04-21 01:13:03,097: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:13:04.925374540Z [2024-04-21 01:13:04,924: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ac78edf1-e578-4eb8-8588-8536ee2712c5] succeeded in 4.013016990998949s: None 2024-04-21T01:13:05.226435090Z [2024-04-21 01:13:05,225: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d928f12-e9c2-457d-8c29-4a27f559f0de] succeeded in 4.356773135999902s: None 2024-04-21T01:14:00.695922889Z [2024-04-21 01:14:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e5720e4-5d0d-4914-a0d7-e31466bc1c99] received 2024-04-21T01:14:00.698692718Z [2024-04-21 01:14:00,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4edc4376-64f2-4320-bbc1-7660378eac6a] received 2024-04-21T01:14:00.706989457Z [2024-04-21 01:14:00,706: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[079b7cde-88e5-4ce6-be35-c2111736fd79] received 2024-04-21T01:14:00.708150891Z [2024-04-21 01:14:00,707: INFO/ForkPoolWorker-16] [4edc4376-64f2-4320-bbc1-7660378eac6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:14:00.720412508Z [2024-04-21 01:14:00,720: INFO/ForkPoolWorker-15] [4e5720e4-5d0d-4914-a0d7-e31466bc1c99] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:14:00.720698254Z [2024-04-21 01:14:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4007170-e7fc-4cb5-b3de-5e681e0c4950] received 2024-04-21T01:14:00.729295143Z [2024-04-21 01:14:00,728: INFO/ForkPoolWorker-2] [a4007170-e7fc-4cb5-b3de-5e681e0c4950] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:14:00.729668666Z [2024-04-21 01:14:00,729: INFO/ForkPoolWorker-1] [079b7cde-88e5-4ce6-be35-c2111736fd79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:14:00.998834292Z [2024-04-21 01:14:00,995: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:14:01.021158839Z [2024-04-21 01:14:01,017: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:14:01.027633614Z [2024-04-21 01:14:01,024: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:14:01.213737239Z [2024-04-21 01:14:01,210: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:14:01.269281605Z [2024-04-21 01:14:01,268: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:14:01.278362283Z [2024-04-21 01:14:01,277: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:14:01.288957117Z [2024-04-21 01:14:01,288: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:14:01.331469838Z [2024-04-21 01:14:01,331: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:14:01.333831162Z [2024-04-21 01:14:01,333: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:14:01.333890781Z [2024-04-21 01:14:01,333: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:14:01.333948717Z [2024-04-21 01:14:01,333: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:14:01.334111695Z [2024-04-21 01:14:01,334: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:14:01.496470281Z [2024-04-21 01:14:01,496: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:14:01.994486280Z [2024-04-21 01:14:01,994: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e5720e4-5d0d-4914-a0d7-e31466bc1c99] succeeded in 1.2936781799999153s: None 2024-04-21T01:14:02.209633839Z [2024-04-21 01:14:02,209: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a4007170-e7fc-4cb5-b3de-5e681e0c4950] succeeded in 1.4872063660004642s: None 2024-04-21T01:14:02.469542324Z [2024-04-21 01:14:02,469: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:14:02.472766194Z [2024-04-21 01:14:02,472: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:14:02.510420618Z [2024-04-21 01:14:02,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:14:02.512622341Z [2024-04-21 01:14:02,512: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:14:02.512739922Z [2024-04-21 01:14:02,512: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:14:02.513007128Z [2024-04-21 01:14:02,512: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:14:02.513132366Z [2024-04-21 01:14:02,512: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:14:02.513684806Z [2024-04-21 01:14:02,513: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:14:02.513802516Z [2024-04-21 01:14:02,513: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:14:02.604533153Z [2024-04-21 01:14:02,604: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:14:02.709967627Z [2024-04-21 01:14:02,709: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:14:02.713486323Z [2024-04-21 01:14:02,713: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:14:02.754314837Z [2024-04-21 01:14:02,754: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:14:02.755488917Z [2024-04-21 01:14:02,755: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:14:02.755650507Z [2024-04-21 01:14:02,755: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:14:02.755813264Z [2024-04-21 01:14:02,755: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:14:02.755938241Z [2024-04-21 01:14:02,755: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:14:02.756162820Z [2024-04-21 01:14:02,756: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:14:02.756265045Z [2024-04-21 01:14:02,756: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:14:02.841911622Z [2024-04-21 01:14:02,841: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:14:04.747605647Z [2024-04-21 01:14:04,747: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[079b7cde-88e5-4ce6-be35-c2111736fd79] succeeded in 4.03768391199992s: None 2024-04-21T01:14:04.854249444Z [2024-04-21 01:14:04,853: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4edc4376-64f2-4320-bbc1-7660378eac6a] succeeded in 4.153911830000652s: None 2024-04-21T01:15:01.218938896Z [2024-04-21 01:15:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77c9bbba-c958-4e15-8e0d-2add8b44556b] received 2024-04-21T01:15:01.221320897Z [2024-04-21 01:15:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d30ab581-cb8c-49a3-b66a-6e3de3414816] received 2024-04-21T01:15:01.228887937Z [2024-04-21 01:15:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fc0e125-2bf6-47cf-8ea3-5097a7f4dff2] received 2024-04-21T01:15:01.233404315Z [2024-04-21 01:15:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc77def6-1806-4ef4-8649-571027289f58] received 2024-04-21T01:15:01.234775100Z [2024-04-21 01:15:01,233: INFO/ForkPoolWorker-16] [d30ab581-cb8c-49a3-b66a-6e3de3414816] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:15:01.244169793Z [2024-04-21 01:15:01,243: INFO/ForkPoolWorker-1] [2fc0e125-2bf6-47cf-8ea3-5097a7f4dff2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:15:01.244316821Z [2024-04-21 01:15:01,244: INFO/ForkPoolWorker-15] [77c9bbba-c958-4e15-8e0d-2add8b44556b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:15:01.258037895Z [2024-04-21 01:15:01,257: INFO/ForkPoolWorker-2] [fc77def6-1806-4ef4-8649-571027289f58] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:15:01.594028242Z [2024-04-21 01:15:01,591: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:15:01.622140868Z [2024-04-21 01:15:01,618: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:15:01.716647818Z [2024-04-21 01:15:01,712: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:15:01.802608019Z [2024-04-21 01:15:01,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:15:01.967262288Z [2024-04-21 01:15:01,963: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:15:01.973757486Z [2024-04-21 01:15:01,973: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:15:02.037032498Z [2024-04-21 01:15:02,036: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:15:02.039198276Z [2024-04-21 01:15:02,038: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:15:02.039435907Z [2024-04-21 01:15:02,039: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:15:02.039572104Z [2024-04-21 01:15:02,039: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:15:02.039917081Z [2024-04-21 01:15:02,039: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:15:02.201999109Z [2024-04-21 01:15:02,201: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:15:02.968891354Z [2024-04-21 01:15:02,968: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc77def6-1806-4ef4-8649-571027289f58] succeeded in 1.7290367580008024s: None 2024-04-21T01:15:03.226934470Z [2024-04-21 01:15:03,226: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:15:03.231146799Z [2024-04-21 01:15:03,230: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:15:03.262114382Z [2024-04-21 01:15:03,261: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:15:03.265100858Z [2024-04-21 01:15:03,264: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:15:03.265217414Z [2024-04-21 01:15:03,265: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:15:03.265474019Z [2024-04-21 01:15:03,265: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:15:03.265603498Z [2024-04-21 01:15:03,265: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:15:03.265873996Z [2024-04-21 01:15:03,265: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:15:03.265979518Z [2024-04-21 01:15:03,265: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:15:03.368852414Z [2024-04-21 01:15:03,368: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:15:03.374077638Z [2024-04-21 01:15:03,373: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:15:03.376710093Z [2024-04-21 01:15:03,376: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:15:03.419007667Z [2024-04-21 01:15:03,418: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:15:03.421166833Z [2024-04-21 01:15:03,420: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:15:03.421181748Z [2024-04-21 01:15:03,421: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:15:03.421266840Z [2024-04-21 01:15:03,421: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:15:03.421277764Z [2024-04-21 01:15:03,421: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:15:03.421523428Z [2024-04-21 01:15:03,421: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:15:03.421534905Z [2024-04-21 01:15:03,421: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:15:03.492906927Z [2024-04-21 01:15:03,492: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:15:03.496314139Z [2024-04-21 01:15:03,495: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:15:03.520740402Z [2024-04-21 01:15:03,520: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:15:03.526190885Z [2024-04-21 01:15:03,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:15:03.529814505Z [2024-04-21 01:15:03,529: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:15:03.529968174Z [2024-04-21 01:15:03,529: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:15:03.530185939Z [2024-04-21 01:15:03,529: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:15:03.530854430Z [2024-04-21 01:15:03,530: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:15:03.531588772Z [2024-04-21 01:15:03,531: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:15:03.531839565Z [2024-04-21 01:15:03,531: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:15:03.697465851Z [2024-04-21 01:15:03,696: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:15:04.122085595Z [2024-04-21 01:15:04,121: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77c9bbba-c958-4e15-8e0d-2add8b44556b] succeeded in 2.8972189810010605s: None 2024-04-21T01:15:04.931737775Z [2024-04-21 01:15:04,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fc3a965-2627-452a-bfb2-bb71828a8edc] received 2024-04-21T01:15:04.940731915Z [2024-04-21 01:15:04,939: INFO/ForkPoolWorker-15] [6fc3a965-2627-452a-bfb2-bb71828a8edc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:15:05.235652954Z [2024-04-21 01:15:05,232: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:15:05.401294661Z [2024-04-21 01:15:05,400: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2fc0e125-2bf6-47cf-8ea3-5097a7f4dff2] succeeded in 4.169207023000126s: None 2024-04-21T01:15:05.901028737Z [2024-04-21 01:15:05,900: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d30ab581-cb8c-49a3-b66a-6e3de3414816] succeeded in 4.676098034999086s: None 2024-04-21T01:15:06.351666998Z [2024-04-21 01:15:06,351: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:15:06.354916484Z [2024-04-21 01:15:06,354: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:15:06.379197720Z [2024-04-21 01:15:06,378: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:15:06.381026626Z [2024-04-21 01:15:06,380: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:15:06.381083129Z [2024-04-21 01:15:06,380: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:15:06.381623858Z [2024-04-21 01:15:06,381: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:15:06.381718928Z [2024-04-21 01:15:06,381: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:15:06.382054297Z [2024-04-21 01:15:06,381: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:15:06.382205867Z [2024-04-21 01:15:06,382: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:15:06.476400587Z [2024-04-21 01:15:06,476: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:15:07.220279000Z [2024-04-21 01:15:07,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6fc3a965-2627-452a-bfb2-bb71828a8edc] succeeded in 2.2862859460001346s: None 2024-04-21T01:15:07.439781940Z [2024-04-21 01:15:07,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95e0be94-66a1-4df6-a4e5-4891fc6a127b] received 2024-04-21T01:15:07.448099929Z [2024-04-21 01:15:07,447: INFO/ForkPoolWorker-15] [95e0be94-66a1-4df6-a4e5-4891fc6a127b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:15:07.752313434Z [2024-04-21 01:15:07,748: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:15:08.774093694Z [2024-04-21 01:15:08,773: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:15:08.777234338Z [2024-04-21 01:15:08,776: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:15:08.801566084Z [2024-04-21 01:15:08,801: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:15:08.803501649Z [2024-04-21 01:15:08,803: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:15:08.803829976Z [2024-04-21 01:15:08,803: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:15:08.804167362Z [2024-04-21 01:15:08,803: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:15:08.804327115Z [2024-04-21 01:15:08,804: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:15:08.804683087Z [2024-04-21 01:15:08,804: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:15:08.804844955Z [2024-04-21 01:15:08,804: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:15:08.903735680Z [2024-04-21 01:15:08,903: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:15:09.475491763Z [2024-04-21 01:15:09,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95e0be94-66a1-4df6-a4e5-4891fc6a127b] succeeded in 2.0332201679993887s: None 2024-04-21T01:15:09.652889139Z [2024-04-21 01:15:09,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d7b7ae9-b241-4b75-927f-51233a9d8f12] received 2024-04-21T01:15:09.665590667Z [2024-04-21 01:15:09,665: INFO/ForkPoolWorker-15] [8d7b7ae9-b241-4b75-927f-51233a9d8f12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:15:09.929974517Z [2024-04-21 01:15:09,927: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:15:10.934303538Z [2024-04-21 01:15:10,933: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:15:10.937406207Z [2024-04-21 01:15:10,936: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:15:10.962241538Z [2024-04-21 01:15:10,961: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:15:10.964237330Z [2024-04-21 01:15:10,964: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:15:10.964396889Z [2024-04-21 01:15:10,964: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:15:10.964640951Z [2024-04-21 01:15:10,964: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:15:10.964753235Z [2024-04-21 01:15:10,964: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:15:10.965167569Z [2024-04-21 01:15:10,964: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:15:10.965339854Z [2024-04-21 01:15:10,965: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:15:11.048153094Z [2024-04-21 01:15:11,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:15:11.618777602Z [2024-04-21 01:15:11,618: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d7b7ae9-b241-4b75-927f-51233a9d8f12] succeeded in 1.962195210999198s: None 2024-04-21T01:16:00.554447100Z [2024-04-21 01:16:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf40470a-e680-4924-bd10-30e2fc7314b0] received 2024-04-21T01:16:00.561522994Z [2024-04-21 01:16:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6872ef5-b3fa-4b0f-bf44-176e43056859] received 2024-04-21T01:16:00.564153927Z [2024-04-21 01:16:00,563: INFO/ForkPoolWorker-15] [cf40470a-e680-4924-bd10-30e2fc7314b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:16:00.565837396Z [2024-04-21 01:16:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4d96aac-dbfe-4b34-9eea-404b1e0de497] received 2024-04-21T01:16:00.576147825Z [2024-04-21 01:16:00,574: INFO/ForkPoolWorker-16] [a6872ef5-b3fa-4b0f-bf44-176e43056859] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:16:00.577232230Z [2024-04-21 01:16:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8542eef1-8814-4b79-a7b9-c67203f9f20a] received 2024-04-21T01:16:00.578440596Z [2024-04-21 01:16:00,578: INFO/ForkPoolWorker-1] [c4d96aac-dbfe-4b34-9eea-404b1e0de497] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:16:00.593214039Z [2024-04-21 01:16:00,592: INFO/ForkPoolWorker-2] [8542eef1-8814-4b79-a7b9-c67203f9f20a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:16:00.971623795Z [2024-04-21 01:16:00,964: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:16:00.986482510Z [2024-04-21 01:16:00,983: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:16:00.992144387Z [2024-04-21 01:16:00,989: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:16:01.027068361Z [2024-04-21 01:16:01,023: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:16:01.246561178Z [2024-04-21 01:16:01,246: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:16:01.250344587Z [2024-04-21 01:16:01,249: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:16:01.279863516Z [2024-04-21 01:16:01,279: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:16:01.281382496Z [2024-04-21 01:16:01,281: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:16:01.281514300Z [2024-04-21 01:16:01,281: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:16:01.281582753Z [2024-04-21 01:16:01,281: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:16:01.281780871Z [2024-04-21 01:16:01,281: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:16:01.305727177Z [2024-04-21 01:16:01,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:16:01.420177831Z [2024-04-21 01:16:01,419: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:16:02.124672223Z [2024-04-21 01:16:02,124: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf40470a-e680-4924-bd10-30e2fc7314b0] succeeded in 1.56775988300069s: None 2024-04-21T01:16:02.256606148Z [2024-04-21 01:16:02,256: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8542eef1-8814-4b79-a7b9-c67203f9f20a] succeeded in 1.66893046199948s: None 2024-04-21T01:16:02.492351083Z [2024-04-21 01:16:02,492: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:16:02.496105695Z [2024-04-21 01:16:02,495: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:16:02.528282878Z [2024-04-21 01:16:02,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:16:02.531613342Z [2024-04-21 01:16:02,531: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:16:02.531902978Z [2024-04-21 01:16:02,531: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:16:02.532618974Z [2024-04-21 01:16:02,532: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:16:02.532865550Z [2024-04-21 01:16:02,532: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:16:02.535457695Z [2024-04-21 01:16:02,534: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:16:02.536202196Z [2024-04-21 01:16:02,535: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:16:02.597634001Z [2024-04-21 01:16:02,597: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:16:02.600825701Z [2024-04-21 01:16:02,600: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:16:02.630434097Z [2024-04-21 01:16:02,630: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:16:02.632566528Z [2024-04-21 01:16:02,632: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:16:02.633679837Z [2024-04-21 01:16:02,633: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:16:02.633699598Z [2024-04-21 01:16:02,633: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:16:02.633826036Z [2024-04-21 01:16:02,633: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:16:02.633860647Z [2024-04-21 01:16:02,633: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:16:02.634081048Z [2024-04-21 01:16:02,633: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:16:02.634101945Z [2024-04-21 01:16:02,634: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:16:02.765398364Z [2024-04-21 01:16:02,765: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:16:04.654855501Z [2024-04-21 01:16:04,654: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6872ef5-b3fa-4b0f-bf44-176e43056859] succeeded in 4.090946639998947s: None 2024-04-21T01:16:06.311760256Z [2024-04-21 01:16:06,311: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4d96aac-dbfe-4b34-9eea-404b1e0de497] succeeded in 5.743906565001453s: None 2024-04-21T01:17:01.071716906Z [2024-04-21 01:17:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59618863-a8b2-48e9-94d9-2d72d71d1e16] received 2024-04-21T01:17:01.099114494Z [2024-04-21 01:17:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36ad3136-8b09-4fb0-b849-b44c0e366c8f] received 2024-04-21T01:17:01.099138383Z [2024-04-21 01:17:01,080: INFO/ForkPoolWorker-15] [59618863-a8b2-48e9-94d9-2d72d71d1e16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:17:01.099142481Z [2024-04-21 01:17:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc342868-93a7-4d00-acf9-921fff49adaa] received 2024-04-21T01:17:01.124056394Z [2024-04-21 01:17:01,105: INFO/ForkPoolWorker-16] [36ad3136-8b09-4fb0-b849-b44c0e366c8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:17:01.133171299Z [2024-04-21 01:17:01,132: INFO/ForkPoolWorker-1] [dc342868-93a7-4d00-acf9-921fff49adaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:17:01.400507807Z [2024-04-21 01:17:01,397: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:17:01.424792570Z [2024-04-21 01:17:01,422: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:17:01.592397865Z [2024-04-21 01:17:01,587: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:17:01.757468318Z [2024-04-21 01:17:01,757: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:17:01.761795115Z [2024-04-21 01:17:01,761: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:17:01.807205830Z [2024-04-21 01:17:01,806: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:17:01.809813427Z [2024-04-21 01:17:01,809: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:17:01.810008237Z [2024-04-21 01:17:01,809: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:17:01.810159471Z [2024-04-21 01:17:01,810: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:17:01.810895724Z [2024-04-21 01:17:01,810: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:17:01.888892581Z [2024-04-21 01:17:01,888: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:17:02.531194343Z [2024-04-21 01:17:02,530: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc342868-93a7-4d00-acf9-921fff49adaa] succeeded in 1.4295257419998961s: None 2024-04-21T01:17:02.642598863Z [2024-04-21 01:17:02,642: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:17:02.646505293Z [2024-04-21 01:17:02,646: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:17:02.686604876Z [2024-04-21 01:17:02,686: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:17:02.695961967Z [2024-04-21 01:17:02,695: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:17:02.696838087Z [2024-04-21 01:17:02,695: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:17:02.697075260Z [2024-04-21 01:17:02,696: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:17:02.698277242Z [2024-04-21 01:17:02,697: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:17:02.698607300Z [2024-04-21 01:17:02,698: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:17:02.699820458Z [2024-04-21 01:17:02,698: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:17:02.726245963Z [2024-04-21 01:17:02,725: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:17:02.729444339Z [2024-04-21 01:17:02,728: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:17:02.766455400Z [2024-04-21 01:17:02,766: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:17:02.770138282Z [2024-04-21 01:17:02,769: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:17:02.770231116Z [2024-04-21 01:17:02,770: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:17:02.770528460Z [2024-04-21 01:17:02,770: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:17:02.770539329Z [2024-04-21 01:17:02,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:17:02.770787158Z [2024-04-21 01:17:02,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:17:02.770883162Z [2024-04-21 01:17:02,770: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:17:02.824775703Z [2024-04-21 01:17:02,824: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:17:02.847058410Z [2024-04-21 01:17:02,846: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:17:04.817004753Z [2024-04-21 01:17:04,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59618863-a8b2-48e9-94d9-2d72d71d1e16] succeeded in 3.74373745199955s: None 2024-04-21T01:17:05.215855941Z [2024-04-21 01:17:05,215: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36ad3136-8b09-4fb0-b849-b44c0e366c8f] succeeded in 4.123128857001575s: None 2024-04-21T01:18:00.405208850Z [2024-04-21 01:18:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab5b6d1b-dc44-46f8-85d9-9d887efc40d6] received 2024-04-21T01:18:00.412527078Z [2024-04-21 01:18:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2027626c-2d2a-49d4-964f-d549c86833f1] received 2024-04-21T01:18:00.413443110Z [2024-04-21 01:18:00,413: INFO/ForkPoolWorker-15] [ab5b6d1b-dc44-46f8-85d9-9d887efc40d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:18:00.421115646Z [2024-04-21 01:18:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fb5da63-0eab-488f-bd6b-60b08f43975b] received 2024-04-21T01:18:00.443945726Z [2024-04-21 01:18:00,443: INFO/ForkPoolWorker-16] [2027626c-2d2a-49d4-964f-d549c86833f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:18:00.448456867Z [2024-04-21 01:18:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b992b44-baaa-44b2-a183-345b738aed49] received 2024-04-21T01:18:00.450031833Z [2024-04-21 01:18:00,449: INFO/ForkPoolWorker-1] [0fb5da63-0eab-488f-bd6b-60b08f43975b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:18:00.464866026Z [2024-04-21 01:18:00,464: INFO/ForkPoolWorker-2] [1b992b44-baaa-44b2-a183-345b738aed49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:18:00.802960128Z [2024-04-21 01:18:00,799: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:18:00.840409355Z [2024-04-21 01:18:00,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:18:00.846569609Z [2024-04-21 01:18:00,842: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:18:00.922921660Z [2024-04-21 01:18:00,919: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:18:00.962578591Z [2024-04-21 01:18:00,962: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:18:00.966491873Z [2024-04-21 01:18:00,966: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:18:00.993551645Z [2024-04-21 01:18:00,993: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:18:00.995107293Z [2024-04-21 01:18:00,994: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:18:00.995380656Z [2024-04-21 01:18:00,995: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:18:00.995604602Z [2024-04-21 01:18:00,995: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:18:00.996029538Z [2024-04-21 01:18:00,995: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:18:01.125116971Z [2024-04-21 01:18:01,119: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:18:01.190955356Z [2024-04-21 01:18:01,190: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:18:01.892252208Z [2024-04-21 01:18:01,891: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2027626c-2d2a-49d4-964f-d549c86833f1] succeeded in 1.4652123260002554s: None 2024-04-21T01:18:01.936822130Z [2024-04-21 01:18:01,936: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0fb5da63-0eab-488f-bd6b-60b08f43975b] succeeded in 1.5098244330001762s: None 2024-04-21T01:18:02.379191189Z [2024-04-21 01:18:02,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:18:02.382215735Z [2024-04-21 01:18:02,381: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:18:02.404193452Z [2024-04-21 01:18:02,403: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:18:02.405330576Z [2024-04-21 01:18:02,405: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:18:02.405372687Z [2024-04-21 01:18:02,405: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:18:02.405540849Z [2024-04-21 01:18:02,405: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:18:02.405611863Z [2024-04-21 01:18:02,405: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:18:02.405861378Z [2024-04-21 01:18:02,405: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:18:02.405931706Z [2024-04-21 01:18:02,405: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:18:02.413669385Z [2024-04-21 01:18:02,413: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:18:02.417506405Z [2024-04-21 01:18:02,417: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:18:02.445992798Z [2024-04-21 01:18:02,445: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:18:02.447125643Z [2024-04-21 01:18:02,446: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:18:02.447188484Z [2024-04-21 01:18:02,447: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:18:02.447359440Z [2024-04-21 01:18:02,447: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:18:02.447430341Z [2024-04-21 01:18:02,447: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:18:02.447650628Z [2024-04-21 01:18:02,447: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:18:02.448079072Z [2024-04-21 01:18:02,447: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:18:02.495664376Z [2024-04-21 01:18:02,495: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:18:02.539446632Z [2024-04-21 01:18:02,539: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:18:04.082496848Z [2024-04-21 01:18:04,081: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab5b6d1b-dc44-46f8-85d9-9d887efc40d6] succeeded in 3.6755328480012395s: None 2024-04-21T01:18:04.942906046Z [2024-04-21 01:18:04,942: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1b992b44-baaa-44b2-a183-345b738aed49] succeeded in 4.491389490000074s: None 2024-04-21T01:19:01.013027139Z [2024-04-21 01:19:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[550339ec-258e-4cb5-a106-ce24ff512c29] received 2024-04-21T01:19:01.019235114Z [2024-04-21 01:19:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78272aa9-4ef8-4a25-81b6-1261af5001e6] received 2024-04-21T01:19:01.023666190Z [2024-04-21 01:19:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad5b79ca-94a6-4491-a67b-23e3816526ba] received 2024-04-21T01:19:01.037596563Z [2024-04-21 01:19:01,037: INFO/ForkPoolWorker-15] [550339ec-258e-4cb5-a106-ce24ff512c29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:19:01.038235431Z [2024-04-21 01:19:01,037: INFO/ForkPoolWorker-1] [ad5b79ca-94a6-4491-a67b-23e3816526ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:19:01.040619505Z [2024-04-21 01:19:01,039: INFO/ForkPoolWorker-16] [78272aa9-4ef8-4a25-81b6-1261af5001e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:19:01.396107076Z [2024-04-21 01:19:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:19:01.603763756Z [2024-04-21 01:19:01,600: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:19:01.696546671Z [2024-04-21 01:19:01,696: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:19:01.700322763Z [2024-04-21 01:19:01,699: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:19:01.714063492Z [2024-04-21 01:19:01,710: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:19:01.740737545Z [2024-04-21 01:19:01,740: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:19:01.741868815Z [2024-04-21 01:19:01,741: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:19:01.742042214Z [2024-04-21 01:19:01,741: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:19:01.742060697Z [2024-04-21 01:19:01,741: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:19:01.742377275Z [2024-04-21 01:19:01,742: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:19:01.837496116Z [2024-04-21 01:19:01,837: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:19:02.446037059Z [2024-04-21 01:19:02,445: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78272aa9-4ef8-4a25-81b6-1261af5001e6] succeeded in 1.4205678449998231s: None 2024-04-21T01:19:02.989948360Z [2024-04-21 01:19:02,989: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:19:02.993385320Z [2024-04-21 01:19:02,992: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:19:03.015476451Z [2024-04-21 01:19:03,015: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:19:03.016955718Z [2024-04-21 01:19:03,016: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:19:03.017003359Z [2024-04-21 01:19:03,016: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:19:03.017140009Z [2024-04-21 01:19:03,016: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:19:03.017203802Z [2024-04-21 01:19:03,017: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:19:03.017477594Z [2024-04-21 01:19:03,017: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:19:03.017534892Z [2024-04-21 01:19:03,017: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:19:03.127919679Z [2024-04-21 01:19:03,127: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:19:03.283765622Z [2024-04-21 01:19:03,283: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:19:03.286971109Z [2024-04-21 01:19:03,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:19:03.305636799Z [2024-04-21 01:19:03,305: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:19:03.306871383Z [2024-04-21 01:19:03,306: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:19:03.307261835Z [2024-04-21 01:19:03,307: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:19:03.307636815Z [2024-04-21 01:19:03,307: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:19:03.308084563Z [2024-04-21 01:19:03,307: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:19:03.308345200Z [2024-04-21 01:19:03,308: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:19:03.308521728Z [2024-04-21 01:19:03,308: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:19:03.437782960Z [2024-04-21 01:19:03,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:19:04.881825333Z [2024-04-21 01:19:04,881: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ad5b79ca-94a6-4491-a67b-23e3816526ba] succeeded in 3.8552808849999565s: None 2024-04-21T01:19:05.471359065Z [2024-04-21 01:19:05,470: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[550339ec-258e-4cb5-a106-ce24ff512c29] succeeded in 4.4540502929994545s: None 2024-04-21T01:20:01.162500920Z [2024-04-21 01:20:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fb9df20-34ab-42ec-998c-beb3476045ca] received 2024-04-21T01:20:01.172659242Z [2024-04-21 01:20:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dd03e07-7a42-4b36-a9a1-e264e2fbc14c] received 2024-04-21T01:20:01.174650618Z [2024-04-21 01:20:01,174: INFO/ForkPoolWorker-15] [0fb9df20-34ab-42ec-998c-beb3476045ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:20:01.177636657Z [2024-04-21 01:20:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c5e4736-a3a9-4597-bf40-16502c836041] received 2024-04-21T01:20:01.182891313Z [2024-04-21 01:20:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25e247ae-5fad-401e-b738-b4cc9fb1e687] received 2024-04-21T01:20:01.183547609Z [2024-04-21 01:20:01,183: INFO/ForkPoolWorker-16] [5dd03e07-7a42-4b36-a9a1-e264e2fbc14c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:20:01.186324292Z [2024-04-21 01:20:01,186: INFO/ForkPoolWorker-1] [0c5e4736-a3a9-4597-bf40-16502c836041] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:20:01.186705208Z [2024-04-21 01:20:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97e89589-6de4-4dc9-a662-2619489c8a6a] received 2024-04-21T01:20:01.207803204Z [2024-04-21 01:20:01,207: INFO/ForkPoolWorker-3] [97e89589-6de4-4dc9-a662-2619489c8a6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:20:01.209731966Z [2024-04-21 01:20:01,209: INFO/ForkPoolWorker-2] [25e247ae-5fad-401e-b738-b4cc9fb1e687] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:20:01.625402528Z [2024-04-21 01:20:01,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:20:01.757388463Z [2024-04-21 01:20:01,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:20:01.787552818Z [2024-04-21 01:20:01,783: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:20:02.037613197Z [2024-04-21 01:20:02,037: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:20:02.118896921Z [2024-04-21 01:20:02,115: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:20:02.172868663Z [2024-04-21 01:20:02,168: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:20:02.364517227Z [2024-04-21 01:20:02,364: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:20:02.368626293Z [2024-04-21 01:20:02,368: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:20:02.412973276Z [2024-04-21 01:20:02,412: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:20:02.416778904Z [2024-04-21 01:20:02,416: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:20:02.417097828Z [2024-04-21 01:20:02,416: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:20:02.417283214Z [2024-04-21 01:20:02,417: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:20:02.417604674Z [2024-04-21 01:20:02,417: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:20:02.576525314Z [2024-04-21 01:20:02,576: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:20:03.037658621Z [2024-04-21 01:20:03,037: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5dd03e07-7a42-4b36-a9a1-e264e2fbc14c] succeeded in 1.863072819000081s: None 2024-04-21T01:20:03.616045714Z [2024-04-21 01:20:03,615: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c5e4736-a3a9-4597-bf40-16502c836041] succeeded in 2.4366372960012086s: None 2024-04-21T01:20:04.202401452Z [2024-04-21 01:20:04,198: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T01:20:04.202539634Z [2024-04-21 01:20:04,201: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:20:04.307866768Z [2024-04-21 01:20:04,300: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T01:20:04.307900764Z [2024-04-21 01:20:04,304: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:20:04.307904379Z [2024-04-21 01:20:04,304: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:20:04.307908143Z [2024-04-21 01:20:04,304: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:20:04.307912011Z [2024-04-21 01:20:04,304: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T01:20:04.307915183Z [2024-04-21 01:20:04,304: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:20:04.307918274Z [2024-04-21 01:20:04,305: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:20:04.430972894Z [2024-04-21 01:20:04,430: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:20:04.590600603Z [2024-04-21 01:20:04,590: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:20:04.599608393Z [2024-04-21 01:20:04,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:20:04.643445233Z [2024-04-21 01:20:04,643: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:20:04.645003014Z [2024-04-21 01:20:04,644: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:20:04.645110433Z [2024-04-21 01:20:04,644: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:20:04.645263224Z [2024-04-21 01:20:04,645: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:20:04.645334014Z [2024-04-21 01:20:04,645: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:20:04.648292834Z [2024-04-21 01:20:04,648: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:20:04.648366716Z [2024-04-21 01:20:04,648: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:20:04.833197181Z [2024-04-21 01:20:04,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:20:05.062285208Z [2024-04-21 01:20:05,061: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:20:05.065779568Z [2024-04-21 01:20:05,065: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:20:05.107261538Z [2024-04-21 01:20:05,106: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:20:05.111608520Z [2024-04-21 01:20:05,111: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:20:05.111638335Z [2024-04-21 01:20:05,111: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:20:05.111789338Z [2024-04-21 01:20:05,111: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:20:05.111880983Z [2024-04-21 01:20:05,111: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:20:05.112232312Z [2024-04-21 01:20:05,112: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:20:05.112348745Z [2024-04-21 01:20:05,112: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:20:05.188868543Z [2024-04-21 01:20:05,188: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:20:05.613459290Z [2024-04-21 01:20:05,613: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0fb9df20-34ab-42ec-998c-beb3476045ca] succeeded in 4.448092931999781s: None 2024-04-21T01:20:05.965131406Z [2024-04-21 01:20:05,964: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[97e89589-6de4-4dc9-a662-2619489c8a6a] succeeded in 4.767075830000977s: None 2024-04-21T01:20:06.630792608Z [2024-04-21 01:20:06,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36d994c0-e6db-4158-8956-7b3536ddfa8a] received 2024-04-21T01:20:06.642778400Z [2024-04-21 01:20:06,642: INFO/ForkPoolWorker-15] [36d994c0-e6db-4158-8956-7b3536ddfa8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:20:06.955763583Z [2024-04-21 01:20:06,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:20:07.086413988Z [2024-04-21 01:20:07,086: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25e247ae-5fad-401e-b738-b4cc9fb1e687] succeeded in 5.901529758000834s: None 2024-04-21T01:20:08.069757771Z [2024-04-21 01:20:08,068: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:20:08.072998864Z [2024-04-21 01:20:08,072: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:20:08.101193611Z [2024-04-21 01:20:08,100: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:20:08.102492197Z [2024-04-21 01:20:08,102: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:20:08.102651142Z [2024-04-21 01:20:08,102: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:20:08.102832874Z [2024-04-21 01:20:08,102: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:20:08.102949341Z [2024-04-21 01:20:08,102: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:20:08.103252945Z [2024-04-21 01:20:08,103: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:20:08.103326495Z [2024-04-21 01:20:08,103: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:20:08.183627743Z [2024-04-21 01:20:08,183: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:20:08.911168852Z [2024-04-21 01:20:08,910: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36d994c0-e6db-4158-8956-7b3536ddfa8a] succeeded in 2.277489546999277s: None 2024-04-21T01:20:09.067506850Z [2024-04-21 01:20:09,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8bc95d7-df74-4d59-9cc1-e0978ec19a6d] received 2024-04-21T01:20:09.073324530Z [2024-04-21 01:20:09,073: INFO/ForkPoolWorker-15] [b8bc95d7-df74-4d59-9cc1-e0978ec19a6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:20:09.326744528Z [2024-04-21 01:20:09,323: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:20:10.334910884Z [2024-04-21 01:20:10,334: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:20:10.337887979Z [2024-04-21 01:20:10,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:20:10.364573704Z [2024-04-21 01:20:10,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:20:10.365918870Z [2024-04-21 01:20:10,365: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:20:10.366056089Z [2024-04-21 01:20:10,365: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:20:10.366120023Z [2024-04-21 01:20:10,365: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:20:10.366131102Z [2024-04-21 01:20:10,365: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:20:10.366428302Z [2024-04-21 01:20:10,366: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:20:10.366446691Z [2024-04-21 01:20:10,366: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:20:10.469694563Z [2024-04-21 01:20:10,469: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:20:11.076634242Z [2024-04-21 01:20:11,076: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8bc95d7-df74-4d59-9cc1-e0978ec19a6d] succeeded in 2.006997564998528s: None 2024-04-21T01:20:11.100264531Z [2024-04-21 01:20:11,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7f7a305-5519-4f78-9d3e-6211063aac5b] received 2024-04-21T01:20:11.106778782Z [2024-04-21 01:20:11,106: INFO/ForkPoolWorker-15] [f7f7a305-5519-4f78-9d3e-6211063aac5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:20:11.359799124Z [2024-04-21 01:20:11,356: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:20:12.424542161Z [2024-04-21 01:20:12,420: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:20:12.424596772Z [2024-04-21 01:20:12,423: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:20:12.458192483Z [2024-04-21 01:20:12,457: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:20:12.460717589Z [2024-04-21 01:20:12,460: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:20:12.460856227Z [2024-04-21 01:20:12,460: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:20:12.461282680Z [2024-04-21 01:20:12,460: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:20:12.461489249Z [2024-04-21 01:20:12,461: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:20:12.462000173Z [2024-04-21 01:20:12,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:20:12.462241420Z [2024-04-21 01:20:12,461: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:20:12.579392206Z [2024-04-21 01:20:12,579: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:20:13.203158072Z [2024-04-21 01:20:13,202: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7f7a305-5519-4f78-9d3e-6211063aac5b] succeeded in 2.101348523001434s: None 2024-04-21T01:21:01.110856959Z [2024-04-21 01:21:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94a8ac59-ab9b-48d9-8ee7-d97fce074aa1] received 2024-04-21T01:21:01.115820149Z [2024-04-21 01:21:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd4c65c8-7f7c-43c7-8ee6-6419eea255cf] received 2024-04-21T01:21:01.116443801Z [2024-04-21 01:21:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42775615-c7d0-483e-baf9-e25ce2de3e2f] received 2024-04-21T01:21:01.117100752Z [2024-04-21 01:21:01,116: INFO/ForkPoolWorker-15] [94a8ac59-ab9b-48d9-8ee7-d97fce074aa1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:21:01.126871837Z [2024-04-21 01:21:01,126: INFO/ForkPoolWorker-16] [cd4c65c8-7f7c-43c7-8ee6-6419eea255cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:21:01.137587528Z [2024-04-21 01:21:01,137: INFO/ForkPoolWorker-1] [42775615-c7d0-483e-baf9-e25ce2de3e2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:21:01.434773401Z [2024-04-21 01:21:01,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:21:01.492605524Z [2024-04-21 01:21:01,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:21:01.662134604Z [2024-04-21 01:21:01,658: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:21:01.835782231Z [2024-04-21 01:21:01,835: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:21:01.840282298Z [2024-04-21 01:21:01,839: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:21:01.871332035Z [2024-04-21 01:21:01,871: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:21:01.872541582Z [2024-04-21 01:21:01,872: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:21:01.872596078Z [2024-04-21 01:21:01,872: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:21:01.872660080Z [2024-04-21 01:21:01,872: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:21:01.872873624Z [2024-04-21 01:21:01,872: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:21:01.967415381Z [2024-04-21 01:21:01,967: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:21:02.588822687Z [2024-04-21 01:21:02,588: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42775615-c7d0-483e-baf9-e25ce2de3e2f] succeeded in 1.4699688380005682s: None 2024-04-21T01:21:02.635314132Z [2024-04-21 01:21:02,634: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:21:02.638673946Z [2024-04-21 01:21:02,638: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:21:02.657893467Z [2024-04-21 01:21:02,657: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:21:02.659513955Z [2024-04-21 01:21:02,659: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:21:02.659789928Z [2024-04-21 01:21:02,659: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:21:02.659973925Z [2024-04-21 01:21:02,659: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:21:02.660280065Z [2024-04-21 01:21:02,660: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:21:02.660867678Z [2024-04-21 01:21:02,660: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:21:02.661582138Z [2024-04-21 01:21:02,661: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:21:02.728653678Z [2024-04-21 01:21:02,728: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:21:02.798424465Z [2024-04-21 01:21:02,797: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:21:02.804646639Z [2024-04-21 01:21:02,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:21:02.825063143Z [2024-04-21 01:21:02,824: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:21:02.826303784Z [2024-04-21 01:21:02,826: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:21:02.826386051Z [2024-04-21 01:21:02,826: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:21:02.826584634Z [2024-04-21 01:21:02,826: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:21:02.826693007Z [2024-04-21 01:21:02,826: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:21:02.826951674Z [2024-04-21 01:21:02,826: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:21:02.827008525Z [2024-04-21 01:21:02,826: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:21:02.906455168Z [2024-04-21 01:21:02,906: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:21:04.655981486Z [2024-04-21 01:21:04,655: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cd4c65c8-7f7c-43c7-8ee6-6419eea255cf] succeeded in 3.540202087999205s: None 2024-04-21T01:21:05.545156470Z [2024-04-21 01:21:05,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94a8ac59-ab9b-48d9-8ee7-d97fce074aa1] succeeded in 4.433349999000711s: None 2024-04-21T01:22:01.099931698Z [2024-04-21 01:22:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[506c98ae-6729-400d-8b11-7fd939b652ae] received 2024-04-21T01:22:01.107952321Z [2024-04-21 01:22:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d045c5cd-2306-4353-a321-ef663f26afed] received 2024-04-21T01:22:01.115732504Z [2024-04-21 01:22:01,106: INFO/ForkPoolWorker-16] [d045c5cd-2306-4353-a321-ef663f26afed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:22:01.115771540Z [2024-04-21 01:22:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2501f1d5-817b-4ae5-a912-c1b46bfc21a8] received 2024-04-21T01:22:01.115903946Z [2024-04-21 01:22:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b43fdc2e-b232-4559-b7c6-190101aec1b4] received 2024-04-21T01:22:01.130679101Z [2024-04-21 01:22:01,128: INFO/ForkPoolWorker-1] [2501f1d5-817b-4ae5-a912-c1b46bfc21a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:22:01.130706611Z [2024-04-21 01:22:01,129: INFO/ForkPoolWorker-15] [506c98ae-6729-400d-8b11-7fd939b652ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:22:01.141946957Z [2024-04-21 01:22:01,141: INFO/ForkPoolWorker-2] [b43fdc2e-b232-4559-b7c6-190101aec1b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:22:01.499892986Z [2024-04-21 01:22:01,491: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:22:01.547759661Z [2024-04-21 01:22:01,527: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:22:01.565375880Z [2024-04-21 01:22:01,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:22:01.702096459Z [2024-04-21 01:22:01,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:22:01.832090408Z [2024-04-21 01:22:01,831: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:22:02.019218758Z [2024-04-21 01:22:02,018: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:22:02.023492606Z [2024-04-21 01:22:02,023: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:22:02.056587453Z [2024-04-21 01:22:02,056: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:22:02.059909136Z [2024-04-21 01:22:02,059: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:22:02.060134630Z [2024-04-21 01:22:02,059: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:22:02.060284967Z [2024-04-21 01:22:02,060: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:22:02.060690843Z [2024-04-21 01:22:02,060: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:22:02.205483323Z [2024-04-21 01:22:02,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:22:02.444577203Z [2024-04-21 01:22:02,444: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2501f1d5-817b-4ae5-a912-c1b46bfc21a8] succeeded in 1.3267306059988186s: None 2024-04-21T01:22:02.876004234Z [2024-04-21 01:22:02,875: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d045c5cd-2306-4353-a321-ef663f26afed] succeeded in 1.7741978020003444s: None 2024-04-21T01:22:02.885758790Z [2024-04-21 01:22:02,885: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:22:02.888934947Z [2024-04-21 01:22:02,888: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:22:02.918143178Z [2024-04-21 01:22:02,917: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:22:02.919609197Z [2024-04-21 01:22:02,919: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:22:02.919712397Z [2024-04-21 01:22:02,919: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:22:02.919916751Z [2024-04-21 01:22:02,919: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:22:02.920086367Z [2024-04-21 01:22:02,919: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:22:02.920447253Z [2024-04-21 01:22:02,920: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:22:02.920548592Z [2024-04-21 01:22:02,920: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:22:03.039643778Z [2024-04-21 01:22:03,039: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:22:03.381939127Z [2024-04-21 01:22:03,381: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:22:03.385915213Z [2024-04-21 01:22:03,385: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:22:03.414481038Z [2024-04-21 01:22:03,414: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:22:03.418735141Z [2024-04-21 01:22:03,418: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:22:03.419029445Z [2024-04-21 01:22:03,418: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:22:03.419249277Z [2024-04-21 01:22:03,419: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:22:03.419366479Z [2024-04-21 01:22:03,419: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:22:03.419837906Z [2024-04-21 01:22:03,419: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:22:03.419985771Z [2024-04-21 01:22:03,419: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:22:03.527912938Z [2024-04-21 01:22:03,527: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:22:05.295399734Z [2024-04-21 01:22:05,294: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[506c98ae-6729-400d-8b11-7fd939b652ae] succeeded in 4.181249999001011s: None 2024-04-21T01:22:06.437711702Z [2024-04-21 01:22:06,437: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b43fdc2e-b232-4559-b7c6-190101aec1b4] succeeded in 5.319559733999995s: None 2024-04-21T01:23:00.265545382Z [2024-04-21 01:23:00,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b63b685-779b-4300-ae3e-9c4bc855e1ee] received 2024-04-21T01:23:00.269953132Z [2024-04-21 01:23:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc97b6c5-f4a9-4d67-a26d-79637248c560] received 2024-04-21T01:23:00.277191253Z [2024-04-21 01:23:00,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cf058d7-3e6b-4469-aa2a-4c2245541847] received 2024-04-21T01:23:00.278913621Z [2024-04-21 01:23:00,278: INFO/ForkPoolWorker-16] [cc97b6c5-f4a9-4d67-a26d-79637248c560] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:23:00.279535940Z [2024-04-21 01:23:00,278: INFO/ForkPoolWorker-15] [6b63b685-779b-4300-ae3e-9c4bc855e1ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:23:00.287665580Z [2024-04-21 01:23:00,286: INFO/ForkPoolWorker-1] [2cf058d7-3e6b-4469-aa2a-4c2245541847] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:23:00.564706240Z [2024-04-21 01:23:00,561: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:23:00.574909593Z [2024-04-21 01:23:00,571: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:23:00.607547665Z [2024-04-21 01:23:00,604: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:23:00.733413573Z [2024-04-21 01:23:00,732: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:23:00.737189675Z [2024-04-21 01:23:00,736: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:23:00.765530841Z [2024-04-21 01:23:00,765: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:23:00.766667736Z [2024-04-21 01:23:00,766: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:23:00.766698535Z [2024-04-21 01:23:00,766: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:23:00.766759973Z [2024-04-21 01:23:00,766: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:23:00.767002775Z [2024-04-21 01:23:00,766: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:23:00.850525040Z [2024-04-21 01:23:00,850: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:23:01.383362326Z [2024-04-21 01:23:01,382: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2cf058d7-3e6b-4469-aa2a-4c2245541847] succeeded in 1.1029366249986197s: None 2024-04-21T01:23:01.741610611Z [2024-04-21 01:23:01,741: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:23:01.744596523Z [2024-04-21 01:23:01,744: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:23:01.757089248Z [2024-04-21 01:23:01,756: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:23:01.761386698Z [2024-04-21 01:23:01,760: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:23:01.765538880Z [2024-04-21 01:23:01,765: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:23:01.766590640Z [2024-04-21 01:23:01,766: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:23:01.766605431Z [2024-04-21 01:23:01,766: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:23:01.766728211Z [2024-04-21 01:23:01,766: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:23:01.766748908Z [2024-04-21 01:23:01,766: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:23:01.767037604Z [2024-04-21 01:23:01,766: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:23:01.767064357Z [2024-04-21 01:23:01,766: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:23:01.779431456Z [2024-04-21 01:23:01,779: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:23:01.780956564Z [2024-04-21 01:23:01,780: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:23:01.781034458Z [2024-04-21 01:23:01,780: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:23:01.781164093Z [2024-04-21 01:23:01,781: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:23:01.781231859Z [2024-04-21 01:23:01,781: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:23:01.781454335Z [2024-04-21 01:23:01,781: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:23:01.781782168Z [2024-04-21 01:23:01,781: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:23:01.852218635Z [2024-04-21 01:23:01,851: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:23:01.880411525Z [2024-04-21 01:23:01,880: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:23:03.761343161Z [2024-04-21 01:23:03,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc97b6c5-f4a9-4d67-a26d-79637248c560] succeeded in 3.4888789289998385s: None 2024-04-21T01:23:04.023251282Z [2024-04-21 01:23:04,022: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b63b685-779b-4300-ae3e-9c4bc855e1ee] succeeded in 3.7553227770004014s: None 2024-04-21T01:24:00.621940743Z [2024-04-21 01:24:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f13e59b0-2ac1-496e-85ef-86a153dc737a] received 2024-04-21T01:24:00.626555194Z [2024-04-21 01:24:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b114a01-5454-47df-8ab1-fee2f6b37dc2] received 2024-04-21T01:24:00.632655732Z [2024-04-21 01:24:00,632: INFO/ForkPoolWorker-15] [f13e59b0-2ac1-496e-85ef-86a153dc737a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:24:00.635848102Z [2024-04-21 01:24:00,635: INFO/ForkPoolWorker-16] [7b114a01-5454-47df-8ab1-fee2f6b37dc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:24:00.646758424Z [2024-04-21 01:24:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb7bad76-f127-4e46-8e3e-914e6bf36226] received 2024-04-21T01:24:00.651941595Z [2024-04-21 01:24:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e44f2e2e-4055-4134-8312-869a578dd01e] received 2024-04-21T01:24:00.658810247Z [2024-04-21 01:24:00,658: INFO/ForkPoolWorker-1] [fb7bad76-f127-4e46-8e3e-914e6bf36226] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:24:00.664791547Z [2024-04-21 01:24:00,664: INFO/ForkPoolWorker-2] [e44f2e2e-4055-4134-8312-869a578dd01e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:24:00.946887150Z [2024-04-21 01:24:00,943: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:24:00.956526984Z [2024-04-21 01:24:00,953: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:24:01.007770439Z [2024-04-21 01:24:01,002: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:24:01.029851507Z [2024-04-21 01:24:01,026: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:24:01.124919860Z [2024-04-21 01:24:01,124: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:24:01.130506645Z [2024-04-21 01:24:01,130: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:24:01.214767862Z [2024-04-21 01:24:01,208: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:24:01.214812079Z [2024-04-21 01:24:01,210: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:24:01.214817480Z [2024-04-21 01:24:01,210: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:24:01.214822066Z [2024-04-21 01:24:01,210: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:24:01.214825699Z [2024-04-21 01:24:01,210: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:24:01.347014546Z [2024-04-21 01:24:01,346: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:24:01.410688958Z [2024-04-21 01:24:01,410: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:24:02.027100880Z [2024-04-21 01:24:02,026: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e44f2e2e-4055-4134-8312-869a578dd01e] succeeded in 1.3738073339991388s: None 2024-04-21T01:24:02.136658105Z [2024-04-21 01:24:02,136: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f13e59b0-2ac1-496e-85ef-86a153dc737a] succeeded in 1.5118816819995118s: None 2024-04-21T01:24:02.423122232Z [2024-04-21 01:24:02,422: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:24:02.428671397Z [2024-04-21 01:24:02,428: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:24:02.447137538Z [2024-04-21 01:24:02,446: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:24:02.447328623Z [2024-04-21 01:24:02,447: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:24:02.448296834Z [2024-04-21 01:24:02,448: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:24:02.448427588Z [2024-04-21 01:24:02,448: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:24:02.448585397Z [2024-04-21 01:24:02,448: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:24:02.448684659Z [2024-04-21 01:24:02,448: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:24:02.448975316Z [2024-04-21 01:24:02,448: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:24:02.449083208Z [2024-04-21 01:24:02,448: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:24:02.450369418Z [2024-04-21 01:24:02,450: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:24:02.466981545Z [2024-04-21 01:24:02,466: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:24:02.467997056Z [2024-04-21 01:24:02,467: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:24:02.468012348Z [2024-04-21 01:24:02,467: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:24:02.468115295Z [2024-04-21 01:24:02,467: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:24:02.468143378Z [2024-04-21 01:24:02,468: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:24:02.468327728Z [2024-04-21 01:24:02,468: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:24:02.468352431Z [2024-04-21 01:24:02,468: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:24:02.524395658Z [2024-04-21 01:24:02,524: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:24:02.544342040Z [2024-04-21 01:24:02,544: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:24:04.286342872Z [2024-04-21 01:24:04,285: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fb7bad76-f127-4e46-8e3e-914e6bf36226] succeeded in 3.6330401380000694s: None 2024-04-21T01:24:04.547575243Z [2024-04-21 01:24:04,546: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b114a01-5454-47df-8ab1-fee2f6b37dc2] succeeded in 3.917752682000355s: None 2024-04-21T01:25:01.176299239Z [2024-04-21 01:25:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4d4b2a4-4cfc-485e-b0c8-306b1d50d865] received 2024-04-21T01:25:01.181146029Z [2024-04-21 01:25:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[334495e2-99b5-43d9-a427-e456ea2c4847] received 2024-04-21T01:25:01.182701287Z [2024-04-21 01:25:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af426086-1d36-48b9-aeda-8cf33124d329] received 2024-04-21T01:25:01.186477182Z [2024-04-21 01:25:01,186: INFO/ForkPoolWorker-15] [d4d4b2a4-4cfc-485e-b0c8-306b1d50d865] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:25:01.190915879Z [2024-04-21 01:25:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[082871c7-d235-461b-a580-e444aa7f28be] received 2024-04-21T01:25:01.196604711Z [2024-04-21 01:25:01,195: INFO/ForkPoolWorker-1] [af426086-1d36-48b9-aeda-8cf33124d329] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:25:01.197245390Z [2024-04-21 01:25:01,196: INFO/ForkPoolWorker-16] [334495e2-99b5-43d9-a427-e456ea2c4847] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:25:01.199376952Z [2024-04-21 01:25:01,199: INFO/ForkPoolWorker-2] [082871c7-d235-461b-a580-e444aa7f28be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:25:01.629231610Z [2024-04-21 01:25:01,599: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:25:01.750416040Z [2024-04-21 01:25:01,746: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:25:01.832321263Z [2024-04-21 01:25:01,826: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:25:02.232072302Z [2024-04-21 01:25:02,229: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:25:02.430693842Z [2024-04-21 01:25:02,430: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:25:02.438156503Z [2024-04-21 01:25:02,437: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:25:02.480429250Z [2024-04-21 01:25:02,480: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:25:02.481583652Z [2024-04-21 01:25:02,481: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:25:02.482232199Z [2024-04-21 01:25:02,482: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:25:02.482400145Z [2024-04-21 01:25:02,482: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:25:02.482668433Z [2024-04-21 01:25:02,482: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:25:02.598651001Z [2024-04-21 01:25:02,598: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:25:03.321111944Z [2024-04-21 01:25:03,320: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:25:03.324357087Z [2024-04-21 01:25:03,323: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:25:03.330446703Z [2024-04-21 01:25:03,330: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[334495e2-99b5-43d9-a427-e456ea2c4847] succeeded in 2.145841678000579s: None 2024-04-21T01:25:03.347412058Z [2024-04-21 01:25:03,347: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:25:03.348727057Z [2024-04-21 01:25:03,348: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:25:03.348982511Z [2024-04-21 01:25:03,348: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:25:03.349210955Z [2024-04-21 01:25:03,349: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:25:03.349365648Z [2024-04-21 01:25:03,349: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:25:03.349669075Z [2024-04-21 01:25:03,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:25:03.350140103Z [2024-04-21 01:25:03,350: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:25:03.427641094Z [2024-04-21 01:25:03,427: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:25:03.550831842Z [2024-04-21 01:25:03,550: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:25:03.558649955Z [2024-04-21 01:25:03,558: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:25:03.603308067Z [2024-04-21 01:25:03,603: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:25:03.606198091Z [2024-04-21 01:25:03,605: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:25:03.606465925Z [2024-04-21 01:25:03,606: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:25:03.606829715Z [2024-04-21 01:25:03,606: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:25:03.607071973Z [2024-04-21 01:25:03,606: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:25:03.607609084Z [2024-04-21 01:25:03,607: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:25:03.608053101Z [2024-04-21 01:25:03,607: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:25:03.722020792Z [2024-04-21 01:25:03,721: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:25:04.085942670Z [2024-04-21 01:25:04,084: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:25:04.094036720Z [2024-04-21 01:25:04,093: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:25:04.140931004Z [2024-04-21 01:25:04,140: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:25:04.144448248Z [2024-04-21 01:25:04,144: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:25:04.144707945Z [2024-04-21 01:25:04,144: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:25:04.145040026Z [2024-04-21 01:25:04,144: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:25:04.145238307Z [2024-04-21 01:25:04,145: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:25:04.145576951Z [2024-04-21 01:25:04,145: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:25:04.145832621Z [2024-04-21 01:25:04,145: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:25:04.234929489Z [2024-04-21 01:25:04,234: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:25:04.482750093Z [2024-04-21 01:25:04,482: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af426086-1d36-48b9-aeda-8cf33124d329] succeeded in 3.298019910000221s: None 2024-04-21T01:25:05.069637161Z [2024-04-21 01:25:05,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d4d4b2a4-4cfc-485e-b0c8-306b1d50d865] succeeded in 3.8908777389988245s: None 2024-04-21T01:25:05.458911558Z [2024-04-21 01:25:05,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34b581b5-52b4-456c-b237-2b5783735ce9] received 2024-04-21T01:25:05.467928147Z [2024-04-21 01:25:05,467: INFO/ForkPoolWorker-15] [34b581b5-52b4-456c-b237-2b5783735ce9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:25:05.755647211Z [2024-04-21 01:25:05,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:25:06.148076616Z [2024-04-21 01:25:06,147: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[082871c7-d235-461b-a580-e444aa7f28be] succeeded in 4.955068174000189s: None 2024-04-21T01:25:06.808207916Z [2024-04-21 01:25:06,807: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:25:06.811288879Z [2024-04-21 01:25:06,810: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:25:06.831816824Z [2024-04-21 01:25:06,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:25:06.832837943Z [2024-04-21 01:25:06,832: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:25:06.832871065Z [2024-04-21 01:25:06,832: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:25:06.832961616Z [2024-04-21 01:25:06,832: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:25:06.833059380Z [2024-04-21 01:25:06,832: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:25:06.833628244Z [2024-04-21 01:25:06,833: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:25:06.833666328Z [2024-04-21 01:25:06,833: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:25:06.923183402Z [2024-04-21 01:25:06,922: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:25:07.530876236Z [2024-04-21 01:25:07,530: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34b581b5-52b4-456c-b237-2b5783735ce9] succeeded in 2.070113312000103s: None 2024-04-21T01:25:07.858942791Z [2024-04-21 01:25:07,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[133425a0-205c-4ed7-b06c-ec51ec872343] received 2024-04-21T01:25:07.866680813Z [2024-04-21 01:25:07,866: INFO/ForkPoolWorker-15] [133425a0-205c-4ed7-b06c-ec51ec872343] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:25:08.189914711Z [2024-04-21 01:25:08,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:25:09.210707058Z [2024-04-21 01:25:09,210: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:25:09.213538023Z [2024-04-21 01:25:09,213: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:25:09.241863007Z [2024-04-21 01:25:09,241: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:25:09.243869802Z [2024-04-21 01:25:09,243: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:25:09.244063339Z [2024-04-21 01:25:09,243: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:25:09.244310865Z [2024-04-21 01:25:09,244: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:25:09.244477684Z [2024-04-21 01:25:09,244: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:25:09.244962243Z [2024-04-21 01:25:09,244: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:25:09.245143369Z [2024-04-21 01:25:09,244: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:25:09.358321843Z [2024-04-21 01:25:09,358: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:25:09.899785429Z [2024-04-21 01:25:09,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[133425a0-205c-4ed7-b06c-ec51ec872343] succeeded in 2.0358824970007845s: None 2024-04-21T01:25:10.393464955Z [2024-04-21 01:25:10,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03ad6791-907a-46d3-9195-9eea1cd42466] received 2024-04-21T01:25:10.401196081Z [2024-04-21 01:25:10,400: INFO/ForkPoolWorker-15] [03ad6791-907a-46d3-9195-9eea1cd42466] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:25:10.706125479Z [2024-04-21 01:25:10,701: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:25:11.766686214Z [2024-04-21 01:25:11,766: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:25:11.769765343Z [2024-04-21 01:25:11,769: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:25:11.796219961Z [2024-04-21 01:25:11,795: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:25:11.797973850Z [2024-04-21 01:25:11,797: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:25:11.798310156Z [2024-04-21 01:25:11,798: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:25:11.798757440Z [2024-04-21 01:25:11,798: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:25:11.799054731Z [2024-04-21 01:25:11,798: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:25:11.799569741Z [2024-04-21 01:25:11,799: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:25:11.800114186Z [2024-04-21 01:25:11,799: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:25:11.910124992Z [2024-04-21 01:25:11,909: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:25:12.578393450Z [2024-04-21 01:25:12,577: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03ad6791-907a-46d3-9195-9eea1cd42466] succeeded in 2.1830622180004866s: None 2024-04-21T01:26:00.267552085Z [2024-04-21 01:26:00,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[606d0455-99cf-4508-901a-a75efbe01682] received 2024-04-21T01:26:00.271190682Z [2024-04-21 01:26:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1143de13-0924-40cb-9e05-390fb0161100] received 2024-04-21T01:26:00.272852448Z [2024-04-21 01:26:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[356f8c87-ae78-4027-a9ca-50eecfeac574] received 2024-04-21T01:26:00.279696088Z [2024-04-21 01:26:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e41a09b0-b3b1-4435-8c70-31144b3b7474] received 2024-04-21T01:26:00.287963435Z [2024-04-21 01:26:00,283: INFO/ForkPoolWorker-16] [1143de13-0924-40cb-9e05-390fb0161100] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:26:00.287988739Z [2024-04-21 01:26:00,284: INFO/ForkPoolWorker-15] [606d0455-99cf-4508-901a-a75efbe01682] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:26:00.290225730Z [2024-04-21 01:26:00,288: INFO/ForkPoolWorker-1] [356f8c87-ae78-4027-a9ca-50eecfeac574] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:26:00.293533476Z [2024-04-21 01:26:00,290: INFO/ForkPoolWorker-2] [e41a09b0-b3b1-4435-8c70-31144b3b7474] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:26:00.632599247Z [2024-04-21 01:26:00,629: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:26:00.663951900Z [2024-04-21 01:26:00,660: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:26:00.713490053Z [2024-04-21 01:26:00,710: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:26:00.810551609Z [2024-04-21 01:26:00,807: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:26:00.893330645Z [2024-04-21 01:26:00,892: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:26:00.897113334Z [2024-04-21 01:26:00,896: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:26:00.922364623Z [2024-04-21 01:26:00,922: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:26:00.923235178Z [2024-04-21 01:26:00,923: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:26:00.923330502Z [2024-04-21 01:26:00,923: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:26:00.923339697Z [2024-04-21 01:26:00,923: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:26:00.923539888Z [2024-04-21 01:26:00,923: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:26:00.959247329Z [2024-04-21 01:26:00,958: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:26:01.041357150Z [2024-04-21 01:26:01,041: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:26:01.483942153Z [2024-04-21 01:26:01,483: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[606d0455-99cf-4508-901a-a75efbe01682] succeeded in 1.2141723800014006s: None 2024-04-21T01:26:01.764137838Z [2024-04-21 01:26:01,763: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e41a09b0-b3b1-4435-8c70-31144b3b7474] succeeded in 1.4834397120012s: None 2024-04-21T01:26:02.050748303Z [2024-04-21 01:26:02,050: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:26:02.054381005Z [2024-04-21 01:26:02,053: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:26:02.081588192Z [2024-04-21 01:26:02,081: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:26:02.082812801Z [2024-04-21 01:26:02,082: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:26:02.082947177Z [2024-04-21 01:26:02,082: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:26:02.083106901Z [2024-04-21 01:26:02,082: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:26:02.083247647Z [2024-04-21 01:26:02,083: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:26:02.083522517Z [2024-04-21 01:26:02,083: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:26:02.083657894Z [2024-04-21 01:26:02,083: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:26:02.205631000Z [2024-04-21 01:26:02,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:26:02.236903592Z [2024-04-21 01:26:02,236: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:26:02.239900161Z [2024-04-21 01:26:02,239: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:26:02.261985055Z [2024-04-21 01:26:02,261: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:26:02.263298044Z [2024-04-21 01:26:02,263: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:26:02.263309027Z [2024-04-21 01:26:02,263: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:26:02.263379479Z [2024-04-21 01:26:02,263: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:26:02.263394085Z [2024-04-21 01:26:02,263: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:26:02.263611343Z [2024-04-21 01:26:02,263: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:26:02.263654901Z [2024-04-21 01:26:02,263: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:26:02.341601713Z [2024-04-21 01:26:02,341: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:26:03.893158121Z [2024-04-21 01:26:03,892: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[356f8c87-ae78-4027-a9ca-50eecfeac574] succeeded in 3.618926213001032s: None 2024-04-21T01:26:04.273285743Z [2024-04-21 01:26:04,272: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1143de13-0924-40cb-9e05-390fb0161100] succeeded in 3.998342794000564s: None 2024-04-21T01:27:01.272800057Z [2024-04-21 01:27:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdd7553e-317c-49ff-9ea2-62d3ac9f0db4] received 2024-04-21T01:27:01.272827301Z [2024-04-21 01:27:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e2ecf83-f456-4bb6-b9df-9183d1c7b919] received 2024-04-21T01:27:01.279859600Z [2024-04-21 01:27:01,278: INFO/ForkPoolWorker-16] [7e2ecf83-f456-4bb6-b9df-9183d1c7b919] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:27:01.284062279Z [2024-04-21 01:27:01,283: INFO/ForkPoolWorker-15] [fdd7553e-317c-49ff-9ea2-62d3ac9f0db4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:27:01.312693861Z [2024-04-21 01:27:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3365eb36-9c42-4d88-923a-7002674dbbfc] received 2024-04-21T01:27:01.329123194Z [2024-04-21 01:27:01,328: INFO/ForkPoolWorker-1] [3365eb36-9c42-4d88-923a-7002674dbbfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:27:01.681138810Z [2024-04-21 01:27:01,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:27:01.693807767Z [2024-04-21 01:27:01,690: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:27:01.701990158Z [2024-04-21 01:27:01,697: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:27:01.870089382Z [2024-04-21 01:27:01,869: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T01:27:01.874023387Z [2024-04-21 01:27:01,873: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:27:01.893933973Z [2024-04-21 01:27:01,893: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:27:01.894894819Z [2024-04-21 01:27:01,894: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:27:01.894959417Z [2024-04-21 01:27:01,894: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:27:01.895008853Z [2024-04-21 01:27:01,894: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T01:27:01.895261728Z [2024-04-21 01:27:01,895: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:27:01.980766119Z [2024-04-21 01:27:01,980: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:27:02.626014136Z [2024-04-21 01:27:02,625: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdd7553e-317c-49ff-9ea2-62d3ac9f0db4] succeeded in 1.3533465529999376s: None 2024-04-21T01:27:02.840177143Z [2024-04-21 01:27:02,839: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:27:02.843501653Z [2024-04-21 01:27:02,843: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:27:02.862721600Z [2024-04-21 01:27:02,862: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:27:02.863801466Z [2024-04-21 01:27:02,863: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:27:02.863969090Z [2024-04-21 01:27:02,863: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:27:02.864192096Z [2024-04-21 01:27:02,864: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:27:02.864318171Z [2024-04-21 01:27:02,864: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:27:02.864643948Z [2024-04-21 01:27:02,864: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:27:02.864794661Z [2024-04-21 01:27:02,864: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:27:02.884593336Z [2024-04-21 01:27:02,884: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:27:02.887648175Z [2024-04-21 01:27:02,887: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:27:02.902217307Z [2024-04-21 01:27:02,901: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:27:02.903547446Z [2024-04-21 01:27:02,903: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:27:02.903626474Z [2024-04-21 01:27:02,903: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:27:02.903731268Z [2024-04-21 01:27:02,903: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:27:02.903746238Z [2024-04-21 01:27:02,903: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:27:02.903916417Z [2024-04-21 01:27:02,903: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:27:02.903938892Z [2024-04-21 01:27:02,903: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:27:02.953701691Z [2024-04-21 01:27:02,953: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:27:02.985036431Z [2024-04-21 01:27:02,984: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:27:04.937690726Z [2024-04-21 01:27:04,936: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3365eb36-9c42-4d88-923a-7002674dbbfc] succeeded in 3.6164344910012005s: None 2024-04-21T01:27:06.358985686Z [2024-04-21 01:27:06,358: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e2ecf83-f456-4bb6-b9df-9183d1c7b919] succeeded in 5.086720688999776s: None 2024-04-21T01:28:00.560048093Z [2024-04-21 01:28:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fed75cf9-c7dd-4d3a-bb55-8c3b7fce16e3] received 2024-04-21T01:28:00.562711764Z [2024-04-21 01:28:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a064c102-80a3-410d-a415-a3b0b804190e] received 2024-04-21T01:28:00.569765985Z [2024-04-21 01:28:00,569: INFO/ForkPoolWorker-15] [fed75cf9-c7dd-4d3a-bb55-8c3b7fce16e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:28:00.572137939Z [2024-04-21 01:28:00,571: INFO/ForkPoolWorker-16] [a064c102-80a3-410d-a415-a3b0b804190e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:28:00.577810187Z [2024-04-21 01:28:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f89718ac-f6cc-42cf-9a65-453e433f82b1] received 2024-04-21T01:28:00.579325476Z [2024-04-21 01:28:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c445ca76-44f0-411a-848a-c2d31aa890d8] received 2024-04-21T01:28:00.586593322Z [2024-04-21 01:28:00,586: INFO/ForkPoolWorker-1] [f89718ac-f6cc-42cf-9a65-453e433f82b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:28:00.603464027Z [2024-04-21 01:28:00,603: INFO/ForkPoolWorker-2] [c445ca76-44f0-411a-848a-c2d31aa890d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:28:00.981886442Z [2024-04-21 01:28:00,978: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:28:01.011612891Z [2024-04-21 01:28:01,007: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:28:01.110744609Z [2024-04-21 01:28:01,105: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:28:01.134677423Z [2024-04-21 01:28:01,127: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:28:01.471814509Z [2024-04-21 01:28:01,469: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:28:01.474763933Z [2024-04-21 01:28:01,473: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:28:01.544544610Z [2024-04-21 01:28:01,544: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:28:01.548708983Z [2024-04-21 01:28:01,548: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:28:01.549002196Z [2024-04-21 01:28:01,548: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:28:01.549137774Z [2024-04-21 01:28:01,549: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:28:01.549418589Z [2024-04-21 01:28:01,549: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:28:01.592035239Z [2024-04-21 01:28:01,591: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:28:01.693079206Z [2024-04-21 01:28:01,692: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:28:02.325630235Z [2024-04-21 01:28:02,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fed75cf9-c7dd-4d3a-bb55-8c3b7fce16e3] succeeded in 1.7632600020006066s: None 2024-04-21T01:28:02.346116989Z [2024-04-21 01:28:02,345: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c445ca76-44f0-411a-848a-c2d31aa890d8] succeeded in 1.762495637000029s: None 2024-04-21T01:28:02.461085513Z [2024-04-21 01:28:02,459: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:28:02.463640415Z [2024-04-21 01:28:02,463: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:28:02.515400792Z [2024-04-21 01:28:02,515: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:28:02.516961138Z [2024-04-21 01:28:02,516: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:28:02.517134988Z [2024-04-21 01:28:02,516: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:28:02.517341714Z [2024-04-21 01:28:02,517: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:28:02.517477442Z [2024-04-21 01:28:02,517: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:28:02.517886856Z [2024-04-21 01:28:02,517: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:28:02.518125905Z [2024-04-21 01:28:02,517: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:28:02.611428922Z [2024-04-21 01:28:02,611: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:28:02.828566470Z [2024-04-21 01:28:02,828: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:28:02.831732451Z [2024-04-21 01:28:02,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:28:02.851390061Z [2024-04-21 01:28:02,851: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:28:02.852627340Z [2024-04-21 01:28:02,852: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:28:02.852644180Z [2024-04-21 01:28:02,852: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:28:02.852707983Z [2024-04-21 01:28:02,852: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:28:02.852749293Z [2024-04-21 01:28:02,852: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:28:02.852951079Z [2024-04-21 01:28:02,852: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:28:02.852999488Z [2024-04-21 01:28:02,852: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:28:02.939567786Z [2024-04-21 01:28:02,939: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:28:04.491730954Z [2024-04-21 01:28:04,490: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f89718ac-f6cc-42cf-9a65-453e433f82b1] succeeded in 3.910902674000681s: None 2024-04-21T01:28:04.543992310Z [2024-04-21 01:28:04,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a064c102-80a3-410d-a415-a3b0b804190e] succeeded in 3.9769175500005076s: None 2024-04-21T01:29:00.835559627Z [2024-04-21 01:29:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa42af9a-fce2-467f-b494-4ae9d6e60c8b] received 2024-04-21T01:29:00.837590107Z [2024-04-21 01:29:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfe6658e-fa7a-47d7-9a92-8fe0adb3b72d] received 2024-04-21T01:29:00.846439929Z [2024-04-21 01:29:00,846: INFO/ForkPoolWorker-16] [bfe6658e-fa7a-47d7-9a92-8fe0adb3b72d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:29:00.847049486Z [2024-04-21 01:29:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42c64354-9efc-4630-b2c2-e7e143c80d63] received 2024-04-21T01:29:00.859094239Z [2024-04-21 01:29:00,858: INFO/ForkPoolWorker-15] [aa42af9a-fce2-467f-b494-4ae9d6e60c8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:29:00.859845059Z [2024-04-21 01:29:00,859: INFO/ForkPoolWorker-1] [42c64354-9efc-4630-b2c2-e7e143c80d63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:29:01.193541891Z [2024-04-21 01:29:01,190: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:29:01.219713100Z [2024-04-21 01:29:01,216: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:29:01.348486386Z [2024-04-21 01:29:01,345: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:29:01.523784768Z [2024-04-21 01:29:01,521: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T01:29:01.534826666Z [2024-04-21 01:29:01,533: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:29:01.576786307Z [2024-04-21 01:29:01,576: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:29:01.578564725Z [2024-04-21 01:29:01,578: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:29:01.578635008Z [2024-04-21 01:29:01,578: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:29:01.578684429Z [2024-04-21 01:29:01,578: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T01:29:01.578839663Z [2024-04-21 01:29:01,578: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:29:01.722476151Z [2024-04-21 01:29:01,722: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:29:02.399263908Z [2024-04-21 01:29:02,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa42af9a-fce2-467f-b494-4ae9d6e60c8b] succeeded in 1.5609327349993691s: None 2024-04-21T01:29:02.551881758Z [2024-04-21 01:29:02,551: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:29:02.555509129Z [2024-04-21 01:29:02,555: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:29:02.574440399Z [2024-04-21 01:29:02,574: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:29:02.576113032Z [2024-04-21 01:29:02,575: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:29:02.576294197Z [2024-04-21 01:29:02,576: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:29:02.576537818Z [2024-04-21 01:29:02,576: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:29:02.576690765Z [2024-04-21 01:29:02,576: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:29:02.577815366Z [2024-04-21 01:29:02,577: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:29:02.578001439Z [2024-04-21 01:29:02,577: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:29:02.665774655Z [2024-04-21 01:29:02,665: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:29:02.893359490Z [2024-04-21 01:29:02,892: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:29:02.896418888Z [2024-04-21 01:29:02,896: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:29:02.923494648Z [2024-04-21 01:29:02,923: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:29:02.925099945Z [2024-04-21 01:29:02,924: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:29:02.925193018Z [2024-04-21 01:29:02,924: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:29:02.925354605Z [2024-04-21 01:29:02,925: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:29:02.925450176Z [2024-04-21 01:29:02,925: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:29:02.925761628Z [2024-04-21 01:29:02,925: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:29:02.925782688Z [2024-04-21 01:29:02,925: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:29:03.027922486Z [2024-04-21 01:29:03,027: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:29:05.358214561Z [2024-04-21 01:29:05,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfe6658e-fa7a-47d7-9a92-8fe0adb3b72d] succeeded in 4.516909384999963s: None 2024-04-21T01:29:05.717681763Z [2024-04-21 01:29:05,716: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42c64354-9efc-4630-b2c2-e7e143c80d63] succeeded in 4.867644058998849s: None 2024-04-21T01:30:01.186384848Z [2024-04-21 01:30:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c70507e4-176a-469b-a202-38f38c966728] received 2024-04-21T01:30:01.189425300Z [2024-04-21 01:30:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0281142-099a-4147-8414-739da32cc489] received 2024-04-21T01:30:01.196721864Z [2024-04-21 01:30:01,196: INFO/ForkPoolWorker-15] [c70507e4-176a-469b-a202-38f38c966728] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:30:01.199537925Z [2024-04-21 01:30:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df1c9971-7f34-4492-828b-4480d8fcefb2] received 2024-04-21T01:30:01.208046953Z [2024-04-21 01:30:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2068ef25-a422-4906-bbb5-4f013c97fefd] received 2024-04-21T01:30:01.210345099Z [2024-04-21 01:30:01,210: INFO/ForkPoolWorker-16] [f0281142-099a-4147-8414-739da32cc489] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:30:01.219177603Z [2024-04-21 01:30:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99dbc794-9c48-4e39-8842-bb2f5a4f68fd] received 2024-04-21T01:30:01.223593065Z [2024-04-21 01:30:01,223: INFO/ForkPoolWorker-1] [df1c9971-7f34-4492-828b-4480d8fcefb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:30:01.227252851Z [2024-04-21 01:30:01,226: INFO/ForkPoolWorker-2] [2068ef25-a422-4906-bbb5-4f013c97fefd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:30:01.244314073Z [2024-04-21 01:30:01,243: INFO/ForkPoolWorker-3] [99dbc794-9c48-4e39-8842-bb2f5a4f68fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:30:01.742814648Z [2024-04-21 01:30:01,739: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:30:01.784864642Z [2024-04-21 01:30:01,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:30:01.826739426Z [2024-04-21 01:30:01,779: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:30:01.989765263Z [2024-04-21 01:30:01,950: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:30:02.346643899Z [2024-04-21 01:30:02,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:30:02.427238906Z [2024-04-21 01:30:02,426: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-21T01:30:02.445117411Z [2024-04-21 01:30:02,439: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:30:02.494106507Z [2024-04-21 01:30:02,493: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T01:30:02.497383203Z [2024-04-21 01:30:02,497: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:30:02.497683099Z [2024-04-21 01:30:02,497: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:30:02.497809960Z [2024-04-21 01:30:02,497: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-21T01:30:02.498050420Z [2024-04-21 01:30:02,497: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:30:02.624846135Z [2024-04-21 01:30:02,624: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:02.666875617Z [2024-04-21 01:30:02,666: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:03.381784640Z [2024-04-21 01:30:03,381: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0281142-099a-4147-8414-739da32cc489] succeeded in 2.19058581399986s: None 2024-04-21T01:30:03.392012806Z [2024-04-21 01:30:03,391: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[99dbc794-9c48-4e39-8842-bb2f5a4f68fd] succeeded in 2.166831231001197s: None 2024-04-21T01:30:03.554111216Z [2024-04-21 01:30:03,553: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:30:03.557661638Z [2024-04-21 01:30:03,557: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:30:03.594041834Z [2024-04-21 01:30:03,593: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:30:03.596608008Z [2024-04-21 01:30:03,596: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:30:03.596953278Z [2024-04-21 01:30:03,596: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:30:03.597420269Z [2024-04-21 01:30:03,597: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:30:03.597639640Z [2024-04-21 01:30:03,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:30:03.598642091Z [2024-04-21 01:30:03,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:30:03.598850860Z [2024-04-21 01:30:03,598: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:30:03.738285034Z [2024-04-21 01:30:03,738: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:04.107728038Z [2024-04-21 01:30:04,106: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:30:04.110127095Z [2024-04-21 01:30:04,109: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:30:04.153796051Z [2024-04-21 01:30:04,153: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:30:04.159754741Z [2024-04-21 01:30:04,159: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:30:04.160053500Z [2024-04-21 01:30:04,159: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:30:04.160288139Z [2024-04-21 01:30:04,159: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:30:04.160423185Z [2024-04-21 01:30:04,160: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:30:04.160756956Z [2024-04-21 01:30:04,160: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:30:04.160892074Z [2024-04-21 01:30:04,160: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:30:04.260566546Z [2024-04-21 01:30:04,260: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:04.632225255Z [2024-04-21 01:30:04,631: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:30:04.635489924Z [2024-04-21 01:30:04,635: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:30:04.676149131Z [2024-04-21 01:30:04,675: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:30:04.677903132Z [2024-04-21 01:30:04,677: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:30:04.678137015Z [2024-04-21 01:30:04,677: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:30:04.678392759Z [2024-04-21 01:30:04,678: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:30:04.678603005Z [2024-04-21 01:30:04,678: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:30:04.678957120Z [2024-04-21 01:30:04,678: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:30:04.679143919Z [2024-04-21 01:30:04,679: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:30:04.713616665Z [2024-04-21 01:30:04,713: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c70507e4-176a-469b-a202-38f38c966728] succeeded in 3.5216671860016504s: None 2024-04-21T01:30:04.781631871Z [2024-04-21 01:30:04,781: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:05.525946364Z [2024-04-21 01:30:05,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c7a8e3c-5daf-41de-a26e-135346fc9286] received 2024-04-21T01:30:05.536449059Z [2024-04-21 01:30:05,536: INFO/ForkPoolWorker-15] [2c7a8e3c-5daf-41de-a26e-135346fc9286] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:30:05.790351162Z [2024-04-21 01:30:05,789: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2068ef25-a422-4906-bbb5-4f013c97fefd] succeeded in 4.578516413001125s: None 2024-04-21T01:30:05.897193037Z [2024-04-21 01:30:05,894: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:30:06.770574533Z [2024-04-21 01:30:06,769: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df1c9971-7f34-4492-828b-4480d8fcefb2] succeeded in 5.559319070000129s: None 2024-04-21T01:30:07.001159207Z [2024-04-21 01:30:07,000: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:30:07.004302934Z [2024-04-21 01:30:07,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:30:07.034657165Z [2024-04-21 01:30:07,034: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:30:07.037262538Z [2024-04-21 01:30:07,036: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:30:07.037629707Z [2024-04-21 01:30:07,037: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:30:07.038082960Z [2024-04-21 01:30:07,037: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:30:07.038288541Z [2024-04-21 01:30:07,038: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:30:07.038855130Z [2024-04-21 01:30:07,038: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:30:07.038931321Z [2024-04-21 01:30:07,038: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:30:07.163624312Z [2024-04-21 01:30:07,162: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:07.874177492Z [2024-04-21 01:30:07,873: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c7a8e3c-5daf-41de-a26e-135346fc9286] succeeded in 2.343781597999623s: None 2024-04-21T01:30:07.990612092Z [2024-04-21 01:30:07,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4d4a949-2901-4cb5-8b66-050af380db47] received 2024-04-21T01:30:07.999606391Z [2024-04-21 01:30:07,999: INFO/ForkPoolWorker-15] [a4d4a949-2901-4cb5-8b66-050af380db47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:30:08.269129765Z [2024-04-21 01:30:08,265: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:30:09.462441684Z [2024-04-21 01:30:09,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:30:09.466580151Z [2024-04-21 01:30:09,466: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:30:09.492021359Z [2024-04-21 01:30:09,491: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:30:09.493641182Z [2024-04-21 01:30:09,493: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:30:09.493785599Z [2024-04-21 01:30:09,493: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:30:09.494072380Z [2024-04-21 01:30:09,493: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:30:09.494120992Z [2024-04-21 01:30:09,493: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:30:09.494455474Z [2024-04-21 01:30:09,494: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:30:09.494618430Z [2024-04-21 01:30:09,494: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:30:09.625139146Z [2024-04-21 01:30:09,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:10.309186588Z [2024-04-21 01:30:10,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4d4a949-2901-4cb5-8b66-050af380db47] succeeded in 2.3158092140001827s: None 2024-04-21T01:30:10.516297030Z [2024-04-21 01:30:10,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cba27a69-bea8-43f0-8a09-1f88ba7ad859] received 2024-04-21T01:30:10.524798635Z [2024-04-21 01:30:10,524: INFO/ForkPoolWorker-15] [cba27a69-bea8-43f0-8a09-1f88ba7ad859] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:30:10.834791442Z [2024-04-21 01:30:10,831: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:30:12.010966065Z [2024-04-21 01:30:12,010: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:30:12.014436603Z [2024-04-21 01:30:12,013: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:30:12.040291022Z [2024-04-21 01:30:12,039: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:30:12.042837375Z [2024-04-21 01:30:12,042: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:30:12.043200385Z [2024-04-21 01:30:12,042: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:30:12.043653458Z [2024-04-21 01:30:12,043: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:30:12.044061155Z [2024-04-21 01:30:12,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:30:12.044706804Z [2024-04-21 01:30:12,044: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:30:12.044941711Z [2024-04-21 01:30:12,044: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:30:12.172701798Z [2024-04-21 01:30:12,172: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:12.882814313Z [2024-04-21 01:30:12,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cba27a69-bea8-43f0-8a09-1f88ba7ad859] succeeded in 2.3647049789997254s: None 2024-04-21T01:30:38.201411688Z [2024-04-21 01:30:38,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7f36861-da45-4242-a14e-9f8a95a8646f] received 2024-04-21T01:30:38.211100954Z [2024-04-21 01:30:38,210: INFO/ForkPoolWorker-15] [c7f36861-da45-4242-a14e-9f8a95a8646f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240421013037_307265', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-21T01:30:38.511336581Z [2024-04-21 01:30:38,508: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-21T01:30:38.802833369Z [2024-04-21 01:30:38,802: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:30:39.488083471Z [2024-04-21 01:30:39,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7f36861-da45-4242-a14e-9f8a95a8646f] succeeded in 1.2845998840002721s: None 2024-04-21T01:31:00.422660672Z [2024-04-21 01:31:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8e57f39-4f0d-4d0a-a851-9e0b4e8c1a7f] received 2024-04-21T01:31:00.427768657Z [2024-04-21 01:31:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b56b4c9a-71b0-46e5-81e2-d026ca58e9ff] received 2024-04-21T01:31:00.430316726Z [2024-04-21 01:31:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0b5ff74-f4be-4587-8e03-2819ab3ba537] received 2024-04-21T01:31:00.435204482Z [2024-04-21 01:31:00,434: INFO/ForkPoolWorker-15] [f8e57f39-4f0d-4d0a-a851-9e0b4e8c1a7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:31:00.438987407Z [2024-04-21 01:31:00,438: INFO/ForkPoolWorker-1] [e0b5ff74-f4be-4587-8e03-2819ab3ba537] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:31:00.440502646Z [2024-04-21 01:31:00,440: INFO/ForkPoolWorker-16] [b56b4c9a-71b0-46e5-81e2-d026ca58e9ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:31:00.721107890Z [2024-04-21 01:31:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:31:00.742083728Z [2024-04-21 01:31:00,738: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:31:00.765634607Z [2024-04-21 01:31:00,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:31:00.867488304Z [2024-04-21 01:31:00,867: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:31:00.871392662Z [2024-04-21 01:31:00,871: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:31:00.893443129Z [2024-04-21 01:31:00,893: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:31:00.894498801Z [2024-04-21 01:31:00,894: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:31:00.894596982Z [2024-04-21 01:31:00,894: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:31:00.894658528Z [2024-04-21 01:31:00,894: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:31:00.894885055Z [2024-04-21 01:31:00,894: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:31:01.007190211Z [2024-04-21 01:31:01,006: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:31:01.640144650Z [2024-04-21 01:31:01,639: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0b5ff74-f4be-4587-8e03-2819ab3ba537] succeeded in 1.2078947840000183s: None 2024-04-21T01:31:01.918400137Z [2024-04-21 01:31:01,918: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:31:01.921595496Z [2024-04-21 01:31:01,921: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:31:01.942885833Z [2024-04-21 01:31:01,942: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:31:01.944763861Z [2024-04-21 01:31:01,944: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:31:01.945973613Z [2024-04-21 01:31:01,945: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:31:01.945984962Z [2024-04-21 01:31:01,945: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:31:01.946151866Z [2024-04-21 01:31:01,945: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:31:01.946162483Z [2024-04-21 01:31:01,946: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:31:01.946478091Z [2024-04-21 01:31:01,946: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:31:01.946483870Z [2024-04-21 01:31:01,946: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:31:01.946700452Z [2024-04-21 01:31:01,946: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:31:01.973261214Z [2024-04-21 01:31:01,973: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:31:01.974445667Z [2024-04-21 01:31:01,974: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:31:01.974552208Z [2024-04-21 01:31:01,974: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:31:01.974715040Z [2024-04-21 01:31:01,974: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:31:01.974786907Z [2024-04-21 01:31:01,974: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:31:01.975028423Z [2024-04-21 01:31:01,974: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:31:01.975102427Z [2024-04-21 01:31:01,975: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:31:02.046188007Z [2024-04-21 01:31:02,045: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:31:02.048080131Z [2024-04-21 01:31:02,047: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:31:03.556476230Z [2024-04-21 01:31:03,556: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b56b4c9a-71b0-46e5-81e2-d026ca58e9ff] succeeded in 3.124234396000247s: None 2024-04-21T01:31:04.412810685Z [2024-04-21 01:31:04,412: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8e57f39-4f0d-4d0a-a851-9e0b4e8c1a7f] succeeded in 3.986309281999638s: None 2024-04-21T01:32:00.414902251Z [2024-04-21 01:32:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52d4ce09-c39e-45a8-99c6-4709e1c3d7af] received 2024-04-21T01:32:00.420727906Z [2024-04-21 01:32:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f7c8613-91af-4697-aa22-533c5a948d09] received 2024-04-21T01:32:00.422314953Z [2024-04-21 01:32:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3124be1f-1d86-4b07-8664-1aad8bf57e70] received 2024-04-21T01:32:00.425723252Z [2024-04-21 01:32:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0194ad17-5b14-413c-b3ef-6e2f548b2f81] received 2024-04-21T01:32:00.428692588Z [2024-04-21 01:32:00,428: INFO/ForkPoolWorker-15] [52d4ce09-c39e-45a8-99c6-4709e1c3d7af] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:32:00.430385747Z [2024-04-21 01:32:00,430: INFO/ForkPoolWorker-16] [7f7c8613-91af-4697-aa22-533c5a948d09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:32:00.438634001Z [2024-04-21 01:32:00,438: INFO/ForkPoolWorker-2] [0194ad17-5b14-413c-b3ef-6e2f548b2f81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:32:00.438926140Z [2024-04-21 01:32:00,438: INFO/ForkPoolWorker-1] [3124be1f-1d86-4b07-8664-1aad8bf57e70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:32:00.766684976Z [2024-04-21 01:32:00,763: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:32:00.774905668Z [2024-04-21 01:32:00,771: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:32:00.776277276Z [2024-04-21 01:32:00,773: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:32:00.792674192Z [2024-04-21 01:32:00,789: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:32:00.966499337Z [2024-04-21 01:32:00,966: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:32:00.971136036Z [2024-04-21 01:32:00,970: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:00.998407481Z [2024-04-21 01:32:00,998: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:32:01.001143545Z [2024-04-21 01:32:01,000: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:32:01.001315972Z [2024-04-21 01:32:01,001: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:32:01.001388416Z [2024-04-21 01:32:01,001: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:32:01.001627073Z [2024-04-21 01:32:01,001: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:32:01.011737658Z [2024-04-21 01:32:01,011: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:01.131415745Z [2024-04-21 01:32:01,131: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:01.638089236Z [2024-04-21 01:32:01,637: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52d4ce09-c39e-45a8-99c6-4709e1c3d7af] succeeded in 1.2213509989996965s: None 2024-04-21T01:32:01.839396397Z [2024-04-21 01:32:01,839: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0194ad17-5b14-413c-b3ef-6e2f548b2f81] succeeded in 1.4112459370007855s: None 2024-04-21T01:32:02.310219352Z [2024-04-21 01:32:02,309: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:32:02.313585301Z [2024-04-21 01:32:02,313: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:02.337635686Z [2024-04-21 01:32:02,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:32:02.338902887Z [2024-04-21 01:32:02,338: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:32:02.338924331Z [2024-04-21 01:32:02,338: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:32:02.338995793Z [2024-04-21 01:32:02,338: INFO/ForkPoolWorker-16] Read VIM e1a0ca83-125f-42b5-a802-354c0639d9eb (basic01_080187) 2024-04-21T01:32:02.339138997Z [2024-04-21 01:32:02,338: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e1a0ca83-125f-42b5-a802-354c0639d9eb', 'name': 'basic01_080187', 'vim_type': 'openstack'}] 2024-04-21T01:32:02.339168962Z [2024-04-21 01:32:02,339: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:32:02.339801722Z [2024-04-21 01:32:02,339: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:32:02.339821129Z [2024-04-21 01:32:02,339: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:32:02.344082981Z [2024-04-21 01:32:02,343: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb 2024-04-21T01:32:02.454241117Z [2024-04-21 01:32:02,453: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:02.637621431Z [2024-04-21 01:32:02,637: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:32:02.641197703Z [2024-04-21 01:32:02,640: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:02.690603961Z [2024-04-21 01:32:02,690: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:32:02.693922663Z [2024-04-21 01:32:02,693: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:32:02.694153435Z [2024-04-21 01:32:02,693: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:32:02.694332932Z [2024-04-21 01:32:02,694: INFO/ForkPoolWorker-1] Read VIM e1a0ca83-125f-42b5-a802-354c0639d9eb (basic01_080187) 2024-04-21T01:32:02.694531116Z [2024-04-21 01:32:02,694: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e1a0ca83-125f-42b5-a802-354c0639d9eb', 'name': 'basic01_080187', 'vim_type': 'openstack'}] 2024-04-21T01:32:02.694649143Z [2024-04-21 01:32:02,694: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:32:02.694927128Z [2024-04-21 01:32:02,694: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:32:02.695077121Z [2024-04-21 01:32:02,694: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:32:02.701502507Z [2024-04-21 01:32:02,701: INFO/ForkPoolWorker-1] Creating DAG vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb 2024-04-21T01:32:02.826848068Z [2024-04-21 01:32:02,826: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:04.950451116Z [2024-04-21 01:32:04,950: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f7c8613-91af-4697-aa22-533c5a948d09] succeeded in 4.526989488998879s: None 2024-04-21T01:32:05.497880643Z [2024-04-21 01:32:05,497: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3124be1f-1d86-4b07-8664-1aad8bf57e70] succeeded in 5.071559084999535s: None 2024-04-21T01:32:13.118015930Z [2024-04-21 01:32:13,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ecd5641-d56d-44ea-b2dd-30e631b6d24c] received 2024-04-21T01:32:13.131552646Z [2024-04-21 01:32:13,131: INFO/ForkPoolWorker-15] [9ecd5641-d56d-44ea-b2dd-30e631b6d24c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:32:13.432332116Z [2024-04-21 01:32:13,428: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:32:14.500760330Z [2024-04-21 01:32:14,500: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:32:14.503915546Z [2024-04-21 01:32:14,503: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:14.531340655Z [2024-04-21 01:32:14,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:32:14.533340133Z [2024-04-21 01:32:14,533: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:32:14.533562106Z [2024-04-21 01:32:14,533: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:32:14.533780828Z [2024-04-21 01:32:14,533: INFO/ForkPoolWorker-15] Read VIM e1a0ca83-125f-42b5-a802-354c0639d9eb (basic01_080187) 2024-04-21T01:32:14.534215723Z [2024-04-21 01:32:14,533: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e1a0ca83-125f-42b5-a802-354c0639d9eb', 'name': 'basic01_080187', 'vim_type': 'openstack'}] 2024-04-21T01:32:14.534420091Z [2024-04-21 01:32:14,534: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:32:14.534928571Z [2024-04-21 01:32:14,534: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:32:14.535229405Z [2024-04-21 01:32:14,534: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:32:14.550418149Z [2024-04-21 01:32:14,550: INFO/ForkPoolWorker-15] Creating DAG vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb 2024-04-21T01:32:14.648179000Z [2024-04-21 01:32:14,647: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:16.065128587Z [2024-04-21 01:32:16,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88498ce2-6218-4cfb-b425-9c35a2c7b1e6] received 2024-04-21T01:32:16.078529037Z [2024-04-21 01:32:16,078: INFO/ForkPoolWorker-16] [88498ce2-6218-4cfb-b425-9c35a2c7b1e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:32:16.402041591Z [2024-04-21 01:32:16,399: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:32:16.992814997Z [2024-04-21 01:32:16,992: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ecd5641-d56d-44ea-b2dd-30e631b6d24c] succeeded in 3.8722073560002173s: None 2024-04-21T01:32:17.550734170Z [2024-04-21 01:32:17,550: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:32:17.554391626Z [2024-04-21 01:32:17,553: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:17.575151480Z [2024-04-21 01:32:17,574: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:32:17.576668338Z [2024-04-21 01:32:17,576: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:32:17.576846727Z [2024-04-21 01:32:17,576: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:32:17.577007114Z [2024-04-21 01:32:17,576: INFO/ForkPoolWorker-16] Read VIM e1a0ca83-125f-42b5-a802-354c0639d9eb (basic01_080187) 2024-04-21T01:32:17.577265827Z [2024-04-21 01:32:17,577: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e1a0ca83-125f-42b5-a802-354c0639d9eb', 'name': 'basic01_080187', 'vim_type': 'openstack'}] 2024-04-21T01:32:17.577411465Z [2024-04-21 01:32:17,577: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:32:17.577894515Z [2024-04-21 01:32:17,577: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:32:17.577955500Z [2024-04-21 01:32:17,577: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:32:17.583493548Z [2024-04-21 01:32:17,583: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb 2024-04-21T01:32:17.665003735Z [2024-04-21 01:32:17,664: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:19.534058778Z [2024-04-21 01:32:19,533: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[88498ce2-6218-4cfb-b425-9c35a2c7b1e6] succeeded in 3.4647706439991452s: None 2024-04-21T01:32:27.394832702Z [2024-04-21 01:32:27,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ac24dec-005a-4f0c-977d-5253de451115] received 2024-04-21T01:32:27.404864906Z [2024-04-21 01:32:27,404: INFO/ForkPoolWorker-15] [8ac24dec-005a-4f0c-977d-5253de451115] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:32:27.693126529Z [2024-04-21 01:32:27,689: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:32:28.745776929Z [2024-04-21 01:32:28,745: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:32:28.748856585Z [2024-04-21 01:32:28,748: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:28.776680727Z [2024-04-21 01:32:28,776: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:32:28.778367481Z [2024-04-21 01:32:28,778: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:32:28.778545491Z [2024-04-21 01:32:28,778: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:32:28.778715422Z [2024-04-21 01:32:28,778: INFO/ForkPoolWorker-15] Read VIM e1a0ca83-125f-42b5-a802-354c0639d9eb (basic01_080187) 2024-04-21T01:32:28.778997902Z [2024-04-21 01:32:28,778: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e1a0ca83-125f-42b5-a802-354c0639d9eb', 'name': 'basic01_080187', 'vim_type': 'openstack'}] 2024-04-21T01:32:28.779171345Z [2024-04-21 01:32:28,778: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:32:28.779606298Z [2024-04-21 01:32:28,779: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:32:28.779832235Z [2024-04-21 01:32:28,779: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:32:28.787465220Z [2024-04-21 01:32:28,787: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb 2024-04-21T01:32:28.895590141Z [2024-04-21 01:32:28,895: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:29.432746193Z [2024-04-21 01:32:29,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08d3f02b-6c8e-425b-83e3-7c19cd71e683] received 2024-04-21T01:32:29.439263936Z [2024-04-21 01:32:29,438: INFO/ForkPoolWorker-16] [08d3f02b-6c8e-425b-83e3-7c19cd71e683] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'split_metrics', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:32:29.494856780Z [2024-04-21 01:32:29,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ac24dec-005a-4f0c-977d-5253de451115] succeeded in 2.0964795110012346s: None 2024-04-21T01:32:29.799242993Z [2024-04-21 01:32:29,795: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:32:30.913841566Z [2024-04-21 01:32:30,913: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:32:30.917139834Z [2024-04-21 01:32:30,916: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:30.938654579Z [2024-04-21 01:32:30,938: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:32:30.940348830Z [2024-04-21 01:32:30,940: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:32:30.940452531Z [2024-04-21 01:32:30,940: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:32:30.940552766Z [2024-04-21 01:32:30,940: INFO/ForkPoolWorker-16] Read VIM e1a0ca83-125f-42b5-a802-354c0639d9eb (basic01_080187) 2024-04-21T01:32:30.940764138Z [2024-04-21 01:32:30,940: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e1a0ca83-125f-42b5-a802-354c0639d9eb', 'name': 'basic01_080187', 'vim_type': 'openstack'}] 2024-04-21T01:32:30.940867211Z [2024-04-21 01:32:30,940: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:32:30.941200472Z [2024-04-21 01:32:30,941: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:32:30.941332982Z [2024-04-21 01:32:30,941: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:32:30.948025919Z [2024-04-21 01:32:30,947: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb 2024-04-21T01:32:31.029905682Z [2024-04-21 01:32:31,029: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:31.693891151Z [2024-04-21 01:32:31,693: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[08d3f02b-6c8e-425b-83e3-7c19cd71e683] succeeded in 2.2596370240007673s: None 2024-04-21T01:32:32.447580215Z [2024-04-21 01:32:32,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a2569a6-b5bb-4022-b080-6aecc805fa43] received 2024-04-21T01:32:32.461335120Z [2024-04-21 01:32:32,460: INFO/ForkPoolWorker-15] [0a2569a6-b5bb-4022-b080-6aecc805fa43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'collect_metrics', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:32:32.776592948Z [2024-04-21 01:32:32,773: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:32:34.007608025Z [2024-04-21 01:32:34,007: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:32:34.011633389Z [2024-04-21 01:32:34,011: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:34.030409355Z [2024-04-21 01:32:34,030: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:32:34.032060311Z [2024-04-21 01:32:34,031: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:32:34.032182917Z [2024-04-21 01:32:34,032: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:32:34.032214324Z [2024-04-21 01:32:34,032: INFO/ForkPoolWorker-15] Read VIM e1a0ca83-125f-42b5-a802-354c0639d9eb (basic01_080187) 2024-04-21T01:32:34.032358893Z [2024-04-21 01:32:34,032: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e1a0ca83-125f-42b5-a802-354c0639d9eb', 'name': 'basic01_080187', 'vim_type': 'openstack'}] 2024-04-21T01:32:34.032424320Z [2024-04-21 01:32:34,032: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:32:34.032771870Z [2024-04-21 01:32:34,032: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:32:34.032785419Z [2024-04-21 01:32:34,032: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:32:34.040951883Z [2024-04-21 01:32:34,040: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb 2024-04-21T01:32:34.119996868Z [2024-04-21 01:32:34,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:34.695930482Z [2024-04-21 01:32:34,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a2569a6-b5bb-4022-b080-6aecc805fa43] succeeded in 2.2454072809996433s: None 2024-04-21T01:32:35.595798130Z [2024-04-21 01:32:35,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc33358a-f535-4a50-9821-0147890a9531] received 2024-04-21T01:32:35.608141372Z [2024-04-21 01:32:35,607: INFO/ForkPoolWorker-15] [dc33358a-f535-4a50-9821-0147890a9531] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'send_prometheus', 'scheduled__2024-04-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:32:35.904389587Z [2024-04-21 01:32:35,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:32:37.236212361Z [2024-04-21 01:32:37,235: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:32:37.244761890Z [2024-04-21 01:32:37,244: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:32:37.273146719Z [2024-04-21 01:32:37,272: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:32:37.274617180Z [2024-04-21 01:32:37,274: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:32:37.274836152Z [2024-04-21 01:32:37,274: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:32:37.274920029Z [2024-04-21 01:32:37,274: INFO/ForkPoolWorker-15] Read VIM e1a0ca83-125f-42b5-a802-354c0639d9eb (basic01_080187) 2024-04-21T01:32:37.275260693Z [2024-04-21 01:32:37,274: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e1a0ca83-125f-42b5-a802-354c0639d9eb', 'name': 'basic01_080187', 'vim_type': 'openstack'}] 2024-04-21T01:32:37.275297888Z [2024-04-21 01:32:37,275: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:32:37.275659450Z [2024-04-21 01:32:37,275: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:32:37.275906912Z [2024-04-21 01:32:37,275: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:32:37.282235359Z [2024-04-21 01:32:37,282: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb 2024-04-21T01:32:37.366688274Z [2024-04-21 01:32:37,366: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:32:37.928606096Z [2024-04-21 01:32:37,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc33358a-f535-4a50-9821-0147890a9531] succeeded in 2.328541150000092s: None 2024-04-21T01:33:00.930995620Z [2024-04-21 01:33:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f968ac4-88c7-4654-8e1a-41cffca45890] received 2024-04-21T01:33:00.935483174Z [2024-04-21 01:33:00,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63092399-6362-44b0-a77e-131caf0e612c] received 2024-04-21T01:33:00.938654424Z [2024-04-21 01:33:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0227b78c-1f46-47c6-930c-429b837d743b] received 2024-04-21T01:33:00.941130416Z [2024-04-21 01:33:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56980adb-7ac4-47da-aa15-aabeca682c49] received 2024-04-21T01:33:00.948504340Z [2024-04-21 01:33:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46b5ff4b-22ee-4b8d-9fc5-991a2d1cff34] received 2024-04-21T01:33:00.953472400Z [2024-04-21 01:33:00,953: INFO/ForkPoolWorker-2] [56980adb-7ac4-47da-aa15-aabeca682c49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:33:00.957494045Z [2024-04-21 01:33:00,957: INFO/ForkPoolWorker-15] [0f968ac4-88c7-4654-8e1a-41cffca45890] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:33:00.959157486Z [2024-04-21 01:33:00,958: INFO/ForkPoolWorker-16] [63092399-6362-44b0-a77e-131caf0e612c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:33:00.966789023Z [2024-04-21 01:33:00,966: INFO/ForkPoolWorker-3] [46b5ff4b-22ee-4b8d-9fc5-991a2d1cff34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:33:00.967637034Z [2024-04-21 01:33:00,967: INFO/ForkPoolWorker-1] [0227b78c-1f46-47c6-930c-429b837d743b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:33:01.297847293Z [2024-04-21 01:33:01,294: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:33:01.393194789Z [2024-04-21 01:33:01,389: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:33:01.699827938Z [2024-04-21 01:33:01,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:33:01.776650732Z [2024-04-21 01:33:01,772: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:33:01.820574169Z [2024-04-21 01:33:01,814: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:33:02.314620742Z [2024-04-21 01:33:02,314: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:33:02.318927113Z [2024-04-21 01:33:02,318: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:02.397745504Z [2024-04-21 01:33:02,397: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:33:02.398790228Z [2024-04-21 01:33:02,398: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:33:02.398974839Z [2024-04-21 01:33:02,398: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:33:02.399083285Z [2024-04-21 01:33:02,398: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:33:02.399388686Z [2024-04-21 01:33:02,399: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:33:02.577645531Z [2024-04-21 01:33:02,577: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:33:02.913002332Z [2024-04-21 01:33:02,912: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:33:02.916466940Z [2024-04-21 01:33:02,916: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:02.963710471Z [2024-04-21 01:33:02,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:33:02.967480827Z [2024-04-21 01:33:02,967: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:02.967497769Z [2024-04-21 01:33:02,967: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:02.967612962Z [2024-04-21 01:33:02,967: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:02.967623026Z [2024-04-21 01:33:02,967: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:33:02.967901220Z [2024-04-21 01:33:02,967: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:33:02.967914012Z [2024-04-21 01:33:02,967: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:02.973975241Z [2024-04-21 01:33:02,973: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:33:02.974580340Z [2024-04-21 01:33:02,974: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:33:02.975324859Z [2024-04-21 01:33:02,975: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:33:02.978036309Z [2024-04-21 01:33:02,977: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:03.010915226Z [2024-04-21 01:33:03,010: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:33:03.016173808Z [2024-04-21 01:33:03,015: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:03.016193765Z [2024-04-21 01:33:03,016: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:03.016253334Z [2024-04-21 01:33:03,016: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:03.016356300Z [2024-04-21 01:33:03,016: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:33:03.016537620Z [2024-04-21 01:33:03,016: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:33:03.016550637Z [2024-04-21 01:33:03,016: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:03.020352525Z [2024-04-21 01:33:03,019: ERROR/ForkPoolWorker-15] [0f968ac4-88c7-4654-8e1a-41cffca45890] Failed to execute task Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse.. 2024-04-21T01:33:03.020366513Z Traceback (most recent call last): 2024-04-21T01:33:03.020372777Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-21T01:33:03.020378448Z args.func(args) 2024-04-21T01:33:03.020383905Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-21T01:33:03.020389538Z return func(*args, **kwargs) 2024-04-21T01:33:03.020393660Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-21T01:33:03.020398385Z return f(*args, **kwargs) 2024-04-21T01:33:03.020420323Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-21T01:33:03.020425341Z dag = get_dag(args.subdir, args.dag_id) 2024-04-21T01:33:03.020428489Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-21T01:33:03.020431687Z raise AirflowException( 2024-04-21T01:33:03.020435383Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse. 2024-04-21T01:33:03.063317904Z [2024-04-21 01:33:03,062: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f968ac4-88c7-4654-8e1a-41cffca45890] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0f968ac4-88c7-4654-8e1a-41cffca45890') 2024-04-21T01:33:03.063338158Z Traceback (most recent call last): 2024-04-21T01:33:03.063342352Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-21T01:33:03.063345539Z R = retval = fun(*args, **kwargs) 2024-04-21T01:33:03.063368933Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-21T01:33:03.063372513Z return self.run(*args, **kwargs) 2024-04-21T01:33:03.063376232Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-21T01:33:03.063380011Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-21T01:33:03.063383056Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-21T01:33:03.063386603Z raise AirflowException(msg) 2024-04-21T01:33:03.063390421Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0f968ac4-88c7-4654-8e1a-41cffca45890 2024-04-21T01:33:03.531398200Z [2024-04-21 01:33:03,530: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0227b78c-1f46-47c6-930c-429b837d743b] succeeded in 2.5911400039985892s: None 2024-04-21T01:33:03.654159986Z [2024-04-21 01:33:03,653: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T01:33:03.657345411Z [2024-04-21 01:33:03,656: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:03.691945379Z [2024-04-21 01:33:03,688: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T01:33:03.691996079Z [2024-04-21 01:33:03,689: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:03.692000532Z [2024-04-21 01:33:03,689: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:03.692004862Z [2024-04-21 01:33:03,689: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:03.692009768Z [2024-04-21 01:33:03,689: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T01:33:03.692013082Z [2024-04-21 01:33:03,689: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:33:03.692016360Z [2024-04-21 01:33:03,689: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:03.815103076Z [2024-04-21 01:33:03,814: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:33:03.820864423Z [2024-04-21 01:33:03,820: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:03.832595214Z [2024-04-21 01:33:03,832: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:33:03.858079364Z [2024-04-21 01:33:03,857: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:33:03.860254439Z [2024-04-21 01:33:03,859: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:03.860273609Z [2024-04-21 01:33:03,860: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:03.860627399Z [2024-04-21 01:33:03,860: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:03.860731437Z [2024-04-21 01:33:03,860: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:33:03.862599875Z [2024-04-21 01:33:03,860: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:33:03.862619940Z [2024-04-21 01:33:03,860: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:03.872276635Z [2024-04-21 01:33:03,872: WARNING/ForkPoolWorker-2] Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:33:03.873371000Z [2024-04-21 01:33:03,872: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:33:03.874245812Z [2024-04-21 01:33:03,874: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:33:03.883764470Z [2024-04-21 01:33:03,881: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:03.948207857Z [2024-04-21 01:33:03,947: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:33:03.963806989Z [2024-04-21 01:33:03,959: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:03.963844488Z [2024-04-21 01:33:03,959: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:03.963849231Z [2024-04-21 01:33:03,959: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:03.963853340Z [2024-04-21 01:33:03,959: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:33:03.963856561Z [2024-04-21 01:33:03,960: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:33:03.963859561Z [2024-04-21 01:33:03,960: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:03.964351185Z [2024-04-21 01:33:03,963: ERROR/ForkPoolWorker-2] [56980adb-7ac4-47da-aa15-aabeca682c49] Failed to execute task Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse.. 2024-04-21T01:33:03.964364580Z Traceback (most recent call last): 2024-04-21T01:33:03.964372009Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-21T01:33:03.964377693Z args.func(args) 2024-04-21T01:33:03.964383718Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-21T01:33:03.964389987Z return func(*args, **kwargs) 2024-04-21T01:33:03.964394542Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-21T01:33:03.964398845Z return f(*args, **kwargs) 2024-04-21T01:33:03.964403190Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-21T01:33:03.964407378Z dag = get_dag(args.subdir, args.dag_id) 2024-04-21T01:33:03.964410634Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-21T01:33:03.964413633Z raise AirflowException( 2024-04-21T01:33:03.964417611Z airflow.exceptions.AirflowException: Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse. 2024-04-21T01:33:04.020231028Z [2024-04-21 01:33:04,019: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[56980adb-7ac4-47da-aa15-aabeca682c49] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 56980adb-7ac4-47da-aa15-aabeca682c49') 2024-04-21T01:33:04.020253615Z Traceback (most recent call last): 2024-04-21T01:33:04.020258123Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-21T01:33:04.020261582Z R = retval = fun(*args, **kwargs) 2024-04-21T01:33:04.020264612Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-21T01:33:04.020267655Z return self.run(*args, **kwargs) 2024-04-21T01:33:04.020271936Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-21T01:33:04.020276616Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-21T01:33:04.020279754Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-21T01:33:04.020283722Z raise AirflowException(msg) 2024-04-21T01:33:04.020288639Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 56980adb-7ac4-47da-aa15-aabeca682c49 2024-04-21T01:33:04.145194000Z [2024-04-21 01:33:04,144: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:33:04.150873749Z [2024-04-21 01:33:04,150: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:04.174417874Z [2024-04-21 01:33:04,174: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:33:04.175610852Z [2024-04-21 01:33:04,175: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:04.175634478Z [2024-04-21 01:33:04,175: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:04.175822311Z [2024-04-21 01:33:04,175: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:04.175857605Z [2024-04-21 01:33:04,175: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:33:04.176055380Z [2024-04-21 01:33:04,175: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:33:04.176084727Z [2024-04-21 01:33:04,176: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:04.307992254Z [2024-04-21 01:33:04,307: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:33:05.624937986Z [2024-04-21 01:33:05,624: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[46b5ff4b-22ee-4b8d-9fc5-991a2d1cff34] succeeded in 4.673702752999816s: None 2024-04-21T01:33:06.493898133Z [2024-04-21 01:33:06,493: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63092399-6362-44b0-a77e-131caf0e612c] succeeded in 5.556688143999054s: None 2024-04-21T01:33:13.430669866Z [2024-04-21 01:33:13,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faac92b7-d445-4478-a68c-591bbf5b597b] received 2024-04-21T01:33:13.444517358Z [2024-04-21 01:33:13,443: INFO/ForkPoolWorker-15] [faac92b7-d445-4478-a68c-591bbf5b597b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:33:13.825247671Z [2024-04-21 01:33:13,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:33:14.719996927Z [2024-04-21 01:33:14,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1ec3e05-1314-4dc8-89be-2b5466c47a49] received 2024-04-21T01:33:14.736959582Z [2024-04-21 01:33:14,736: INFO/ForkPoolWorker-16] [e1ec3e05-1314-4dc8-89be-2b5466c47a49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:33:14.953692123Z [2024-04-21 01:33:14,953: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:33:14.974807199Z [2024-04-21 01:33:14,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:15.008477257Z [2024-04-21 01:33:15,008: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:33:15.011658449Z [2024-04-21 01:33:15,011: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:15.011781161Z [2024-04-21 01:33:15,011: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:15.011987961Z [2024-04-21 01:33:15,011: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:15.012120806Z [2024-04-21 01:33:15,011: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:33:15.012455528Z [2024-04-21 01:33:15,012: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:33:15.012527949Z [2024-04-21 01:33:15,012: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:15.021557453Z [2024-04-21 01:33:15,021: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:33:15.022854241Z [2024-04-21 01:33:15,022: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:33:15.023792820Z [2024-04-21 01:33:15,023: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:33:15.026519544Z [2024-04-21 01:33:15,026: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:15.044216217Z [2024-04-21 01:33:15,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:33:15.045715388Z [2024-04-21 01:33:15,045: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:15.046936362Z [2024-04-21 01:33:15,045: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:15.047152860Z [2024-04-21 01:33:15,046: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:15.047227070Z [2024-04-21 01:33:15,047: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:33:15.047569230Z [2024-04-21 01:33:15,047: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:33:15.048056171Z [2024-04-21 01:33:15,047: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:15.052219469Z [2024-04-21 01:33:15,051: ERROR/ForkPoolWorker-15] [faac92b7-d445-4478-a68c-591bbf5b597b] Failed to execute task Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse.. 2024-04-21T01:33:15.052239697Z Traceback (most recent call last): 2024-04-21T01:33:15.052244089Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-21T01:33:15.052249063Z args.func(args) 2024-04-21T01:33:15.052253470Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-21T01:33:15.052258246Z return func(*args, **kwargs) 2024-04-21T01:33:15.052275128Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-21T01:33:15.052278356Z return f(*args, **kwargs) 2024-04-21T01:33:15.052281587Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-21T01:33:15.052285091Z dag = get_dag(args.subdir, args.dag_id) 2024-04-21T01:33:15.052288299Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-21T01:33:15.052291571Z raise AirflowException( 2024-04-21T01:33:15.052295561Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse. 2024-04-21T01:33:15.086424964Z [2024-04-21 01:33:15,085: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[faac92b7-d445-4478-a68c-591bbf5b597b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id faac92b7-d445-4478-a68c-591bbf5b597b') 2024-04-21T01:33:15.086460199Z Traceback (most recent call last): 2024-04-21T01:33:15.086465920Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-21T01:33:15.086470873Z R = retval = fun(*args, **kwargs) 2024-04-21T01:33:15.086475505Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-21T01:33:15.086480036Z return self.run(*args, **kwargs) 2024-04-21T01:33:15.086485635Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-21T01:33:15.086492947Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-21T01:33:15.086497122Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-21T01:33:15.086500966Z raise AirflowException(msg) 2024-04-21T01:33:15.086504936Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id faac92b7-d445-4478-a68c-591bbf5b597b 2024-04-21T01:33:15.144133941Z [2024-04-21 01:33:15,141: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:33:16.218860067Z [2024-04-21 01:33:16,218: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:33:16.222510739Z [2024-04-21 01:33:16,222: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:16.241252336Z [2024-04-21 01:33:16,239: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:33:16.247218729Z [2024-04-21 01:33:16,241: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:16.247229368Z [2024-04-21 01:33:16,242: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:16.247234782Z [2024-04-21 01:33:16,242: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:16.247240308Z [2024-04-21 01:33:16,242: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:33:16.247245036Z [2024-04-21 01:33:16,242: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:33:16.247263261Z [2024-04-21 01:33:16,242: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:16.263177333Z [2024-04-21 01:33:16,260: WARNING/ForkPoolWorker-16] Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:33:16.263202309Z [2024-04-21 01:33:16,260: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:33:16.263206602Z [2024-04-21 01:33:16,262: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:33:16.270095262Z [2024-04-21 01:33:16,269: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:33:16.311962992Z [2024-04-21 01:33:16,311: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:33:16.313187449Z [2024-04-21 01:33:16,312: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:33:16.313223821Z [2024-04-21 01:33:16,313: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:33:16.313345343Z [2024-04-21 01:33:16,313: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:33:16.313393250Z [2024-04-21 01:33:16,313: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:33:16.313567468Z [2024-04-21 01:33:16,313: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:33:16.313625286Z [2024-04-21 01:33:16,313: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:33:16.317769359Z [2024-04-21 01:33:16,317: ERROR/ForkPoolWorker-16] [e1ec3e05-1314-4dc8-89be-2b5466c47a49] Failed to execute task Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse.. 2024-04-21T01:33:16.317797785Z Traceback (most recent call last): 2024-04-21T01:33:16.317802204Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-21T01:33:16.317805996Z args.func(args) 2024-04-21T01:33:16.317813141Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-21T01:33:16.317816958Z return func(*args, **kwargs) 2024-04-21T01:33:16.317820067Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-21T01:33:16.317823224Z return f(*args, **kwargs) 2024-04-21T01:33:16.317826317Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-21T01:33:16.317829330Z dag = get_dag(args.subdir, args.dag_id) 2024-04-21T01:33:16.317832418Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-21T01:33:16.317835527Z raise AirflowException( 2024-04-21T01:33:16.317843551Z airflow.exceptions.AirflowException: Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse. 2024-04-21T01:33:16.351699450Z [2024-04-21 01:33:16,351: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e1ec3e05-1314-4dc8-89be-2b5466c47a49] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e1ec3e05-1314-4dc8-89be-2b5466c47a49') 2024-04-21T01:33:16.351733216Z Traceback (most recent call last): 2024-04-21T01:33:16.351737402Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-21T01:33:16.351740708Z R = retval = fun(*args, **kwargs) 2024-04-21T01:33:16.351743722Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-21T01:33:16.351746882Z return self.run(*args, **kwargs) 2024-04-21T01:33:16.351750795Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-21T01:33:16.351754105Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-21T01:33:16.351757271Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-21T01:33:16.351760604Z raise AirflowException(msg) 2024-04-21T01:33:16.351764358Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e1ec3e05-1314-4dc8-89be-2b5466c47a49 2024-04-21T01:34:01.242586541Z [2024-04-21 01:34:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6539a826-c21c-4da9-8d7d-264159334b27] received 2024-04-21T01:34:01.251226440Z [2024-04-21 01:34:01,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0573b08e-2b09-421c-a15f-411118358cb9] received 2024-04-21T01:34:01.256823134Z [2024-04-21 01:34:01,256: INFO/ForkPoolWorker-15] [6539a826-c21c-4da9-8d7d-264159334b27] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:34:01.257500722Z [2024-04-21 01:34:01,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3671042d-003d-415a-92bc-111ccfcf9851] received 2024-04-21T01:34:01.258146502Z [2024-04-21 01:34:01,257: INFO/ForkPoolWorker-16] [0573b08e-2b09-421c-a15f-411118358cb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:34:01.264277161Z [2024-04-21 01:34:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2c55ca1-cb37-4d16-88f7-c25634af8b0b] received 2024-04-21T01:34:01.265425982Z [2024-04-21 01:34:01,265: INFO/ForkPoolWorker-1] [3671042d-003d-415a-92bc-111ccfcf9851] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:34:01.270827695Z [2024-04-21 01:34:01,270: INFO/ForkPoolWorker-2] [c2c55ca1-cb37-4d16-88f7-c25634af8b0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:34:01.277044297Z [2024-04-21 01:34:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9038a3cd-d153-4482-9095-04e5693eaaa2] received 2024-04-21T01:34:01.280790629Z [2024-04-21 01:34:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[943c99f7-fdd7-44e6-9ab7-e09758a90a86] received 2024-04-21T01:34:01.289749951Z [2024-04-21 01:34:01,289: INFO/ForkPoolWorker-3] [9038a3cd-d153-4482-9095-04e5693eaaa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:34:01.300595930Z [2024-04-21 01:34:01,300: INFO/ForkPoolWorker-4] [943c99f7-fdd7-44e6-9ab7-e09758a90a86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:34:01.602872397Z [2024-04-21 01:34:01,598: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:34:01.798102664Z [2024-04-21 01:34:01,793: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:34:01.962699774Z [2024-04-21 01:34:01,962: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-21T01:34:01.967214641Z [2024-04-21 01:34:01,966: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:34:02.010754714Z [2024-04-21 01:34:02,010: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T01:34:02.031731328Z [2024-04-21 01:34:02,031: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:34:02.032007091Z [2024-04-21 01:34:02,031: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:34:02.032175278Z [2024-04-21 01:34:02,032: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-21T01:34:02.032679681Z [2024-04-21 01:34:02,032: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:34:02.165389890Z [2024-04-21 01:34:02,165: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:34:02.363652756Z [2024-04-21 01:34:02,360: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:34:02.389988694Z [2024-04-21 01:34:02,386: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:34:02.920617527Z [2024-04-21 01:34:02,913: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:34:02.944848733Z [2024-04-21 01:34:02,944: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:34:03.013129638Z [2024-04-21 01:34:03,012: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9038a3cd-d153-4482-9095-04e5693eaaa2] succeeded in 1.7342533610008104s: None 2024-04-21T01:34:03.343416025Z [2024-04-21 01:34:03,340: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:34:03.684607969Z [2024-04-21 01:34:03,684: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:34:03.687998044Z [2024-04-21 01:34:03,687: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:34:03.753771059Z [2024-04-21 01:34:03,752: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:34:03.754912794Z [2024-04-21 01:34:03,754: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:34:03.754947766Z [2024-04-21 01:34:03,754: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:34:03.755142592Z [2024-04-21 01:34:03,754: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:34:03.755249495Z [2024-04-21 01:34:03,755: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:34:03.755582654Z [2024-04-21 01:34:03,755: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:34:03.755691116Z [2024-04-21 01:34:03,755: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:34:03.761804771Z [2024-04-21 01:34:03,761: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:34:03.762394398Z [2024-04-21 01:34:03,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:34:03.763136649Z [2024-04-21 01:34:03,762: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:34:03.767143717Z [2024-04-21 01:34:03,766: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:34:03.819077317Z [2024-04-21 01:34:03,818: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:34:03.820061403Z [2024-04-21 01:34:03,819: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:34:03.820097430Z [2024-04-21 01:34:03,820: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:34:03.820195994Z [2024-04-21 01:34:03,820: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:34:03.820233015Z [2024-04-21 01:34:03,820: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:34:03.820445382Z [2024-04-21 01:34:03,820: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:34:03.820449746Z [2024-04-21 01:34:03,820: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:34:03.827123009Z [2024-04-21 01:34:03,826: ERROR/ForkPoolWorker-16] [0573b08e-2b09-421c-a15f-411118358cb9] Failed to execute task Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse.. 2024-04-21T01:34:03.827142947Z Traceback (most recent call last): 2024-04-21T01:34:03.827146776Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-21T01:34:03.827169495Z args.func(args) 2024-04-21T01:34:03.827187093Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-21T01:34:03.827191697Z return func(*args, **kwargs) 2024-04-21T01:34:03.827194614Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-21T01:34:03.827197449Z return f(*args, **kwargs) 2024-04-21T01:34:03.827200601Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-21T01:34:03.827203617Z dag = get_dag(args.subdir, args.dag_id) 2024-04-21T01:34:03.827206648Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-21T01:34:03.827209681Z raise AirflowException( 2024-04-21T01:34:03.827214280Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse. 2024-04-21T01:34:03.918066558Z [2024-04-21 01:34:03,916: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0573b08e-2b09-421c-a15f-411118358cb9] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0573b08e-2b09-421c-a15f-411118358cb9') 2024-04-21T01:34:03.918088187Z Traceback (most recent call last): 2024-04-21T01:34:03.918092301Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-21T01:34:03.918095659Z R = retval = fun(*args, **kwargs) 2024-04-21T01:34:03.918098836Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-21T01:34:03.918139454Z return self.run(*args, **kwargs) 2024-04-21T01:34:03.918143608Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-21T01:34:03.918148599Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-21T01:34:03.918151677Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-21T01:34:03.918156142Z raise AirflowException(msg) 2024-04-21T01:34:03.918159874Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0573b08e-2b09-421c-a15f-411118358cb9 2024-04-21T01:34:03.987786301Z [2024-04-21 01:34:03,985: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6539a826-c21c-4da9-8d7d-264159334b27] succeeded in 2.7405453070005024s: None 2024-04-21T01:34:04.437264930Z [2024-04-21 01:34:04,436: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:34:04.440750851Z [2024-04-21 01:34:04,440: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:34:04.478024278Z [2024-04-21 01:34:04,477: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:34:04.483156530Z [2024-04-21 01:34:04,482: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:34:04.483179282Z [2024-04-21 01:34:04,483: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:34:04.483254443Z [2024-04-21 01:34:04,483: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:34:04.484369262Z [2024-04-21 01:34:04,483: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:34:04.484863250Z [2024-04-21 01:34:04,484: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:34:04.484908185Z [2024-04-21 01:34:04,484: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:34:04.623461900Z [2024-04-21 01:34:04,623: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:34:04.888500371Z [2024-04-21 01:34:04,888: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:34:04.892162224Z [2024-04-21 01:34:04,891: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:34:04.919581310Z [2024-04-21 01:34:04,918: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-21T01:34:04.923423427Z [2024-04-21 01:34:04,923: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:34:04.930474365Z [2024-04-21 01:34:04,930: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:34:04.931885199Z [2024-04-21 01:34:04,931: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:34:04.931936870Z [2024-04-21 01:34:04,931: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:34:04.932030995Z [2024-04-21 01:34:04,931: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:34:04.932060195Z [2024-04-21 01:34:04,931: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:34:04.932924113Z [2024-04-21 01:34:04,932: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:34:04.933019892Z [2024-04-21 01:34:04,932: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:34:04.953271785Z [2024-04-21 01:34:04,953: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-21T01:34:04.955445596Z [2024-04-21 01:34:04,955: INFO/ForkPoolWorker-4] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:34:04.955633012Z [2024-04-21 01:34:04,955: INFO/ForkPoolWorker-4] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:34:04.955894113Z [2024-04-21 01:34:04,955: INFO/ForkPoolWorker-4] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:34:04.956047528Z [2024-04-21 01:34:04,955: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-21T01:34:04.959243647Z [2024-04-21 01:34:04,959: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:34:04.959435445Z [2024-04-21 01:34:04,959: INFO/ForkPoolWorker-4] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:34:04.969906774Z [2024-04-21 01:34:04,969: WARNING/ForkPoolWorker-4] Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:34:04.975402329Z [2024-04-21 01:34:04,970: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:34:04.976281669Z [2024-04-21 01:34:04,976: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-21T01:34:04.982202586Z [2024-04-21 01:34:04,980: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:34:05.001819741Z [2024-04-21 01:34:05,001: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-21T01:34:05.003276954Z [2024-04-21 01:34:05,003: INFO/ForkPoolWorker-4] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:34:05.003445268Z [2024-04-21 01:34:05,003: INFO/ForkPoolWorker-4] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:34:05.003617774Z [2024-04-21 01:34:05,003: INFO/ForkPoolWorker-4] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:34:05.003772896Z [2024-04-21 01:34:05,003: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-21T01:34:05.004029052Z [2024-04-21 01:34:05,003: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:34:05.004421183Z [2024-04-21 01:34:05,004: INFO/ForkPoolWorker-4] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:34:05.007625426Z [2024-04-21 01:34:05,007: ERROR/ForkPoolWorker-4] [943c99f7-fdd7-44e6-9ab7-e09758a90a86] Failed to execute task Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse.. 2024-04-21T01:34:05.007643930Z Traceback (most recent call last): 2024-04-21T01:34:05.007660844Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-21T01:34:05.007665278Z args.func(args) 2024-04-21T01:34:05.007669244Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-21T01:34:05.007685126Z return func(*args, **kwargs) 2024-04-21T01:34:05.007689404Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-21T01:34:05.007692540Z return f(*args, **kwargs) 2024-04-21T01:34:05.007696268Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-21T01:34:05.007699673Z dag = get_dag(args.subdir, args.dag_id) 2024-04-21T01:34:05.007702847Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-21T01:34:05.007706044Z raise AirflowException( 2024-04-21T01:34:05.007718816Z airflow.exceptions.AirflowException: Dag 'vim_status_e1a0ca83-125f-42b5-a802-354c0639d9eb' could not be found; either it does not exist or it failed to parse. 2024-04-21T01:34:05.035580555Z [2024-04-21 01:34:05,035: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:34:05.049733882Z [2024-04-21 01:34:05,049: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[943c99f7-fdd7-44e6-9ab7-e09758a90a86] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 943c99f7-fdd7-44e6-9ab7-e09758a90a86') 2024-04-21T01:34:05.049767777Z Traceback (most recent call last): 2024-04-21T01:34:05.049772499Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-21T01:34:05.049775678Z R = retval = fun(*args, **kwargs) 2024-04-21T01:34:05.049778724Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-21T01:34:05.049781911Z return self.run(*args, **kwargs) 2024-04-21T01:34:05.049785490Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-21T01:34:05.049790927Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-21T01:34:05.049793994Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-21T01:34:05.049797778Z raise AirflowException(msg) 2024-04-21T01:34:05.049801687Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 943c99f7-fdd7-44e6-9ab7-e09758a90a86 2024-04-21T01:34:06.176673036Z [2024-04-21 01:34:06,175: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c2c55ca1-cb37-4d16-88f7-c25634af8b0b] succeeded in 4.9107259520005755s: None 2024-04-21T01:34:06.870569021Z [2024-04-21 01:34:06,870: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3671042d-003d-415a-92bc-111ccfcf9851] succeeded in 5.611611627000457s: None 2024-04-21T01:34:38.898391490Z [2024-04-21 01:34:38,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21a4ce5c-2adc-4539-9276-33a8e7bc5a16] received 2024-04-21T01:34:38.905882148Z [2024-04-21 01:34:38,905: INFO/ForkPoolWorker-15] [21a4ce5c-2adc-4539-9276-33a8e7bc5a16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240421013437_586852', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-21T01:34:39.207840225Z [2024-04-21 01:34:39,201: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-21T01:34:39.560029032Z [2024-04-21 01:34:39,559: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:34:40.230506682Z [2024-04-21 01:34:40,230: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21a4ce5c-2adc-4539-9276-33a8e7bc5a16] succeeded in 1.329771269000048s: None 2024-04-21T01:35:00.464060112Z [2024-04-21 01:35:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be1aae96-86b6-4972-9ba7-207a6249e768] received 2024-04-21T01:35:00.471758513Z [2024-04-21 01:35:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bcb6261-f5b4-46e8-bb37-f9b8afbb7fb6] received 2024-04-21T01:35:00.472869912Z [2024-04-21 01:35:00,472: INFO/ForkPoolWorker-15] [be1aae96-86b6-4972-9ba7-207a6249e768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:35:00.480524621Z [2024-04-21 01:35:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06b579ad-70b5-4990-a66b-415bac7a9199] received 2024-04-21T01:35:00.482484082Z [2024-04-21 01:35:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60560774-5921-4da0-aa3e-1fbb177292b6] received 2024-04-21T01:35:00.491807868Z [2024-04-21 01:35:00,491: INFO/ForkPoolWorker-2] [60560774-5921-4da0-aa3e-1fbb177292b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:35:00.497941685Z [2024-04-21 01:35:00,497: INFO/ForkPoolWorker-1] [06b579ad-70b5-4990-a66b-415bac7a9199] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:35:00.504074735Z [2024-04-21 01:35:00,503: INFO/ForkPoolWorker-16] [2bcb6261-f5b4-46e8-bb37-f9b8afbb7fb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:35:00.802981174Z [2024-04-21 01:35:00,799: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:35:00.869447119Z [2024-04-21 01:35:00,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:35:00.949612164Z [2024-04-21 01:35:00,939: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:35:01.027134301Z [2024-04-21 01:35:01,022: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:35:01.260817606Z [2024-04-21 01:35:01,260: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:35:01.265144756Z [2024-04-21 01:35:01,264: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:35:01.289728582Z [2024-04-21 01:35:01,289: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:35:01.290762227Z [2024-04-21 01:35:01,290: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:35:01.290909203Z [2024-04-21 01:35:01,290: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:35:01.291029374Z [2024-04-21 01:35:01,290: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:35:01.291259175Z [2024-04-21 01:35:01,291: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:35:01.404454493Z [2024-04-21 01:35:01,404: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:35:02.174309168Z [2024-04-21 01:35:02,173: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[06b579ad-70b5-4990-a66b-415bac7a9199] succeeded in 1.692042685999695s: None 2024-04-21T01:35:02.255966520Z [2024-04-21 01:35:02,255: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:35:02.259405154Z [2024-04-21 01:35:02,258: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:35:02.296233603Z [2024-04-21 01:35:02,295: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:35:02.298040555Z [2024-04-21 01:35:02,297: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:35:02.298235761Z [2024-04-21 01:35:02,298: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:35:02.298432056Z [2024-04-21 01:35:02,298: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:35:02.298561809Z [2024-04-21 01:35:02,298: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:35:02.298883038Z [2024-04-21 01:35:02,298: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:35:02.299007770Z [2024-04-21 01:35:02,298: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:35:02.377618876Z [2024-04-21 01:35:02,377: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:35:02.417481411Z [2024-04-21 01:35:02,417: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:35:02.420696705Z [2024-04-21 01:35:02,420: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:35:02.453873195Z [2024-04-21 01:35:02,453: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:35:02.455334512Z [2024-04-21 01:35:02,455: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:35:02.455357368Z [2024-04-21 01:35:02,455: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:35:02.455534884Z [2024-04-21 01:35:02,455: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:35:02.455568638Z [2024-04-21 01:35:02,455: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:35:02.455881164Z [2024-04-21 01:35:02,455: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:35:02.455921524Z [2024-04-21 01:35:02,455: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:35:02.569713370Z [2024-04-21 01:35:02,569: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:35:02.654441483Z [2024-04-21 01:35:02,654: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:35:02.658277128Z [2024-04-21 01:35:02,657: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:35:02.692304565Z [2024-04-21 01:35:02,691: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:35:02.694361198Z [2024-04-21 01:35:02,694: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:35:02.694609038Z [2024-04-21 01:35:02,694: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:35:02.694952190Z [2024-04-21 01:35:02,694: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:35:02.695104513Z [2024-04-21 01:35:02,694: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:35:02.695800965Z [2024-04-21 01:35:02,695: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:35:02.696041303Z [2024-04-21 01:35:02,695: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:35:02.820316142Z [2024-04-21 01:35:02,820: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:35:03.279040899Z [2024-04-21 01:35:03,278: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be1aae96-86b6-4972-9ba7-207a6249e768] succeeded in 2.8132907939998404s: None 2024-04-21T01:35:03.996667459Z [2024-04-21 01:35:03,996: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2bcb6261-f5b4-46e8-bb37-f9b8afbb7fb6] succeeded in 3.5173672060009267s: None 2024-04-21T01:35:04.313766478Z [2024-04-21 01:35:04,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41101370-9724-4eba-a225-5814cd7fc934] received 2024-04-21T01:35:04.325168426Z [2024-04-21 01:35:04,324: INFO/ForkPoolWorker-15] [41101370-9724-4eba-a225-5814cd7fc934] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:35:04.640056772Z [2024-04-21 01:35:04,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:35:04.889278784Z [2024-04-21 01:35:04,888: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[60560774-5921-4da0-aa3e-1fbb177292b6] succeeded in 4.405061317000218s: None 2024-04-21T01:35:05.778118991Z [2024-04-21 01:35:05,777: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:35:05.781479538Z [2024-04-21 01:35:05,781: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:35:05.801776695Z [2024-04-21 01:35:05,801: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:35:05.803174947Z [2024-04-21 01:35:05,802: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:35:05.803329101Z [2024-04-21 01:35:05,803: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:35:05.803562044Z [2024-04-21 01:35:05,803: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:35:05.803738311Z [2024-04-21 01:35:05,803: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:35:05.804146233Z [2024-04-21 01:35:05,803: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:35:05.804255451Z [2024-04-21 01:35:05,804: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:35:05.917872481Z [2024-04-21 01:35:05,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:35:06.674423999Z [2024-04-21 01:35:06,673: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41101370-9724-4eba-a225-5814cd7fc934] succeeded in 2.3590180239989422s: None 2024-04-21T01:35:06.692118470Z [2024-04-21 01:35:06,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7194f75-989f-4621-898c-aae8ec8804d0] received 2024-04-21T01:35:06.709084308Z [2024-04-21 01:35:06,708: INFO/ForkPoolWorker-15] [b7194f75-989f-4621-898c-aae8ec8804d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:35:07.044730200Z [2024-04-21 01:35:07,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:35:08.153961161Z [2024-04-21 01:35:08,153: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:35:08.157183159Z [2024-04-21 01:35:08,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:35:08.185240772Z [2024-04-21 01:35:08,184: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:35:08.186957037Z [2024-04-21 01:35:08,186: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:35:08.187051636Z [2024-04-21 01:35:08,186: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:35:08.187349764Z [2024-04-21 01:35:08,187: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:35:08.187457767Z [2024-04-21 01:35:08,187: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:35:08.187913378Z [2024-04-21 01:35:08,187: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:35:08.188146472Z [2024-04-21 01:35:08,187: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:35:08.286957669Z [2024-04-21 01:35:08,286: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:35:08.893980939Z [2024-04-21 01:35:08,893: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7194f75-989f-4621-898c-aae8ec8804d0] succeeded in 2.1964018720009335s: None 2024-04-21T01:35:09.331763381Z [2024-04-21 01:35:09,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50d789e7-3e85-4b48-8840-420fc10b40c7] received 2024-04-21T01:35:09.341657477Z [2024-04-21 01:35:09,341: INFO/ForkPoolWorker-15] [50d789e7-3e85-4b48-8840-420fc10b40c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:35:09.794789580Z [2024-04-21 01:35:09,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:35:10.962412103Z [2024-04-21 01:35:10,961: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:35:10.966079866Z [2024-04-21 01:35:10,965: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:35:11.008742862Z [2024-04-21 01:35:11,008: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:35:11.010479760Z [2024-04-21 01:35:11,010: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:35:11.010753857Z [2024-04-21 01:35:11,010: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:35:11.011143811Z [2024-04-21 01:35:11,010: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:35:11.011324034Z [2024-04-21 01:35:11,011: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:35:11.011849870Z [2024-04-21 01:35:11,011: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:35:11.012086953Z [2024-04-21 01:35:11,011: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:35:11.133756059Z [2024-04-21 01:35:11,133: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:35:11.808454414Z [2024-04-21 01:35:11,808: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50d789e7-3e85-4b48-8840-420fc10b40c7] succeeded in 2.4735248800006957s: None 2024-04-21T01:36:01.168507210Z [2024-04-21 01:36:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cd98d2a-d557-4d6c-8b92-f3f1f67ae57b] received 2024-04-21T01:36:01.173789820Z [2024-04-21 01:36:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[612e4268-d43e-46aa-85d5-59af4936a10c] received 2024-04-21T01:36:01.179985461Z [2024-04-21 01:36:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0d6bd16-6e16-44f3-a0bf-8ba6faeb1188] received 2024-04-21T01:36:01.181121812Z [2024-04-21 01:36:01,180: INFO/ForkPoolWorker-16] [612e4268-d43e-46aa-85d5-59af4936a10c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:36:01.191576934Z [2024-04-21 01:36:01,191: INFO/ForkPoolWorker-15] [5cd98d2a-d557-4d6c-8b92-f3f1f67ae57b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:36:01.196368702Z [2024-04-21 01:36:01,195: INFO/ForkPoolWorker-1] [a0d6bd16-6e16-44f3-a0bf-8ba6faeb1188] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:36:01.207321326Z [2024-04-21 01:36:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16982d54-7a30-402d-a1ba-8dcc1923adc0] received 2024-04-21T01:36:01.217013112Z [2024-04-21 01:36:01,216: INFO/ForkPoolWorker-2] [16982d54-7a30-402d-a1ba-8dcc1923adc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:36:01.593269907Z [2024-04-21 01:36:01,588: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:36:01.632689998Z [2024-04-21 01:36:01,628: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:36:01.666756301Z [2024-04-21 01:36:01,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:36:01.791577688Z [2024-04-21 01:36:01,787: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:36:01.868055756Z [2024-04-21 01:36:01,867: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:36:01.990756364Z [2024-04-21 01:36:01,990: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T01:36:01.994847293Z [2024-04-21 01:36:01,994: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:36:02.027897566Z [2024-04-21 01:36:02,027: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:36:02.029079109Z [2024-04-21 01:36:02,028: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:36:02.029190527Z [2024-04-21 01:36:02,029: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:36:02.029280578Z [2024-04-21 01:36:02,029: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T01:36:02.029459476Z [2024-04-21 01:36:02,029: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:36:02.116941850Z [2024-04-21 01:36:02,116: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:36:02.459764870Z [2024-04-21 01:36:02,459: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5cd98d2a-d557-4d6c-8b92-f3f1f67ae57b] succeeded in 1.2876607010002772s: None 2024-04-21T01:36:02.616197352Z [2024-04-21 01:36:02,615: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[16982d54-7a30-402d-a1ba-8dcc1923adc0] succeeded in 1.406675284000812s: None 2024-04-21T01:36:03.149968114Z [2024-04-21 01:36:03,149: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:36:03.153317488Z [2024-04-21 01:36:03,152: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:36:03.174476536Z [2024-04-21 01:36:03,174: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:36:03.176591571Z [2024-04-21 01:36:03,176: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:36:03.176604880Z [2024-04-21 01:36:03,176: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:36:03.176887882Z [2024-04-21 01:36:03,176: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:36:03.177275158Z [2024-04-21 01:36:03,176: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:36:03.177820359Z [2024-04-21 01:36:03,177: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:36:03.177858443Z [2024-04-21 01:36:03,177: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:36:03.181053953Z [2024-04-21 01:36:03,180: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:36:03.184436374Z [2024-04-21 01:36:03,184: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:36:03.210652711Z [2024-04-21 01:36:03,210: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:36:03.212736169Z [2024-04-21 01:36:03,212: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:36:03.212911083Z [2024-04-21 01:36:03,212: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:36:03.213142779Z [2024-04-21 01:36:03,212: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:36:03.213285700Z [2024-04-21 01:36:03,213: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:36:03.213704757Z [2024-04-21 01:36:03,213: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:36:03.214450175Z [2024-04-21 01:36:03,214: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:36:03.265315802Z [2024-04-21 01:36:03,265: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:36:03.306807862Z [2024-04-21 01:36:03,306: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:36:04.975503693Z [2024-04-21 01:36:04,974: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a0d6bd16-6e16-44f3-a0bf-8ba6faeb1188] succeeded in 3.788886893000381s: None 2024-04-21T01:36:05.338813092Z [2024-04-21 01:36:05,337: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[612e4268-d43e-46aa-85d5-59af4936a10c] succeeded in 4.163161589000083s: None 2024-04-21T01:37:00.309861948Z [2024-04-21 01:37:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63d81ca6-602d-47e1-aea9-e908298eace3] received 2024-04-21T01:37:00.320171705Z [2024-04-21 01:37:00,319: INFO/ForkPoolWorker-15] [63d81ca6-602d-47e1-aea9-e908298eace3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:37:00.320207206Z [2024-04-21 01:37:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[532144f6-7487-4d1d-bff2-5f27da573ba8] received 2024-04-21T01:37:00.326410246Z [2024-04-21 01:37:00,326: INFO/ForkPoolWorker-16] [532144f6-7487-4d1d-bff2-5f27da573ba8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:37:00.344006207Z [2024-04-21 01:37:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed16542a-8495-4507-9c98-b3d0964c597b] received 2024-04-21T01:37:00.358479298Z [2024-04-21 01:37:00,358: INFO/ForkPoolWorker-1] [ed16542a-8495-4507-9c98-b3d0964c597b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:37:00.704743792Z [2024-04-21 01:37:00,701: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:37:00.785238600Z [2024-04-21 01:37:00,782: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:37:00.799103876Z [2024-04-21 01:37:00,795: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:37:00.951519909Z [2024-04-21 01:37:00,950: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T01:37:00.955881387Z [2024-04-21 01:37:00,955: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:37:00.997376524Z [2024-04-21 01:37:00,997: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:37:01.001551657Z [2024-04-21 01:37:01,001: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:37:01.001665919Z [2024-04-21 01:37:01,001: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:37:01.001803065Z [2024-04-21 01:37:01,001: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T01:37:01.002606951Z [2024-04-21 01:37:01,002: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:37:01.190413136Z [2024-04-21 01:37:01,190: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:37:01.865355267Z [2024-04-21 01:37:01,861: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63d81ca6-602d-47e1-aea9-e908298eace3] succeeded in 1.5492095760000666s: None 2024-04-21T01:37:02.239154909Z [2024-04-21 01:37:02,238: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:37:02.242526925Z [2024-04-21 01:37:02,242: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:37:02.265655586Z [2024-04-21 01:37:02,265: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:37:02.267407183Z [2024-04-21 01:37:02,267: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:37:02.267499124Z [2024-04-21 01:37:02,267: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:37:02.267703745Z [2024-04-21 01:37:02,267: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:37:02.267850438Z [2024-04-21 01:37:02,267: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:37:02.268143681Z [2024-04-21 01:37:02,268: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:37:02.268261653Z [2024-04-21 01:37:02,268: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:37:02.317262308Z [2024-04-21 01:37:02,316: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:37:02.320687358Z [2024-04-21 01:37:02,320: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:37:02.342374285Z [2024-04-21 01:37:02,342: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:37:02.343856378Z [2024-04-21 01:37:02,343: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:37:02.343949574Z [2024-04-21 01:37:02,343: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:37:02.344095872Z [2024-04-21 01:37:02,343: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:37:02.344167278Z [2024-04-21 01:37:02,344: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:37:02.344488109Z [2024-04-21 01:37:02,344: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:37:02.344582733Z [2024-04-21 01:37:02,344: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:37:02.361523764Z [2024-04-21 01:37:02,361: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:37:02.455623689Z [2024-04-21 01:37:02,455: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:37:03.951899696Z [2024-04-21 01:37:03,951: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed16542a-8495-4507-9c98-b3d0964c597b] succeeded in 3.6056549240001914s: None 2024-04-21T01:37:04.383045351Z [2024-04-21 01:37:04,382: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[532144f6-7487-4d1d-bff2-5f27da573ba8] succeeded in 4.061211721000291s: None 2024-04-21T01:38:01.280655043Z [2024-04-21 01:38:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9958480-4a62-42b9-b831-3b3fbc283425] received 2024-04-21T01:38:01.283031892Z [2024-04-21 01:38:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[293d58c1-f727-4cd8-aee3-8e4f603c3849] received 2024-04-21T01:38:01.284784033Z [2024-04-21 01:38:01,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb108542-eb2c-4ba8-bce7-9f06e87ef4fa] received 2024-04-21T01:38:01.287713000Z [2024-04-21 01:38:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0feb217-f1a4-437a-b9b3-ec05c6d8458a] received 2024-04-21T01:38:01.296411694Z [2024-04-21 01:38:01,296: INFO/ForkPoolWorker-15] [f9958480-4a62-42b9-b831-3b3fbc283425] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:38:01.298386344Z [2024-04-21 01:38:01,298: INFO/ForkPoolWorker-2] [a0feb217-f1a4-437a-b9b3-ec05c6d8458a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:38:01.304835224Z [2024-04-21 01:38:01,304: INFO/ForkPoolWorker-1] [eb108542-eb2c-4ba8-bce7-9f06e87ef4fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:38:01.312389413Z [2024-04-21 01:38:01,312: INFO/ForkPoolWorker-16] [293d58c1-f727-4cd8-aee3-8e4f603c3849] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:38:01.744459712Z [2024-04-21 01:38:01,733: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:38:01.818343911Z [2024-04-21 01:38:01,815: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:38:01.917936521Z [2024-04-21 01:38:01,914: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:38:01.918519909Z [2024-04-21 01:38:01,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:38:02.087355270Z [2024-04-21 01:38:02,086: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T01:38:02.091187336Z [2024-04-21 01:38:02,090: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:38:02.117298342Z [2024-04-21 01:38:02,117: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:38:02.119618226Z [2024-04-21 01:38:02,119: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:38:02.120102442Z [2024-04-21 01:38:02,119: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:38:02.120436385Z [2024-04-21 01:38:02,120: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T01:38:02.124010392Z [2024-04-21 01:38:02,120: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:38:02.222233920Z [2024-04-21 01:38:02,222: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:38:02.231794099Z [2024-04-21 01:38:02,231: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:38:02.825791034Z [2024-04-21 01:38:02,824: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb108542-eb2c-4ba8-bce7-9f06e87ef4fa] succeeded in 1.5362922929998604s: None 2024-04-21T01:38:02.909003002Z [2024-04-21 01:38:02,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9958480-4a62-42b9-b831-3b3fbc283425] succeeded in 1.6234433429999626s: None 2024-04-21T01:38:03.327152412Z [2024-04-21 01:38:03,326: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:38:03.330465340Z [2024-04-21 01:38:03,330: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:38:03.357012351Z [2024-04-21 01:38:03,356: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:38:03.358746799Z [2024-04-21 01:38:03,358: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:38:03.358858487Z [2024-04-21 01:38:03,358: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:38:03.359403447Z [2024-04-21 01:38:03,359: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:38:03.359532312Z [2024-04-21 01:38:03,359: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:38:03.359854726Z [2024-04-21 01:38:03,359: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:38:03.359976736Z [2024-04-21 01:38:03,359: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:38:03.441960819Z [2024-04-21 01:38:03,441: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:38:03.514829165Z [2024-04-21 01:38:03,514: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:38:03.518136618Z [2024-04-21 01:38:03,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:38:03.535614436Z [2024-04-21 01:38:03,535: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:38:03.537351550Z [2024-04-21 01:38:03,537: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:38:03.537461346Z [2024-04-21 01:38:03,537: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:38:03.537644999Z [2024-04-21 01:38:03,537: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:38:03.537748131Z [2024-04-21 01:38:03,537: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:38:03.538023468Z [2024-04-21 01:38:03,537: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:38:03.538811848Z [2024-04-21 01:38:03,538: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:38:03.626571784Z [2024-04-21 01:38:03,626: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:38:05.486056948Z [2024-04-21 01:38:05,485: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[293d58c1-f727-4cd8-aee3-8e4f603c3849] succeeded in 4.201203348999115s: None 2024-04-21T01:38:05.498817569Z [2024-04-21 01:38:05,498: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a0feb217-f1a4-437a-b9b3-ec05c6d8458a] succeeded in 4.2085622970007535s: None 2024-04-21T01:39:01.176730009Z [2024-04-21 01:39:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[436bfb3b-4a7a-46f4-a0e1-07b8cbac8d85] received 2024-04-21T01:39:01.189453181Z [2024-04-21 01:39:01,189: INFO/ForkPoolWorker-15] [436bfb3b-4a7a-46f4-a0e1-07b8cbac8d85] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:39:01.189927088Z [2024-04-21 01:39:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[feef2285-ade4-411b-a58d-6af829d08d40] received 2024-04-21T01:39:01.205422270Z [2024-04-21 01:39:01,205: INFO/ForkPoolWorker-16] [feef2285-ade4-411b-a58d-6af829d08d40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:39:01.208908442Z [2024-04-21 01:39:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2711440-be90-4c05-86fb-b96299ec37d5] received 2024-04-21T01:39:01.225941630Z [2024-04-21 01:39:01,225: INFO/ForkPoolWorker-1] [f2711440-be90-4c05-86fb-b96299ec37d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:39:01.546683545Z [2024-04-21 01:39:01,534: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:39:01.633174855Z [2024-04-21 01:39:01,629: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:39:01.718875730Z [2024-04-21 01:39:01,714: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:39:01.753597218Z [2024-04-21 01:39:01,742: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T01:39:01.761594756Z [2024-04-21 01:39:01,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:39:01.798874748Z [2024-04-21 01:39:01,798: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:39:01.800984933Z [2024-04-21 01:39:01,800: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:39:01.801045102Z [2024-04-21 01:39:01,800: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:39:01.801100073Z [2024-04-21 01:39:01,801: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T01:39:01.801308986Z [2024-04-21 01:39:01,801: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:39:01.909686202Z [2024-04-21 01:39:01,909: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:39:02.532771657Z [2024-04-21 01:39:02,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[436bfb3b-4a7a-46f4-a0e1-07b8cbac8d85] succeeded in 1.3545010690013441s: None 2024-04-21T01:39:02.925857488Z [2024-04-21 01:39:02,925: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:39:02.929614462Z [2024-04-21 01:39:02,929: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:39:02.945962963Z [2024-04-21 01:39:02,945: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:39:02.947333134Z [2024-04-21 01:39:02,947: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:39:02.947420383Z [2024-04-21 01:39:02,947: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:39:02.947551098Z [2024-04-21 01:39:02,947: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:39:02.947651403Z [2024-04-21 01:39:02,947: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:39:02.948217040Z [2024-04-21 01:39:02,948: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:39:02.948292369Z [2024-04-21 01:39:02,948: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:39:03.038208420Z [2024-04-21 01:39:03,037: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:39:03.465356438Z [2024-04-21 01:39:03,465: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:39:03.469001813Z [2024-04-21 01:39:03,468: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:39:03.499654890Z [2024-04-21 01:39:03,499: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:39:03.501076807Z [2024-04-21 01:39:03,500: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:39:03.501234519Z [2024-04-21 01:39:03,501: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:39:03.501444231Z [2024-04-21 01:39:03,501: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:39:03.501596283Z [2024-04-21 01:39:03,501: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:39:03.501980042Z [2024-04-21 01:39:03,501: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:39:03.502121157Z [2024-04-21 01:39:03,502: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:39:03.597170416Z [2024-04-21 01:39:03,596: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:39:05.272551817Z [2024-04-21 01:39:05,272: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[feef2285-ade4-411b-a58d-6af829d08d40] succeeded in 4.0788699879994965s: None 2024-04-21T01:39:05.386794728Z [2024-04-21 01:39:05,386: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2711440-be90-4c05-86fb-b96299ec37d5] succeeded in 4.175095278000299s: None 2024-04-21T01:40:01.314777217Z [2024-04-21 01:40:01,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f798966-52b9-4eb1-9c1c-8e91bdde8d8c] received 2024-04-21T01:40:01.317764036Z [2024-04-21 01:40:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6834ff6-6860-4c71-8cc3-956d5a74058f] received 2024-04-21T01:40:01.334044880Z [2024-04-21 01:40:01,333: INFO/ForkPoolWorker-15] [6f798966-52b9-4eb1-9c1c-8e91bdde8d8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:40:01.336016378Z [2024-04-21 01:40:01,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa725f80-906b-490b-9fa5-4e7b84eb6657] received 2024-04-21T01:40:01.342000515Z [2024-04-21 01:40:01,341: INFO/ForkPoolWorker-16] [b6834ff6-6860-4c71-8cc3-956d5a74058f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:40:01.352791371Z [2024-04-21 01:40:01,352: INFO/ForkPoolWorker-1] [aa725f80-906b-490b-9fa5-4e7b84eb6657] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:40:01.395196072Z [2024-04-21 01:40:01,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d27e7f1-e279-41e1-b1ab-dd8dab1ee983] received 2024-04-21T01:40:01.404364622Z [2024-04-21 01:40:01,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce8aa8cf-5b3a-485b-b2c4-70bd12610b77] received 2024-04-21T01:40:01.420486748Z [2024-04-21 01:40:01,420: INFO/ForkPoolWorker-3] [ce8aa8cf-5b3a-485b-b2c4-70bd12610b77] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:40:01.450975388Z [2024-04-21 01:40:01,450: INFO/ForkPoolWorker-2] [4d27e7f1-e279-41e1-b1ab-dd8dab1ee983] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:40:01.888615715Z [2024-04-21 01:40:01,881: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:40:02.238618360Z [2024-04-21 01:40:02,216: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:40:02.336901488Z [2024-04-21 01:40:02,330: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:40:02.502406471Z [2024-04-21 01:40:02,499: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:40:02.556071657Z [2024-04-21 01:40:02,532: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:40:02.658330681Z [2024-04-21 01:40:02,657: INFO/ForkPoolWorker-3] Getting SDNC list 2024-04-21T01:40:02.666658780Z [2024-04-21 01:40:02,666: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:40:02.745451916Z [2024-04-21 01:40:02,745: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T01:40:02.753107458Z [2024-04-21 01:40:02,752: INFO/ForkPoolWorker-3] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:40:02.753169024Z [2024-04-21 01:40:02,752: INFO/ForkPoolWorker-3] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:40:02.753339903Z [2024-04-21 01:40:02,753: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-04-21T01:40:02.754394755Z [2024-04-21 01:40:02,754: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:40:03.186502334Z [2024-04-21 01:40:03,186: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:40:03.852565555Z [2024-04-21 01:40:03,852: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:40:04.694700726Z [2024-04-21 01:40:04,694: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ce8aa8cf-5b3a-485b-b2c4-70bd12610b77] succeeded in 3.2826883340003405s: None 2024-04-21T01:40:04.905474662Z [2024-04-21 01:40:04,905: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:40:04.911159186Z [2024-04-21 01:40:04,910: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:40:04.952014627Z [2024-04-21 01:40:04,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:40:04.954520853Z [2024-04-21 01:40:04,954: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:40:04.954812147Z [2024-04-21 01:40:04,954: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:40:04.955064241Z [2024-04-21 01:40:04,954: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:40:04.957083372Z [2024-04-21 01:40:04,956: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:40:04.958003691Z [2024-04-21 01:40:04,957: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:40:04.958264826Z [2024-04-21 01:40:04,958: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:40:05.197157464Z [2024-04-21 01:40:05,196: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:40:05.314012126Z [2024-04-21 01:40:05,313: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa725f80-906b-490b-9fa5-4e7b84eb6657] succeeded in 3.9712179460002517s: None 2024-04-21T01:40:05.711057051Z [2024-04-21 01:40:05,710: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:40:05.722465244Z [2024-04-21 01:40:05,721: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:40:05.791337184Z [2024-04-21 01:40:05,791: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:40:05.792998221Z [2024-04-21 01:40:05,792: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:40:05.793021784Z [2024-04-21 01:40:05,792: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:40:05.793372393Z [2024-04-21 01:40:05,793: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:40:05.793422416Z [2024-04-21 01:40:05,793: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:40:05.793785648Z [2024-04-21 01:40:05,793: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:40:05.794224685Z [2024-04-21 01:40:05,793: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:40:05.980639019Z [2024-04-21 01:40:05,980: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:40:06.257237325Z [2024-04-21 01:40:06,253: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:40:06.262136219Z [2024-04-21 01:40:06,258: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:40:06.403657301Z [2024-04-21 01:40:06,403: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:40:06.408476977Z [2024-04-21 01:40:06,408: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:40:06.408662733Z [2024-04-21 01:40:06,408: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:40:06.408963529Z [2024-04-21 01:40:06,408: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:40:06.411924986Z [2024-04-21 01:40:06,408: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:40:06.412328182Z [2024-04-21 01:40:06,412: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:40:06.412512100Z [2024-04-21 01:40:06,412: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:40:06.586989194Z [2024-04-21 01:40:06,586: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:40:06.904593019Z [2024-04-21 01:40:06,904: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f798966-52b9-4eb1-9c1c-8e91bdde8d8c] succeeded in 5.582508429999507s: None 2024-04-21T01:40:07.074485822Z [2024-04-21 01:40:07,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[592ace07-fad8-4cab-a8dd-ab907977fb78] received 2024-04-21T01:40:07.099777192Z [2024-04-21 01:40:07,099: INFO/ForkPoolWorker-15] [592ace07-fad8-4cab-a8dd-ab907977fb78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:40:07.535575238Z [2024-04-21 01:40:07,535: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6834ff6-6860-4c71-8cc3-956d5a74058f] succeeded in 6.205244410999512s: None 2024-04-21T01:40:07.741415758Z [2024-04-21 01:40:07,738: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:40:08.989575717Z [2024-04-21 01:40:08,988: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4d27e7f1-e279-41e1-b1ab-dd8dab1ee983] succeeded in 7.59163908499977s: None 2024-04-21T01:40:09.181810061Z [2024-04-21 01:40:09,181: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:40:09.185174192Z [2024-04-21 01:40:09,184: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:40:09.220794544Z [2024-04-21 01:40:09,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:40:09.222408369Z [2024-04-21 01:40:09,222: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:40:09.222558776Z [2024-04-21 01:40:09,222: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:40:09.222793333Z [2024-04-21 01:40:09,222: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:40:09.223009499Z [2024-04-21 01:40:09,222: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:40:09.223409499Z [2024-04-21 01:40:09,223: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:40:09.223584859Z [2024-04-21 01:40:09,223: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:40:09.346066071Z [2024-04-21 01:40:09,345: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:40:10.237512415Z [2024-04-21 01:40:10,237: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[592ace07-fad8-4cab-a8dd-ab907977fb78] succeeded in 3.1606975930008048s: None 2024-04-21T01:40:10.912380357Z [2024-04-21 01:40:10,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9721dac-97b7-4e93-87ac-4b69fb9d0b3f] received 2024-04-21T01:40:10.950747108Z [2024-04-21 01:40:10,950: INFO/ForkPoolWorker-15] [f9721dac-97b7-4e93-87ac-4b69fb9d0b3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:40:11.361817965Z [2024-04-21 01:40:11,357: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:40:12.817734411Z [2024-04-21 01:40:12,817: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:40:12.821991377Z [2024-04-21 01:40:12,821: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:40:12.840127411Z [2024-04-21 01:40:12,839: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:40:12.841394843Z [2024-04-21 01:40:12,841: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:40:12.841474556Z [2024-04-21 01:40:12,841: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:40:12.841616814Z [2024-04-21 01:40:12,841: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:40:12.841690886Z [2024-04-21 01:40:12,841: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:40:12.841941624Z [2024-04-21 01:40:12,841: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:40:12.842057132Z [2024-04-21 01:40:12,841: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:40:12.952821749Z [2024-04-21 01:40:12,952: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:40:13.654582525Z [2024-04-21 01:40:13,654: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9721dac-97b7-4e93-87ac-4b69fb9d0b3f] succeeded in 2.7250126559993078s: None 2024-04-21T01:40:14.433971444Z [2024-04-21 01:40:14,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47c4a703-1736-47ae-9cc1-238d1d5b0c84] received 2024-04-21T01:40:14.443350770Z [2024-04-21 01:40:14,443: INFO/ForkPoolWorker-15] [47c4a703-1736-47ae-9cc1-238d1d5b0c84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:40:14.783958531Z [2024-04-21 01:40:14,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:40:16.053567077Z [2024-04-21 01:40:16,053: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:40:16.056893943Z [2024-04-21 01:40:16,056: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:40:16.079357362Z [2024-04-21 01:40:16,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:40:16.080319651Z [2024-04-21 01:40:16,080: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:40:16.080360080Z [2024-04-21 01:40:16,080: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:40:16.080509729Z [2024-04-21 01:40:16,080: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:40:16.080572122Z [2024-04-21 01:40:16,080: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:40:16.081004865Z [2024-04-21 01:40:16,080: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:40:16.081009471Z [2024-04-21 01:40:16,080: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:40:16.164456965Z [2024-04-21 01:40:16,163: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:40:16.769741068Z [2024-04-21 01:40:16,769: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47c4a703-1736-47ae-9cc1-238d1d5b0c84] succeeded in 2.330968034999387s: None 2024-04-21T01:41:00.726614976Z [2024-04-21 01:41:00,726: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d19ea0b-1ed2-410c-bab0-a532f9d1dc04] received 2024-04-21T01:41:00.735437606Z [2024-04-21 01:41:00,735: INFO/ForkPoolWorker-15] [5d19ea0b-1ed2-410c-bab0-a532f9d1dc04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:41:00.737436504Z [2024-04-21 01:41:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54db92ee-ed16-4511-b69c-d0e8927905a5] received 2024-04-21T01:41:00.744968845Z [2024-04-21 01:41:00,744: INFO/ForkPoolWorker-16] [54db92ee-ed16-4511-b69c-d0e8927905a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:41:00.750960236Z [2024-04-21 01:41:00,750: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[190431ed-99bd-4d1a-b5d8-1e82365ed395] received 2024-04-21T01:41:00.766892331Z [2024-04-21 01:41:00,766: INFO/ForkPoolWorker-1] [190431ed-99bd-4d1a-b5d8-1e82365ed395] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:41:01.107073661Z [2024-04-21 01:41:01,099: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:41:01.179665499Z [2024-04-21 01:41:01,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:41:01.199955393Z [2024-04-21 01:41:01,190: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:41:01.543060121Z [2024-04-21 01:41:01,542: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:41:01.547230698Z [2024-04-21 01:41:01,546: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:41:01.577587396Z [2024-04-21 01:41:01,577: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:41:01.578599341Z [2024-04-21 01:41:01,578: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:41:01.578645184Z [2024-04-21 01:41:01,578: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:41:01.578708328Z [2024-04-21 01:41:01,578: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:41:01.578898388Z [2024-04-21 01:41:01,578: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:41:01.667927701Z [2024-04-21 01:41:01,667: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:41:02.209176058Z [2024-04-21 01:41:02,208: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[190431ed-99bd-4d1a-b5d8-1e82365ed395] succeeded in 1.451128118998895s: None 2024-04-21T01:41:02.618932754Z [2024-04-21 01:41:02,618: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:41:02.622462037Z [2024-04-21 01:41:02,622: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:41:02.653155841Z [2024-04-21 01:41:02,652: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:41:02.658816541Z [2024-04-21 01:41:02,658: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:41:02.659491243Z [2024-04-21 01:41:02,659: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:41:02.659779698Z [2024-04-21 01:41:02,659: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:41:02.659987054Z [2024-04-21 01:41:02,659: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:41:02.660478260Z [2024-04-21 01:41:02,660: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:41:02.664120461Z [2024-04-21 01:41:02,663: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:41:02.786690261Z [2024-04-21 01:41:02,786: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:41:02.805197021Z [2024-04-21 01:41:02,804: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:41:02.809250080Z [2024-04-21 01:41:02,808: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:41:02.856505172Z [2024-04-21 01:41:02,856: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:41:02.858162630Z [2024-04-21 01:41:02,857: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:41:02.858184091Z [2024-04-21 01:41:02,858: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:41:02.858346140Z [2024-04-21 01:41:02,858: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:41:02.858379313Z [2024-04-21 01:41:02,858: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:41:02.858773059Z [2024-04-21 01:41:02,858: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:41:02.858802736Z [2024-04-21 01:41:02,858: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:41:02.958054615Z [2024-04-21 01:41:02,957: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:41:04.702988602Z [2024-04-21 01:41:04,702: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[54db92ee-ed16-4511-b69c-d0e8927905a5] succeeded in 3.9637036210006045s: None 2024-04-21T01:41:05.610499808Z [2024-04-21 01:41:05,609: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d19ea0b-1ed2-410c-bab0-a532f9d1dc04] succeeded in 4.881572387999768s: None 2024-04-21T01:42:00.373256000Z [2024-04-21 01:42:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8bef73f-6fb3-423d-b498-b1385221655b] received 2024-04-21T01:42:00.377669893Z [2024-04-21 01:42:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc461ff8-c0d5-4656-a3b0-44922cb5e6c8] received 2024-04-21T01:42:00.382123053Z [2024-04-21 01:42:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cddb77a-6903-43b5-91b3-379a06fbd0d0] received 2024-04-21T01:42:00.384858812Z [2024-04-21 01:42:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[199941a1-176b-4fbd-9144-1ae7b31f49c6] received 2024-04-21T01:42:00.391689266Z [2024-04-21 01:42:00,391: INFO/ForkPoolWorker-16] [dc461ff8-c0d5-4656-a3b0-44922cb5e6c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:42:00.392509193Z [2024-04-21 01:42:00,392: INFO/ForkPoolWorker-15] [e8bef73f-6fb3-423d-b498-b1385221655b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:42:00.405018376Z [2024-04-21 01:42:00,404: INFO/ForkPoolWorker-1] [3cddb77a-6903-43b5-91b3-379a06fbd0d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:42:00.415276554Z [2024-04-21 01:42:00,414: INFO/ForkPoolWorker-2] [199941a1-176b-4fbd-9144-1ae7b31f49c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:42:00.850617482Z [2024-04-21 01:42:00,846: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:42:00.907056914Z [2024-04-21 01:42:00,903: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:42:00.980681064Z [2024-04-21 01:42:00,968: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:42:01.129129715Z [2024-04-21 01:42:01,106: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:42:01.257582723Z [2024-04-21 01:42:01,257: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:42:01.262904509Z [2024-04-21 01:42:01,262: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:42:01.316997406Z [2024-04-21 01:42:01,316: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:42:01.320798909Z [2024-04-21 01:42:01,320: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:42:01.321089103Z [2024-04-21 01:42:01,320: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:42:01.321333793Z [2024-04-21 01:42:01,321: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:42:01.321634182Z [2024-04-21 01:42:01,321: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:42:01.428162826Z [2024-04-21 01:42:01,427: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:42:01.547841162Z [2024-04-21 01:42:01,540: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:42:02.169153702Z [2024-04-21 01:42:02,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc461ff8-c0d5-4656-a3b0-44922cb5e6c8] succeeded in 1.7890973169996869s: None 2024-04-21T01:42:02.277439568Z [2024-04-21 01:42:02,276: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cddb77a-6903-43b5-91b3-379a06fbd0d0] succeeded in 1.8915293680001923s: None 2024-04-21T01:42:02.484133558Z [2024-04-21 01:42:02,483: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:42:02.487912590Z [2024-04-21 01:42:02,487: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:42:02.526267781Z [2024-04-21 01:42:02,525: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:42:02.527841491Z [2024-04-21 01:42:02,527: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:42:02.527879078Z [2024-04-21 01:42:02,527: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:42:02.528077385Z [2024-04-21 01:42:02,527: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:42:02.528107919Z [2024-04-21 01:42:02,527: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:42:02.528458632Z [2024-04-21 01:42:02,528: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:42:02.528481319Z [2024-04-21 01:42:02,528: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:42:02.622566848Z [2024-04-21 01:42:02,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:42:02.750448361Z [2024-04-21 01:42:02,749: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:42:02.754723021Z [2024-04-21 01:42:02,754: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:42:02.778299585Z [2024-04-21 01:42:02,778: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:42:02.779808137Z [2024-04-21 01:42:02,779: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:42:02.780252913Z [2024-04-21 01:42:02,779: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:42:02.780273318Z [2024-04-21 01:42:02,779: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:42:02.780279769Z [2024-04-21 01:42:02,780: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:42:02.780632365Z [2024-04-21 01:42:02,780: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:42:02.781229554Z [2024-04-21 01:42:02,781: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:42:02.900814964Z [2024-04-21 01:42:02,900: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:42:05.294390833Z [2024-04-21 01:42:05,293: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[199941a1-176b-4fbd-9144-1ae7b31f49c6] succeeded in 4.906021630000396s: None 2024-04-21T01:42:05.498827056Z [2024-04-21 01:42:05,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8bef73f-6fb3-423d-b498-b1385221655b] succeeded in 5.119941046001259s: None 2024-04-21T01:43:00.478678844Z [2024-04-21 01:43:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecfd50bf-ddd9-4f2e-99a0-cf3b1cf039fa] received 2024-04-21T01:43:00.480908400Z [2024-04-21 01:43:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83664fb1-cdc9-4948-85f8-d81b8aabdf3f] received 2024-04-21T01:43:00.483851382Z [2024-04-21 01:43:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[206e5656-ac25-45dc-8850-214d8d226e93] received 2024-04-21T01:43:00.494863028Z [2024-04-21 01:43:00,494: INFO/ForkPoolWorker-1] [206e5656-ac25-45dc-8850-214d8d226e93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:43:00.501035810Z [2024-04-21 01:43:00,500: INFO/ForkPoolWorker-16] [83664fb1-cdc9-4948-85f8-d81b8aabdf3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:43:00.501885903Z [2024-04-21 01:43:00,501: INFO/ForkPoolWorker-15] [ecfd50bf-ddd9-4f2e-99a0-cf3b1cf039fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:43:00.815253529Z [2024-04-21 01:43:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:43:00.850434760Z [2024-04-21 01:43:00,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:43:00.861132629Z [2024-04-21 01:43:00,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:43:01.031579671Z [2024-04-21 01:43:01,031: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T01:43:01.036025645Z [2024-04-21 01:43:01,035: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:43:01.082055742Z [2024-04-21 01:43:01,081: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:43:01.083858084Z [2024-04-21 01:43:01,083: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:43:01.083872821Z [2024-04-21 01:43:01,083: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:43:01.083877075Z [2024-04-21 01:43:01,083: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T01:43:01.086504032Z [2024-04-21 01:43:01,083: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:43:01.198768477Z [2024-04-21 01:43:01,198: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:43:01.831947453Z [2024-04-21 01:43:01,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ecfd50bf-ddd9-4f2e-99a0-cf3b1cf039fa] succeeded in 1.348433727000156s: None 2024-04-21T01:43:02.107209577Z [2024-04-21 01:43:02,106: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:43:02.110932637Z [2024-04-21 01:43:02,110: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:43:02.131059036Z [2024-04-21 01:43:02,130: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:43:02.132325100Z [2024-04-21 01:43:02,132: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:43:02.132437477Z [2024-04-21 01:43:02,132: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:43:02.132633535Z [2024-04-21 01:43:02,132: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:43:02.132752922Z [2024-04-21 01:43:02,132: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:43:02.133038942Z [2024-04-21 01:43:02,132: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:43:02.133164352Z [2024-04-21 01:43:02,132: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:43:02.221932193Z [2024-04-21 01:43:02,221: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:43:02.316394885Z [2024-04-21 01:43:02,315: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:43:02.320005374Z [2024-04-21 01:43:02,319: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:43:02.349998059Z [2024-04-21 01:43:02,349: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:43:02.351635549Z [2024-04-21 01:43:02,351: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:43:02.351875517Z [2024-04-21 01:43:02,351: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:43:02.352176675Z [2024-04-21 01:43:02,351: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:43:02.352468163Z [2024-04-21 01:43:02,352: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:43:02.353072413Z [2024-04-21 01:43:02,352: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:43:02.353337696Z [2024-04-21 01:43:02,353: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:43:02.456227423Z [2024-04-21 01:43:02,455: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:43:03.939070825Z [2024-04-21 01:43:03,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83664fb1-cdc9-4948-85f8-d81b8aabdf3f] succeeded in 3.4519012429991562s: None 2024-04-21T01:43:04.243959486Z [2024-04-21 01:43:04,243: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[206e5656-ac25-45dc-8850-214d8d226e93] succeeded in 3.7580740609992063s: None 2024-04-21T01:44:00.429377488Z [2024-04-21 01:44:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[445fcc95-816e-44be-b595-0cbb0b58543c] received 2024-04-21T01:44:00.434939984Z [2024-04-21 01:44:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2883e380-5ab8-491a-86ed-6df47338cfb6] received 2024-04-21T01:44:00.444191941Z [2024-04-21 01:44:00,443: INFO/ForkPoolWorker-16] [2883e380-5ab8-491a-86ed-6df47338cfb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:44:00.445180620Z [2024-04-21 01:44:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64ef6c15-db3c-4c32-810d-0ddbb93017f9] received 2024-04-21T01:44:00.450523979Z [2024-04-21 01:44:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[805854b0-4dfb-4293-b81d-02cfb4df4cfb] received 2024-04-21T01:44:00.461561201Z [2024-04-21 01:44:00,461: INFO/ForkPoolWorker-1] [64ef6c15-db3c-4c32-810d-0ddbb93017f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:44:00.464665493Z [2024-04-21 01:44:00,464: INFO/ForkPoolWorker-2] [805854b0-4dfb-4293-b81d-02cfb4df4cfb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:44:00.467515153Z [2024-04-21 01:44:00,467: INFO/ForkPoolWorker-15] [445fcc95-816e-44be-b595-0cbb0b58543c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:44:00.794773151Z [2024-04-21 01:44:00,791: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:44:00.930410259Z [2024-04-21 01:44:00,926: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:44:00.956626839Z [2024-04-21 01:44:00,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:44:01.011177710Z [2024-04-21 01:44:01,007: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:44:01.219345551Z [2024-04-21 01:44:01,218: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:44:01.226104327Z [2024-04-21 01:44:01,225: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:44:01.265663468Z [2024-04-21 01:44:01,265: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:44:01.266871313Z [2024-04-21 01:44:01,266: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:44:01.267155245Z [2024-04-21 01:44:01,266: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:44:01.267316275Z [2024-04-21 01:44:01,267: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:44:01.267625493Z [2024-04-21 01:44:01,267: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:44:01.280992305Z [2024-04-21 01:44:01,280: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:44:01.407206261Z [2024-04-21 01:44:01,406: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:44:02.082043604Z [2024-04-21 01:44:02,081: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[445fcc95-816e-44be-b595-0cbb0b58543c] succeeded in 1.6429224650000833s: None 2024-04-21T01:44:02.199207330Z [2024-04-21 01:44:02,198: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64ef6c15-db3c-4c32-810d-0ddbb93017f9] succeeded in 1.752240443998744s: None 2024-04-21T01:44:02.240184878Z [2024-04-21 01:44:02,239: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:44:02.243761515Z [2024-04-21 01:44:02,243: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:44:02.277998206Z [2024-04-21 01:44:02,277: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:44:02.280170978Z [2024-04-21 01:44:02,279: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:44:02.280203895Z [2024-04-21 01:44:02,280: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:44:02.280345602Z [2024-04-21 01:44:02,280: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:44:02.280540122Z [2024-04-21 01:44:02,280: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:44:02.280925498Z [2024-04-21 01:44:02,280: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:44:02.281170441Z [2024-04-21 01:44:02,280: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:44:02.369769060Z [2024-04-21 01:44:02,369: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:44:02.747875239Z [2024-04-21 01:44:02,747: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:44:02.752693595Z [2024-04-21 01:44:02,751: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:44:02.787717187Z [2024-04-21 01:44:02,787: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:44:02.793769687Z [2024-04-21 01:44:02,793: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:44:02.793798507Z [2024-04-21 01:44:02,793: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:44:02.793972949Z [2024-04-21 01:44:02,793: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:44:02.794034646Z [2024-04-21 01:44:02,793: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:44:02.794621026Z [2024-04-21 01:44:02,794: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:44:02.794673764Z [2024-04-21 01:44:02,794: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:44:02.904403643Z [2024-04-21 01:44:02,904: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:44:03.916506664Z [2024-04-21 01:44:03,916: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[805854b0-4dfb-4293-b81d-02cfb4df4cfb] succeeded in 3.4599640640008147s: None 2024-04-21T01:44:04.959827684Z [2024-04-21 01:44:04,959: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2883e380-5ab8-491a-86ed-6df47338cfb6] succeeded in 4.522925473998839s: None 2024-04-21T01:45:00.525882318Z [2024-04-21 01:45:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c096f44a-c185-40ad-8c02-953f009574cc] received 2024-04-21T01:45:00.535449567Z [2024-04-21 01:45:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3fac3c9-9ee7-446b-b039-3f7535ba4826] received 2024-04-21T01:45:00.547811449Z [2024-04-21 01:45:00,547: INFO/ForkPoolWorker-16] [f3fac3c9-9ee7-446b-b039-3f7535ba4826] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:45:00.553517328Z [2024-04-21 01:45:00,553: INFO/ForkPoolWorker-15] [c096f44a-c185-40ad-8c02-953f009574cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:45:00.613954747Z [2024-04-21 01:45:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c737e71d-d714-487e-b4f0-80e176964933] received 2024-04-21T01:45:00.616772089Z [2024-04-21 01:45:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62a599c4-0f9a-408d-a4b3-a3c451d3e345] received 2024-04-21T01:45:00.645728543Z [2024-04-21 01:45:00,645: INFO/ForkPoolWorker-2] [62a599c4-0f9a-408d-a4b3-a3c451d3e345] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:45:00.675212743Z [2024-04-21 01:45:00,667: INFO/ForkPoolWorker-1] [c737e71d-d714-487e-b4f0-80e176964933] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:45:01.019815261Z [2024-04-21 01:45:01,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:45:01.147765829Z [2024-04-21 01:45:01,143: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:45:01.760359609Z [2024-04-21 01:45:01,751: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:45:01.804759691Z [2024-04-21 01:45:01,785: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:45:01.972355699Z [2024-04-21 01:45:01,971: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:45:01.976905153Z [2024-04-21 01:45:01,976: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:45:02.044393007Z [2024-04-21 01:45:02,044: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:45:02.052437026Z [2024-04-21 01:45:02,052: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:45:02.052585869Z [2024-04-21 01:45:02,052: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:45:02.052650116Z [2024-04-21 01:45:02,052: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:45:02.053041985Z [2024-04-21 01:45:02,052: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:45:02.156629262Z [2024-04-21 01:45:02,156: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:45:03.012852489Z [2024-04-21 01:45:03,012: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:45:03.016127180Z [2024-04-21 01:45:03,015: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:45:03.055221041Z [2024-04-21 01:45:03,053: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:45:03.066467528Z [2024-04-21 01:45:03,066: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:45:03.072192113Z [2024-04-21 01:45:03,066: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:45:03.076011549Z [2024-04-21 01:45:03,072: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:45:03.076197431Z [2024-04-21 01:45:03,075: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:45:03.076567480Z [2024-04-21 01:45:03,076: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:45:03.080045993Z [2024-04-21 01:45:03,076: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:45:03.129297207Z [2024-04-21 01:45:03,128: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c737e71d-d714-487e-b4f0-80e176964933] succeeded in 2.5119232030010608s: None 2024-04-21T01:45:03.411530833Z [2024-04-21 01:45:03,411: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:45:03.689689717Z [2024-04-21 01:45:03,689: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:45:03.694988953Z [2024-04-21 01:45:03,694: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:45:03.731427043Z [2024-04-21 01:45:03,731: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:45:03.735095752Z [2024-04-21 01:45:03,733: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:45:03.735210933Z [2024-04-21 01:45:03,735: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:45:03.735388262Z [2024-04-21 01:45:03,735: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:45:03.735507661Z [2024-04-21 01:45:03,735: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:45:03.735859756Z [2024-04-21 01:45:03,735: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:45:03.736508980Z [2024-04-21 01:45:03,736: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:45:03.831763614Z [2024-04-21 01:45:03,830: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:45:03.839785090Z [2024-04-21 01:45:03,838: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:45:03.855758442Z [2024-04-21 01:45:03,854: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:45:04.024481109Z [2024-04-21 01:45:04,024: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:45:04.030279026Z [2024-04-21 01:45:04,029: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:45:04.030470800Z [2024-04-21 01:45:04,030: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:45:04.030799767Z [2024-04-21 01:45:04,030: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:45:04.030816279Z [2024-04-21 01:45:04,030: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:45:04.031464701Z [2024-04-21 01:45:04,031: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:45:04.031517351Z [2024-04-21 01:45:04,031: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:45:04.288913402Z [2024-04-21 01:45:04,288: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:45:05.003978466Z [2024-04-21 01:45:05,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c096f44a-c185-40ad-8c02-953f009574cc] succeeded in 4.475058156000159s: None 2024-04-21T01:45:05.844810885Z [2024-04-21 01:45:05,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eff963b0-9bd6-442d-a1b9-5cf65b4f613e] received 2024-04-21T01:45:05.859503456Z [2024-04-21 01:45:05,859: INFO/ForkPoolWorker-15] [eff963b0-9bd6-442d-a1b9-5cf65b4f613e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:45:06.019442302Z [2024-04-21 01:45:06,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3fac3c9-9ee7-446b-b039-3f7535ba4826] succeeded in 5.481824546999633s: None 2024-04-21T01:45:06.102760221Z [2024-04-21 01:45:06,102: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[62a599c4-0f9a-408d-a4b3-a3c451d3e345] succeeded in 5.4789656679986365s: None 2024-04-21T01:45:06.383451404Z [2024-04-21 01:45:06,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:45:07.653770958Z [2024-04-21 01:45:07,653: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:45:07.657758758Z [2024-04-21 01:45:07,657: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:45:07.683663006Z [2024-04-21 01:45:07,683: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:45:07.685353066Z [2024-04-21 01:45:07,685: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:45:07.685386172Z [2024-04-21 01:45:07,685: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:45:07.685550933Z [2024-04-21 01:45:07,685: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:45:07.685580052Z [2024-04-21 01:45:07,685: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:45:07.685893982Z [2024-04-21 01:45:07,685: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:45:07.685940282Z [2024-04-21 01:45:07,685: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:45:07.776081682Z [2024-04-21 01:45:07,775: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:45:08.434423077Z [2024-04-21 01:45:08,433: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eff963b0-9bd6-442d-a1b9-5cf65b4f613e] succeeded in 2.587477924000268s: None 2024-04-21T01:45:08.713058628Z [2024-04-21 01:45:08,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c668dbe-26db-412f-be8b-747563496827] received 2024-04-21T01:45:08.728147057Z [2024-04-21 01:45:08,727: INFO/ForkPoolWorker-15] [8c668dbe-26db-412f-be8b-747563496827] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:45:09.015772414Z [2024-04-21 01:45:09,012: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:45:10.261729585Z [2024-04-21 01:45:10,261: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:45:10.265194993Z [2024-04-21 01:45:10,264: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:45:10.291973752Z [2024-04-21 01:45:10,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:45:10.294370373Z [2024-04-21 01:45:10,294: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:45:10.294601016Z [2024-04-21 01:45:10,294: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:45:10.294935301Z [2024-04-21 01:45:10,294: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:45:10.295134760Z [2024-04-21 01:45:10,294: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:45:10.295655661Z [2024-04-21 01:45:10,295: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:45:10.295855723Z [2024-04-21 01:45:10,295: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:45:10.386287227Z [2024-04-21 01:45:10,385: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:45:11.043600223Z [2024-04-21 01:45:11,042: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c668dbe-26db-412f-be8b-747563496827] succeeded in 2.3274048479997873s: None 2024-04-21T01:45:11.069535626Z [2024-04-21 01:45:11,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ab3e929-7006-44a8-9eed-250a379acdf2] received 2024-04-21T01:45:11.082909778Z [2024-04-21 01:45:11,082: INFO/ForkPoolWorker-15] [4ab3e929-7006-44a8-9eed-250a379acdf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:45:11.410846515Z [2024-04-21 01:45:11,405: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:45:12.943673473Z [2024-04-21 01:45:12,943: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:45:12.947086106Z [2024-04-21 01:45:12,946: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:45:12.984843102Z [2024-04-21 01:45:12,984: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:45:12.988763544Z [2024-04-21 01:45:12,988: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:45:12.988852025Z [2024-04-21 01:45:12,988: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:45:12.989170102Z [2024-04-21 01:45:12,988: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:45:12.989297239Z [2024-04-21 01:45:12,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:45:12.989599898Z [2024-04-21 01:45:12,989: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:45:12.989726011Z [2024-04-21 01:45:12,989: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:45:13.143437805Z [2024-04-21 01:45:13,143: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:45:14.146809811Z [2024-04-21 01:45:14,146: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ab3e929-7006-44a8-9eed-250a379acdf2] succeeded in 3.0750716069996997s: None 2024-04-21T01:46:00.899050813Z [2024-04-21 01:46:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53110812-75e9-4487-aa09-86530043eeba] received 2024-04-21T01:46:00.903617127Z [2024-04-21 01:46:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aebe67f-d0bf-4c78-bc10-635d368529ee] received 2024-04-21T01:46:00.909929073Z [2024-04-21 01:46:00,909: INFO/ForkPoolWorker-15] [53110812-75e9-4487-aa09-86530043eeba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:46:00.918970303Z [2024-04-21 01:46:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be279a87-2fc6-4c0e-a1ce-eee5ae8c0c4b] received 2024-04-21T01:46:00.922606426Z [2024-04-21 01:46:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a95f959e-50f6-4cd1-b475-bcc31ec20da5] received 2024-04-21T01:46:00.933779375Z [2024-04-21 01:46:00,933: INFO/ForkPoolWorker-16] [5aebe67f-d0bf-4c78-bc10-635d368529ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:46:00.934419751Z [2024-04-21 01:46:00,934: INFO/ForkPoolWorker-2] [a95f959e-50f6-4cd1-b475-bcc31ec20da5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:46:00.945989982Z [2024-04-21 01:46:00,945: INFO/ForkPoolWorker-1] [be279a87-2fc6-4c0e-a1ce-eee5ae8c0c4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:46:01.373485833Z [2024-04-21 01:46:01,368: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:46:01.482821425Z [2024-04-21 01:46:01,477: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:46:01.717577868Z [2024-04-21 01:46:01,714: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:46:02.010615678Z [2024-04-21 01:46:01,973: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:46:02.186810781Z [2024-04-21 01:46:02,186: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:46:02.193654891Z [2024-04-21 01:46:02,193: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T01:46:02.201034435Z [2024-04-21 01:46:02,200: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:46:02.242473952Z [2024-04-21 01:46:02,242: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:46:02.248648318Z [2024-04-21 01:46:02,248: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:46:02.248811483Z [2024-04-21 01:46:02,248: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:46:02.248891802Z [2024-04-21 01:46:02,248: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T01:46:02.249261728Z [2024-04-21 01:46:02,249: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:46:02.446872551Z [2024-04-21 01:46:02,446: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:46:03.166701758Z [2024-04-21 01:46:03,166: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[be279a87-2fc6-4c0e-a1ce-eee5ae8c0c4b] succeeded in 2.242393345999517s: None 2024-04-21T01:46:03.316563974Z [2024-04-21 01:46:03,316: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53110812-75e9-4487-aa09-86530043eeba] succeeded in 2.4145321209998656s: None 2024-04-21T01:46:03.701550354Z [2024-04-21 01:46:03,701: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:46:03.707122258Z [2024-04-21 01:46:03,706: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:46:03.746418240Z [2024-04-21 01:46:03,746: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:46:03.751305384Z [2024-04-21 01:46:03,751: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:46:03.751328181Z [2024-04-21 01:46:03,751: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:46:03.751414038Z [2024-04-21 01:46:03,751: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:46:03.751431196Z [2024-04-21 01:46:03,751: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:46:03.754425267Z [2024-04-21 01:46:03,751: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:46:03.754497169Z [2024-04-21 01:46:03,754: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:46:03.820582282Z [2024-04-21 01:46:03,815: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:46:03.823798488Z [2024-04-21 01:46:03,821: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:46:03.874938352Z [2024-04-21 01:46:03,873: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:46:03.886941056Z [2024-04-21 01:46:03,886: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:46:03.887494696Z [2024-04-21 01:46:03,886: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:46:03.887502892Z [2024-04-21 01:46:03,886: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:46:03.895788903Z [2024-04-21 01:46:03,886: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:46:03.895811707Z [2024-04-21 01:46:03,887: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:46:03.895815139Z [2024-04-21 01:46:03,887: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:46:03.915371068Z [2024-04-21 01:46:03,906: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:46:04.033928227Z [2024-04-21 01:46:04,033: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:46:05.406822224Z [2024-04-21 01:46:05,406: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5aebe67f-d0bf-4c78-bc10-635d368529ee] succeeded in 4.497446229999696s: None 2024-04-21T01:46:05.989343869Z [2024-04-21 01:46:05,988: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a95f959e-50f6-4cd1-b475-bcc31ec20da5] succeeded in 5.064478054999199s: None 2024-04-21T01:47:01.015340689Z [2024-04-21 01:47:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2542636d-438b-40eb-94a4-5092913d7756] received 2024-04-21T01:47:01.020793293Z [2024-04-21 01:47:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b51ebaa7-db13-446c-9e2a-541887cb607d] received 2024-04-21T01:47:01.022245819Z [2024-04-21 01:47:01,021: INFO/ForkPoolWorker-15] [2542636d-438b-40eb-94a4-5092913d7756] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:47:01.030987835Z [2024-04-21 01:47:01,030: INFO/ForkPoolWorker-16] [b51ebaa7-db13-446c-9e2a-541887cb607d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:47:01.031336281Z [2024-04-21 01:47:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bb1c4ef-da09-4637-acb3-27b31d15ab1d] received 2024-04-21T01:47:01.037862643Z [2024-04-21 01:47:01,037: INFO/ForkPoolWorker-1] [6bb1c4ef-da09-4637-acb3-27b31d15ab1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:47:01.378858190Z [2024-04-21 01:47:01,375: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:47:01.459755247Z [2024-04-21 01:47:01,456: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:47:01.583386684Z [2024-04-21 01:47:01,579: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:47:01.673234318Z [2024-04-21 01:47:01,672: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:47:01.681565095Z [2024-04-21 01:47:01,681: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:47:01.742376638Z [2024-04-21 01:47:01,742: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:47:01.745873072Z [2024-04-21 01:47:01,745: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:47:01.745981353Z [2024-04-21 01:47:01,745: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:47:01.746162778Z [2024-04-21 01:47:01,745: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:47:01.746998118Z [2024-04-21 01:47:01,746: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:47:01.847592695Z [2024-04-21 01:47:01,847: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:47:02.537398048Z [2024-04-21 01:47:02,536: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6bb1c4ef-da09-4637-acb3-27b31d15ab1d] succeeded in 1.5041127019994747s: None 2024-04-21T01:47:02.809225441Z [2024-04-21 01:47:02,808: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:47:02.813793928Z [2024-04-21 01:47:02,813: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:47:02.844587860Z [2024-04-21 01:47:02,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:47:02.849107644Z [2024-04-21 01:47:02,848: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:47:02.849193381Z [2024-04-21 01:47:02,848: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:47:02.849545463Z [2024-04-21 01:47:02,849: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:47:02.849722768Z [2024-04-21 01:47:02,849: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:47:02.850208377Z [2024-04-21 01:47:02,850: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:47:02.850403539Z [2024-04-21 01:47:02,850: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:47:02.963084608Z [2024-04-21 01:47:02,962: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:47:03.270333132Z [2024-04-21 01:47:03,269: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:47:03.273763169Z [2024-04-21 01:47:03,273: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:47:03.305748535Z [2024-04-21 01:47:03,305: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:47:03.307300396Z [2024-04-21 01:47:03,307: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:47:03.307535123Z [2024-04-21 01:47:03,307: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:47:03.307828642Z [2024-04-21 01:47:03,307: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:47:03.307997973Z [2024-04-21 01:47:03,307: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:47:03.308399730Z [2024-04-21 01:47:03,308: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:47:03.309127152Z [2024-04-21 01:47:03,308: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:47:03.394539746Z [2024-04-21 01:47:03,394: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:47:07.003435619Z [2024-04-21 01:47:07,002: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b51ebaa7-db13-446c-9e2a-541887cb607d] succeeded in 5.980880888000684s: None 2024-04-21T01:47:07.487007246Z [2024-04-21 01:47:07,486: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2542636d-438b-40eb-94a4-5092913d7756] succeeded in 6.4696215509993635s: None 2024-04-21T01:48:00.918912714Z [2024-04-21 01:48:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbc30e60-cfee-4642-b8ea-e29bf2814cb0] received 2024-04-21T01:48:00.932804654Z [2024-04-21 01:48:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3e540ca-e703-44db-aba3-9dc83b62c5b5] received 2024-04-21T01:48:00.935185537Z [2024-04-21 01:48:00,934: INFO/ForkPoolWorker-15] [dbc30e60-cfee-4642-b8ea-e29bf2814cb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:48:00.943991443Z [2024-04-21 01:48:00,943: INFO/ForkPoolWorker-16] [a3e540ca-e703-44db-aba3-9dc83b62c5b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:48:00.950864516Z [2024-04-21 01:48:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3120cb52-5662-4165-b3bd-c7f162d0c355] received 2024-04-21T01:48:00.957584875Z [2024-04-21 01:48:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e527f881-d076-4373-ba08-f60e7ab2c84c] received 2024-04-21T01:48:00.969087756Z [2024-04-21 01:48:00,968: INFO/ForkPoolWorker-1] [3120cb52-5662-4165-b3bd-c7f162d0c355] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:48:00.984515460Z [2024-04-21 01:48:00,984: INFO/ForkPoolWorker-2] [e527f881-d076-4373-ba08-f60e7ab2c84c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:48:01.326111466Z [2024-04-21 01:48:01,322: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:48:01.451301390Z [2024-04-21 01:48:01,447: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:48:01.537912337Z [2024-04-21 01:48:01,534: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:48:01.540004107Z [2024-04-21 01:48:01,539: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:48:01.575618320Z [2024-04-21 01:48:01,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:48:01.579133038Z [2024-04-21 01:48:01,578: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:48:01.579338064Z [2024-04-21 01:48:01,579: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:48:01.579508283Z [2024-04-21 01:48:01,579: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:48:01.579955941Z [2024-04-21 01:48:01,579: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:48:01.674208927Z [2024-04-21 01:48:01,673: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:48:01.718581407Z [2024-04-21 01:48:01,715: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:48:01.774899389Z [2024-04-21 01:48:01,771: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:48:01.801225969Z [2024-04-21 01:48:01,800: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:48:02.459254615Z [2024-04-21 01:48:02,458: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3e540ca-e703-44db-aba3-9dc83b62c5b5] succeeded in 1.5220527269993909s: None 2024-04-21T01:48:02.583943229Z [2024-04-21 01:48:02,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dbc30e60-cfee-4642-b8ea-e29bf2814cb0] succeeded in 1.662820075000127s: None 2024-04-21T01:48:03.231915884Z [2024-04-21 01:48:03,231: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:48:03.235491837Z [2024-04-21 01:48:03,235: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:48:03.237805059Z [2024-04-21 01:48:03,237: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:48:03.241058001Z [2024-04-21 01:48:03,240: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:48:03.258325235Z [2024-04-21 01:48:03,258: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:48:03.260946499Z [2024-04-21 01:48:03,260: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:48:03.260961478Z [2024-04-21 01:48:03,260: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:48:03.261086740Z [2024-04-21 01:48:03,260: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:48:03.261105042Z [2024-04-21 01:48:03,261: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:48:03.261381656Z [2024-04-21 01:48:03,261: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:48:03.261446873Z [2024-04-21 01:48:03,261: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:48:03.265602326Z [2024-04-21 01:48:03,265: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:48:03.266953122Z [2024-04-21 01:48:03,266: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:48:03.267079732Z [2024-04-21 01:48:03,266: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:48:03.267227759Z [2024-04-21 01:48:03,267: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:48:03.267300290Z [2024-04-21 01:48:03,267: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:48:03.268604507Z [2024-04-21 01:48:03,267: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:48:03.268621231Z [2024-04-21 01:48:03,267: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:48:03.361628784Z [2024-04-21 01:48:03,361: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:48:03.369394314Z [2024-04-21 01:48:03,368: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:48:05.439952017Z [2024-04-21 01:48:05,439: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e527f881-d076-4373-ba08-f60e7ab2c84c] succeeded in 4.474047965999489s: None 2024-04-21T01:48:06.071311236Z [2024-04-21 01:48:06,070: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3120cb52-5662-4165-b3bd-c7f162d0c355] succeeded in 5.11826517100053s: None 2024-04-21T01:49:00.966820780Z [2024-04-21 01:49:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[853f0583-bf2b-4345-9f56-8178f98cc08f] received 2024-04-21T01:49:00.976300906Z [2024-04-21 01:49:00,975: INFO/ForkPoolWorker-15] [853f0583-bf2b-4345-9f56-8178f98cc08f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:49:00.979896956Z [2024-04-21 01:49:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47321699-4a18-4e98-960c-a07999b0ca25] received 2024-04-21T01:49:00.992995968Z [2024-04-21 01:49:00,992: INFO/ForkPoolWorker-16] [47321699-4a18-4e98-960c-a07999b0ca25] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:49:00.998475079Z [2024-04-21 01:49:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[010759dd-5925-469e-ae7c-8e3b5bc33b9a] received 2024-04-21T01:49:01.018182985Z [2024-04-21 01:49:01,017: INFO/ForkPoolWorker-1] [010759dd-5925-469e-ae7c-8e3b5bc33b9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:49:01.300825501Z [2024-04-21 01:49:01,297: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:49:01.409281106Z [2024-04-21 01:49:01,405: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:49:01.438324005Z [2024-04-21 01:49:01,434: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:49:01.579797737Z [2024-04-21 01:49:01,576: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:49:01.581280366Z [2024-04-21 01:49:01,580: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:49:01.626490934Z [2024-04-21 01:49:01,626: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:49:01.628649850Z [2024-04-21 01:49:01,628: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:49:01.629005172Z [2024-04-21 01:49:01,628: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:49:01.629313580Z [2024-04-21 01:49:01,629: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:49:01.629878020Z [2024-04-21 01:49:01,629: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:49:01.721438388Z [2024-04-21 01:49:01,721: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:49:02.287959271Z [2024-04-21 01:49:02,287: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[47321699-4a18-4e98-960c-a07999b0ca25] succeeded in 1.3084951040000306s: None 2024-04-21T01:49:02.684690618Z [2024-04-21 01:49:02,684: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:49:02.688379549Z [2024-04-21 01:49:02,687: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:49:02.725033028Z [2024-04-21 01:49:02,724: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:49:02.729237240Z [2024-04-21 01:49:02,728: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:49:02.729593587Z [2024-04-21 01:49:02,729: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:49:02.729940551Z [2024-04-21 01:49:02,729: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:49:02.730137584Z [2024-04-21 01:49:02,729: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:49:02.730705259Z [2024-04-21 01:49:02,730: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:49:02.730937419Z [2024-04-21 01:49:02,730: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:49:02.825627058Z [2024-04-21 01:49:02,825: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:49:02.829228354Z [2024-04-21 01:49:02,828: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:49:02.832599067Z [2024-04-21 01:49:02,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:49:02.853717909Z [2024-04-21 01:49:02,852: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:49:02.853971921Z [2024-04-21 01:49:02,853: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:49:02.853999873Z [2024-04-21 01:49:02,853: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:49:02.854130117Z [2024-04-21 01:49:02,853: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:49:02.854160789Z [2024-04-21 01:49:02,854: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:49:02.854528587Z [2024-04-21 01:49:02,854: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:49:02.854570020Z [2024-04-21 01:49:02,854: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:49:02.945990383Z [2024-04-21 01:49:02,945: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:49:05.623688030Z [2024-04-21 01:49:05,623: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[010759dd-5925-469e-ae7c-8e3b5bc33b9a] succeeded in 4.615223884999068s: None 2024-04-21T01:49:06.059045017Z [2024-04-21 01:49:06,058: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[853f0583-bf2b-4345-9f56-8178f98cc08f] succeeded in 5.090036313999008s: None 2024-04-21T01:50:00.616969009Z [2024-04-21 01:50:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e7ff293-617e-4355-8efc-901a5814c005] received 2024-04-21T01:50:00.628655856Z [2024-04-21 01:50:00,628: INFO/ForkPoolWorker-15] [4e7ff293-617e-4355-8efc-901a5814c005] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:50:00.634652396Z [2024-04-21 01:50:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bba91d0a-dc20-4ebc-bb54-11b98f235072] received 2024-04-21T01:50:00.648904163Z [2024-04-21 01:50:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86e27e98-7041-4a6f-b0fa-099bf23b1d29] received 2024-04-21T01:50:00.652929242Z [2024-04-21 01:50:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cebb504d-d1a6-422b-b04d-21fc1e8e90a2] received 2024-04-21T01:50:00.662542341Z [2024-04-21 01:50:00,662: INFO/ForkPoolWorker-1] [86e27e98-7041-4a6f-b0fa-099bf23b1d29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:50:00.666007860Z [2024-04-21 01:50:00,664: INFO/ForkPoolWorker-16] [bba91d0a-dc20-4ebc-bb54-11b98f235072] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:50:00.669319088Z [2024-04-21 01:50:00,668: INFO/ForkPoolWorker-2] [cebb504d-d1a6-422b-b04d-21fc1e8e90a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:50:00.674859181Z [2024-04-21 01:50:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3a02914-7b39-407d-803e-635f503525a0] received 2024-04-21T01:50:00.699288792Z [2024-04-21 01:50:00,698: INFO/ForkPoolWorker-3] [e3a02914-7b39-407d-803e-635f503525a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:50:01.099836588Z [2024-04-21 01:50:01,095: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:50:01.127841606Z [2024-04-21 01:50:01,122: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:50:01.202318878Z [2024-04-21 01:50:01,192: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:50:01.210123853Z [2024-04-21 01:50:01,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:50:01.323413571Z [2024-04-21 01:50:01,319: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:50:01.593136051Z [2024-04-21 01:50:01,592: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:50:01.642977829Z [2024-04-21 01:50:01,642: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:50:01.647415976Z [2024-04-21 01:50:01,646: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:50:01.701559476Z [2024-04-21 01:50:01,701: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:50:01.708613119Z [2024-04-21 01:50:01,708: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:50:01.708792865Z [2024-04-21 01:50:01,708: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:50:01.708908938Z [2024-04-21 01:50:01,708: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:50:01.709171527Z [2024-04-21 01:50:01,709: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:50:01.809515686Z [2024-04-21 01:50:01,809: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:50:02.414712448Z [2024-04-21 01:50:02,414: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cebb504d-d1a6-422b-b04d-21fc1e8e90a2] succeeded in 1.7592377590008255s: None 2024-04-21T01:50:02.648684233Z [2024-04-21 01:50:02,648: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:50:02.652222626Z [2024-04-21 01:50:02,651: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:50:02.692468125Z [2024-04-21 01:50:02,692: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:50:02.694710564Z [2024-04-21 01:50:02,694: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:50:02.695425494Z [2024-04-21 01:50:02,694: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:50:02.698060393Z [2024-04-21 01:50:02,697: INFO/ForkPoolWorker-1] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:50:02.699241516Z [2024-04-21 01:50:02,698: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:50:02.699533121Z [2024-04-21 01:50:02,699: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:50:02.700200994Z [2024-04-21 01:50:02,699: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:50:02.701200446Z [2024-04-21 01:50:02,700: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:50:02.720075455Z [2024-04-21 01:50:02,719: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:50:02.756801314Z [2024-04-21 01:50:02,756: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:50:02.760571888Z [2024-04-21 01:50:02,760: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:50:02.781543679Z [2024-04-21 01:50:02,781: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bba91d0a-dc20-4ebc-bb54-11b98f235072] succeeded in 2.132109694000974s: None 2024-04-21T01:50:02.795338391Z [2024-04-21 01:50:02,795: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:50:02.798730833Z [2024-04-21 01:50:02,798: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:50:02.799488610Z [2024-04-21 01:50:02,798: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:50:02.801155538Z [2024-04-21 01:50:02,800: INFO/ForkPoolWorker-15] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:50:02.801402928Z [2024-04-21 01:50:02,801: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:50:02.802485908Z [2024-04-21 01:50:02,801: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:50:02.802970971Z [2024-04-21 01:50:02,802: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:50:02.803116129Z [2024-04-21 01:50:02,802: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:50:02.807767268Z [2024-04-21 01:50:02,807: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:50:02.826394573Z [2024-04-21 01:50:02,826: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:50:02.895134288Z [2024-04-21 01:50:02,894: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:50:03.055301277Z [2024-04-21 01:50:03,054: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T01:50:03.060415256Z [2024-04-21 01:50:03,059: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:50:03.085972688Z [2024-04-21 01:50:03,085: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T01:50:03.088186003Z [2024-04-21 01:50:03,087: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:50:03.088281325Z [2024-04-21 01:50:03,088: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:50:03.088428678Z [2024-04-21 01:50:03,088: INFO/ForkPoolWorker-3] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:50:03.088977733Z [2024-04-21 01:50:03,088: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:50:03.088990507Z [2024-04-21 01:50:03,088: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T01:50:03.088995722Z [2024-04-21 01:50:03,088: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:50:03.089460481Z [2024-04-21 01:50:03,088: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:50:03.095179814Z [2024-04-21 01:50:03,094: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:50:03.225405260Z [2024-04-21 01:50:03,224: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:50:03.603350139Z [2024-04-21 01:50:03,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73e9902f-8457-4a2e-b655-31788e31aa10] received 2024-04-21T01:50:03.618702588Z [2024-04-21 01:50:03,618: INFO/ForkPoolWorker-16] [73e9902f-8457-4a2e-b655-31788e31aa10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:50:03.669658410Z [2024-04-21 01:50:03,669: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86e27e98-7041-4a6f-b0fa-099bf23b1d29] succeeded in 3.0187345419999474s: None 2024-04-21T01:50:04.107273516Z [2024-04-21 01:50:04,104: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:50:04.855793475Z [2024-04-21 01:50:04,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e7ff293-617e-4355-8efc-901a5814c005] succeeded in 4.2326301250013785s: None 2024-04-21T01:50:05.034614693Z [2024-04-21 01:50:05,034: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e3a02914-7b39-407d-803e-635f503525a0] succeeded in 4.356631004000519s: None 2024-04-21T01:50:05.395746266Z [2024-04-21 01:50:05,395: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:50:05.398853548Z [2024-04-21 01:50:05,398: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:50:05.424614988Z [2024-04-21 01:50:05,424: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:50:05.426399100Z [2024-04-21 01:50:05,426: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:50:05.426725476Z [2024-04-21 01:50:05,426: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:50:05.426797805Z [2024-04-21 01:50:05,426: INFO/ForkPoolWorker-16] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:50:05.427154049Z [2024-04-21 01:50:05,426: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:50:05.427386269Z [2024-04-21 01:50:05,427: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:50:05.428155843Z [2024-04-21 01:50:05,427: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:50:05.428399845Z [2024-04-21 01:50:05,428: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:50:05.437008280Z [2024-04-21 01:50:05,436: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:50:05.516935374Z [2024-04-21 01:50:05,516: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:50:06.191175902Z [2024-04-21 01:50:06,189: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[73e9902f-8457-4a2e-b655-31788e31aa10] succeeded in 2.585340581001219s: None 2024-04-21T01:50:06.350404418Z [2024-04-21 01:50:06,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[815bce02-e5d5-4ef1-b665-6a35f9b26e79] received 2024-04-21T01:50:06.361221374Z [2024-04-21 01:50:06,359: INFO/ForkPoolWorker-15] [815bce02-e5d5-4ef1-b665-6a35f9b26e79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:50:06.673630772Z [2024-04-21 01:50:06,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:50:07.804714390Z [2024-04-21 01:50:07,804: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:50:07.808056328Z [2024-04-21 01:50:07,807: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:50:07.833163141Z [2024-04-21 01:50:07,832: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:50:07.834956616Z [2024-04-21 01:50:07,834: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:50:07.835156882Z [2024-04-21 01:50:07,834: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:50:07.835252815Z [2024-04-21 01:50:07,835: INFO/ForkPoolWorker-15] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:50:07.835484384Z [2024-04-21 01:50:07,835: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:50:07.835556208Z [2024-04-21 01:50:07,835: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:50:07.836021213Z [2024-04-21 01:50:07,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:50:07.836176759Z [2024-04-21 01:50:07,835: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:50:07.842337300Z [2024-04-21 01:50:07,842: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:50:07.932857304Z [2024-04-21 01:50:07,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:50:08.562976324Z [2024-04-21 01:50:08,562: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[815bce02-e5d5-4ef1-b665-6a35f9b26e79] succeeded in 2.2104359320001095s: None 2024-04-21T01:50:09.447082945Z [2024-04-21 01:50:09,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[995051bd-f905-43db-b5a5-ae48fab3a98a] received 2024-04-21T01:50:09.453913406Z [2024-04-21 01:50:09,453: INFO/ForkPoolWorker-15] [995051bd-f905-43db-b5a5-ae48fab3a98a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:50:09.844653881Z [2024-04-21 01:50:09,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:50:10.902947381Z [2024-04-21 01:50:10,902: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:50:10.906175301Z [2024-04-21 01:50:10,905: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:50:10.942886223Z [2024-04-21 01:50:10,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:50:10.946299497Z [2024-04-21 01:50:10,945: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:50:10.946357408Z [2024-04-21 01:50:10,946: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:50:10.946615926Z [2024-04-21 01:50:10,946: INFO/ForkPoolWorker-15] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:50:10.946908259Z [2024-04-21 01:50:10,946: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:50:10.947040450Z [2024-04-21 01:50:10,946: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:50:10.947461901Z [2024-04-21 01:50:10,947: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:50:10.947857181Z [2024-04-21 01:50:10,947: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:50:10.956748808Z [2024-04-21 01:50:10,956: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:50:11.076761429Z [2024-04-21 01:50:11,075: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:50:11.653066674Z [2024-04-21 01:50:11,652: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[995051bd-f905-43db-b5a5-ae48fab3a98a] succeeded in 2.203758016001302s: None 2024-04-21T01:51:01.079658334Z [2024-04-21 01:51:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd905478-1bc5-4114-956e-4f9b06b02f3a] received 2024-04-21T01:51:01.080414221Z [2024-04-21 01:51:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b74c585-1af5-48d6-9076-6c366dd964fc] received 2024-04-21T01:51:01.094256333Z [2024-04-21 01:51:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15947732-cb8c-46fe-b259-bdf034729448] received 2024-04-21T01:51:01.099823372Z [2024-04-21 01:51:01,097: INFO/ForkPoolWorker-15] [fd905478-1bc5-4114-956e-4f9b06b02f3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:51:01.100641064Z [2024-04-21 01:51:01,100: INFO/ForkPoolWorker-16] [0b74c585-1af5-48d6-9076-6c366dd964fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:51:01.103841345Z [2024-04-21 01:51:01,103: INFO/ForkPoolWorker-1] [15947732-cb8c-46fe-b259-bdf034729448] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:51:01.408432425Z [2024-04-21 01:51:01,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:51:01.433375462Z [2024-04-21 01:51:01,430: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:51:01.444534476Z [2024-04-21 01:51:01,441: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:51:01.632549883Z [2024-04-21 01:51:01,632: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:51:01.637060466Z [2024-04-21 01:51:01,636: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:51:01.670625964Z [2024-04-21 01:51:01,670: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:51:01.672191927Z [2024-04-21 01:51:01,672: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:51:01.672283324Z [2024-04-21 01:51:01,672: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:51:01.672325027Z [2024-04-21 01:51:01,672: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:51:01.672720382Z [2024-04-21 01:51:01,672: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:51:01.794455432Z [2024-04-21 01:51:01,794: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:51:02.485190543Z [2024-04-21 01:51:02,484: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b74c585-1af5-48d6-9076-6c366dd964fc] succeeded in 1.4030213610003557s: None 2024-04-21T01:51:02.837246776Z [2024-04-21 01:51:02,836: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:51:02.840980510Z [2024-04-21 01:51:02,840: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:51:02.846682375Z [2024-04-21 01:51:02,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:51:02.853397158Z [2024-04-21 01:51:02,852: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:51:02.865034434Z [2024-04-21 01:51:02,864: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:51:02.866375448Z [2024-04-21 01:51:02,866: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:51:02.866597028Z [2024-04-21 01:51:02,866: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:51:02.866759398Z [2024-04-21 01:51:02,866: INFO/ForkPoolWorker-1] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:51:02.867015430Z [2024-04-21 01:51:02,866: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:51:02.867180462Z [2024-04-21 01:51:02,867: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:51:02.867529246Z [2024-04-21 01:51:02,867: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:51:02.867819166Z [2024-04-21 01:51:02,867: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:51:02.878037089Z [2024-04-21 01:51:02,877: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:51:02.911873257Z [2024-04-21 01:51:02,911: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:51:02.925348325Z [2024-04-21 01:51:02,925: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:51:02.925631940Z [2024-04-21 01:51:02,925: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:51:02.925824145Z [2024-04-21 01:51:02,925: INFO/ForkPoolWorker-15] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:51:02.926097543Z [2024-04-21 01:51:02,925: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:51:02.926271693Z [2024-04-21 01:51:02,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:51:02.926695976Z [2024-04-21 01:51:02,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:51:02.926882189Z [2024-04-21 01:51:02,926: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:51:02.931641727Z [2024-04-21 01:51:02,931: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:51:03.027871262Z [2024-04-21 01:51:03,027: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:51:03.086348419Z [2024-04-21 01:51:03,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:51:05.016829995Z [2024-04-21 01:51:05,016: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd905478-1bc5-4114-956e-4f9b06b02f3a] succeeded in 3.935903724999662s: None 2024-04-21T01:51:05.365019486Z [2024-04-21 01:51:05,364: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15947732-cb8c-46fe-b259-bdf034729448] succeeded in 4.26895449299991s: None 2024-04-21T01:52:00.512717292Z [2024-04-21 01:52:00,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a9944ec-7eb5-48fa-9d6f-eb2f16b40978] received 2024-04-21T01:52:00.516671557Z [2024-04-21 01:52:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a22079d-5a5e-43b9-94c1-a9c1f1cc6818] received 2024-04-21T01:52:00.523418653Z [2024-04-21 01:52:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5c939eb-eb6a-4f2b-8c46-6fe0cd8bfeba] received 2024-04-21T01:52:00.527975887Z [2024-04-21 01:52:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f7595c6-80ea-4528-aae7-37329ad9f0ba] received 2024-04-21T01:52:00.534534800Z [2024-04-21 01:52:00,534: INFO/ForkPoolWorker-16] [1a22079d-5a5e-43b9-94c1-a9c1f1cc6818] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:52:00.538964315Z [2024-04-21 01:52:00,538: INFO/ForkPoolWorker-15] [5a9944ec-7eb5-48fa-9d6f-eb2f16b40978] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:52:00.551583168Z [2024-04-21 01:52:00,550: INFO/ForkPoolWorker-2] [6f7595c6-80ea-4528-aae7-37329ad9f0ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:52:00.559936359Z [2024-04-21 01:52:00,559: INFO/ForkPoolWorker-1] [b5c939eb-eb6a-4f2b-8c46-6fe0cd8bfeba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:52:00.907077656Z [2024-04-21 01:52:00,903: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:52:00.940174843Z [2024-04-21 01:52:00,936: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:52:01.061386910Z [2024-04-21 01:52:01,050: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:52:01.087813629Z [2024-04-21 01:52:01,082: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:52:01.364803610Z [2024-04-21 01:52:01,364: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:52:01.374548025Z [2024-04-21 01:52:01,374: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:52:01.441400085Z [2024-04-21 01:52:01,441: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:52:01.444674519Z [2024-04-21 01:52:01,444: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:52:01.448886731Z [2024-04-21 01:52:01,448: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:52:01.449008565Z [2024-04-21 01:52:01,448: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:52:01.449531859Z [2024-04-21 01:52:01,448: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:52:01.450252153Z [2024-04-21 01:52:01,449: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:52:01.610325967Z [2024-04-21 01:52:01,610: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:52:02.512786634Z [2024-04-21 01:52:02,512: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5c939eb-eb6a-4f2b-8c46-6fe0cd8bfeba] succeeded in 1.9848406959990825s: None 2024-04-21T01:52:02.575303530Z [2024-04-21 01:52:02,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a9944ec-7eb5-48fa-9d6f-eb2f16b40978] succeeded in 2.05816023800071s: None 2024-04-21T01:52:02.725441500Z [2024-04-21 01:52:02,725: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:52:02.725648340Z [2024-04-21 01:52:02,725: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:52:02.728749532Z [2024-04-21 01:52:02,728: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:52:02.728970839Z [2024-04-21 01:52:02,728: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:52:02.750841826Z [2024-04-21 01:52:02,750: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:52:02.752230167Z [2024-04-21 01:52:02,752: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:52:02.752473861Z [2024-04-21 01:52:02,752: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:52:02.752689006Z [2024-04-21 01:52:02,752: INFO/ForkPoolWorker-2] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:52:02.752913728Z [2024-04-21 01:52:02,752: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:52:02.753031967Z [2024-04-21 01:52:02,752: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:52:02.753418179Z [2024-04-21 01:52:02,753: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:52:02.753529424Z [2024-04-21 01:52:02,753: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:52:02.753965739Z [2024-04-21 01:52:02,753: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:52:02.755191625Z [2024-04-21 01:52:02,755: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:52:02.755260665Z [2024-04-21 01:52:02,755: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:52:02.755354571Z [2024-04-21 01:52:02,755: INFO/ForkPoolWorker-16] Read VIM 62bbbb58-5a40-4db6-9ac4-6282139a7383 (k8s07_dummy) 2024-04-21T01:52:02.755510277Z [2024-04-21 01:52:02,755: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '62bbbb58-5a40-4db6-9ac4-6282139a7383', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-21T01:52:02.755584395Z [2024-04-21 01:52:02,755: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:52:02.755925360Z [2024-04-21 01:52:02,755: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:52:02.755998582Z [2024-04-21 01:52:02,755: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:52:02.758332588Z [2024-04-21 01:52:02,758: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:52:02.760901462Z [2024-04-21 01:52:02,760: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:52:02.834451291Z [2024-04-21 01:52:02,834: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:52:02.844397566Z [2024-04-21 01:52:02,844: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:52:04.785019339Z [2024-04-21 01:52:04,782: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6f7595c6-80ea-4528-aae7-37329ad9f0ba] succeeded in 4.249964181000905s: None 2024-04-21T01:52:05.688486582Z [2024-04-21 01:52:05,688: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1a22079d-5a5e-43b9-94c1-a9c1f1cc6818] succeeded in 5.169298773000264s: None 2024-04-21T01:53:00.324515441Z [2024-04-21 01:53:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d12076a-eb9c-4251-8a93-407924cda677] received 2024-04-21T01:53:00.328802093Z [2024-04-21 01:53:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc9b504e-a45d-4339-b261-64aa24086d11] received 2024-04-21T01:53:00.331045190Z [2024-04-21 01:53:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f39ddf9c-891b-458e-83e3-1868c17d4ad6] received 2024-04-21T01:53:00.335433852Z [2024-04-21 01:53:00,335: INFO/ForkPoolWorker-15] [0d12076a-eb9c-4251-8a93-407924cda677] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:53:00.346687077Z [2024-04-21 01:53:00,346: INFO/ForkPoolWorker-16] [cc9b504e-a45d-4339-b261-64aa24086d11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:53:00.351755921Z [2024-04-21 01:53:00,351: INFO/ForkPoolWorker-1] [f39ddf9c-891b-458e-83e3-1868c17d4ad6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:53:00.639276649Z [2024-04-21 01:53:00,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:53:00.660418086Z [2024-04-21 01:53:00,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:53:00.698877357Z [2024-04-21 01:53:00,695: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:53:00.800429573Z [2024-04-21 01:53:00,799: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T01:53:00.804557072Z [2024-04-21 01:53:00,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:53:00.844351540Z [2024-04-21 01:53:00,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:53:00.846061278Z [2024-04-21 01:53:00,845: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:53:00.846270489Z [2024-04-21 01:53:00,845: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:53:00.846432195Z [2024-04-21 01:53:00,846: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T01:53:00.846744323Z [2024-04-21 01:53:00,846: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:53:00.969608106Z [2024-04-21 01:53:00,969: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:53:01.612132152Z [2024-04-21 01:53:01,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d12076a-eb9c-4251-8a93-407924cda677] succeeded in 1.2844991750007466s: None 2024-04-21T01:53:01.962711853Z [2024-04-21 01:53:01,962: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:53:01.965912902Z [2024-04-21 01:53:01,965: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:53:01.975372819Z [2024-04-21 01:53:01,974: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:53:01.978796287Z [2024-04-21 01:53:01,978: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:53:01.997353538Z [2024-04-21 01:53:01,997: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:53:01.998067341Z [2024-04-21 01:53:01,997: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:53:01.998947778Z [2024-04-21 01:53:01,998: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:53:01.999433128Z [2024-04-21 01:53:01,999: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:53:01.999906194Z [2024-04-21 01:53:01,999: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:53:01.999970944Z [2024-04-21 01:53:01,999: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:53:02.003317072Z [2024-04-21 01:53:02,003: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:53:02.003356867Z [2024-04-21 01:53:02,003: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:53:02.008982301Z [2024-04-21 01:53:02,008: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:53:02.009084176Z [2024-04-21 01:53:02,008: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:53:02.009298010Z [2024-04-21 01:53:02,009: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:53:02.009422464Z [2024-04-21 01:53:02,009: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:53:02.009808824Z [2024-04-21 01:53:02,009: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:53:02.010403576Z [2024-04-21 01:53:02,010: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:53:02.092584449Z [2024-04-21 01:53:02,092: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:53:02.128401403Z [2024-04-21 01:53:02,128: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:53:03.753533945Z [2024-04-21 01:53:03,753: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc9b504e-a45d-4339-b261-64aa24086d11] succeeded in 3.417388650999783s: None 2024-04-21T01:53:04.239708402Z [2024-04-21 01:53:04,239: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f39ddf9c-891b-458e-83e3-1868c17d4ad6] succeeded in 3.8992320010002004s: None 2024-04-21T01:54:00.316008820Z [2024-04-21 01:54:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c499a123-cfe1-40b9-a649-829d86d4c0cf] received 2024-04-21T01:54:00.318505439Z [2024-04-21 01:54:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68a90b62-430f-46cb-af85-ad62c546140a] received 2024-04-21T01:54:00.321572246Z [2024-04-21 01:54:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86cb681d-0a0e-4cf1-bee4-965ba7e8565a] received 2024-04-21T01:54:00.324316954Z [2024-04-21 01:54:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b37bd93a-127e-4b61-ba9c-d07f23e290bd] received 2024-04-21T01:54:00.333723082Z [2024-04-21 01:54:00,333: INFO/ForkPoolWorker-1] [86cb681d-0a0e-4cf1-bee4-965ba7e8565a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:54:00.338457241Z [2024-04-21 01:54:00,338: INFO/ForkPoolWorker-16] [68a90b62-430f-46cb-af85-ad62c546140a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:54:00.339011466Z [2024-04-21 01:54:00,338: INFO/ForkPoolWorker-15] [c499a123-cfe1-40b9-a649-829d86d4c0cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:54:00.339509066Z [2024-04-21 01:54:00,338: INFO/ForkPoolWorker-2] [b37bd93a-127e-4b61-ba9c-d07f23e290bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:54:00.618482717Z [2024-04-21 01:54:00,615: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:54:00.801682001Z [2024-04-21 01:54:00,798: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:54:00.804148558Z [2024-04-21 01:54:00,801: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:54:00.817232855Z [2024-04-21 01:54:00,805: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:54:00.977232930Z [2024-04-21 01:54:00,976: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:54:00.981335099Z [2024-04-21 01:54:00,980: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:54:01.014551475Z [2024-04-21 01:54:01,014: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:54:01.019107557Z [2024-04-21 01:54:01,018: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:54:01.019736777Z [2024-04-21 01:54:01,019: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:54:01.019905687Z [2024-04-21 01:54:01,019: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:54:01.020194553Z [2024-04-21 01:54:01,020: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:54:01.087777412Z [2024-04-21 01:54:01,080: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:54:01.167433926Z [2024-04-21 01:54:01,167: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:54:01.819755898Z [2024-04-21 01:54:01,819: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c499a123-cfe1-40b9-a649-829d86d4c0cf] succeeded in 1.4995968940002058s: None 2024-04-21T01:54:01.961208446Z [2024-04-21 01:54:01,960: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[68a90b62-430f-46cb-af85-ad62c546140a] succeeded in 1.6383521140014636s: None 2024-04-21T01:54:02.219590113Z [2024-04-21 01:54:02,219: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:54:02.223001386Z [2024-04-21 01:54:02,222: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:54:02.241422828Z [2024-04-21 01:54:02,241: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:54:02.242541823Z [2024-04-21 01:54:02,242: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:54:02.242555579Z [2024-04-21 01:54:02,242: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:54:02.242728032Z [2024-04-21 01:54:02,242: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:54:02.242749905Z [2024-04-21 01:54:02,242: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:54:02.243021717Z [2024-04-21 01:54:02,242: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:54:02.243035410Z [2024-04-21 01:54:02,242: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:54:02.328878729Z [2024-04-21 01:54:02,328: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:54:02.402763656Z [2024-04-21 01:54:02,402: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:54:02.406028062Z [2024-04-21 01:54:02,405: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:54:02.433008457Z [2024-04-21 01:54:02,432: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:54:02.434238654Z [2024-04-21 01:54:02,434: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:54:02.434494261Z [2024-04-21 01:54:02,434: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:54:02.434635595Z [2024-04-21 01:54:02,434: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:54:02.434870405Z [2024-04-21 01:54:02,434: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:54:02.435436399Z [2024-04-21 01:54:02,435: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:54:02.435518591Z [2024-04-21 01:54:02,435: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:54:02.523742083Z [2024-04-21 01:54:02,523: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:54:03.782945023Z [2024-04-21 01:54:03,782: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b37bd93a-127e-4b61-ba9c-d07f23e290bd] succeeded in 3.4559048099999927s: None 2024-04-21T01:54:04.582113547Z [2024-04-21 01:54:04,581: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86cb681d-0a0e-4cf1-bee4-965ba7e8565a] succeeded in 4.255400727999586s: None 2024-04-21T01:55:01.177047500Z [2024-04-21 01:55:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[953095e8-c333-4914-9bc2-dad32d88c34f] received 2024-04-21T01:55:01.200234113Z [2024-04-21 01:55:01,199: INFO/ForkPoolWorker-15] [953095e8-c333-4914-9bc2-dad32d88c34f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:55:01.202862143Z [2024-04-21 01:55:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16245119-5093-4c6f-82ed-4fd7ad584f2d] received 2024-04-21T01:55:01.209906911Z [2024-04-21 01:55:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1387ae05-db51-4b1c-8dfd-76f3e6b91a54] received 2024-04-21T01:55:01.215974950Z [2024-04-21 01:55:01,215: INFO/ForkPoolWorker-16] [16245119-5093-4c6f-82ed-4fd7ad584f2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:55:01.219011841Z [2024-04-21 01:55:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[585c1d17-0b62-4095-a5a5-4fb0af769c96] received 2024-04-21T01:55:01.233138652Z [2024-04-21 01:55:01,232: INFO/ForkPoolWorker-1] [1387ae05-db51-4b1c-8dfd-76f3e6b91a54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:55:01.240761865Z [2024-04-21 01:55:01,240: INFO/ForkPoolWorker-2] [585c1d17-0b62-4095-a5a5-4fb0af769c96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:55:01.765839665Z [2024-04-21 01:55:01,762: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:55:01.840241474Z [2024-04-21 01:55:01,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:55:01.866037352Z [2024-04-21 01:55:01,860: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:55:02.105293980Z [2024-04-21 01:55:02,101: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:55:02.209253220Z [2024-04-21 01:55:02,191: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:55:02.213260717Z [2024-04-21 01:55:02,212: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:55:02.311949888Z [2024-04-21 01:55:02,311: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:55:02.325406463Z [2024-04-21 01:55:02,325: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:55:02.325448927Z [2024-04-21 01:55:02,325: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:55:02.325499048Z [2024-04-21 01:55:02,325: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:55:02.325688861Z [2024-04-21 01:55:02,325: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:55:02.560821378Z [2024-04-21 01:55:02,560: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:55:03.756738470Z [2024-04-21 01:55:03,756: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[16245119-5093-4c6f-82ed-4fd7ad584f2d] succeeded in 2.5500182199994015s: None 2024-04-21T01:55:03.974815279Z [2024-04-21 01:55:03,972: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:55:03.983928373Z [2024-04-21 01:55:03,981: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:55:04.047861602Z [2024-04-21 01:55:04,045: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:55:04.051804472Z [2024-04-21 01:55:04,049: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:55:04.051824925Z [2024-04-21 01:55:04,049: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:55:04.051841363Z [2024-04-21 01:55:04,049: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:55:04.051845816Z [2024-04-21 01:55:04,049: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:55:04.051849096Z [2024-04-21 01:55:04,050: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:55:04.051852590Z [2024-04-21 01:55:04,050: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:55:04.185546745Z [2024-04-21 01:55:04,185: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:55:04.472908493Z [2024-04-21 01:55:04,472: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:55:04.488400005Z [2024-04-21 01:55:04,487: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:55:04.509524531Z [2024-04-21 01:55:04,509: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:55:04.512909711Z [2024-04-21 01:55:04,512: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:55:04.543335022Z [2024-04-21 01:55:04,543: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:55:04.545452773Z [2024-04-21 01:55:04,545: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:55:04.545635735Z [2024-04-21 01:55:04,545: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:55:04.545913027Z [2024-04-21 01:55:04,545: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:55:04.546088599Z [2024-04-21 01:55:04,545: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:55:04.546629231Z [2024-04-21 01:55:04,546: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:55:04.546815739Z [2024-04-21 01:55:04,546: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:55:04.563738765Z [2024-04-21 01:55:04,563: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:55:04.567032974Z [2024-04-21 01:55:04,566: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:55:04.567183961Z [2024-04-21 01:55:04,566: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:55:04.567388585Z [2024-04-21 01:55:04,567: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:55:04.567514492Z [2024-04-21 01:55:04,567: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:55:04.567938721Z [2024-04-21 01:55:04,567: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:55:04.568142905Z [2024-04-21 01:55:04,567: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:55:04.659125766Z [2024-04-21 01:55:04,657: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:55:04.702128101Z [2024-04-21 01:55:04,701: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:55:05.374624362Z [2024-04-21 01:55:05,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36be4788-68f4-4194-9e66-3653c8c79e9a] received 2024-04-21T01:55:05.382168456Z [2024-04-21 01:55:05,380: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[953095e8-c333-4914-9bc2-dad32d88c34f] succeeded in 4.1939318500008085s: None 2024-04-21T01:55:05.388357329Z [2024-04-21 01:55:05,388: INFO/ForkPoolWorker-16] [36be4788-68f4-4194-9e66-3653c8c79e9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:55:05.720419144Z [2024-04-21 01:55:05,716: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:55:06.283992449Z [2024-04-21 01:55:06,278: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[585c1d17-0b62-4095-a5a5-4fb0af769c96] succeeded in 5.057348594000359s: None 2024-04-21T01:55:06.862285509Z [2024-04-21 01:55:06,861: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1387ae05-db51-4b1c-8dfd-76f3e6b91a54] succeeded in 5.6480591319996165s: None 2024-04-21T01:55:07.095655040Z [2024-04-21 01:55:07,095: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:55:07.099076854Z [2024-04-21 01:55:07,098: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:55:07.119985531Z [2024-04-21 01:55:07,119: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:55:07.121305184Z [2024-04-21 01:55:07,121: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:55:07.121409278Z [2024-04-21 01:55:07,121: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:55:07.121570309Z [2024-04-21 01:55:07,121: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:55:07.121677553Z [2024-04-21 01:55:07,121: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:55:07.122037243Z [2024-04-21 01:55:07,121: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:55:07.122145275Z [2024-04-21 01:55:07,122: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:55:07.217055512Z [2024-04-21 01:55:07,216: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:55:07.944215748Z [2024-04-21 01:55:07,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b18f4123-1806-4cad-b271-bd5e905ddeb6] received 2024-04-21T01:55:07.956561475Z [2024-04-21 01:55:07,956: INFO/ForkPoolWorker-15] [b18f4123-1806-4cad-b271-bd5e905ddeb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T01:55:07.980032455Z [2024-04-21 01:55:07,979: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36be4788-68f4-4194-9e66-3653c8c79e9a] succeeded in 2.6029587120010547s: None 2024-04-21T01:55:08.277025237Z [2024-04-21 01:55:08,273: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:55:09.489523921Z [2024-04-21 01:55:09,489: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:55:09.492756958Z [2024-04-21 01:55:09,492: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:55:09.514389703Z [2024-04-21 01:55:09,514: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:55:09.516206312Z [2024-04-21 01:55:09,515: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:55:09.516323379Z [2024-04-21 01:55:09,516: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:55:09.516529344Z [2024-04-21 01:55:09,516: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:55:09.516649146Z [2024-04-21 01:55:09,516: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:55:09.517037533Z [2024-04-21 01:55:09,516: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:55:09.517147305Z [2024-04-21 01:55:09,516: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:55:09.650171626Z [2024-04-21 01:55:09,649: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:55:10.286170299Z [2024-04-21 01:55:10,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f033b03d-f6c9-4707-90bf-929db7349799] received 2024-04-21T01:55:10.294411604Z [2024-04-21 01:55:10,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b18f4123-1806-4cad-b271-bd5e905ddeb6] succeeded in 2.3480369169992628s: None 2024-04-21T01:55:10.295398717Z [2024-04-21 01:55:10,295: INFO/ForkPoolWorker-16] [f033b03d-f6c9-4707-90bf-929db7349799] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T01:55:10.573298957Z [2024-04-21 01:55:10,570: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T01:55:11.656070074Z [2024-04-21 01:55:11,655: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:55:11.658706380Z [2024-04-21 01:55:11,658: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:55:11.682079232Z [2024-04-21 01:55:11,681: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:55:11.683813346Z [2024-04-21 01:55:11,683: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:55:11.683860651Z [2024-04-21 01:55:11,683: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:55:11.684042924Z [2024-04-21 01:55:11,683: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:55:11.686451553Z [2024-04-21 01:55:11,686: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:55:11.687562712Z [2024-04-21 01:55:11,687: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T01:55:11.687592632Z [2024-04-21 01:55:11,687: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:55:11.801880611Z [2024-04-21 01:55:11,801: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:55:12.528017803Z [2024-04-21 01:55:12,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f033b03d-f6c9-4707-90bf-929db7349799] succeeded in 2.2402337719995558s: None 2024-04-21T01:56:01.287062520Z [2024-04-21 01:56:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf1b77ae-751d-4657-9919-e068cefa61cc] received 2024-04-21T01:56:01.296363882Z [2024-04-21 01:56:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[663a659c-857a-4bff-b0d0-ef3ba691622e] received 2024-04-21T01:56:01.299433322Z [2024-04-21 01:56:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e5a68d3-9783-4958-a4ee-444faa57aa40] received 2024-04-21T01:56:01.300757409Z [2024-04-21 01:56:01,297: INFO/ForkPoolWorker-15] [cf1b77ae-751d-4657-9919-e068cefa61cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:56:01.303156394Z [2024-04-21 01:56:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1b65ce8-7c37-4459-88fa-d7828acc49a6] received 2024-04-21T01:56:01.306732135Z [2024-04-21 01:56:01,306: INFO/ForkPoolWorker-1] [0e5a68d3-9783-4958-a4ee-444faa57aa40] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:56:01.308561856Z [2024-04-21 01:56:01,308: INFO/ForkPoolWorker-16] [663a659c-857a-4bff-b0d0-ef3ba691622e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:56:01.310370422Z [2024-04-21 01:56:01,310: INFO/ForkPoolWorker-2] [f1b65ce8-7c37-4459-88fa-d7828acc49a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:56:01.709544828Z [2024-04-21 01:56:01,706: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:56:01.784485552Z [2024-04-21 01:56:01,780: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:56:01.786112975Z [2024-04-21 01:56:01,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:56:02.057231179Z [2024-04-21 01:56:02,050: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:56:02.082092638Z [2024-04-21 01:56:02,081: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T01:56:02.091753194Z [2024-04-21 01:56:02,091: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:56:02.130683247Z [2024-04-21 01:56:02,130: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:56:02.131542899Z [2024-04-21 01:56:02,131: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:56:02.132447911Z [2024-04-21 01:56:02,132: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:56:02.132580699Z [2024-04-21 01:56:02,132: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:56:02.132610334Z [2024-04-21 01:56:02,132: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T01:56:02.132854019Z [2024-04-21 01:56:02,132: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:56:02.291393717Z [2024-04-21 01:56:02,285: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:56:03.051706344Z [2024-04-21 01:56:03,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf1b77ae-751d-4657-9919-e068cefa61cc] succeeded in 1.7611364040003537s: None 2024-04-21T01:56:03.086386127Z [2024-04-21 01:56:03,086: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0e5a68d3-9783-4958-a4ee-444faa57aa40] succeeded in 1.7854687889994239s: None 2024-04-21T01:56:03.255357075Z [2024-04-21 01:56:03,254: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T01:56:03.258607074Z [2024-04-21 01:56:03,258: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:56:03.281596427Z [2024-04-21 01:56:03,281: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:56:03.283222237Z [2024-04-21 01:56:03,283: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:56:03.283421150Z [2024-04-21 01:56:03,283: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:56:03.283773461Z [2024-04-21 01:56:03,283: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:56:03.283998176Z [2024-04-21 01:56:03,283: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T01:56:03.284843543Z [2024-04-21 01:56:03,284: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:56:03.285038297Z [2024-04-21 01:56:03,284: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:56:03.396095914Z [2024-04-21 01:56:03,395: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:56:03.571292247Z [2024-04-21 01:56:03,570: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:56:03.574708564Z [2024-04-21 01:56:03,574: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:56:03.599269250Z [2024-04-21 01:56:03,599: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:56:03.601125857Z [2024-04-21 01:56:03,600: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:56:03.601139920Z [2024-04-21 01:56:03,601: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:56:03.608703276Z [2024-04-21 01:56:03,601: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:56:03.609332956Z [2024-04-21 01:56:03,609: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:56:03.609643732Z [2024-04-21 01:56:03,609: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:56:03.609653480Z [2024-04-21 01:56:03,609: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:56:03.794058620Z [2024-04-21 01:56:03,793: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:56:06.137022168Z [2024-04-21 01:56:06,136: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1b65ce8-7c37-4459-88fa-d7828acc49a6] succeeded in 4.831528061999052s: None 2024-04-21T01:56:06.554708068Z [2024-04-21 01:56:06,554: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[663a659c-857a-4bff-b0d0-ef3ba691622e] succeeded in 5.255902349999815s: None 2024-04-21T01:57:01.231071140Z [2024-04-21 01:57:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88735a69-a9a2-46ef-97c3-e4da40abe33a] received 2024-04-21T01:57:01.239438367Z [2024-04-21 01:57:01,239: INFO/ForkPoolWorker-15] [88735a69-a9a2-46ef-97c3-e4da40abe33a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:57:01.239462181Z [2024-04-21 01:57:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b0f83f2-9de7-4814-aa85-ea2f108495e5] received 2024-04-21T01:57:01.250598862Z [2024-04-21 01:57:01,250: INFO/ForkPoolWorker-16] [8b0f83f2-9de7-4814-aa85-ea2f108495e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:57:01.253292498Z [2024-04-21 01:57:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71c2521c-9a42-4c58-a52c-3b590b07674c] received 2024-04-21T01:57:01.261009517Z [2024-04-21 01:57:01,260: INFO/ForkPoolWorker-1] [71c2521c-9a42-4c58-a52c-3b590b07674c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:57:01.621066115Z [2024-04-21 01:57:01,617: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:57:01.682170176Z [2024-04-21 01:57:01,674: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:57:01.814365969Z [2024-04-21 01:57:01,804: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:57:01.980499109Z [2024-04-21 01:57:01,980: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:57:01.984845975Z [2024-04-21 01:57:01,984: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:57:02.023321798Z [2024-04-21 01:57:02,022: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:57:02.030873805Z [2024-04-21 01:57:02,030: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:57:02.031159609Z [2024-04-21 01:57:02,030: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:57:02.031329857Z [2024-04-21 01:57:02,031: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:57:02.031789655Z [2024-04-21 01:57:02,031: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:57:02.163447281Z [2024-04-21 01:57:02,163: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:57:02.730670896Z [2024-04-21 01:57:02,730: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b0f83f2-9de7-4814-aa85-ea2f108495e5] succeeded in 1.4860417389991198s: None 2024-04-21T01:57:03.010800788Z [2024-04-21 01:57:03,010: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:57:03.014309505Z [2024-04-21 01:57:03,013: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:57:03.040738331Z [2024-04-21 01:57:03,040: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:57:03.042236040Z [2024-04-21 01:57:03,042: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:57:03.042401342Z [2024-04-21 01:57:03,042: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:57:03.042550353Z [2024-04-21 01:57:03,042: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:57:03.042620345Z [2024-04-21 01:57:03,042: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:57:03.043469550Z [2024-04-21 01:57:03,043: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:57:03.043480541Z [2024-04-21 01:57:03,043: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:57:03.077228124Z [2024-04-21 01:57:03,076: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:57:03.080931978Z [2024-04-21 01:57:03,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:57:03.105662811Z [2024-04-21 01:57:03,105: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:57:03.107266670Z [2024-04-21 01:57:03,107: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:57:03.107455632Z [2024-04-21 01:57:03,107: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:57:03.107704777Z [2024-04-21 01:57:03,107: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:57:03.107877924Z [2024-04-21 01:57:03,107: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:57:03.108325539Z [2024-04-21 01:57:03,108: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:57:03.108988822Z [2024-04-21 01:57:03,108: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:57:03.138346028Z [2024-04-21 01:57:03,138: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:57:03.188762265Z [2024-04-21 01:57:03,188: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:57:06.123385438Z [2024-04-21 01:57:06,122: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71c2521c-9a42-4c58-a52c-3b590b07674c] succeeded in 4.867558153999198s: None 2024-04-21T01:57:06.533510812Z [2024-04-21 01:57:06,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88735a69-a9a2-46ef-97c3-e4da40abe33a] succeeded in 5.2997354550007s: None 2024-04-21T01:58:00.392386181Z [2024-04-21 01:58:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de3e3d16-340b-49c3-82bb-bcef4eca1a1c] received 2024-04-21T01:58:00.395313318Z [2024-04-21 01:58:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1a5694f-c48a-4a16-9eda-6cca8aa6a23b] received 2024-04-21T01:58:00.397478338Z [2024-04-21 01:58:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25426d45-fe6d-4328-b9c9-99082b2a93f8] received 2024-04-21T01:58:00.405202779Z [2024-04-21 01:58:00,404: INFO/ForkPoolWorker-15] [de3e3d16-340b-49c3-82bb-bcef4eca1a1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T01:58:00.406431767Z [2024-04-21 01:58:00,406: INFO/ForkPoolWorker-1] [25426d45-fe6d-4328-b9c9-99082b2a93f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:58:00.408403160Z [2024-04-21 01:58:00,408: INFO/ForkPoolWorker-16] [d1a5694f-c48a-4a16-9eda-6cca8aa6a23b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:58:00.412527671Z [2024-04-21 01:58:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8afca59e-20c3-4e42-bcd9-955446c491c6] received 2024-04-21T01:58:00.437366331Z [2024-04-21 01:58:00,436: INFO/ForkPoolWorker-2] [8afca59e-20c3-4e42-bcd9-955446c491c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:58:00.772890838Z [2024-04-21 01:58:00,767: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T01:58:00.806714705Z [2024-04-21 01:58:00,803: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:58:00.853544349Z [2024-04-21 01:58:00,849: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:58:00.940280070Z [2024-04-21 01:58:00,936: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:58:01.172268429Z [2024-04-21 01:58:01,172: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:58:01.260705059Z [2024-04-21 01:58:01,260: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:58:01.265076972Z [2024-04-21 01:58:01,264: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:58:01.287608310Z [2024-04-21 01:58:01,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:58:01.289293200Z [2024-04-21 01:58:01,289: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:58:01.289578381Z [2024-04-21 01:58:01,289: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:58:01.289814159Z [2024-04-21 01:58:01,289: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:58:01.290442118Z [2024-04-21 01:58:01,290: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:58:01.404769304Z [2024-04-21 01:58:01,404: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:58:01.869269809Z [2024-04-21 01:58:01,868: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de3e3d16-340b-49c3-82bb-bcef4eca1a1c] succeeded in 1.472328412999559s: None 2024-04-21T01:58:02.138545389Z [2024-04-21 01:58:02,138: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1a5694f-c48a-4a16-9eda-6cca8aa6a23b] succeeded in 1.741589572000521s: None 2024-04-21T01:58:02.473327495Z [2024-04-21 01:58:02,472: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:58:02.477874342Z [2024-04-21 01:58:02,477: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:58:02.506027884Z [2024-04-21 01:58:02,505: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T01:58:02.509592359Z [2024-04-21 01:58:02,509: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:58:02.510265207Z [2024-04-21 01:58:02,509: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:58:02.512290756Z [2024-04-21 01:58:02,512: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:58:02.512831877Z [2024-04-21 01:58:02,512: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:58:02.513035821Z [2024-04-21 01:58:02,512: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:58:02.513212712Z [2024-04-21 01:58:02,512: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:58:02.513601612Z [2024-04-21 01:58:02,513: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:58:02.513738153Z [2024-04-21 01:58:02,513: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:58:02.533240692Z [2024-04-21 01:58:02,533: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T01:58:02.536406156Z [2024-04-21 01:58:02,536: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:58:02.536803529Z [2024-04-21 01:58:02,536: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:58:02.537208291Z [2024-04-21 01:58:02,536: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:58:02.537888816Z [2024-04-21 01:58:02,537: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T01:58:02.538196544Z [2024-04-21 01:58:02,538: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:58:02.540287689Z [2024-04-21 01:58:02,538: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:58:02.635273148Z [2024-04-21 01:58:02,634: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:58:02.643500390Z [2024-04-21 01:58:02,643: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:58:04.966487321Z [2024-04-21 01:58:04,965: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8afca59e-20c3-4e42-bcd9-955446c491c6] succeeded in 4.548518488001719s: None 2024-04-21T01:58:05.517557086Z [2024-04-21 01:58:05,517: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25426d45-fe6d-4328-b9c9-99082b2a93f8] succeeded in 5.117820063998806s: None 2024-04-21T01:59:00.360824538Z [2024-04-21 01:59:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab5ea2d3-7e95-452c-afae-96a1535f56f2] received 2024-04-21T01:59:00.365737816Z [2024-04-21 01:59:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f07a8c8-72fb-40fb-a09f-8ca8e6378815] received 2024-04-21T01:59:00.374236913Z [2024-04-21 01:59:00,373: INFO/ForkPoolWorker-16] [3f07a8c8-72fb-40fb-a09f-8ca8e6378815] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T01:59:00.377039841Z [2024-04-21 01:59:00,376: INFO/ForkPoolWorker-15] [ab5ea2d3-7e95-452c-afae-96a1535f56f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T01:59:00.389801194Z [2024-04-21 01:59:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f353de8-972d-477d-97a7-b0c7ff9f0dea] received 2024-04-21T01:59:00.416066922Z [2024-04-21 01:59:00,415: INFO/ForkPoolWorker-1] [5f353de8-972d-477d-97a7-b0c7ff9f0dea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T01:59:00.707397548Z [2024-04-21 01:59:00,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T01:59:00.819259809Z [2024-04-21 01:59:00,816: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T01:59:00.904310087Z [2024-04-21 01:59:00,898: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T01:59:00.973463626Z [2024-04-21 01:59:00,972: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T01:59:00.977218282Z [2024-04-21 01:59:00,976: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:59:01.007627861Z [2024-04-21 01:59:01,007: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T01:59:01.008686429Z [2024-04-21 01:59:01,008: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T01:59:01.008724330Z [2024-04-21 01:59:01,008: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T01:59:01.008732204Z [2024-04-21 01:59:01,008: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T01:59:01.008979050Z [2024-04-21 01:59:01,008: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T01:59:01.132786394Z [2024-04-21 01:59:01,132: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:59:01.815450489Z [2024-04-21 01:59:01,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f07a8c8-72fb-40fb-a09f-8ca8e6378815] succeeded in 1.4466871840013482s: None 2024-04-21T01:59:01.926657963Z [2024-04-21 01:59:01,926: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T01:59:01.930110559Z [2024-04-21 01:59:01,929: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:59:01.970486945Z [2024-04-21 01:59:01,970: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T01:59:01.972800614Z [2024-04-21 01:59:01,972: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:59:01.972931533Z [2024-04-21 01:59:01,972: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:59:01.973161044Z [2024-04-21 01:59:01,972: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:59:01.973273963Z [2024-04-21 01:59:01,973: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T01:59:01.974320833Z [2024-04-21 01:59:01,973: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T01:59:01.974489518Z [2024-04-21 01:59:01,974: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:59:02.054802301Z [2024-04-21 01:59:02,054: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:59:02.239262923Z [2024-04-21 01:59:02,238: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T01:59:02.242492939Z [2024-04-21 01:59:02,242: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T01:59:02.269507551Z [2024-04-21 01:59:02,269: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T01:59:02.271035740Z [2024-04-21 01:59:02,270: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T01:59:02.271052574Z [2024-04-21 01:59:02,270: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T01:59:02.271194481Z [2024-04-21 01:59:02,271: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T01:59:02.271236294Z [2024-04-21 01:59:02,271: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T01:59:02.271487126Z [2024-04-21 01:59:02,271: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T01:59:02.271525681Z [2024-04-21 01:59:02,271: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T01:59:02.383814125Z [2024-04-21 01:59:02,383: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T01:59:04.064571320Z [2024-04-21 01:59:04,063: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f353de8-972d-477d-97a7-b0c7ff9f0dea] succeeded in 3.66514896300032s: None 2024-04-21T01:59:04.281352247Z [2024-04-21 01:59:04,280: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab5ea2d3-7e95-452c-afae-96a1535f56f2] succeeded in 3.912569308999082s: None 2024-04-21T02:00:00.429814780Z [2024-04-21 02:00:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ed760da-405b-4693-a213-729926794437] received 2024-04-21T02:00:00.434129175Z [2024-04-21 02:00:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaf37b5e-63f1-4a44-a57b-34f0a2e3e7f5] received 2024-04-21T02:00:00.442595521Z [2024-04-21 02:00:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9bec355-3601-4115-811c-717bb1d5bdb6] received 2024-04-21T02:00:00.443187859Z [2024-04-21 02:00:00,442: INFO/ForkPoolWorker-15] [1ed760da-405b-4693-a213-729926794437] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:00:00.448514087Z [2024-04-21 02:00:00,448: INFO/ForkPoolWorker-16] [aaf37b5e-63f1-4a44-a57b-34f0a2e3e7f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:00:00.450198023Z [2024-04-21 02:00:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d815f81-8121-4c48-9360-3c2ead1dc501] received 2024-04-21T02:00:00.455925364Z [2024-04-21 02:00:00,455: INFO/ForkPoolWorker-1] [f9bec355-3601-4115-811c-717bb1d5bdb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:00:00.470178520Z [2024-04-21 02:00:00,469: INFO/ForkPoolWorker-2] [8d815f81-8121-4c48-9360-3c2ead1dc501] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:00:00.477914469Z [2024-04-21 02:00:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38127995-8680-434f-b342-37a7223bd411] received 2024-04-21T02:00:00.505462265Z [2024-04-21 02:00:00,505: INFO/ForkPoolWorker-3] [38127995-8680-434f-b342-37a7223bd411] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:00:00.825401849Z [2024-04-21 02:00:00,820: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:00:00.888665295Z [2024-04-21 02:00:00,884: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:00:00.908067237Z [2024-04-21 02:00:00,905: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:00:01.057165647Z [2024-04-21 02:00:01,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:00:01.122140800Z [2024-04-21 02:00:01,121: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T02:00:01.127448794Z [2024-04-21 02:00:01,126: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:00:01.144263172Z [2024-04-21 02:00:01,127: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:00:01.217205553Z [2024-04-21 02:00:01,216: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:00:01.220170740Z [2024-04-21 02:00:01,219: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:00:01.220248678Z [2024-04-21 02:00:01,220: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:00:01.220317874Z [2024-04-21 02:00:01,220: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T02:00:01.220872003Z [2024-04-21 02:00:01,220: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:00:01.297593240Z [2024-04-21 02:00:01,297: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:00:01.426420189Z [2024-04-21 02:00:01,426: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:00:02.270620999Z [2024-04-21 02:00:02,270: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f9bec355-3601-4115-811c-717bb1d5bdb6] succeeded in 1.8266515909999725s: None 2024-04-21T02:00:02.431299705Z [2024-04-21 02:00:02,430: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8d815f81-8121-4c48-9360-3c2ead1dc501] succeeded in 1.9778974300006666s: None 2024-04-21T02:00:02.847608321Z [2024-04-21 02:00:02,847: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T02:00:02.852113213Z [2024-04-21 02:00:02,851: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:00:02.876609472Z [2024-04-21 02:00:02,876: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T02:00:02.877885946Z [2024-04-21 02:00:02,877: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:00:02.877963585Z [2024-04-21 02:00:02,877: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:00:02.878141279Z [2024-04-21 02:00:02,877: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:00:02.878210031Z [2024-04-21 02:00:02,878: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T02:00:02.878449758Z [2024-04-21 02:00:02,878: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:00:02.878544272Z [2024-04-21 02:00:02,878: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:00:02.901567548Z [2024-04-21 02:00:02,901: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:00:02.911568395Z [2024-04-21 02:00:02,911: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:00:02.990680932Z [2024-04-21 02:00:02,990: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:00:02.994796721Z [2024-04-21 02:00:02,994: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:00:02.995225943Z [2024-04-21 02:00:02,994: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:00:02.995598944Z [2024-04-21 02:00:02,995: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:00:02.995906905Z [2024-04-21 02:00:02,995: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:00:02.996501544Z [2024-04-21 02:00:02,996: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:00:03.007848180Z [2024-04-21 02:00:02,999: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:00:03.039197886Z [2024-04-21 02:00:03,038: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:00:03.139585935Z [2024-04-21 02:00:03,139: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:00:03.353352988Z [2024-04-21 02:00:03,352: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:00:03.357614988Z [2024-04-21 02:00:03,357: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:00:03.405071640Z [2024-04-21 02:00:03,404: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:00:03.408036729Z [2024-04-21 02:00:03,407: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:00:03.408057327Z [2024-04-21 02:00:03,407: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:00:03.408845611Z [2024-04-21 02:00:03,408: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:00:03.409003743Z [2024-04-21 02:00:03,408: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:00:03.412086927Z [2024-04-21 02:00:03,411: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:00:03.412190538Z [2024-04-21 02:00:03,412: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:00:03.520091713Z [2024-04-21 02:00:03,519: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:00:04.452779084Z [2024-04-21 02:00:04,452: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ed760da-405b-4693-a213-729926794437] succeeded in 4.018065561000185s: None 2024-04-21T02:00:04.861720114Z [2024-04-21 02:00:04,861: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[38127995-8680-434f-b342-37a7223bd411] succeeded in 4.369030711999585s: None 2024-04-21T02:00:05.453343335Z [2024-04-21 02:00:05,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56a86098-da08-4e72-9e9e-7c87fb617126] received 2024-04-21T02:00:05.464732816Z [2024-04-21 02:00:05,464: INFO/ForkPoolWorker-15] [56a86098-da08-4e72-9e9e-7c87fb617126] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:00:05.783301055Z [2024-04-21 02:00:05,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:00:05.986388910Z [2024-04-21 02:00:05,985: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aaf37b5e-63f1-4a44-a57b-34f0a2e3e7f5] succeeded in 5.549908810000488s: None 2024-04-21T02:00:07.094580257Z [2024-04-21 02:00:07,093: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:00:07.101747815Z [2024-04-21 02:00:07,100: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:00:07.142255229Z [2024-04-21 02:00:07,141: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:00:07.144506697Z [2024-04-21 02:00:07,144: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:00:07.144525209Z [2024-04-21 02:00:07,144: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:00:07.144663700Z [2024-04-21 02:00:07,144: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:00:07.144736191Z [2024-04-21 02:00:07,144: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:00:07.144980172Z [2024-04-21 02:00:07,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:00:07.145035041Z [2024-04-21 02:00:07,144: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:00:07.243899404Z [2024-04-21 02:00:07,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:00:07.975437994Z [2024-04-21 02:00:07,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56a86098-da08-4e72-9e9e-7c87fb617126] succeeded in 2.51988638200055s: None 2024-04-21T02:00:08.526757128Z [2024-04-21 02:00:08,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18fde6a6-6b09-42e3-b764-43eb08e45b32] received 2024-04-21T02:00:08.535340622Z [2024-04-21 02:00:08,535: INFO/ForkPoolWorker-15] [18fde6a6-6b09-42e3-b764-43eb08e45b32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:00:08.813972163Z [2024-04-21 02:00:08,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:00:09.891668567Z [2024-04-21 02:00:09,891: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:00:09.894756959Z [2024-04-21 02:00:09,894: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:00:09.924757892Z [2024-04-21 02:00:09,924: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:00:09.927121294Z [2024-04-21 02:00:09,926: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:00:09.927141748Z [2024-04-21 02:00:09,927: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:00:09.927539582Z [2024-04-21 02:00:09,927: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:00:09.927754499Z [2024-04-21 02:00:09,927: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:00:09.929523821Z [2024-04-21 02:00:09,929: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:00:09.929570305Z [2024-04-21 02:00:09,929: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:00:10.028857860Z [2024-04-21 02:00:10,028: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:00:10.560988146Z [2024-04-21 02:00:10,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[913fdecf-b402-41a4-a734-8cecbec35cfd] received 2024-04-21T02:00:10.569371353Z [2024-04-21 02:00:10,569: INFO/ForkPoolWorker-16] [913fdecf-b402-41a4-a734-8cecbec35cfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:00:10.604919106Z [2024-04-21 02:00:10,604: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18fde6a6-6b09-42e3-b764-43eb08e45b32] succeeded in 2.075448585999766s: None 2024-04-21T02:00:10.855837321Z [2024-04-21 02:00:10,852: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:00:11.946763297Z [2024-04-21 02:00:11,946: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:00:11.949936689Z [2024-04-21 02:00:11,949: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:00:11.974437865Z [2024-04-21 02:00:11,973: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:00:11.977501236Z [2024-04-21 02:00:11,976: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:00:11.977616802Z [2024-04-21 02:00:11,977: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:00:11.978305292Z [2024-04-21 02:00:11,977: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:00:11.978331052Z [2024-04-21 02:00:11,978: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:00:11.978830467Z [2024-04-21 02:00:11,978: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:00:11.979072185Z [2024-04-21 02:00:11,978: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:00:12.112735898Z [2024-04-21 02:00:12,112: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:00:12.783326455Z [2024-04-21 02:00:12,782: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[913fdecf-b402-41a4-a734-8cecbec35cfd] succeeded in 2.2194956069997716s: None 2024-04-21T02:01:00.669018409Z [2024-04-21 02:01:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7f104ec-496f-4dfb-af1d-10aef31d1814] received 2024-04-21T02:01:00.673851221Z [2024-04-21 02:01:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19da6ef3-a24b-4e73-9301-040ca8eee3e8] received 2024-04-21T02:01:00.675474742Z [2024-04-21 02:01:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cb323e8-dc21-4061-987e-a08b63e4923a] received 2024-04-21T02:01:00.682321832Z [2024-04-21 02:01:00,681: INFO/ForkPoolWorker-15] [c7f104ec-496f-4dfb-af1d-10aef31d1814] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:01:00.688408036Z [2024-04-21 02:01:00,688: INFO/ForkPoolWorker-16] [19da6ef3-a24b-4e73-9301-040ca8eee3e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:01:00.689609920Z [2024-04-21 02:01:00,689: INFO/ForkPoolWorker-1] [5cb323e8-dc21-4061-987e-a08b63e4923a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:01:00.958517523Z [2024-04-21 02:01:00,955: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:01:00.984988777Z [2024-04-21 02:01:00,981: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:01:01.002102641Z [2024-04-21 02:01:00,995: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:01:01.226042123Z [2024-04-21 02:01:01,225: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:01:01.229918423Z [2024-04-21 02:01:01,229: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:01:01.269160416Z [2024-04-21 02:01:01,268: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:01:01.270316960Z [2024-04-21 02:01:01,270: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:01:01.270509550Z [2024-04-21 02:01:01,270: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:01:01.270579166Z [2024-04-21 02:01:01,270: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:01:01.271373042Z [2024-04-21 02:01:01,271: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:01:01.394566660Z [2024-04-21 02:01:01,394: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:01:02.152838966Z [2024-04-21 02:01:02,152: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19da6ef3-a24b-4e73-9301-040ca8eee3e8] succeeded in 1.4777078759998403s: None 2024-04-21T02:01:02.495390379Z [2024-04-21 02:01:02,494: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:01:02.499040451Z [2024-04-21 02:01:02,498: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:01:02.531928036Z [2024-04-21 02:01:02,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:01:02.534282781Z [2024-04-21 02:01:02,533: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:01:02.534402935Z [2024-04-21 02:01:02,534: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:01:02.534690959Z [2024-04-21 02:01:02,534: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:01:02.534811187Z [2024-04-21 02:01:02,534: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:01:02.535441194Z [2024-04-21 02:01:02,535: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:01:02.535635407Z [2024-04-21 02:01:02,535: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:01:02.619879135Z [2024-04-21 02:01:02,618: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:01:02.626852553Z [2024-04-21 02:01:02,625: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:01:02.679096566Z [2024-04-21 02:01:02,678: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:01:02.680857041Z [2024-04-21 02:01:02,680: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:01:02.680976420Z [2024-04-21 02:01:02,680: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:01:02.681058163Z [2024-04-21 02:01:02,680: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:01:02.681075869Z [2024-04-21 02:01:02,680: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:01:02.686822042Z [2024-04-21 02:01:02,680: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:01:02.686923719Z [2024-04-21 02:01:02,681: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:01:02.692097689Z [2024-04-21 02:01:02,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:01:02.824380404Z [2024-04-21 02:01:02,823: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:01:04.496189392Z [2024-04-21 02:01:04,495: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5cb323e8-dc21-4061-987e-a08b63e4923a] succeeded in 3.8177454249998846s: None 2024-04-21T02:01:06.308690394Z [2024-04-21 02:01:06,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7f104ec-496f-4dfb-af1d-10aef31d1814] succeeded in 5.637443093999536s: None 2024-04-21T02:02:00.562291115Z [2024-04-21 02:02:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71a497c8-47ae-4e10-b287-54c6ce02c854] received 2024-04-21T02:02:00.574890968Z [2024-04-21 02:02:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f7cf427-307b-42d7-b293-b863ffbf950b] received 2024-04-21T02:02:00.589780355Z [2024-04-21 02:02:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db7d5395-71e1-4cc9-acd0-6a344a8e21dd] received 2024-04-21T02:02:00.592279099Z [2024-04-21 02:02:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25edb18f-ae99-4dbe-aa20-e8a32637fd5f] received 2024-04-21T02:02:00.593787250Z [2024-04-21 02:02:00,593: INFO/ForkPoolWorker-15] [71a497c8-47ae-4e10-b287-54c6ce02c854] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:02:00.604369872Z [2024-04-21 02:02:00,604: INFO/ForkPoolWorker-16] [8f7cf427-307b-42d7-b293-b863ffbf950b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:02:00.607064668Z [2024-04-21 02:02:00,605: INFO/ForkPoolWorker-1] [db7d5395-71e1-4cc9-acd0-6a344a8e21dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:02:00.620989809Z [2024-04-21 02:02:00,620: INFO/ForkPoolWorker-2] [25edb18f-ae99-4dbe-aa20-e8a32637fd5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:02:00.946139336Z [2024-04-21 02:02:00,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:02:00.961578074Z [2024-04-21 02:02:00,956: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:02:00.977706369Z [2024-04-21 02:02:00,974: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:02:01.072294563Z [2024-04-21 02:02:01,067: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:02:01.165604620Z [2024-04-21 02:02:01,165: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:02:01.170010844Z [2024-04-21 02:02:01,169: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:02:01.220831300Z [2024-04-21 02:02:01,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:02:01.223057083Z [2024-04-21 02:02:01,222: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:02:01.223238230Z [2024-04-21 02:02:01,223: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:02:01.223348377Z [2024-04-21 02:02:01,223: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:02:01.223635444Z [2024-04-21 02:02:01,223: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:02:01.316956000Z [2024-04-21 02:02:01,316: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:02:01.350706079Z [2024-04-21 02:02:01,350: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:02:02.027739269Z [2024-04-21 02:02:02,027: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f7cf427-307b-42d7-b293-b863ffbf950b] succeeded in 1.4423938400013867s: None 2024-04-21T02:02:02.123052022Z [2024-04-21 02:02:02,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71a497c8-47ae-4e10-b287-54c6ce02c854] succeeded in 1.555711203998726s: None 2024-04-21T02:02:02.569547287Z [2024-04-21 02:02:02,569: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:02:02.573333540Z [2024-04-21 02:02:02,572: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:02:02.603307857Z [2024-04-21 02:02:02,603: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:02:02.605057877Z [2024-04-21 02:02:02,604: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:02:02.605289443Z [2024-04-21 02:02:02,605: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:02:02.605567278Z [2024-04-21 02:02:02,605: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:02:02.605778085Z [2024-04-21 02:02:02,605: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:02:02.606159818Z [2024-04-21 02:02:02,606: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:02:02.606695091Z [2024-04-21 02:02:02,606: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:02:02.700730799Z [2024-04-21 02:02:02,700: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:02:02.737290159Z [2024-04-21 02:02:02,736: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:02:02.740601531Z [2024-04-21 02:02:02,740: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:02:02.756780020Z [2024-04-21 02:02:02,756: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:02:02.758001462Z [2024-04-21 02:02:02,757: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:02:02.758013725Z [2024-04-21 02:02:02,757: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:02:02.758137919Z [2024-04-21 02:02:02,757: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:02:02.758204751Z [2024-04-21 02:02:02,758: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:02:02.758488197Z [2024-04-21 02:02:02,758: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:02:02.758500085Z [2024-04-21 02:02:02,758: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:02:02.862512912Z [2024-04-21 02:02:02,862: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:02:04.903739404Z [2024-04-21 02:02:04,902: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25edb18f-ae99-4dbe-aa20-e8a32637fd5f] succeeded in 4.305171970001538s: None 2024-04-21T02:02:05.448183299Z [2024-04-21 02:02:05,447: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db7d5395-71e1-4cc9-acd0-6a344a8e21dd] succeeded in 4.854479482999523s: None 2024-04-21T02:03:00.382527157Z [2024-04-21 02:03:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[883779cb-7517-4b79-b0f6-fda6dd40ee27] received 2024-04-21T02:03:00.388935428Z [2024-04-21 02:03:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e143bc36-0a28-4db7-9593-5a440c65c670] received 2024-04-21T02:03:00.396928302Z [2024-04-21 02:03:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d881f1c-03d5-4dbe-bf24-04665de4aa12] received 2024-04-21T02:03:00.403450001Z [2024-04-21 02:03:00,403: INFO/ForkPoolWorker-1] [6d881f1c-03d5-4dbe-bf24-04665de4aa12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:03:00.407444174Z [2024-04-21 02:03:00,406: INFO/ForkPoolWorker-15] [883779cb-7517-4b79-b0f6-fda6dd40ee27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:03:00.407517426Z [2024-04-21 02:03:00,407: INFO/ForkPoolWorker-16] [e143bc36-0a28-4db7-9593-5a440c65c670] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:03:00.751844498Z [2024-04-21 02:03:00,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:03:00.817103671Z [2024-04-21 02:03:00,795: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:03:00.960390496Z [2024-04-21 02:03:00,959: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:03:00.964461957Z [2024-04-21 02:03:00,963: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:03:00.997383239Z [2024-04-21 02:03:00,993: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:03:01.013059239Z [2024-04-21 02:03:01,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:03:01.020843400Z [2024-04-21 02:03:01,020: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:03:01.021142031Z [2024-04-21 02:03:01,020: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:03:01.021340120Z [2024-04-21 02:03:01,021: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:03:01.021773308Z [2024-04-21 02:03:01,021: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:03:01.192110729Z [2024-04-21 02:03:01,191: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:03:01.786306483Z [2024-04-21 02:03:01,785: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e143bc36-0a28-4db7-9593-5a440c65c670] succeeded in 1.392932340999323s: None 2024-04-21T02:03:02.286457808Z [2024-04-21 02:03:02,285: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:03:02.290223464Z [2024-04-21 02:03:02,289: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:03:02.316472296Z [2024-04-21 02:03:02,316: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:03:02.317890108Z [2024-04-21 02:03:02,317: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:03:02.317907227Z [2024-04-21 02:03:02,317: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:03:02.318059753Z [2024-04-21 02:03:02,317: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:03:02.318108959Z [2024-04-21 02:03:02,318: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:03:02.318821482Z [2024-04-21 02:03:02,318: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:03:02.318840813Z [2024-04-21 02:03:02,318: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:03:02.435108512Z [2024-04-21 02:03:02,434: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:03:02.462588438Z [2024-04-21 02:03:02,462: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:03:02.466067561Z [2024-04-21 02:03:02,465: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:03:02.496747726Z [2024-04-21 02:03:02,496: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:03:02.499282783Z [2024-04-21 02:03:02,499: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:03:02.499402241Z [2024-04-21 02:03:02,499: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:03:02.499612488Z [2024-04-21 02:03:02,499: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:03:02.499765760Z [2024-04-21 02:03:02,499: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:03:02.500106759Z [2024-04-21 02:03:02,499: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:03:02.500320130Z [2024-04-21 02:03:02,500: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:03:02.606076453Z [2024-04-21 02:03:02,605: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:03:04.655562493Z [2024-04-21 02:03:04,655: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d881f1c-03d5-4dbe-bf24-04665de4aa12] succeeded in 4.257299824001166s: None 2024-04-21T02:03:05.772048447Z [2024-04-21 02:03:05,771: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[883779cb-7517-4b79-b0f6-fda6dd40ee27] succeeded in 5.384299375999035s: None 2024-04-21T02:04:00.348502454Z [2024-04-21 02:04:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f981d13d-a1d5-4464-9fb9-8df912f09075] received 2024-04-21T02:04:00.351531316Z [2024-04-21 02:04:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c09b533e-61eb-489f-86f9-9f2a2e03e5ba] received 2024-04-21T02:04:00.354554433Z [2024-04-21 02:04:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5876ca3-0bbd-43ed-843d-dc3d4c6b14d3] received 2024-04-21T02:04:00.357312029Z [2024-04-21 02:04:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e42b04bb-260d-41ec-ba64-eeb66e9ebd3f] received 2024-04-21T02:04:00.364875726Z [2024-04-21 02:04:00,364: INFO/ForkPoolWorker-1] [f5876ca3-0bbd-43ed-843d-dc3d4c6b14d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:04:00.366384895Z [2024-04-21 02:04:00,365: INFO/ForkPoolWorker-15] [f981d13d-a1d5-4464-9fb9-8df912f09075] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:04:00.375507008Z [2024-04-21 02:04:00,375: INFO/ForkPoolWorker-16] [c09b533e-61eb-489f-86f9-9f2a2e03e5ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:04:00.381315833Z [2024-04-21 02:04:00,380: INFO/ForkPoolWorker-2] [e42b04bb-260d-41ec-ba64-eeb66e9ebd3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:04:00.669626551Z [2024-04-21 02:04:00,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:04:00.715436012Z [2024-04-21 02:04:00,712: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:04:00.758082428Z [2024-04-21 02:04:00,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:04:00.782459170Z [2024-04-21 02:04:00,779: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:04:00.929545051Z [2024-04-21 02:04:00,929: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:04:00.934017668Z [2024-04-21 02:04:00,933: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:04:00.993311442Z [2024-04-21 02:04:00,993: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:04:00.996751561Z [2024-04-21 02:04:00,996: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:04:00.996992704Z [2024-04-21 02:04:00,996: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:04:00.997160341Z [2024-04-21 02:04:00,997: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:04:00.997521024Z [2024-04-21 02:04:00,997: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:04:01.240519766Z [2024-04-21 02:04:01,240: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:04:01.268267191Z [2024-04-21 02:04:01,268: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:04:02.098250616Z [2024-04-21 02:04:02,097: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5876ca3-0bbd-43ed-843d-dc3d4c6b14d3] succeeded in 1.742124012000204s: None 2024-04-21T02:04:02.185379355Z [2024-04-21 02:04:02,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f981d13d-a1d5-4464-9fb9-8df912f09075] succeeded in 1.8317472900016583s: None 2024-04-21T02:04:02.468122914Z [2024-04-21 02:04:02,467: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:04:02.477698896Z [2024-04-21 02:04:02,477: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:04:02.526035240Z [2024-04-21 02:04:02,525: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:04:02.528895727Z [2024-04-21 02:04:02,528: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:04:02.529471494Z [2024-04-21 02:04:02,529: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:04:02.530055949Z [2024-04-21 02:04:02,529: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:04:02.530397745Z [2024-04-21 02:04:02,530: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:04:02.530953013Z [2024-04-21 02:04:02,530: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:04:02.531929869Z [2024-04-21 02:04:02,531: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:04:02.581537978Z [2024-04-21 02:04:02,581: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:04:02.585282943Z [2024-04-21 02:04:02,584: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:04:02.623958937Z [2024-04-21 02:04:02,623: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:04:02.627175198Z [2024-04-21 02:04:02,626: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:04:02.627194399Z [2024-04-21 02:04:02,627: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:04:02.627277307Z [2024-04-21 02:04:02,627: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:04:02.627329377Z [2024-04-21 02:04:02,627: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:04:02.627575366Z [2024-04-21 02:04:02,627: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:04:02.627594591Z [2024-04-21 02:04:02,627: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:04:02.666646722Z [2024-04-21 02:04:02,666: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:04:02.743881029Z [2024-04-21 02:04:02,743: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:04:04.915345306Z [2024-04-21 02:04:04,914: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c09b533e-61eb-489f-86f9-9f2a2e03e5ba] succeeded in 4.560876915000335s: None 2024-04-21T02:04:05.624389932Z [2024-04-21 02:04:05,623: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e42b04bb-260d-41ec-ba64-eeb66e9ebd3f] succeeded in 5.26245177599958s: None 2024-04-21T02:05:00.690214793Z [2024-04-21 02:05:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0bb2362-5fc4-43eb-8980-5db19e9c98e0] received 2024-04-21T02:05:00.695012254Z [2024-04-21 02:05:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3fc305d-00a0-4eb1-aa51-5bba56071581] received 2024-04-21T02:05:00.706914002Z [2024-04-21 02:05:00,706: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98dedb9b-52c0-43eb-a23e-823fa459d4c4] received 2024-04-21T02:05:00.709153854Z [2024-04-21 02:05:00,708: INFO/ForkPoolWorker-16] [c3fc305d-00a0-4eb1-aa51-5bba56071581] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:05:00.710714467Z [2024-04-21 02:05:00,710: INFO/ForkPoolWorker-15] [f0bb2362-5fc4-43eb-8980-5db19e9c98e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:05:00.714932580Z [2024-04-21 02:05:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61b2bef2-3727-46c4-addb-2f2b8654c362] received 2024-04-21T02:05:00.736261757Z [2024-04-21 02:05:00,735: INFO/ForkPoolWorker-2] [61b2bef2-3727-46c4-addb-2f2b8654c362] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:05:00.743397400Z [2024-04-21 02:05:00,743: INFO/ForkPoolWorker-1] [98dedb9b-52c0-43eb-a23e-823fa459d4c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:05:01.022591200Z [2024-04-21 02:05:01,019: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:05:01.069999284Z [2024-04-21 02:05:01,064: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:05:01.191735115Z [2024-04-21 02:05:01,185: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:05:01.260052873Z [2024-04-21 02:05:01,256: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:05:01.331386283Z [2024-04-21 02:05:01,330: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:05:01.335485543Z [2024-04-21 02:05:01,335: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:05:01.381709418Z [2024-04-21 02:05:01,381: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:05:01.383468492Z [2024-04-21 02:05:01,383: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:05:01.383610333Z [2024-04-21 02:05:01,383: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:05:01.383705909Z [2024-04-21 02:05:01,383: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:05:01.384034131Z [2024-04-21 02:05:01,383: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:05:01.581275868Z [2024-04-21 02:05:01,581: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:05:02.355617791Z [2024-04-21 02:05:02,355: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3fc305d-00a0-4eb1-aa51-5bba56071581] succeeded in 1.6574462589996983s: None 2024-04-21T02:05:02.707418767Z [2024-04-21 02:05:02,706: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:05:02.711097054Z [2024-04-21 02:05:02,710: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:05:02.733773480Z [2024-04-21 02:05:02,733: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:05:02.737259963Z [2024-04-21 02:05:02,736: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:05:02.748484625Z [2024-04-21 02:05:02,748: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:05:02.749888987Z [2024-04-21 02:05:02,749: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:05:02.749920834Z [2024-04-21 02:05:02,749: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:05:02.750093866Z [2024-04-21 02:05:02,749: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:05:02.750148500Z [2024-04-21 02:05:02,750: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:05:02.750422090Z [2024-04-21 02:05:02,750: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:05:02.750474698Z [2024-04-21 02:05:02,750: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:05:02.816783059Z [2024-04-21 02:05:02,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:05:02.817959173Z [2024-04-21 02:05:02,817: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:05:02.817980628Z [2024-04-21 02:05:02,817: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:05:02.818089353Z [2024-04-21 02:05:02,817: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:05:02.818102371Z [2024-04-21 02:05:02,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:05:02.818344263Z [2024-04-21 02:05:02,818: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:05:02.818357432Z [2024-04-21 02:05:02,818: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:05:02.837360585Z [2024-04-21 02:05:02,837: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:05:02.927271134Z [2024-04-21 02:05:02,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:05:03.198044398Z [2024-04-21 02:05:03,197: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:05:03.201695105Z [2024-04-21 02:05:03,201: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:05:03.230555184Z [2024-04-21 02:05:03,230: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:05:03.232197529Z [2024-04-21 02:05:03,231: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:05:03.232893904Z [2024-04-21 02:05:03,232: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:05:03.236983186Z [2024-04-21 02:05:03,236: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:05:03.237232799Z [2024-04-21 02:05:03,237: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:05:03.239060380Z [2024-04-21 02:05:03,238: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:05:03.240037600Z [2024-04-21 02:05:03,239: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:05:03.342936603Z [2024-04-21 02:05:03,342: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:05:03.608856566Z [2024-04-21 02:05:03,608: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0bb2362-5fc4-43eb-8980-5db19e9c98e0] succeeded in 2.9148709400014923s: None 2024-04-21T02:05:03.692924211Z [2024-04-21 02:05:03,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d081ac0-64a8-4fb1-8b3e-d75e8dd8920d] received 2024-04-21T02:05:03.700485007Z [2024-04-21 02:05:03,700: INFO/ForkPoolWorker-15] [0d081ac0-64a8-4fb1-8b3e-d75e8dd8920d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:05:04.253541822Z [2024-04-21 02:05:04,249: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:05:04.578613538Z [2024-04-21 02:05:04,577: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[61b2bef2-3727-46c4-addb-2f2b8654c362] succeeded in 3.859988369000348s: None 2024-04-21T02:05:05.578934477Z [2024-04-21 02:05:05,578: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:05:05.582145733Z [2024-04-21 02:05:05,581: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:05:05.615370960Z [2024-04-21 02:05:05,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:05:05.619166108Z [2024-04-21 02:05:05,618: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:05:05.619185500Z [2024-04-21 02:05:05,619: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:05:05.620292932Z [2024-04-21 02:05:05,619: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:05:05.620498901Z [2024-04-21 02:05:05,620: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:05:05.621061173Z [2024-04-21 02:05:05,620: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:05:05.621243454Z [2024-04-21 02:05:05,621: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:05:05.741817591Z [2024-04-21 02:05:05,741: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[98dedb9b-52c0-43eb-a23e-823fa459d4c4] succeeded in 5.029810120000548s: None 2024-04-21T02:05:05.749890621Z [2024-04-21 02:05:05,749: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:05:06.445068740Z [2024-04-21 02:05:06,444: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d081ac0-64a8-4fb1-8b3e-d75e8dd8920d] succeeded in 2.7502259590000904s: None 2024-04-21T02:05:06.826264634Z [2024-04-21 02:05:06,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92be9270-552c-4b39-8806-f3cb6c302e6c] received 2024-04-21T02:05:06.832869516Z [2024-04-21 02:05:06,832: INFO/ForkPoolWorker-15] [92be9270-552c-4b39-8806-f3cb6c302e6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:05:07.129277838Z [2024-04-21 02:05:07,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:05:08.238176882Z [2024-04-21 02:05:08,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:05:08.241042446Z [2024-04-21 02:05:08,240: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:05:08.279074214Z [2024-04-21 02:05:08,278: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:05:08.281932281Z [2024-04-21 02:05:08,281: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:05:08.282071742Z [2024-04-21 02:05:08,281: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:05:08.282507965Z [2024-04-21 02:05:08,282: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:05:08.282678334Z [2024-04-21 02:05:08,282: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:05:08.283211077Z [2024-04-21 02:05:08,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:05:08.283519217Z [2024-04-21 02:05:08,283: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:05:08.372769827Z [2024-04-21 02:05:08,372: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:05:09.055063346Z [2024-04-21 02:05:09,054: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92be9270-552c-4b39-8806-f3cb6c302e6c] succeeded in 2.2265285570010747s: None 2024-04-21T02:05:09.268669419Z [2024-04-21 02:05:09,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24023bf0-9348-483a-b10d-78a9024e2ff5] received 2024-04-21T02:05:09.279248815Z [2024-04-21 02:05:09,278: INFO/ForkPoolWorker-15] [24023bf0-9348-483a-b10d-78a9024e2ff5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:05:09.565626405Z [2024-04-21 02:05:09,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:05:10.673219853Z [2024-04-21 02:05:10,672: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:05:10.676232972Z [2024-04-21 02:05:10,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:05:10.700432618Z [2024-04-21 02:05:10,700: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:05:10.702116003Z [2024-04-21 02:05:10,701: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:05:10.702139212Z [2024-04-21 02:05:10,701: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:05:10.702814986Z [2024-04-21 02:05:10,702: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:05:10.702832049Z [2024-04-21 02:05:10,702: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:05:10.703280415Z [2024-04-21 02:05:10,702: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:05:10.703338669Z [2024-04-21 02:05:10,703: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:05:10.805458022Z [2024-04-21 02:05:10,805: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:05:11.449536964Z [2024-04-21 02:05:11,449: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24023bf0-9348-483a-b10d-78a9024e2ff5] succeeded in 2.177853900999253s: None 2024-04-21T02:06:00.525407231Z [2024-04-21 02:06:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[803c3b42-dd9a-4124-b49a-af947d37ccb5] received 2024-04-21T02:06:00.528473766Z [2024-04-21 02:06:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f4e6776-79bd-44b8-8819-50cf8be16f6d] received 2024-04-21T02:06:00.531520942Z [2024-04-21 02:06:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[170df0a5-f507-4c83-a0c7-e706770f6822] received 2024-04-21T02:06:00.533636813Z [2024-04-21 02:06:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8b30452-42e4-4f51-8300-4107fe106ff5] received 2024-04-21T02:06:00.541833549Z [2024-04-21 02:06:00,541: INFO/ForkPoolWorker-16] [3f4e6776-79bd-44b8-8819-50cf8be16f6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:06:00.550812220Z [2024-04-21 02:06:00,550: INFO/ForkPoolWorker-2] [e8b30452-42e4-4f51-8300-4107fe106ff5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:06:00.554051600Z [2024-04-21 02:06:00,553: INFO/ForkPoolWorker-1] [170df0a5-f507-4c83-a0c7-e706770f6822] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:06:00.574295255Z [2024-04-21 02:06:00,573: INFO/ForkPoolWorker-15] [803c3b42-dd9a-4124-b49a-af947d37ccb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:06:00.865963471Z [2024-04-21 02:06:00,859: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:06:00.872582862Z [2024-04-21 02:06:00,867: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:06:00.951039091Z [2024-04-21 02:06:00,946: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:06:01.031930813Z [2024-04-21 02:06:01,028: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:06:01.207412184Z [2024-04-21 02:06:01,206: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:06:01.210114694Z [2024-04-21 02:06:01,209: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:06:01.211574713Z [2024-04-21 02:06:01,211: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:06:01.253230753Z [2024-04-21 02:06:01,252: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:06:01.254319862Z [2024-04-21 02:06:01,254: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:06:01.254372877Z [2024-04-21 02:06:01,254: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:06:01.254429537Z [2024-04-21 02:06:01,254: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:06:01.254630528Z [2024-04-21 02:06:01,254: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:06:01.343228274Z [2024-04-21 02:06:01,342: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:06:01.908423679Z [2024-04-21 02:06:01,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f4e6776-79bd-44b8-8819-50cf8be16f6d] succeeded in 1.3777381330000935s: None 2024-04-21T02:06:02.014715216Z [2024-04-21 02:06:02,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[803c3b42-dd9a-4124-b49a-af947d37ccb5] succeeded in 1.4823344679989532s: None 2024-04-21T02:06:02.420849412Z [2024-04-21 02:06:02,420: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:06:02.424118182Z [2024-04-21 02:06:02,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:06:02.452683661Z [2024-04-21 02:06:02,450: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:06:02.455477878Z [2024-04-21 02:06:02,455: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:06:02.455659641Z [2024-04-21 02:06:02,455: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:06:02.456208563Z [2024-04-21 02:06:02,455: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:06:02.456371511Z [2024-04-21 02:06:02,456: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:06:02.457066271Z [2024-04-21 02:06:02,456: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:06:02.457204973Z [2024-04-21 02:06:02,457: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:06:02.546378262Z [2024-04-21 02:06:02,546: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:06:02.550137843Z [2024-04-21 02:06:02,549: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:06:02.581136999Z [2024-04-21 02:06:02,580: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:06:02.583183750Z [2024-04-21 02:06:02,582: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:06:02.588182279Z [2024-04-21 02:06:02,587: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:06:02.588877110Z [2024-04-21 02:06:02,588: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:06:02.589116731Z [2024-04-21 02:06:02,588: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:06:02.589282757Z [2024-04-21 02:06:02,589: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:06:02.589615608Z [2024-04-21 02:06:02,589: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:06:02.589794207Z [2024-04-21 02:06:02,589: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:06:02.702337740Z [2024-04-21 02:06:02,702: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:06:04.407074980Z [2024-04-21 02:06:04,406: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e8b30452-42e4-4f51-8300-4107fe106ff5] succeeded in 3.869757942000433s: None 2024-04-21T02:06:05.254074476Z [2024-04-21 02:06:05,253: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[170df0a5-f507-4c83-a0c7-e706770f6822] succeeded in 4.717990325998471s: None 2024-04-21T02:07:00.926685253Z [2024-04-21 02:07:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ad047a3-89dc-418f-b092-854d88915a5e] received 2024-04-21T02:07:00.932132952Z [2024-04-21 02:07:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b781b54-f4ab-4e28-8c05-d6af40f69d38] received 2024-04-21T02:07:00.935880599Z [2024-04-21 02:07:00,935: INFO/ForkPoolWorker-15] [5ad047a3-89dc-418f-b092-854d88915a5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:07:00.943487719Z [2024-04-21 02:07:00,943: INFO/ForkPoolWorker-16] [2b781b54-f4ab-4e28-8c05-d6af40f69d38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:07:00.949532669Z [2024-04-21 02:07:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1ccca7e-3b09-4085-9808-6985055d798d] received 2024-04-21T02:07:00.968413708Z [2024-04-21 02:07:00,968: INFO/ForkPoolWorker-1] [c1ccca7e-3b09-4085-9808-6985055d798d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:07:01.372915885Z [2024-04-21 02:07:01,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:07:01.410923104Z [2024-04-21 02:07:01,405: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:07:01.471813076Z [2024-04-21 02:07:01,464: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:07:01.686097380Z [2024-04-21 02:07:01,685: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:07:01.693065587Z [2024-04-21 02:07:01,692: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:07:01.756455168Z [2024-04-21 02:07:01,756: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:07:01.760903187Z [2024-04-21 02:07:01,760: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:07:01.761716637Z [2024-04-21 02:07:01,761: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:07:01.761791331Z [2024-04-21 02:07:01,761: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:07:01.762185295Z [2024-04-21 02:07:01,761: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:07:01.894495189Z [2024-04-21 02:07:01,894: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:07:02.696904617Z [2024-04-21 02:07:02,696: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ad047a3-89dc-418f-b092-854d88915a5e] succeeded in 1.7680241910002223s: None 2024-04-21T02:07:03.011744462Z [2024-04-21 02:07:03,011: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:07:03.014999173Z [2024-04-21 02:07:03,014: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:07:03.040174498Z [2024-04-21 02:07:03,039: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:07:03.043340063Z [2024-04-21 02:07:03,043: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:07:03.043624696Z [2024-04-21 02:07:03,043: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:07:03.043818121Z [2024-04-21 02:07:03,043: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:07:03.043899962Z [2024-04-21 02:07:03,043: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:07:03.044216937Z [2024-04-21 02:07:03,044: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:07:03.044548058Z [2024-04-21 02:07:03,044: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:07:03.169801652Z [2024-04-21 02:07:03,167: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:07:03.201927909Z [2024-04-21 02:07:03,201: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:07:03.206643629Z [2024-04-21 02:07:03,206: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:07:03.286738051Z [2024-04-21 02:07:03,286: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:07:03.288047673Z [2024-04-21 02:07:03,287: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:07:03.288184993Z [2024-04-21 02:07:03,287: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:07:03.288375610Z [2024-04-21 02:07:03,288: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:07:03.288449676Z [2024-04-21 02:07:03,288: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:07:03.288711551Z [2024-04-21 02:07:03,288: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:07:03.288728479Z [2024-04-21 02:07:03,288: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:07:03.373775367Z [2024-04-21 02:07:03,373: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:07:05.009165486Z [2024-04-21 02:07:05,008: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1ccca7e-3b09-4085-9808-6985055d798d] succeeded in 4.054110974999276s: None 2024-04-21T02:07:05.706784955Z [2024-04-21 02:07:05,706: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b781b54-f4ab-4e28-8c05-d6af40f69d38] succeeded in 4.769776229999479s: None 2024-04-21T02:08:01.297289741Z [2024-04-21 02:08:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76f55372-20df-49c5-9d6d-b4be51bc2d3e] received 2024-04-21T02:08:01.300618291Z [2024-04-21 02:08:01,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[817d6516-b81a-486e-bf8d-41e670c37612] received 2024-04-21T02:08:01.310770916Z [2024-04-21 02:08:01,309: INFO/ForkPoolWorker-15] [76f55372-20df-49c5-9d6d-b4be51bc2d3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:08:01.310816876Z [2024-04-21 02:08:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d5550e6-5564-41c8-8067-b54a0ca0df43] received 2024-04-21T02:08:01.317286191Z [2024-04-21 02:08:01,316: INFO/ForkPoolWorker-16] [817d6516-b81a-486e-bf8d-41e670c37612] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:08:01.322398686Z [2024-04-21 02:08:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b52386d7-0623-4efd-af01-aba4c39289e5] received 2024-04-21T02:08:01.328160275Z [2024-04-21 02:08:01,327: INFO/ForkPoolWorker-1] [7d5550e6-5564-41c8-8067-b54a0ca0df43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:08:01.343882331Z [2024-04-21 02:08:01,343: INFO/ForkPoolWorker-2] [b52386d7-0623-4efd-af01-aba4c39289e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:08:01.864610534Z [2024-04-21 02:08:01,859: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:08:01.962809423Z [2024-04-21 02:08:01,959: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:08:02.036284529Z [2024-04-21 02:08:02,032: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:08:02.286360850Z [2024-04-21 02:08:02,277: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:08:02.441604196Z [2024-04-21 02:08:02,439: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T02:08:02.450702048Z [2024-04-21 02:08:02,450: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:08:02.455753513Z [2024-04-21 02:08:02,455: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:08:02.511655694Z [2024-04-21 02:08:02,511: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:08:02.514600322Z [2024-04-21 02:08:02,514: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:08:02.514791398Z [2024-04-21 02:08:02,514: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:08:02.515003111Z [2024-04-21 02:08:02,514: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T02:08:02.515516952Z [2024-04-21 02:08:02,515: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:08:02.689514160Z [2024-04-21 02:08:02,689: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:08:03.342723104Z [2024-04-21 02:08:03,342: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76f55372-20df-49c5-9d6d-b4be51bc2d3e] succeeded in 2.0394604810007877s: None 2024-04-21T02:08:03.442289715Z [2024-04-21 02:08:03,441: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b52386d7-0623-4efd-af01-aba4c39289e5] succeeded in 2.1136316079991957s: None 2024-04-21T02:08:04.706789290Z [2024-04-21 02:08:04,706: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:08:04.711711115Z [2024-04-21 02:08:04,711: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:08:04.723600878Z [2024-04-21 02:08:04,723: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:08:04.728909620Z [2024-04-21 02:08:04,728: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:08:04.752711683Z [2024-04-21 02:08:04,752: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:08:04.756362714Z [2024-04-21 02:08:04,756: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:08:04.756539005Z [2024-04-21 02:08:04,756: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:08:04.756741047Z [2024-04-21 02:08:04,756: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:08:04.756954857Z [2024-04-21 02:08:04,756: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:08:04.757282839Z [2024-04-21 02:08:04,757: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:08:04.757395162Z [2024-04-21 02:08:04,757: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:08:04.776128876Z [2024-04-21 02:08:04,775: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:08:04.796598893Z [2024-04-21 02:08:04,796: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:08:04.796634224Z [2024-04-21 02:08:04,796: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:08:04.796700850Z [2024-04-21 02:08:04,796: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:08:04.797642990Z [2024-04-21 02:08:04,796: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:08:04.797655708Z [2024-04-21 02:08:04,797: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:08:04.797659399Z [2024-04-21 02:08:04,797: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:08:04.952544763Z [2024-04-21 02:08:04,952: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:08:04.961156409Z [2024-04-21 02:08:04,960: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:08:06.893610128Z [2024-04-21 02:08:06,893: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7d5550e6-5564-41c8-8067-b54a0ca0df43] succeeded in 5.575896242000454s: None 2024-04-21T02:08:07.381294572Z [2024-04-21 02:08:07,380: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[817d6516-b81a-486e-bf8d-41e670c37612] succeeded in 6.072146926999267s: None 2024-04-21T02:09:00.272911252Z [2024-04-21 02:09:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3087331e-319d-4415-b085-e431fde0b6e4] received 2024-04-21T02:09:00.275791245Z [2024-04-21 02:09:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[030c8a1d-b78a-4b51-806e-a0b676b76197] received 2024-04-21T02:09:00.280453010Z [2024-04-21 02:09:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8d10bc0-328d-45bc-aeee-a483db3475d6] received 2024-04-21T02:09:00.295440433Z [2024-04-21 02:09:00,295: INFO/ForkPoolWorker-16] [030c8a1d-b78a-4b51-806e-a0b676b76197] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:09:00.299568182Z [2024-04-21 02:09:00,299: INFO/ForkPoolWorker-1] [c8d10bc0-328d-45bc-aeee-a483db3475d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:09:00.304883339Z [2024-04-21 02:09:00,304: INFO/ForkPoolWorker-15] [3087331e-319d-4415-b085-e431fde0b6e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:09:00.633586907Z [2024-04-21 02:09:00,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:09:00.645240364Z [2024-04-21 02:09:00,641: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:09:00.711525411Z [2024-04-21 02:09:00,707: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:09:00.830730749Z [2024-04-21 02:09:00,830: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:09:00.834609327Z [2024-04-21 02:09:00,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:09:00.861506222Z [2024-04-21 02:09:00,861: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:09:00.863108819Z [2024-04-21 02:09:00,862: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:09:00.863265551Z [2024-04-21 02:09:00,863: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:09:00.863376375Z [2024-04-21 02:09:00,863: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:09:00.863770069Z [2024-04-21 02:09:00,863: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:09:00.951961677Z [2024-04-21 02:09:00,951: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:09:01.635406200Z [2024-04-21 02:09:01,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3087331e-319d-4415-b085-e431fde0b6e4] succeeded in 1.3550668530006078s: None 2024-04-21T02:09:02.049414384Z [2024-04-21 02:09:02,049: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:09:02.053100758Z [2024-04-21 02:09:02,052: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:09:02.080281565Z [2024-04-21 02:09:02,079: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:09:02.081980442Z [2024-04-21 02:09:02,081: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:09:02.082263656Z [2024-04-21 02:09:02,082: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:09:02.082681265Z [2024-04-21 02:09:02,082: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:09:02.082960079Z [2024-04-21 02:09:02,082: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:09:02.083552026Z [2024-04-21 02:09:02,083: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:09:02.084011937Z [2024-04-21 02:09:02,083: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:09:02.169579210Z [2024-04-21 02:09:02,169: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:09:02.190520369Z [2024-04-21 02:09:02,187: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:09:02.196034341Z [2024-04-21 02:09:02,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:09:02.221345411Z [2024-04-21 02:09:02,221: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:09:02.225051281Z [2024-04-21 02:09:02,224: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:09:02.225124569Z [2024-04-21 02:09:02,224: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:09:02.225353316Z [2024-04-21 02:09:02,225: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:09:02.225437249Z [2024-04-21 02:09:02,225: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:09:02.225948680Z [2024-04-21 02:09:02,225: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:09:02.226079570Z [2024-04-21 02:09:02,225: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:09:02.318919263Z [2024-04-21 02:09:02,318: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:09:03.757004835Z [2024-04-21 02:09:03,756: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c8d10bc0-328d-45bc-aeee-a483db3475d6] succeeded in 3.472403990001112s: None 2024-04-21T02:09:04.192599334Z [2024-04-21 02:09:04,192: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[030c8a1d-b78a-4b51-806e-a0b676b76197] succeeded in 3.913674663001075s: None 2024-04-21T02:10:01.259603634Z [2024-04-21 02:10:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cb56dc6-c532-450c-9840-99281a0e2e56] received 2024-04-21T02:10:01.269716920Z [2024-04-21 02:10:01,269: INFO/ForkPoolWorker-15] [9cb56dc6-c532-450c-9840-99281a0e2e56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:10:01.270069695Z [2024-04-21 02:10:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc8c9959-7bee-4715-9a4a-d54fd0de78ba] received 2024-04-21T02:10:01.276684165Z [2024-04-21 02:10:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07ba032b-b11d-4f6f-bbd8-9a8b039a81e7] received 2024-04-21T02:10:01.284680757Z [2024-04-21 02:10:01,284: INFO/ForkPoolWorker-1] [07ba032b-b11d-4f6f-bbd8-9a8b039a81e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:10:01.284714093Z [2024-04-21 02:10:01,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36b68764-2407-45f0-9c85-b2f3b44713ed] received 2024-04-21T02:10:01.286942026Z [2024-04-21 02:10:01,286: INFO/ForkPoolWorker-16] [fc8c9959-7bee-4715-9a4a-d54fd0de78ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:10:01.290283379Z [2024-04-21 02:10:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93772af8-9d40-48ef-a8cf-a30df959a455] received 2024-04-21T02:10:01.330711706Z [2024-04-21 02:10:01,330: INFO/ForkPoolWorker-2] [36b68764-2407-45f0-9c85-b2f3b44713ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:10:01.335524620Z [2024-04-21 02:10:01,335: INFO/ForkPoolWorker-3] [93772af8-9d40-48ef-a8cf-a30df959a455] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:10:01.726169285Z [2024-04-21 02:10:01,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:10:01.742151562Z [2024-04-21 02:10:01,738: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:10:01.905913946Z [2024-04-21 02:10:01,892: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:10:01.954977665Z [2024-04-21 02:10:01,954: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:10:01.959301136Z [2024-04-21 02:10:01,958: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:10:01.988891831Z [2024-04-21 02:10:01,988: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:10:01.990097114Z [2024-04-21 02:10:01,989: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:10:01.990174679Z [2024-04-21 02:10:01,990: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:10:01.990226575Z [2024-04-21 02:10:01,990: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:10:01.990495027Z [2024-04-21 02:10:01,990: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:10:02.012414445Z [2024-04-21 02:10:02,005: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:10:02.114685170Z [2024-04-21 02:10:02,114: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:10:02.543469615Z [2024-04-21 02:10:02,539: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:10:02.767456967Z [2024-04-21 02:10:02,767: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:10:02.822094636Z [2024-04-21 02:10:02,821: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9cb56dc6-c532-450c-9840-99281a0e2e56] succeeded in 1.5587440399995103s: None 2024-04-21T02:10:03.602789947Z [2024-04-21 02:10:03,602: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[36b68764-2407-45f0-9c85-b2f3b44713ed] succeeded in 2.31283303499913s: None 2024-04-21T02:10:03.790492425Z [2024-04-21 02:10:03,788: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:10:03.795799437Z [2024-04-21 02:10:03,791: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:10:03.872184209Z [2024-04-21 02:10:03,864: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:10:03.872211098Z [2024-04-21 02:10:03,871: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:10:03.872215078Z [2024-04-21 02:10:03,871: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:10:03.872218795Z [2024-04-21 02:10:03,871: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:10:03.872224439Z [2024-04-21 02:10:03,871: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:10:03.873609696Z [2024-04-21 02:10:03,871: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:10:03.873624964Z [2024-04-21 02:10:03,872: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:10:04.023797611Z [2024-04-21 02:10:04,023: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:10:04.505492860Z [2024-04-21 02:10:04,505: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:10:04.512775841Z [2024-04-21 02:10:04,512: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:10:04.584333665Z [2024-04-21 02:10:04,584: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:10:04.594885359Z [2024-04-21 02:10:04,594: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:10:04.594910749Z [2024-04-21 02:10:04,594: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:10:04.595062959Z [2024-04-21 02:10:04,594: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:10:04.595106599Z [2024-04-21 02:10:04,595: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:10:04.595759309Z [2024-04-21 02:10:04,595: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:10:04.595773869Z [2024-04-21 02:10:04,595: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:10:04.743776621Z [2024-04-21 02:10:04,743: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T02:10:04.747473623Z [2024-04-21 02:10:04,747: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:10:04.767975020Z [2024-04-21 02:10:04,767: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:10:04.805310740Z [2024-04-21 02:10:04,805: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T02:10:04.808611336Z [2024-04-21 02:10:04,808: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:10:04.816663963Z [2024-04-21 02:10:04,808: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:10:04.817101831Z [2024-04-21 02:10:04,816: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:10:04.817317510Z [2024-04-21 02:10:04,817: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T02:10:04.817736086Z [2024-04-21 02:10:04,817: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:10:04.817913764Z [2024-04-21 02:10:04,817: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:10:05.036787417Z [2024-04-21 02:10:05,036: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07ba032b-b11d-4f6f-bbd8-9a8b039a81e7] succeeded in 3.757950379000249s: None 2024-04-21T02:10:05.069157436Z [2024-04-21 02:10:05,068: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:10:05.102320859Z [2024-04-21 02:10:05,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[520c9daf-a030-476a-8c18-f3f2281cec32] received 2024-04-21T02:10:05.110001983Z [2024-04-21 02:10:05,109: INFO/ForkPoolWorker-15] [520c9daf-a030-476a-8c18-f3f2281cec32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:10:05.658487834Z [2024-04-21 02:10:05,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:10:06.725842939Z [2024-04-21 02:10:06,725: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[93772af8-9d40-48ef-a8cf-a30df959a455] succeeded in 5.432201237999834s: None 2024-04-21T02:10:06.844085179Z [2024-04-21 02:10:06,843: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc8c9959-7bee-4715-9a4a-d54fd0de78ba] succeeded in 5.5670895610001025s: None 2024-04-21T02:10:07.395643715Z [2024-04-21 02:10:07,395: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:10:07.399500643Z [2024-04-21 02:10:07,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:10:07.421776698Z [2024-04-21 02:10:07,421: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:10:07.423719829Z [2024-04-21 02:10:07,423: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:10:07.423756201Z [2024-04-21 02:10:07,423: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:10:07.423969091Z [2024-04-21 02:10:07,423: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:10:07.423988057Z [2024-04-21 02:10:07,423: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:10:07.426491968Z [2024-04-21 02:10:07,426: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:10:07.426572876Z [2024-04-21 02:10:07,426: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:10:07.561538884Z [2024-04-21 02:10:07,561: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:10:08.241320275Z [2024-04-21 02:10:08,240: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[520c9daf-a030-476a-8c18-f3f2281cec32] succeeded in 3.137461106000046s: None 2024-04-21T02:10:08.846597625Z [2024-04-21 02:10:08,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[431a0e8b-bb03-41e8-bc00-8e34d3d57238] received 2024-04-21T02:10:08.859754574Z [2024-04-21 02:10:08,859: INFO/ForkPoolWorker-15] [431a0e8b-bb03-41e8-bc00-8e34d3d57238] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:10:09.198779363Z [2024-04-21 02:10:09,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:10:10.414219808Z [2024-04-21 02:10:10,413: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:10:10.417445659Z [2024-04-21 02:10:10,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:10:10.447753920Z [2024-04-21 02:10:10,447: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:10:10.449717396Z [2024-04-21 02:10:10,449: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:10:10.449853602Z [2024-04-21 02:10:10,449: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:10:10.450097582Z [2024-04-21 02:10:10,449: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:10:10.450240299Z [2024-04-21 02:10:10,450: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:10:10.450636719Z [2024-04-21 02:10:10,450: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:10:10.450799937Z [2024-04-21 02:10:10,450: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:10:10.557110032Z [2024-04-21 02:10:10,556: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:10:11.190004714Z [2024-04-21 02:10:11,189: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[431a0e8b-bb03-41e8-bc00-8e34d3d57238] succeeded in 2.3404508660005376s: None 2024-04-21T02:10:11.428883456Z [2024-04-21 02:10:11,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf4db681-ec8d-460b-b03a-612c9a5a8f53] received 2024-04-21T02:10:11.442443673Z [2024-04-21 02:10:11,442: INFO/ForkPoolWorker-15] [bf4db681-ec8d-460b-b03a-612c9a5a8f53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:10:11.786096447Z [2024-04-21 02:10:11,782: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:10:13.012164272Z [2024-04-21 02:10:13,011: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:10:13.015517283Z [2024-04-21 02:10:13,014: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:10:13.044031439Z [2024-04-21 02:10:13,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:10:13.046382422Z [2024-04-21 02:10:13,046: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:10:13.046460790Z [2024-04-21 02:10:13,046: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:10:13.046815966Z [2024-04-21 02:10:13,046: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:10:13.046948186Z [2024-04-21 02:10:13,046: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:10:13.047336869Z [2024-04-21 02:10:13,047: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:10:13.047495444Z [2024-04-21 02:10:13,047: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:10:13.142315701Z [2024-04-21 02:10:13,142: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:10:13.850615842Z [2024-04-21 02:10:13,850: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf4db681-ec8d-460b-b03a-612c9a5a8f53] succeeded in 2.419951988000321s: None 2024-04-21T02:11:00.508660400Z [2024-04-21 02:11:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e4b2cb2-a832-4f75-b05c-24cadce4b9f8] received 2024-04-21T02:11:00.517496959Z [2024-04-21 02:11:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3e0668a-0923-41d9-ab28-89793d785ffc] received 2024-04-21T02:11:00.522647017Z [2024-04-21 02:11:00,522: INFO/ForkPoolWorker-15] [8e4b2cb2-a832-4f75-b05c-24cadce4b9f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:11:00.527186682Z [2024-04-21 02:11:00,526: INFO/ForkPoolWorker-16] [d3e0668a-0923-41d9-ab28-89793d785ffc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:11:00.531468485Z [2024-04-21 02:11:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb026abb-6e87-431c-b295-efe7c433d57f] received 2024-04-21T02:11:00.544017625Z [2024-04-21 02:11:00,543: INFO/ForkPoolWorker-1] [bb026abb-6e87-431c-b295-efe7c433d57f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:11:00.828622779Z [2024-04-21 02:11:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:11:00.844221417Z [2024-04-21 02:11:00,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:11:00.879412992Z [2024-04-21 02:11:00,875: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:11:01.003468707Z [2024-04-21 02:11:01,003: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:11:01.007631480Z [2024-04-21 02:11:01,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:11:01.032699945Z [2024-04-21 02:11:01,032: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:11:01.033630606Z [2024-04-21 02:11:01,033: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:11:01.033704481Z [2024-04-21 02:11:01,033: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:11:01.033779779Z [2024-04-21 02:11:01,033: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:11:01.034080043Z [2024-04-21 02:11:01,033: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:11:01.152675803Z [2024-04-21 02:11:01,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:11:01.814698136Z [2024-04-21 02:11:01,814: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e4b2cb2-a832-4f75-b05c-24cadce4b9f8] succeeded in 1.3018637929999386s: None 2024-04-21T02:11:02.356959473Z [2024-04-21 02:11:02,356: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:11:02.360306285Z [2024-04-21 02:11:02,359: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:11:02.377518431Z [2024-04-21 02:11:02,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:11:02.378686475Z [2024-04-21 02:11:02,378: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:11:02.378699802Z [2024-04-21 02:11:02,378: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:11:02.378813882Z [2024-04-21 02:11:02,378: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:11:02.378823698Z [2024-04-21 02:11:02,378: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:11:02.379073855Z [2024-04-21 02:11:02,378: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:11:02.379092297Z [2024-04-21 02:11:02,379: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:11:02.404011091Z [2024-04-21 02:11:02,403: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:11:02.407468082Z [2024-04-21 02:11:02,406: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:11:02.452796942Z [2024-04-21 02:11:02,452: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:11:02.454421306Z [2024-04-21 02:11:02,454: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:11:02.454447797Z [2024-04-21 02:11:02,454: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:11:02.454675639Z [2024-04-21 02:11:02,454: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:11:02.454729106Z [2024-04-21 02:11:02,454: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:11:02.455094845Z [2024-04-21 02:11:02,454: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:11:02.455176182Z [2024-04-21 02:11:02,455: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:11:02.506466959Z [2024-04-21 02:11:02,506: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:11:02.535728967Z [2024-04-21 02:11:02,535: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:11:04.654831754Z [2024-04-21 02:11:04,654: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d3e0668a-0923-41d9-ab28-89793d785ffc] succeeded in 4.135723792000135s: None 2024-04-21T02:11:05.246504964Z [2024-04-21 02:11:05,245: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb026abb-6e87-431c-b295-efe7c433d57f] succeeded in 4.713151347999883s: None 2024-04-21T02:12:00.977292073Z [2024-04-21 02:12:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b915e348-6006-4664-aaab-91555adce328] received 2024-04-21T02:12:00.992422406Z [2024-04-21 02:12:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fc59c1c-b494-4832-b375-c7d8a8761ca8] received 2024-04-21T02:12:00.998242195Z [2024-04-21 02:12:00,997: INFO/ForkPoolWorker-15] [b915e348-6006-4664-aaab-91555adce328] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:12:01.013990809Z [2024-04-21 02:12:01,013: INFO/ForkPoolWorker-16] [3fc59c1c-b494-4832-b375-c7d8a8761ca8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:12:01.019976205Z [2024-04-21 02:12:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4cc0431-2316-47fe-8a95-a29546996f3f] received 2024-04-21T02:12:01.026078056Z [2024-04-21 02:12:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdbd570d-d384-4f80-af66-21d643e0c34f] received 2024-04-21T02:12:01.050473867Z [2024-04-21 02:12:01,050: INFO/ForkPoolWorker-1] [f4cc0431-2316-47fe-8a95-a29546996f3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:12:01.082652933Z [2024-04-21 02:12:01,081: INFO/ForkPoolWorker-2] [cdbd570d-d384-4f80-af66-21d643e0c34f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:12:01.438653352Z [2024-04-21 02:12:01,434: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:12:01.752044470Z [2024-04-21 02:12:01,748: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:12:01.805695123Z [2024-04-21 02:12:01,777: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:12:02.126692285Z [2024-04-21 02:12:02,126: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:12:02.415442748Z [2024-04-21 02:12:02,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:12:03.133210334Z [2024-04-21 02:12:03,132: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:12:03.142408162Z [2024-04-21 02:12:03,141: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:12:03.231378275Z [2024-04-21 02:12:03,231: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:12:03.243597551Z [2024-04-21 02:12:03,242: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:12:03.243620819Z [2024-04-21 02:12:03,243: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:12:03.243624879Z [2024-04-21 02:12:03,243: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:12:03.243628046Z [2024-04-21 02:12:03,243: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:12:03.273867531Z [2024-04-21 02:12:03,273: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f4cc0431-2316-47fe-8a95-a29546996f3f] succeeded in 2.248284158000388s: None 2024-04-21T02:12:03.374506588Z [2024-04-21 02:12:03,374: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:12:03.585544001Z [2024-04-21 02:12:03,585: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:12:03.589411534Z [2024-04-21 02:12:03,588: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:12:03.610430283Z [2024-04-21 02:12:03,610: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:12:03.611647710Z [2024-04-21 02:12:03,611: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:12:03.611753921Z [2024-04-21 02:12:03,611: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:12:03.611767426Z [2024-04-21 02:12:03,611: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:12:03.611797755Z [2024-04-21 02:12:03,611: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:12:03.612682003Z [2024-04-21 02:12:03,612: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:12:03.612784490Z [2024-04-21 02:12:03,612: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:12:03.740684470Z [2024-04-21 02:12:03,740: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:12:04.318494151Z [2024-04-21 02:12:04,317: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b915e348-6006-4664-aaab-91555adce328] succeeded in 3.337078962000305s: None 2024-04-21T02:12:04.758482790Z [2024-04-21 02:12:04,758: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:12:04.761760848Z [2024-04-21 02:12:04,761: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:12:04.795063018Z [2024-04-21 02:12:04,794: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:12:04.798035321Z [2024-04-21 02:12:04,797: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:12:04.798335177Z [2024-04-21 02:12:04,797: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:12:04.798749700Z [2024-04-21 02:12:04,798: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:12:04.799065596Z [2024-04-21 02:12:04,798: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:12:04.799785903Z [2024-04-21 02:12:04,799: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:12:04.800098268Z [2024-04-21 02:12:04,799: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:12:04.908918793Z [2024-04-21 02:12:04,908: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:12:05.785895233Z [2024-04-21 02:12:05,785: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3fc59c1c-b494-4832-b375-c7d8a8761ca8] succeeded in 4.790988819000631s: None 2024-04-21T02:12:06.815543417Z [2024-04-21 02:12:06,814: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cdbd570d-d384-4f80-af66-21d643e0c34f] succeeded in 5.784982490000402s: None 2024-04-21T02:13:00.319180455Z [2024-04-21 02:13:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60ea9845-c3e9-4090-851d-fc9163971ffc] received 2024-04-21T02:13:00.321223274Z [2024-04-21 02:13:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cb9ca3d-d35d-4126-bbe6-3d293f012acb] received 2024-04-21T02:13:00.330083889Z [2024-04-21 02:13:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1311758-a6b0-4f60-b09b-81cf8b8cb7c8] received 2024-04-21T02:13:00.331221820Z [2024-04-21 02:13:00,330: INFO/ForkPoolWorker-16] [6cb9ca3d-d35d-4126-bbe6-3d293f012acb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:13:00.335196586Z [2024-04-21 02:13:00,334: INFO/ForkPoolWorker-15] [60ea9845-c3e9-4090-851d-fc9163971ffc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:13:00.341503951Z [2024-04-21 02:13:00,341: INFO/ForkPoolWorker-1] [f1311758-a6b0-4f60-b09b-81cf8b8cb7c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:13:00.628659939Z [2024-04-21 02:13:00,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:13:00.653462932Z [2024-04-21 02:13:00,650: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:13:00.662267786Z [2024-04-21 02:13:00,657: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:13:00.789935714Z [2024-04-21 02:13:00,789: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:13:00.794365915Z [2024-04-21 02:13:00,793: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:13:00.819804025Z [2024-04-21 02:13:00,819: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:13:00.821688510Z [2024-04-21 02:13:00,821: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:13:00.822078656Z [2024-04-21 02:13:00,821: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:13:00.822151797Z [2024-04-21 02:13:00,822: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:13:00.822440244Z [2024-04-21 02:13:00,822: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:13:00.905788215Z [2024-04-21 02:13:00,905: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:13:01.422522777Z [2024-04-21 02:13:01,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60ea9845-c3e9-4090-851d-fc9163971ffc] succeeded in 1.101550370998666s: None 2024-04-21T02:13:02.021897096Z [2024-04-21 02:13:02,021: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:13:02.025299179Z [2024-04-21 02:13:02,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:13:02.049663837Z [2024-04-21 02:13:02,049: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:13:02.050599085Z [2024-04-21 02:13:02,050: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:13:02.053444686Z [2024-04-21 02:13:02,053: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:13:02.053463008Z [2024-04-21 02:13:02,053: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:13:02.053625137Z [2024-04-21 02:13:02,053: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:13:02.053676859Z [2024-04-21 02:13:02,053: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:13:02.053988024Z [2024-04-21 02:13:02,053: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:13:02.054002621Z [2024-04-21 02:13:02,053: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:13:02.055971057Z [2024-04-21 02:13:02,055: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:13:02.085160380Z [2024-04-21 02:13:02,084: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:13:02.088621703Z [2024-04-21 02:13:02,088: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:13:02.088638966Z [2024-04-21 02:13:02,088: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:13:02.088797673Z [2024-04-21 02:13:02,088: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:13:02.088832615Z [2024-04-21 02:13:02,088: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:13:02.089101799Z [2024-04-21 02:13:02,088: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:13:02.089146993Z [2024-04-21 02:13:02,089: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:13:02.156612600Z [2024-04-21 02:13:02,156: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:13:02.207028936Z [2024-04-21 02:13:02,206: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:13:04.236450509Z [2024-04-21 02:13:04,235: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1311758-a6b0-4f60-b09b-81cf8b8cb7c8] succeeded in 3.901468832000319s: None 2024-04-21T02:13:04.845253704Z [2024-04-21 02:13:04,844: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6cb9ca3d-d35d-4126-bbe6-3d293f012acb] succeeded in 4.522544718000063s: None 2024-04-21T02:14:00.691176467Z [2024-04-21 02:14:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59ebf7c6-2562-4e19-aabc-d73f6019f91a] received 2024-04-21T02:14:00.693701516Z [2024-04-21 02:14:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fb0f193-0862-46b6-bc34-9098abbb63f7] received 2024-04-21T02:14:00.699775758Z [2024-04-21 02:14:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfd2e082-abbb-40b3-bbbd-e47a4639b2ff] received 2024-04-21T02:14:00.704575793Z [2024-04-21 02:14:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a044c16a-850e-47f4-9c2d-9ded39db645d] received 2024-04-21T02:14:00.706115767Z [2024-04-21 02:14:00,705: INFO/ForkPoolWorker-15] [59ebf7c6-2562-4e19-aabc-d73f6019f91a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:14:00.714354318Z [2024-04-21 02:14:00,713: INFO/ForkPoolWorker-16] [4fb0f193-0862-46b6-bc34-9098abbb63f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:14:00.720071203Z [2024-04-21 02:14:00,719: INFO/ForkPoolWorker-1] [cfd2e082-abbb-40b3-bbbd-e47a4639b2ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:14:00.722004607Z [2024-04-21 02:14:00,721: INFO/ForkPoolWorker-2] [a044c16a-850e-47f4-9c2d-9ded39db645d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:14:01.080032204Z [2024-04-21 02:14:01,072: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:14:01.121993192Z [2024-04-21 02:14:01,110: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:14:01.175791197Z [2024-04-21 02:14:01,163: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:14:01.236317169Z [2024-04-21 02:14:01,233: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:14:01.255305464Z [2024-04-21 02:14:01,254: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:14:01.259645667Z [2024-04-21 02:14:01,259: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:14:01.312805256Z [2024-04-21 02:14:01,312: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:14:01.316665395Z [2024-04-21 02:14:01,316: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:14:01.317035060Z [2024-04-21 02:14:01,316: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:14:01.317297711Z [2024-04-21 02:14:01,317: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:14:01.317765100Z [2024-04-21 02:14:01,317: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:14:01.421343455Z [2024-04-21 02:14:01,421: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:14:01.666942725Z [2024-04-21 02:14:01,666: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:14:02.113595872Z [2024-04-21 02:14:02,113: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cfd2e082-abbb-40b3-bbbd-e47a4639b2ff] succeeded in 1.4109699679993355s: None 2024-04-21T02:14:02.533295127Z [2024-04-21 02:14:02,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59ebf7c6-2562-4e19-aabc-d73f6019f91a] succeeded in 1.8382147480006097s: None 2024-04-21T02:14:02.820279748Z [2024-04-21 02:14:02,819: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:14:02.824132847Z [2024-04-21 02:14:02,823: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:14:02.844511897Z [2024-04-21 02:14:02,843: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:14:02.845161951Z [2024-04-21 02:14:02,844: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:14:02.845215421Z [2024-04-21 02:14:02,845: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:14:02.845311837Z [2024-04-21 02:14:02,845: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:14:02.845348045Z [2024-04-21 02:14:02,845: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:14:02.845566123Z [2024-04-21 02:14:02,845: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:14:02.845595718Z [2024-04-21 02:14:02,845: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:14:02.920007576Z [2024-04-21 02:14:02,919: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:14:02.923299467Z [2024-04-21 02:14:02,922: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:14:02.940732924Z [2024-04-21 02:14:02,940: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:14:02.941867547Z [2024-04-21 02:14:02,941: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:14:02.941879350Z [2024-04-21 02:14:02,941: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:14:02.941983731Z [2024-04-21 02:14:02,941: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:14:02.941996425Z [2024-04-21 02:14:02,941: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:14:02.942209063Z [2024-04-21 02:14:02,942: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:14:02.942218002Z [2024-04-21 02:14:02,942: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:14:02.943315698Z [2024-04-21 02:14:02,942: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:14:03.074575086Z [2024-04-21 02:14:03,074: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:14:05.625378270Z [2024-04-21 02:14:05,624: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a044c16a-850e-47f4-9c2d-9ded39db645d] succeeded in 4.911986974000683s: None 2024-04-21T02:14:06.035274530Z [2024-04-21 02:14:06,034: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fb0f193-0862-46b6-bc34-9098abbb63f7] succeeded in 5.33744094100075s: None 2024-04-21T02:15:00.687128595Z [2024-04-21 02:15:00,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7385559-2c8a-448a-ba46-ecdd921bd62c] received 2024-04-21T02:15:00.689853752Z [2024-04-21 02:15:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[124ba097-1555-4f0c-83ff-79ae1f450ae5] received 2024-04-21T02:15:00.694158105Z [2024-04-21 02:15:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[075db2cd-bcca-4da3-80df-be752f31132e] received 2024-04-21T02:15:00.698186517Z [2024-04-21 02:15:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95c0a075-6458-4046-895d-4aa467a6d6a1] received 2024-04-21T02:15:00.699334687Z [2024-04-21 02:15:00,699: INFO/ForkPoolWorker-16] [124ba097-1555-4f0c-83ff-79ae1f450ae5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:15:00.709610437Z [2024-04-21 02:15:00,709: INFO/ForkPoolWorker-1] [075db2cd-bcca-4da3-80df-be752f31132e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:15:00.712994953Z [2024-04-21 02:15:00,712: INFO/ForkPoolWorker-15] [b7385559-2c8a-448a-ba46-ecdd921bd62c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:15:00.717149433Z [2024-04-21 02:15:00,716: INFO/ForkPoolWorker-2] [95c0a075-6458-4046-895d-4aa467a6d6a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:15:01.031455257Z [2024-04-21 02:15:01,027: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:15:01.046796819Z [2024-04-21 02:15:01,042: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:15:01.128487273Z [2024-04-21 02:15:01,125: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:15:01.205752259Z [2024-04-21 02:15:01,191: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:15:01.330979899Z [2024-04-21 02:15:01,330: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:15:01.335355200Z [2024-04-21 02:15:01,334: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:15:01.377708797Z [2024-04-21 02:15:01,377: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:15:01.380577363Z [2024-04-21 02:15:01,380: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:15:01.380995955Z [2024-04-21 02:15:01,380: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:15:01.381194259Z [2024-04-21 02:15:01,381: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:15:01.381607439Z [2024-04-21 02:15:01,381: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:15:01.558316023Z [2024-04-21 02:15:01,558: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:15:02.221030532Z [2024-04-21 02:15:02,220: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[075db2cd-bcca-4da3-80df-be752f31132e] succeeded in 1.5230566090012871s: None 2024-04-21T02:15:02.577973363Z [2024-04-21 02:15:02,577: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:15:02.583007197Z [2024-04-21 02:15:02,582: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:15:02.634988863Z [2024-04-21 02:15:02,634: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:15:02.638545067Z [2024-04-21 02:15:02,638: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:15:02.638805536Z [2024-04-21 02:15:02,638: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:15:02.639417435Z [2024-04-21 02:15:02,639: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:15:02.639846874Z [2024-04-21 02:15:02,639: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:15:02.641074510Z [2024-04-21 02:15:02,640: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:15:02.641399335Z [2024-04-21 02:15:02,641: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:15:02.654063834Z [2024-04-21 02:15:02,653: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:15:02.658301405Z [2024-04-21 02:15:02,657: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:15:02.714795103Z [2024-04-21 02:15:02,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:15:02.716776572Z [2024-04-21 02:15:02,716: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:15:02.717149486Z [2024-04-21 02:15:02,716: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:15:02.717415672Z [2024-04-21 02:15:02,717: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:15:02.717612012Z [2024-04-21 02:15:02,717: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:15:02.717964572Z [2024-04-21 02:15:02,717: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:15:02.718094679Z [2024-04-21 02:15:02,717: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:15:02.775072600Z [2024-04-21 02:15:02,774: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:15:02.826805538Z [2024-04-21 02:15:02,826: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:15:03.210637546Z [2024-04-21 02:15:03,210: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:15:03.216008340Z [2024-04-21 02:15:03,215: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:15:03.256876670Z [2024-04-21 02:15:03,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:15:03.258356793Z [2024-04-21 02:15:03,258: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:15:03.258370659Z [2024-04-21 02:15:03,258: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:15:03.258492015Z [2024-04-21 02:15:03,258: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:15:03.258519723Z [2024-04-21 02:15:03,258: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:15:03.258794627Z [2024-04-21 02:15:03,258: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:15:03.258936161Z [2024-04-21 02:15:03,258: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:15:03.397403616Z [2024-04-21 02:15:03,397: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:15:04.238472276Z [2024-04-21 02:15:04,238: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7385559-2c8a-448a-ba46-ecdd921bd62c] succeeded in 3.546897345000616s: None 2024-04-21T02:15:04.663589788Z [2024-04-21 02:15:04,663: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95c0a075-6458-4046-895d-4aa467a6d6a1] succeeded in 3.961811477000083s: None 2024-04-21T02:15:05.149271591Z [2024-04-21 02:15:05,148: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[124ba097-1555-4f0c-83ff-79ae1f450ae5] succeeded in 4.457752737998817s: None 2024-04-21T02:15:05.200968377Z [2024-04-21 02:15:05,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8e8c4a4-e93f-457d-88c6-054d04a129c2] received 2024-04-21T02:15:05.212899981Z [2024-04-21 02:15:05,212: INFO/ForkPoolWorker-15] [d8e8c4a4-e93f-457d-88c6-054d04a129c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:15:05.501864287Z [2024-04-21 02:15:05,498: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:15:06.770790658Z [2024-04-21 02:15:06,769: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:15:06.774304134Z [2024-04-21 02:15:06,773: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:15:06.804116191Z [2024-04-21 02:15:06,803: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:15:06.805319840Z [2024-04-21 02:15:06,805: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:15:06.805372621Z [2024-04-21 02:15:06,805: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:15:06.805564605Z [2024-04-21 02:15:06,805: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:15:06.805644398Z [2024-04-21 02:15:06,805: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:15:06.806033279Z [2024-04-21 02:15:06,805: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:15:06.806096868Z [2024-04-21 02:15:06,806: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:15:06.906098598Z [2024-04-21 02:15:06,905: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:15:07.639914696Z [2024-04-21 02:15:07,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8e8c4a4-e93f-457d-88c6-054d04a129c2] succeeded in 2.4355583880005724s: None 2024-04-21T02:15:08.558486545Z [2024-04-21 02:15:08,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b59ed42f-f1bf-4ac7-b626-05dee1f1a1c4] received 2024-04-21T02:15:08.570022273Z [2024-04-21 02:15:08,569: INFO/ForkPoolWorker-15] [b59ed42f-f1bf-4ac7-b626-05dee1f1a1c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:15:08.917160684Z [2024-04-21 02:15:08,914: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:15:10.074978370Z [2024-04-21 02:15:10,074: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:15:10.078297989Z [2024-04-21 02:15:10,077: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:15:10.101581100Z [2024-04-21 02:15:10,101: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:15:10.107541395Z [2024-04-21 02:15:10,107: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:15:10.107658654Z [2024-04-21 02:15:10,107: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:15:10.107959519Z [2024-04-21 02:15:10,107: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:15:10.108175419Z [2024-04-21 02:15:10,107: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:15:10.108644591Z [2024-04-21 02:15:10,108: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:15:10.108909868Z [2024-04-21 02:15:10,108: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:15:10.202393318Z [2024-04-21 02:15:10,201: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:15:11.837235595Z [2024-04-21 02:15:11,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b59ed42f-f1bf-4ac7-b626-05dee1f1a1c4] succeeded in 3.275323121999463s: None 2024-04-21T02:15:12.742416123Z [2024-04-21 02:15:12,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1a09a31-cbfd-481c-be72-48044cf97d8a] received 2024-04-21T02:15:12.752423832Z [2024-04-21 02:15:12,752: INFO/ForkPoolWorker-15] [a1a09a31-cbfd-481c-be72-48044cf97d8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:15:13.090055311Z [2024-04-21 02:15:13,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:15:14.233763995Z [2024-04-21 02:15:14,232: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:15:14.235997428Z [2024-04-21 02:15:14,235: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:15:14.256880361Z [2024-04-21 02:15:14,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:15:14.258448972Z [2024-04-21 02:15:14,258: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:15:14.258472496Z [2024-04-21 02:15:14,258: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:15:14.258536268Z [2024-04-21 02:15:14,258: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:15:14.258770055Z [2024-04-21 02:15:14,258: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:15:14.258797926Z [2024-04-21 02:15:14,258: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:15:14.258806655Z [2024-04-21 02:15:14,258: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:15:14.344487028Z [2024-04-21 02:15:14,344: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:15:14.950823574Z [2024-04-21 02:15:14,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1a09a31-cbfd-481c-be72-48044cf97d8a] succeeded in 2.2053123589994357s: None 2024-04-21T02:16:01.282486449Z [2024-04-21 02:16:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d14f4219-297c-4494-8e2b-b692f4be9c20] received 2024-04-21T02:16:01.286363663Z [2024-04-21 02:16:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e764235d-2a14-4a90-bfb1-62e7f0eb6abd] received 2024-04-21T02:16:01.288609368Z [2024-04-21 02:16:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07b4d9c6-14ee-41b4-b862-a564ae90c698] received 2024-04-21T02:16:01.290395209Z [2024-04-21 02:16:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18446b78-c602-4a30-9756-bd5b053c6ec8] received 2024-04-21T02:16:01.294503985Z [2024-04-21 02:16:01,294: INFO/ForkPoolWorker-1] [07b4d9c6-14ee-41b4-b862-a564ae90c698] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:16:01.297797809Z [2024-04-21 02:16:01,297: INFO/ForkPoolWorker-15] [d14f4219-297c-4494-8e2b-b692f4be9c20] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:16:01.305133684Z [2024-04-21 02:16:01,304: INFO/ForkPoolWorker-2] [18446b78-c602-4a30-9756-bd5b053c6ec8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:16:01.316577398Z [2024-04-21 02:16:01,316: INFO/ForkPoolWorker-16] [e764235d-2a14-4a90-bfb1-62e7f0eb6abd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:16:01.763873327Z [2024-04-21 02:16:01,759: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:16:01.806799505Z [2024-04-21 02:16:01,798: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:16:01.826161973Z [2024-04-21 02:16:01,815: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:16:01.842007747Z [2024-04-21 02:16:01,838: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:16:02.102711730Z [2024-04-21 02:16:02,102: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:16:02.116316853Z [2024-04-21 02:16:02,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:16:02.152547233Z [2024-04-21 02:16:02,152: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:16:02.155459122Z [2024-04-21 02:16:02,155: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:16:02.155581198Z [2024-04-21 02:16:02,155: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:16:02.155871516Z [2024-04-21 02:16:02,155: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:16:02.159920225Z [2024-04-21 02:16:02,155: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:16:02.220515069Z [2024-04-21 02:16:02,220: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:16:02.379284605Z [2024-04-21 02:16:02,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:16:02.957932274Z [2024-04-21 02:16:02,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e764235d-2a14-4a90-bfb1-62e7f0eb6abd] succeeded in 1.665378399000474s: None 2024-04-21T02:16:03.142074348Z [2024-04-21 02:16:03,141: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d14f4219-297c-4494-8e2b-b692f4be9c20] succeeded in 1.8568039769997995s: None 2024-04-21T02:16:03.495343608Z [2024-04-21 02:16:03,494: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:16:03.495439951Z [2024-04-21 02:16:03,495: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:16:03.498627802Z [2024-04-21 02:16:03,498: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:16:03.498815790Z [2024-04-21 02:16:03,498: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:16:03.521818299Z [2024-04-21 02:16:03,521: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:16:03.523660887Z [2024-04-21 02:16:03,523: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:16:03.523827485Z [2024-04-21 02:16:03,523: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:16:03.524011318Z [2024-04-21 02:16:03,523: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:16:03.524200977Z [2024-04-21 02:16:03,523: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:16:03.525129681Z [2024-04-21 02:16:03,524: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:16:03.525159436Z [2024-04-21 02:16:03,525: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:16:03.525627442Z [2024-04-21 02:16:03,525: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:16:03.529571022Z [2024-04-21 02:16:03,528: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:16:03.529642795Z [2024-04-21 02:16:03,529: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:16:03.529850986Z [2024-04-21 02:16:03,529: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:16:03.529869373Z [2024-04-21 02:16:03,529: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:16:03.530236261Z [2024-04-21 02:16:03,530: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:16:03.530284276Z [2024-04-21 02:16:03,530: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:16:03.666500259Z [2024-04-21 02:16:03,666: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:16:03.675456060Z [2024-04-21 02:16:03,674: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:16:05.832380389Z [2024-04-21 02:16:05,831: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[18446b78-c602-4a30-9756-bd5b053c6ec8] succeeded in 4.532805128999826s: None 2024-04-21T02:16:06.295521925Z [2024-04-21 02:16:06,295: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07b4d9c6-14ee-41b4-b862-a564ae90c698] succeeded in 5.00558554700001s: None 2024-04-21T02:17:00.567383868Z [2024-04-21 02:17:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfb1b25c-569c-4748-8de7-b4f3595e06fa] received 2024-04-21T02:17:00.578858900Z [2024-04-21 02:17:00,578: INFO/ForkPoolWorker-15] [dfb1b25c-569c-4748-8de7-b4f3595e06fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:17:00.579217720Z [2024-04-21 02:17:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb90f079-70c8-4f12-bf3a-12f2634edbd0] received 2024-04-21T02:17:00.581844191Z [2024-04-21 02:17:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb886604-8170-46db-9582-e1dd137f1687] received 2024-04-21T02:17:00.587227236Z [2024-04-21 02:17:00,587: INFO/ForkPoolWorker-16] [bb90f079-70c8-4f12-bf3a-12f2634edbd0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:17:00.594559145Z [2024-04-21 02:17:00,594: INFO/ForkPoolWorker-1] [cb886604-8170-46db-9582-e1dd137f1687] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:17:00.859812105Z [2024-04-21 02:17:00,856: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:17:00.895212962Z [2024-04-21 02:17:00,891: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:17:00.946275629Z [2024-04-21 02:17:00,943: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:17:01.136916703Z [2024-04-21 02:17:01,132: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:17:01.139840654Z [2024-04-21 02:17:01,136: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:17:01.169846589Z [2024-04-21 02:17:01,169: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:17:01.170976166Z [2024-04-21 02:17:01,170: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:17:01.171126615Z [2024-04-21 02:17:01,170: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:17:01.171189754Z [2024-04-21 02:17:01,171: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:17:01.171395000Z [2024-04-21 02:17:01,171: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:17:01.272386873Z [2024-04-21 02:17:01,272: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:17:01.839008398Z [2024-04-21 02:17:01,838: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb886604-8170-46db-9582-e1dd137f1687] succeeded in 1.2535929510013375s: None 2024-04-21T02:17:02.265642568Z [2024-04-21 02:17:02,265: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:17:02.269225398Z [2024-04-21 02:17:02,268: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:17:02.296655803Z [2024-04-21 02:17:02,296: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:17:02.300975714Z [2024-04-21 02:17:02,300: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:17:02.301009403Z [2024-04-21 02:17:02,300: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:17:02.301145596Z [2024-04-21 02:17:02,300: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:17:02.301216457Z [2024-04-21 02:17:02,301: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:17:02.301561470Z [2024-04-21 02:17:02,301: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:17:02.301578395Z [2024-04-21 02:17:02,301: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:17:02.350809724Z [2024-04-21 02:17:02,350: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:17:02.354339278Z [2024-04-21 02:17:02,353: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:17:02.374173683Z [2024-04-21 02:17:02,373: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:17:02.375436137Z [2024-04-21 02:17:02,375: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:17:02.375459442Z [2024-04-21 02:17:02,375: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:17:02.375819560Z [2024-04-21 02:17:02,375: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:17:02.375840897Z [2024-04-21 02:17:02,375: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:17:02.376079866Z [2024-04-21 02:17:02,375: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:17:02.376116757Z [2024-04-21 02:17:02,376: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:17:02.379631918Z [2024-04-21 02:17:02,379: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:17:02.500785769Z [2024-04-21 02:17:02,500: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:17:04.697624404Z [2024-04-21 02:17:04,697: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bb90f079-70c8-4f12-bf3a-12f2634edbd0] succeeded in 4.116190442000516s: None 2024-04-21T02:17:06.705080490Z [2024-04-21 02:17:06,704: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfb1b25c-569c-4748-8de7-b4f3595e06fa] succeeded in 6.134433208999326s: None 2024-04-21T02:18:00.873814518Z [2024-04-21 02:18:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd5bdbe9-0b2d-4b06-a0bd-cbe5f259f010] received 2024-04-21T02:18:00.877817279Z [2024-04-21 02:18:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f215f204-fbb3-4793-b8ac-81b5481006cd] received 2024-04-21T02:18:00.883774410Z [2024-04-21 02:18:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f30be19-6a78-4ff1-8253-b6ee39071973] received 2024-04-21T02:18:00.889654639Z [2024-04-21 02:18:00,889: INFO/ForkPoolWorker-15] [dd5bdbe9-0b2d-4b06-a0bd-cbe5f259f010] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:18:00.890920076Z [2024-04-21 02:18:00,890: INFO/ForkPoolWorker-16] [f215f204-fbb3-4793-b8ac-81b5481006cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:18:00.892183943Z [2024-04-21 02:18:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15c4fb89-88fe-40e9-9a9c-e436793e99fb] received 2024-04-21T02:18:00.907631564Z [2024-04-21 02:18:00,907: INFO/ForkPoolWorker-2] [15c4fb89-88fe-40e9-9a9c-e436793e99fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:18:00.907930132Z [2024-04-21 02:18:00,906: INFO/ForkPoolWorker-1] [5f30be19-6a78-4ff1-8253-b6ee39071973] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:18:01.278183787Z [2024-04-21 02:18:01,274: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:18:01.301093376Z [2024-04-21 02:18:01,298: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:18:01.417176232Z [2024-04-21 02:18:01,413: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:18:01.455127973Z [2024-04-21 02:18:01,451: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:18:01.602257967Z [2024-04-21 02:18:01,601: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:18:01.608570340Z [2024-04-21 02:18:01,608: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:18:01.612688496Z [2024-04-21 02:18:01,612: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:18:01.656359620Z [2024-04-21 02:18:01,656: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:18:01.660125851Z [2024-04-21 02:18:01,659: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:18:01.660299238Z [2024-04-21 02:18:01,660: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:18:01.660445901Z [2024-04-21 02:18:01,660: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:18:01.660858605Z [2024-04-21 02:18:01,660: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:18:01.764572647Z [2024-04-21 02:18:01,764: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:18:02.279644058Z [2024-04-21 02:18:02,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd5bdbe9-0b2d-4b06-a0bd-cbe5f259f010] succeeded in 1.4026913569996395s: None 2024-04-21T02:18:02.557851616Z [2024-04-21 02:18:02,557: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f215f204-fbb3-4793-b8ac-81b5481006cd] succeeded in 1.6768700899992837s: None 2024-04-21T02:18:02.863317274Z [2024-04-21 02:18:02,862: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:18:02.866668259Z [2024-04-21 02:18:02,866: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:18:02.888600889Z [2024-04-21 02:18:02,888: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:18:02.889793264Z [2024-04-21 02:18:02,889: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:18:02.889817343Z [2024-04-21 02:18:02,889: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:18:02.889942190Z [2024-04-21 02:18:02,889: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:18:02.889967284Z [2024-04-21 02:18:02,889: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:18:02.890630107Z [2024-04-21 02:18:02,890: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:18:02.890744400Z [2024-04-21 02:18:02,890: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:18:02.894941400Z [2024-04-21 02:18:02,894: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:18:02.899944256Z [2024-04-21 02:18:02,899: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:18:02.921939899Z [2024-04-21 02:18:02,921: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:18:02.923388684Z [2024-04-21 02:18:02,923: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:18:02.923418943Z [2024-04-21 02:18:02,923: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:18:02.923534460Z [2024-04-21 02:18:02,923: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:18:02.923669476Z [2024-04-21 02:18:02,923: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:18:02.924049823Z [2024-04-21 02:18:02,923: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:18:02.924180583Z [2024-04-21 02:18:02,924: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:18:02.981661191Z [2024-04-21 02:18:02,981: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:18:03.030367534Z [2024-04-21 02:18:03,030: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:18:04.576235521Z [2024-04-21 02:18:04,575: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[15c4fb89-88fe-40e9-9a9c-e436793e99fb] succeeded in 3.6816700480012514s: None 2024-04-21T02:18:05.326575083Z [2024-04-21 02:18:05,326: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f30be19-6a78-4ff1-8253-b6ee39071973] succeeded in 4.432519140000295s: None 2024-04-21T02:19:00.482181305Z [2024-04-21 02:19:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ab07d22-1481-466a-a57d-56bbc8364da8] received 2024-04-21T02:19:00.496386991Z [2024-04-21 02:19:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f3c5987-dfa4-45ac-a62c-17fcfb17a61f] received 2024-04-21T02:19:00.502099347Z [2024-04-21 02:19:00,500: INFO/ForkPoolWorker-15] [9ab07d22-1481-466a-a57d-56bbc8364da8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:19:00.508546432Z [2024-04-21 02:19:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1c82367-58c1-4857-bee0-98cf7889e8ea] received 2024-04-21T02:19:00.512609297Z [2024-04-21 02:19:00,512: INFO/ForkPoolWorker-16] [4f3c5987-dfa4-45ac-a62c-17fcfb17a61f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:19:00.526776458Z [2024-04-21 02:19:00,526: INFO/ForkPoolWorker-1] [c1c82367-58c1-4857-bee0-98cf7889e8ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:19:00.805897374Z [2024-04-21 02:19:00,802: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:19:00.844250018Z [2024-04-21 02:19:00,840: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:19:00.862023166Z [2024-04-21 02:19:00,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:19:01.018646441Z [2024-04-21 02:19:01,018: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:19:01.024567162Z [2024-04-21 02:19:01,023: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:19:01.056933197Z [2024-04-21 02:19:01,056: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:19:01.059165262Z [2024-04-21 02:19:01,058: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:19:01.059556678Z [2024-04-21 02:19:01,059: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:19:01.059785778Z [2024-04-21 02:19:01,059: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:19:01.060096141Z [2024-04-21 02:19:01,059: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:19:01.163226193Z [2024-04-21 02:19:01,162: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:19:01.768813153Z [2024-04-21 02:19:01,768: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f3c5987-dfa4-45ac-a62c-17fcfb17a61f] succeeded in 1.269924745998651s: None 2024-04-21T02:19:02.179550822Z [2024-04-21 02:19:02,179: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:19:02.183040982Z [2024-04-21 02:19:02,182: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:19:02.221164348Z [2024-04-21 02:19:02,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:19:02.222483607Z [2024-04-21 02:19:02,222: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:19:02.222545097Z [2024-04-21 02:19:02,222: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:19:02.222735629Z [2024-04-21 02:19:02,222: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:19:02.222811962Z [2024-04-21 02:19:02,222: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:19:02.223219824Z [2024-04-21 02:19:02,222: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:19:02.223257236Z [2024-04-21 02:19:02,223: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:19:02.234828482Z [2024-04-21 02:19:02,234: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:19:02.238175514Z [2024-04-21 02:19:02,237: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:19:02.269134027Z [2024-04-21 02:19:02,268: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:19:02.270547747Z [2024-04-21 02:19:02,270: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:19:02.270776052Z [2024-04-21 02:19:02,270: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:19:02.271036324Z [2024-04-21 02:19:02,270: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:19:02.271136147Z [2024-04-21 02:19:02,271: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:19:02.271495202Z [2024-04-21 02:19:02,271: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:19:02.272084678Z [2024-04-21 02:19:02,271: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:19:02.318428386Z [2024-04-21 02:19:02,318: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:19:02.380148635Z [2024-04-21 02:19:02,379: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:19:04.364219425Z [2024-04-21 02:19:04,363: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1c82367-58c1-4857-bee0-98cf7889e8ea] succeeded in 3.85248673499882s: None 2024-04-21T02:19:04.408273625Z [2024-04-21 02:19:04,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ab07d22-1481-466a-a57d-56bbc8364da8] succeeded in 3.921950668000136s: None 2024-04-21T02:20:00.465142433Z [2024-04-21 02:20:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e50629f-2b34-467f-86d6-31ee4f5f7c12] received 2024-04-21T02:20:00.471298023Z [2024-04-21 02:20:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74f2a891-030b-4578-bc21-b3a070cae89b] received 2024-04-21T02:20:00.473479376Z [2024-04-21 02:20:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[977651ef-84f6-4752-8480-78abc62203da] received 2024-04-21T02:20:00.474104908Z [2024-04-21 02:20:00,473: INFO/ForkPoolWorker-15] [2e50629f-2b34-467f-86d6-31ee4f5f7c12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:20:00.478126450Z [2024-04-21 02:20:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bfdcd9d-0a39-4248-a287-625d1de9a115] received 2024-04-21T02:20:00.488161173Z [2024-04-21 02:20:00,487: INFO/ForkPoolWorker-2] [7bfdcd9d-0a39-4248-a287-625d1de9a115] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:20:00.490181269Z [2024-04-21 02:20:00,489: INFO/ForkPoolWorker-1] [977651ef-84f6-4752-8480-78abc62203da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:20:00.491615013Z [2024-04-21 02:20:00,491: INFO/ForkPoolWorker-16] [74f2a891-030b-4578-bc21-b3a070cae89b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:20:00.500888294Z [2024-04-21 02:20:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ede3443c-d154-4e3d-9127-d3c0dad77310] received 2024-04-21T02:20:00.523136943Z [2024-04-21 02:20:00,522: INFO/ForkPoolWorker-3] [ede3443c-d154-4e3d-9127-d3c0dad77310] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:20:00.840402632Z [2024-04-21 02:20:00,837: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:20:00.853089729Z [2024-04-21 02:20:00,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:20:00.952179797Z [2024-04-21 02:20:00,949: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:20:01.038170103Z [2024-04-21 02:20:01,034: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:20:01.144352644Z [2024-04-21 02:20:01,137: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:20:01.276545153Z [2024-04-21 02:20:01,276: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:20:01.288694414Z [2024-04-21 02:20:01,288: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:20:01.339532504Z [2024-04-21 02:20:01,339: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:20:01.340864220Z [2024-04-21 02:20:01,340: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:20:01.341054588Z [2024-04-21 02:20:01,340: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:20:01.341346174Z [2024-04-21 02:20:01,341: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:20:01.341781015Z [2024-04-21 02:20:01,341: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:20:01.494341048Z [2024-04-21 02:20:01,492: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:20:01.622609244Z [2024-04-21 02:20:01,622: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:20:02.448214410Z [2024-04-21 02:20:02,447: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[74f2a891-030b-4578-bc21-b3a070cae89b] succeeded in 1.9709773149988905s: None 2024-04-21T02:20:02.525753483Z [2024-04-21 02:20:02,525: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[977651ef-84f6-4752-8480-78abc62203da] succeeded in 2.050011565001114s: None 2024-04-21T02:20:02.785098537Z [2024-04-21 02:20:02,784: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T02:20:02.789399595Z [2024-04-21 02:20:02,788: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:20:02.808987866Z [2024-04-21 02:20:02,808: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:20:02.813778094Z [2024-04-21 02:20:02,813: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:20:02.817145541Z [2024-04-21 02:20:02,816: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T02:20:02.820712379Z [2024-04-21 02:20:02,820: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:20:02.820826380Z [2024-04-21 02:20:02,820: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:20:02.821022508Z [2024-04-21 02:20:02,820: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:20:02.821128269Z [2024-04-21 02:20:02,820: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T02:20:02.821433329Z [2024-04-21 02:20:02,821: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:20:02.821542079Z [2024-04-21 02:20:02,821: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:20:02.837371696Z [2024-04-21 02:20:02,837: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:20:02.841020142Z [2024-04-21 02:20:02,840: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:20:02.841042946Z [2024-04-21 02:20:02,840: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:20:02.841196712Z [2024-04-21 02:20:02,841: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:20:02.841238767Z [2024-04-21 02:20:02,841: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:20:02.841538003Z [2024-04-21 02:20:02,841: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:20:02.841598038Z [2024-04-21 02:20:02,841: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:20:02.932453289Z [2024-04-21 02:20:02,932: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:20:02.995496965Z [2024-04-21 02:20:02,995: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:20:03.006045567Z [2024-04-21 02:20:03,005: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:20:03.009317140Z [2024-04-21 02:20:03,008: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:20:03.044884434Z [2024-04-21 02:20:03,044: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:20:03.048836290Z [2024-04-21 02:20:03,048: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:20:03.048885825Z [2024-04-21 02:20:03,048: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:20:03.049052834Z [2024-04-21 02:20:03,048: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:20:03.049108808Z [2024-04-21 02:20:03,049: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:20:03.049389227Z [2024-04-21 02:20:03,049: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:20:03.049823110Z [2024-04-21 02:20:03,049: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:20:03.160697725Z [2024-04-21 02:20:03,160: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:20:03.606796225Z [2024-04-21 02:20:03,606: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e50629f-2b34-467f-86d6-31ee4f5f7c12] succeeded in 3.1399714580002183s: None 2024-04-21T02:20:04.171488857Z [2024-04-21 02:20:04,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9c6331c-ae9d-4dc0-afc7-0cc4c7cd3db0] received 2024-04-21T02:20:04.180668396Z [2024-04-21 02:20:04,180: INFO/ForkPoolWorker-15] [d9c6331c-ae9d-4dc0-afc7-0cc4c7cd3db0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:20:04.497992619Z [2024-04-21 02:20:04,494: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:20:04.781638518Z [2024-04-21 02:20:04,780: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ede3443c-d154-4e3d-9127-d3c0dad77310] succeeded in 4.274884689000828s: None 2024-04-21T02:20:05.686559923Z [2024-04-21 02:20:05,686: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:20:05.689887544Z [2024-04-21 02:20:05,689: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:20:05.709099409Z [2024-04-21 02:20:05,708: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:20:05.710454323Z [2024-04-21 02:20:05,710: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:20:05.710477709Z [2024-04-21 02:20:05,710: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:20:05.710673492Z [2024-04-21 02:20:05,710: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:20:05.710737107Z [2024-04-21 02:20:05,710: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:20:05.710943408Z [2024-04-21 02:20:05,710: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:20:05.710978741Z [2024-04-21 02:20:05,710: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:20:05.799102423Z [2024-04-21 02:20:05,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:20:05.849120931Z [2024-04-21 02:20:05,848: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7bfdcd9d-0a39-4248-a287-625d1de9a115] succeeded in 5.368628178999643s: None 2024-04-21T02:20:06.540368614Z [2024-04-21 02:20:06,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9c6331c-ae9d-4dc0-afc7-0cc4c7cd3db0] succeeded in 2.3666785869991145s: None 2024-04-21T02:20:06.660333648Z [2024-04-21 02:20:06,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74f93185-fccc-4b4d-bfaa-8f1ed4e4ea11] received 2024-04-21T02:20:06.667293663Z [2024-04-21 02:20:06,667: INFO/ForkPoolWorker-15] [74f93185-fccc-4b4d-bfaa-8f1ed4e4ea11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:20:06.952597624Z [2024-04-21 02:20:06,949: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:20:08.018722427Z [2024-04-21 02:20:08,018: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:20:08.021963151Z [2024-04-21 02:20:08,021: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:20:08.044711820Z [2024-04-21 02:20:08,044: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:20:08.046092641Z [2024-04-21 02:20:08,045: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:20:08.046109268Z [2024-04-21 02:20:08,046: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:20:08.046343486Z [2024-04-21 02:20:08,046: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:20:08.046377440Z [2024-04-21 02:20:08,046: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:20:08.048670401Z [2024-04-21 02:20:08,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:20:08.048879427Z [2024-04-21 02:20:08,048: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:20:08.145757454Z [2024-04-21 02:20:08,145: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:20:09.793788569Z [2024-04-21 02:20:09,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74f93185-fccc-4b4d-bfaa-8f1ed4e4ea11] succeeded in 3.1309399219990155s: None 2024-04-21T02:20:10.335855475Z [2024-04-21 02:20:10,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4fb7fc9-1a3b-4ca8-9432-393df98e0a83] received 2024-04-21T02:20:10.344696283Z [2024-04-21 02:20:10,344: INFO/ForkPoolWorker-15] [f4fb7fc9-1a3b-4ca8-9432-393df98e0a83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:20:10.672527915Z [2024-04-21 02:20:10,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:20:11.767417767Z [2024-04-21 02:20:11,766: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:20:11.770452390Z [2024-04-21 02:20:11,769: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:20:11.794876560Z [2024-04-21 02:20:11,794: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:20:11.798092030Z [2024-04-21 02:20:11,795: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:20:11.798125770Z [2024-04-21 02:20:11,796: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:20:11.798137279Z [2024-04-21 02:20:11,796: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:20:11.798147516Z [2024-04-21 02:20:11,796: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:20:11.798156593Z [2024-04-21 02:20:11,796: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:20:11.798165373Z [2024-04-21 02:20:11,796: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:20:11.910643614Z [2024-04-21 02:20:11,910: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:20:12.560101485Z [2024-04-21 02:20:12,559: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4fb7fc9-1a3b-4ca8-9432-393df98e0a83] succeeded in 2.2219664989988814s: None 2024-04-21T02:21:01.244122587Z [2024-04-21 02:21:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4aac1cc-2969-4dae-b571-495a93e67342] received 2024-04-21T02:21:01.245850566Z [2024-04-21 02:21:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d07dd601-2c9e-45b6-9277-a01c28afbfc4] received 2024-04-21T02:21:01.255799891Z [2024-04-21 02:21:01,255: INFO/ForkPoolWorker-15] [e4aac1cc-2969-4dae-b571-495a93e67342] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:21:01.258921324Z [2024-04-21 02:21:01,258: INFO/ForkPoolWorker-16] [d07dd601-2c9e-45b6-9277-a01c28afbfc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:21:01.268234968Z [2024-04-21 02:21:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ad02c7a-7135-4e5e-8c64-b227e37a500d] received 2024-04-21T02:21:01.279120859Z [2024-04-21 02:21:01,278: INFO/ForkPoolWorker-1] [2ad02c7a-7135-4e5e-8c64-b227e37a500d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:21:01.584913185Z [2024-04-21 02:21:01,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:21:01.683007318Z [2024-04-21 02:21:01,679: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:21:01.889360417Z [2024-04-21 02:21:01,886: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:21:02.055399029Z [2024-04-21 02:21:02,054: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:21:02.059767121Z [2024-04-21 02:21:02,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:21:02.081625499Z [2024-04-21 02:21:02,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:21:02.082430078Z [2024-04-21 02:21:02,082: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:21:02.082595631Z [2024-04-21 02:21:02,082: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:21:02.082696009Z [2024-04-21 02:21:02,082: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:21:02.082942913Z [2024-04-21 02:21:02,082: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:21:02.183502227Z [2024-04-21 02:21:02,183: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:21:02.806745216Z [2024-04-21 02:21:02,806: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:21:02.810434887Z [2024-04-21 02:21:02,809: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:21:02.849517409Z [2024-04-21 02:21:02,849: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:21:02.852316735Z [2024-04-21 02:21:02,852: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:21:02.852538421Z [2024-04-21 02:21:02,852: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:21:02.852872665Z [2024-04-21 02:21:02,852: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:21:02.853117833Z [2024-04-21 02:21:02,852: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:21:02.853569024Z [2024-04-21 02:21:02,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:21:02.853901954Z [2024-04-21 02:21:02,853: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:21:02.979510525Z [2024-04-21 02:21:02,979: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d07dd601-2c9e-45b6-9277-a01c28afbfc4] succeeded in 1.7306810749996657s: None 2024-04-21T02:21:03.025470350Z [2024-04-21 02:21:03,025: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:21:03.348366817Z [2024-04-21 02:21:03,347: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:21:03.355837424Z [2024-04-21 02:21:03,355: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:21:03.386142452Z [2024-04-21 02:21:03,385: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:21:03.388287138Z [2024-04-21 02:21:03,388: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:21:03.388381734Z [2024-04-21 02:21:03,388: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:21:03.388552335Z [2024-04-21 02:21:03,388: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:21:03.388696480Z [2024-04-21 02:21:03,388: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:21:03.389017425Z [2024-04-21 02:21:03,388: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:21:03.389150417Z [2024-04-21 02:21:03,389: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:21:03.500731167Z [2024-04-21 02:21:03,500: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:21:05.657062201Z [2024-04-21 02:21:05,656: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ad02c7a-7135-4e5e-8c64-b227e37a500d] succeeded in 4.386853959998916s: None 2024-04-21T02:21:05.828358651Z [2024-04-21 02:21:05,827: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4aac1cc-2969-4dae-b571-495a93e67342] succeeded in 4.579795536999882s: None 2024-04-21T02:22:00.409610187Z [2024-04-21 02:22:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dd9c756-ecd8-4afb-b38e-6acf11f74005] received 2024-04-21T02:22:00.413469710Z [2024-04-21 02:22:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[158d7175-235e-4d2a-af52-1d0cf583166c] received 2024-04-21T02:22:00.423064213Z [2024-04-21 02:22:00,422: INFO/ForkPoolWorker-16] [158d7175-235e-4d2a-af52-1d0cf583166c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:22:00.423832872Z [2024-04-21 02:22:00,423: INFO/ForkPoolWorker-15] [6dd9c756-ecd8-4afb-b38e-6acf11f74005] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:22:00.426912870Z [2024-04-21 02:22:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a466110-f7ff-45e6-ac4e-a4deac137b21] received 2024-04-21T02:22:00.431476632Z [2024-04-21 02:22:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2e05874-b01f-4cd0-9ac8-2ce3b2b5b345] received 2024-04-21T02:22:00.454368166Z [2024-04-21 02:22:00,453: INFO/ForkPoolWorker-2] [d2e05874-b01f-4cd0-9ac8-2ce3b2b5b345] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:22:00.460753877Z [2024-04-21 02:22:00,460: INFO/ForkPoolWorker-1] [2a466110-f7ff-45e6-ac4e-a4deac137b21] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:22:00.755395615Z [2024-04-21 02:22:00,751: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:22:00.798779326Z [2024-04-21 02:22:00,795: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:22:00.829832457Z [2024-04-21 02:22:00,825: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:22:00.844284003Z [2024-04-21 02:22:00,838: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:22:01.015503010Z [2024-04-21 02:22:01,015: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:22:01.019973904Z [2024-04-21 02:22:01,019: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:22:01.067192331Z [2024-04-21 02:22:01,067: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:22:01.075785697Z [2024-04-21 02:22:01,072: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:22:01.075812932Z [2024-04-21 02:22:01,072: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:22:01.075817066Z [2024-04-21 02:22:01,072: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:22:01.075821371Z [2024-04-21 02:22:01,072: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:22:01.075824526Z [2024-04-21 02:22:01,072: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:22:01.212748771Z [2024-04-21 02:22:01,212: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:22:01.934101312Z [2024-04-21 02:22:01,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6dd9c756-ecd8-4afb-b38e-6acf11f74005] succeeded in 1.5223062570003094s: None 2024-04-21T02:22:01.957424045Z [2024-04-21 02:22:01,957: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a466110-f7ff-45e6-ac4e-a4deac137b21] succeeded in 1.5213304389999394s: None 2024-04-21T02:22:02.292274081Z [2024-04-21 02:22:02,281: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:22:02.299900989Z [2024-04-21 02:22:02,295: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:22:02.323224839Z [2024-04-21 02:22:02,322: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:22:02.324586753Z [2024-04-21 02:22:02,324: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:22:02.324603455Z [2024-04-21 02:22:02,324: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:22:02.324751994Z [2024-04-21 02:22:02,324: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:22:02.324780061Z [2024-04-21 02:22:02,324: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:22:02.325063910Z [2024-04-21 02:22:02,324: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:22:02.325148492Z [2024-04-21 02:22:02,325: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:22:02.417698697Z [2024-04-21 02:22:02,417: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:22:02.455378320Z [2024-04-21 02:22:02,455: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:22:02.458747021Z [2024-04-21 02:22:02,458: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:22:02.485126729Z [2024-04-21 02:22:02,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:22:02.486562636Z [2024-04-21 02:22:02,486: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:22:02.486730883Z [2024-04-21 02:22:02,486: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:22:02.486980504Z [2024-04-21 02:22:02,486: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:22:02.487131903Z [2024-04-21 02:22:02,487: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:22:02.487607950Z [2024-04-21 02:22:02,487: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:22:02.487814214Z [2024-04-21 02:22:02,487: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:22:02.593015211Z [2024-04-21 02:22:02,592: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:22:04.217803040Z [2024-04-21 02:22:04,217: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d2e05874-b01f-4cd0-9ac8-2ce3b2b5b345] succeeded in 3.7835612350008887s: None 2024-04-21T02:22:05.010847717Z [2024-04-21 02:22:05,010: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[158d7175-235e-4d2a-af52-1d0cf583166c] succeeded in 4.595420604000537s: None 2024-04-21T02:23:00.426975831Z [2024-04-21 02:23:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d4a1111-b385-4511-a435-bb99d5a8a882] received 2024-04-21T02:23:00.431745412Z [2024-04-21 02:23:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f9d8d1e-96e1-4dbe-945d-13acaaed08bf] received 2024-04-21T02:23:00.440414772Z [2024-04-21 02:23:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f88dd81a-8b3f-4e79-9c86-c10a77dc08bb] received 2024-04-21T02:23:00.441372011Z [2024-04-21 02:23:00,441: INFO/ForkPoolWorker-16] [6f9d8d1e-96e1-4dbe-945d-13acaaed08bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:23:00.444738924Z [2024-04-21 02:23:00,444: INFO/ForkPoolWorker-15] [1d4a1111-b385-4511-a435-bb99d5a8a882] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:23:00.459065707Z [2024-04-21 02:23:00,458: INFO/ForkPoolWorker-1] [f88dd81a-8b3f-4e79-9c86-c10a77dc08bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:23:00.756763538Z [2024-04-21 02:23:00,753: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:23:00.767028513Z [2024-04-21 02:23:00,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:23:00.854460004Z [2024-04-21 02:23:00,850: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:23:00.947423559Z [2024-04-21 02:23:00,946: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:23:00.951565049Z [2024-04-21 02:23:00,951: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:23:00.984971617Z [2024-04-21 02:23:00,984: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:23:00.986140591Z [2024-04-21 02:23:00,985: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:23:00.986177616Z [2024-04-21 02:23:00,986: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:23:00.986358129Z [2024-04-21 02:23:00,986: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:23:00.986645344Z [2024-04-21 02:23:00,986: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:23:01.145835432Z [2024-04-21 02:23:01,145: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:23:01.751851827Z [2024-04-21 02:23:01,751: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f88dd81a-8b3f-4e79-9c86-c10a77dc08bb] succeeded in 1.309411836999061s: None 2024-04-21T02:23:02.064367834Z [2024-04-21 02:23:02,063: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:23:02.067904264Z [2024-04-21 02:23:02,067: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:23:02.098432557Z [2024-04-21 02:23:02,097: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:23:02.100779705Z [2024-04-21 02:23:02,100: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:23:02.101137618Z [2024-04-21 02:23:02,100: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:23:02.101539956Z [2024-04-21 02:23:02,101: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:23:02.101804574Z [2024-04-21 02:23:02,101: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:23:02.102664476Z [2024-04-21 02:23:02,102: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:23:02.102956931Z [2024-04-21 02:23:02,102: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:23:02.192453622Z [2024-04-21 02:23:02,192: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:23:02.195666213Z [2024-04-21 02:23:02,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:23:02.229992417Z [2024-04-21 02:23:02,229: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:23:02.236878917Z [2024-04-21 02:23:02,236: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:23:02.238368793Z [2024-04-21 02:23:02,238: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:23:02.238383886Z [2024-04-21 02:23:02,238: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:23:02.238719019Z [2024-04-21 02:23:02,238: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:23:02.238729406Z [2024-04-21 02:23:02,238: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:23:02.239269258Z [2024-04-21 02:23:02,238: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:23:02.239415444Z [2024-04-21 02:23:02,239: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:23:02.325591529Z [2024-04-21 02:23:02,325: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:23:04.660138287Z [2024-04-21 02:23:04,659: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6f9d8d1e-96e1-4dbe-945d-13acaaed08bf] succeeded in 4.225532127000406s: None 2024-04-21T02:23:05.268285350Z [2024-04-21 02:23:05,267: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d4a1111-b385-4511-a435-bb99d5a8a882] succeeded in 4.83667529000013s: None 2024-04-21T02:24:01.196091429Z [2024-04-21 02:24:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5247bd8-35e8-485c-9131-7063ce88d71c] received 2024-04-21T02:24:01.199745812Z [2024-04-21 02:24:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ff547f6-c8b4-4c31-991f-575c64a487c2] received 2024-04-21T02:24:01.207247041Z [2024-04-21 02:24:01,206: INFO/ForkPoolWorker-16] [2ff547f6-c8b4-4c31-991f-575c64a487c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:24:01.208046786Z [2024-04-21 02:24:01,207: INFO/ForkPoolWorker-15] [b5247bd8-35e8-485c-9131-7063ce88d71c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:24:01.217424901Z [2024-04-21 02:24:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55fe0f69-f635-45a1-9b57-44e5019595ad] received 2024-04-21T02:24:01.221362235Z [2024-04-21 02:24:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2201045a-7fe0-4b11-aae3-09f176d79d4d] received 2024-04-21T02:24:01.232998334Z [2024-04-21 02:24:01,232: INFO/ForkPoolWorker-1] [55fe0f69-f635-45a1-9b57-44e5019595ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:24:01.244369604Z [2024-04-21 02:24:01,244: INFO/ForkPoolWorker-2] [2201045a-7fe0-4b11-aae3-09f176d79d4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:24:01.573348575Z [2024-04-21 02:24:01,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:24:01.606348481Z [2024-04-21 02:24:01,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:24:01.695643003Z [2024-04-21 02:24:01,692: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:24:01.770143929Z [2024-04-21 02:24:01,767: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:24:02.032250910Z [2024-04-21 02:24:02,031: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:24:02.040767762Z [2024-04-21 02:24:02,040: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:24:02.064529001Z [2024-04-21 02:24:02,064: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:24:02.092134173Z [2024-04-21 02:24:02,091: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:24:02.095435951Z [2024-04-21 02:24:02,094: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:24:02.096001223Z [2024-04-21 02:24:02,095: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:24:02.096556916Z [2024-04-21 02:24:02,096: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:24:02.097234889Z [2024-04-21 02:24:02,096: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:24:02.302487396Z [2024-04-21 02:24:02,302: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:24:02.994902024Z [2024-04-21 02:24:02,994: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5247bd8-35e8-485c-9131-7063ce88d71c] succeeded in 1.7940126169996802s: None 2024-04-21T02:24:03.181164795Z [2024-04-21 02:24:03,180: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[55fe0f69-f635-45a1-9b57-44e5019595ad] succeeded in 1.961778807999508s: None 2024-04-21T02:24:03.193485297Z [2024-04-21 02:24:03,193: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:24:03.196773823Z [2024-04-21 02:24:03,196: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:24:03.219403799Z [2024-04-21 02:24:03,219: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:24:03.220437904Z [2024-04-21 02:24:03,220: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:24:03.220452912Z [2024-04-21 02:24:03,220: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:24:03.220672033Z [2024-04-21 02:24:03,220: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:24:03.220813865Z [2024-04-21 02:24:03,220: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:24:03.221211523Z [2024-04-21 02:24:03,220: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:24:03.221271633Z [2024-04-21 02:24:03,221: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:24:03.251460758Z [2024-04-21 02:24:03,251: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:24:03.254750051Z [2024-04-21 02:24:03,254: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:24:03.281650325Z [2024-04-21 02:24:03,281: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:24:03.283394415Z [2024-04-21 02:24:03,283: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:24:03.283553866Z [2024-04-21 02:24:03,283: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:24:03.283783166Z [2024-04-21 02:24:03,283: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:24:03.283894389Z [2024-04-21 02:24:03,283: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:24:03.284185917Z [2024-04-21 02:24:03,284: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:24:03.284703259Z [2024-04-21 02:24:03,284: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:24:03.317363911Z [2024-04-21 02:24:03,317: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:24:03.372066638Z [2024-04-21 02:24:03,371: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:24:05.306023245Z [2024-04-21 02:24:05,305: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2201045a-7fe0-4b11-aae3-09f176d79d4d] succeeded in 4.082896505999088s: None 2024-04-21T02:24:06.488337576Z [2024-04-21 02:24:06,487: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ff547f6-c8b4-4c31-991f-575c64a487c2] succeeded in 5.286467152000114s: None 2024-04-21T02:25:01.182649264Z [2024-04-21 02:25:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0371fcc2-3275-4bca-a007-76bf9cd52e8f] received 2024-04-21T02:25:01.193076556Z [2024-04-21 02:25:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98ce06e2-7cdf-46f9-a2c3-795d6bbf6111] received 2024-04-21T02:25:01.196793951Z [2024-04-21 02:25:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c215fe3a-7cfb-4da5-84ba-28340e697d82] received 2024-04-21T02:25:01.198883934Z [2024-04-21 02:25:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a73f9b15-2292-49a9-96f6-8c2904c3b1cc] received 2024-04-21T02:25:01.203851222Z [2024-04-21 02:25:01,203: INFO/ForkPoolWorker-16] [98ce06e2-7cdf-46f9-a2c3-795d6bbf6111] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:25:01.203880154Z [2024-04-21 02:25:01,203: INFO/ForkPoolWorker-15] [0371fcc2-3275-4bca-a007-76bf9cd52e8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:25:01.214475677Z [2024-04-21 02:25:01,214: INFO/ForkPoolWorker-2] [a73f9b15-2292-49a9-96f6-8c2904c3b1cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:25:01.225186707Z [2024-04-21 02:25:01,224: INFO/ForkPoolWorker-1] [c215fe3a-7cfb-4da5-84ba-28340e697d82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:25:01.554986173Z [2024-04-21 02:25:01,548: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:25:01.654959291Z [2024-04-21 02:25:01,651: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:25:01.732615801Z [2024-04-21 02:25:01,732: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:25:01.736554912Z [2024-04-21 02:25:01,736: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:25:01.779332929Z [2024-04-21 02:25:01,779: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:25:01.787799058Z [2024-04-21 02:25:01,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:25:01.791811827Z [2024-04-21 02:25:01,791: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:25:01.791916868Z [2024-04-21 02:25:01,791: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:25:01.792055493Z [2024-04-21 02:25:01,791: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:25:01.792285240Z [2024-04-21 02:25:01,792: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:25:01.838356687Z [2024-04-21 02:25:01,834: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:25:01.954530553Z [2024-04-21 02:25:01,954: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:25:02.794597567Z [2024-04-21 02:25:02,794: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[98ce06e2-7cdf-46f9-a2c3-795d6bbf6111] succeeded in 1.5997470769998472s: None 2024-04-21T02:25:03.198735802Z [2024-04-21 02:25:03,198: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:25:03.202125456Z [2024-04-21 02:25:03,201: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:25:03.238093967Z [2024-04-21 02:25:03,237: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:25:03.239317877Z [2024-04-21 02:25:03,239: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:25:03.239472190Z [2024-04-21 02:25:03,239: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:25:03.239702586Z [2024-04-21 02:25:03,239: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:25:03.239864953Z [2024-04-21 02:25:03,239: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:25:03.240291991Z [2024-04-21 02:25:03,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:25:03.240404054Z [2024-04-21 02:25:03,240: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:25:03.326571315Z [2024-04-21 02:25:03,326: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:25:03.431008827Z [2024-04-21 02:25:03,430: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:25:03.434304375Z [2024-04-21 02:25:03,433: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:25:03.467604774Z [2024-04-21 02:25:03,467: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:25:03.470561229Z [2024-04-21 02:25:03,470: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:25:03.470786747Z [2024-04-21 02:25:03,470: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:25:03.471452902Z [2024-04-21 02:25:03,471: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:25:03.471629018Z [2024-04-21 02:25:03,471: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:25:03.472162334Z [2024-04-21 02:25:03,471: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:25:03.472549279Z [2024-04-21 02:25:03,472: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:25:03.536377071Z [2024-04-21 02:25:03,531: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:25:03.540124392Z [2024-04-21 02:25:03,539: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:25:03.575983649Z [2024-04-21 02:25:03,575: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:25:03.578076411Z [2024-04-21 02:25:03,577: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:25:03.581097686Z [2024-04-21 02:25:03,580: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:25:03.581231747Z [2024-04-21 02:25:03,581: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:25:03.581461133Z [2024-04-21 02:25:03,581: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:25:03.581808006Z [2024-04-21 02:25:03,581: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:25:03.582071759Z [2024-04-21 02:25:03,581: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:25:03.582229610Z [2024-04-21 02:25:03,582: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:25:03.689070909Z [2024-04-21 02:25:03,688: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:25:04.221132299Z [2024-04-21 02:25:04,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eafaa1a9-7bd9-4db7-97c8-e60598237e31] received 2024-04-21T02:25:04.225605379Z [2024-04-21 02:25:04,225: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0371fcc2-3275-4bca-a007-76bf9cd52e8f] succeeded in 3.029070796999804s: None 2024-04-21T02:25:04.228159931Z [2024-04-21 02:25:04,227: INFO/ForkPoolWorker-16] [eafaa1a9-7bd9-4db7-97c8-e60598237e31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:25:04.534428156Z [2024-04-21 02:25:04,531: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:25:05.659799972Z [2024-04-21 02:25:05,659: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a73f9b15-2292-49a9-96f6-8c2904c3b1cc] succeeded in 4.458693354999923s: None 2024-04-21T02:25:05.851183201Z [2024-04-21 02:25:05,850: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:25:05.855762690Z [2024-04-21 02:25:05,855: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:25:05.882079077Z [2024-04-21 02:25:05,881: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:25:05.883425203Z [2024-04-21 02:25:05,883: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:25:05.883563078Z [2024-04-21 02:25:05,883: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:25:05.883874320Z [2024-04-21 02:25:05,883: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:25:05.884054453Z [2024-04-21 02:25:05,883: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:25:05.884481337Z [2024-04-21 02:25:05,884: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:25:05.884554610Z [2024-04-21 02:25:05,884: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:25:05.994158482Z [2024-04-21 02:25:05,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c215fe3a-7cfb-4da5-84ba-28340e697d82] succeeded in 4.794769262000045s: None 2024-04-21T02:25:06.004787595Z [2024-04-21 02:25:06,004: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:25:06.746948980Z [2024-04-21 02:25:06,746: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eafaa1a9-7bd9-4db7-97c8-e60598237e31] succeeded in 2.5240636649996304s: None 2024-04-21T02:25:07.805350930Z [2024-04-21 02:25:07,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[225e36c6-3b57-4ff8-ad9e-c25dce240b1f] received 2024-04-21T02:25:07.818638437Z [2024-04-21 02:25:07,818: INFO/ForkPoolWorker-15] [225e36c6-3b57-4ff8-ad9e-c25dce240b1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:25:08.154140294Z [2024-04-21 02:25:08,150: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:25:09.347745903Z [2024-04-21 02:25:09,347: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:25:09.352745658Z [2024-04-21 02:25:09,352: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:25:09.380425869Z [2024-04-21 02:25:09,380: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:25:09.382377260Z [2024-04-21 02:25:09,382: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:25:09.382589058Z [2024-04-21 02:25:09,382: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:25:09.383007605Z [2024-04-21 02:25:09,382: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:25:09.383045044Z [2024-04-21 02:25:09,382: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:25:09.383376142Z [2024-04-21 02:25:09,383: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:25:09.383566251Z [2024-04-21 02:25:09,383: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:25:09.490241019Z [2024-04-21 02:25:09,489: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:25:11.154454758Z [2024-04-21 02:25:11,153: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[225e36c6-3b57-4ff8-ad9e-c25dce240b1f] succeeded in 3.345422326001426s: None 2024-04-21T02:25:11.527121456Z [2024-04-21 02:25:11,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7aa10b34-cb8b-4593-9fca-2fda19149794] received 2024-04-21T02:25:11.534083975Z [2024-04-21 02:25:11,533: INFO/ForkPoolWorker-15] [7aa10b34-cb8b-4593-9fca-2fda19149794] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:25:11.833830536Z [2024-04-21 02:25:11,830: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:25:12.944085252Z [2024-04-21 02:25:12,943: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:25:12.947257934Z [2024-04-21 02:25:12,946: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:25:12.970270896Z [2024-04-21 02:25:12,970: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:25:12.971864394Z [2024-04-21 02:25:12,971: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:25:12.971977045Z [2024-04-21 02:25:12,971: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:25:12.972189822Z [2024-04-21 02:25:12,971: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:25:12.972269332Z [2024-04-21 02:25:12,972: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:25:12.972599111Z [2024-04-21 02:25:12,972: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:25:12.972792829Z [2024-04-21 02:25:12,972: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:25:13.097185597Z [2024-04-21 02:25:13,096: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:25:13.717401280Z [2024-04-21 02:25:13,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7aa10b34-cb8b-4593-9fca-2fda19149794] succeeded in 2.1883192069999495s: None 2024-04-21T02:26:00.318899343Z [2024-04-21 02:26:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4422d6b-2674-4e17-9905-9cfe35e164a2] received 2024-04-21T02:26:00.321549431Z [2024-04-21 02:26:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd89a274-4d53-41f2-8516-82fe4f634765] received 2024-04-21T02:26:00.328809490Z [2024-04-21 02:26:00,328: INFO/ForkPoolWorker-16] [fd89a274-4d53-41f2-8516-82fe4f634765] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:26:00.330762518Z [2024-04-21 02:26:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bae978c-00e0-4df5-be59-bc6aa0adc9d1] received 2024-04-21T02:26:00.331491205Z [2024-04-21 02:26:00,331: INFO/ForkPoolWorker-15] [a4422d6b-2674-4e17-9905-9cfe35e164a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:26:00.338364101Z [2024-04-21 02:26:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a1a73bd-70fb-4c6d-aeda-db388459ddf7] received 2024-04-21T02:26:00.348841219Z [2024-04-21 02:26:00,348: INFO/ForkPoolWorker-1] [7bae978c-00e0-4df5-be59-bc6aa0adc9d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:26:00.356407266Z [2024-04-21 02:26:00,356: INFO/ForkPoolWorker-2] [0a1a73bd-70fb-4c6d-aeda-db388459ddf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:26:00.662241894Z [2024-04-21 02:26:00,658: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:26:00.732284418Z [2024-04-21 02:26:00,724: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:26:00.752921198Z [2024-04-21 02:26:00,747: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:26:00.778309567Z [2024-04-21 02:26:00,774: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:26:00.827391928Z [2024-04-21 02:26:00,826: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:26:00.831630734Z [2024-04-21 02:26:00,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:26:00.867708960Z [2024-04-21 02:26:00,867: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:26:00.869656126Z [2024-04-21 02:26:00,869: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:26:00.869830185Z [2024-04-21 02:26:00,869: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:26:00.869937839Z [2024-04-21 02:26:00,869: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:26:00.870153385Z [2024-04-21 02:26:00,870: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:26:00.950770589Z [2024-04-21 02:26:00,950: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:26:01.110197885Z [2024-04-21 02:26:01,109: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:26:01.636640502Z [2024-04-21 02:26:01,636: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7bae978c-00e0-4df5-be59-bc6aa0adc9d1] succeeded in 1.302612190000218s: None 2024-04-21T02:26:01.790809245Z [2024-04-21 02:26:01,790: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4422d6b-2674-4e17-9905-9cfe35e164a2] succeeded in 1.4700438370000484s: None 2024-04-21T02:26:02.072419600Z [2024-04-21 02:26:02,072: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:26:02.075614519Z [2024-04-21 02:26:02,075: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:26:02.093739390Z [2024-04-21 02:26:02,093: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:26:02.094936409Z [2024-04-21 02:26:02,094: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:26:02.095072121Z [2024-04-21 02:26:02,094: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:26:02.095257093Z [2024-04-21 02:26:02,095: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:26:02.095380724Z [2024-04-21 02:26:02,095: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:26:02.095658964Z [2024-04-21 02:26:02,095: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:26:02.095877393Z [2024-04-21 02:26:02,095: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:26:02.165786493Z [2024-04-21 02:26:02,165: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:26:02.187714480Z [2024-04-21 02:26:02,187: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:26:02.190954153Z [2024-04-21 02:26:02,190: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:26:02.210704195Z [2024-04-21 02:26:02,210: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:26:02.211979582Z [2024-04-21 02:26:02,211: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:26:02.212126437Z [2024-04-21 02:26:02,211: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:26:02.212347336Z [2024-04-21 02:26:02,212: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:26:02.212493631Z [2024-04-21 02:26:02,212: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:26:02.213013362Z [2024-04-21 02:26:02,212: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:26:02.213265018Z [2024-04-21 02:26:02,212: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:26:02.301208246Z [2024-04-21 02:26:02,300: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:26:03.883775735Z [2024-04-21 02:26:03,881: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0a1a73bd-70fb-4c6d-aeda-db388459ddf7] succeeded in 3.538296941000226s: None 2024-04-21T02:26:04.245426826Z [2024-04-21 02:26:04,244: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fd89a274-4d53-41f2-8516-82fe4f634765] succeeded in 3.9223874720009917s: None 2024-04-21T02:27:00.306303029Z [2024-04-21 02:27:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a31ffae6-700a-4f8e-a6e6-4fe007a56322] received 2024-04-21T02:27:00.312526189Z [2024-04-21 02:27:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d0ef88f-ba79-4294-a111-4fc6dd5bd329] received 2024-04-21T02:27:00.317744564Z [2024-04-21 02:27:00,317: INFO/ForkPoolWorker-15] [a31ffae6-700a-4f8e-a6e6-4fe007a56322] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:27:00.319271967Z [2024-04-21 02:27:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ed3b221-b916-4d19-93b3-c655ca13b7e7] received 2024-04-21T02:27:00.327389563Z [2024-04-21 02:27:00,327: INFO/ForkPoolWorker-16] [5d0ef88f-ba79-4294-a111-4fc6dd5bd329] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:27:00.331983097Z [2024-04-21 02:27:00,331: INFO/ForkPoolWorker-1] [2ed3b221-b916-4d19-93b3-c655ca13b7e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:27:00.614794079Z [2024-04-21 02:27:00,610: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:27:00.628870147Z [2024-04-21 02:27:00,625: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:27:00.655119697Z [2024-04-21 02:27:00,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:27:00.767266662Z [2024-04-21 02:27:00,766: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:27:00.771300539Z [2024-04-21 02:27:00,770: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:27:00.793762525Z [2024-04-21 02:27:00,793: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:27:00.795121695Z [2024-04-21 02:27:00,794: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:27:00.795306381Z [2024-04-21 02:27:00,795: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:27:00.795431578Z [2024-04-21 02:27:00,795: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:27:00.795745087Z [2024-04-21 02:27:00,795: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:27:00.904425165Z [2024-04-21 02:27:00,904: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:27:01.507814478Z [2024-04-21 02:27:01,504: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d0ef88f-ba79-4294-a111-4fc6dd5bd329] succeeded in 1.1893325250002817s: None 2024-04-21T02:27:01.859542013Z [2024-04-21 02:27:01,859: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:27:01.866232978Z [2024-04-21 02:27:01,865: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:27:01.904860252Z [2024-04-21 02:27:01,901: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:27:01.907783985Z [2024-04-21 02:27:01,907: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:27:01.907950848Z [2024-04-21 02:27:01,907: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:27:01.908082122Z [2024-04-21 02:27:01,907: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:27:01.908115593Z [2024-04-21 02:27:01,908: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:27:01.908358050Z [2024-04-21 02:27:01,908: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:27:01.908370007Z [2024-04-21 02:27:01,908: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:27:02.009329735Z [2024-04-21 02:27:02,009: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:27:02.083236702Z [2024-04-21 02:27:02,082: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:27:02.086621158Z [2024-04-21 02:27:02,086: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:27:02.116657007Z [2024-04-21 02:27:02,116: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:27:02.121064311Z [2024-04-21 02:27:02,120: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:27:02.121103204Z [2024-04-21 02:27:02,120: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:27:02.121130213Z [2024-04-21 02:27:02,120: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:27:02.121162766Z [2024-04-21 02:27:02,121: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:27:02.121409079Z [2024-04-21 02:27:02,121: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:27:02.121424016Z [2024-04-21 02:27:02,121: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:27:02.220836416Z [2024-04-21 02:27:02,220: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:27:03.806087721Z [2024-04-21 02:27:03,805: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ed3b221-b916-4d19-93b3-c655ca13b7e7] succeeded in 3.4850569649988756s: None 2024-04-21T02:27:04.423785020Z [2024-04-21 02:27:04,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a31ffae6-700a-4f8e-a6e6-4fe007a56322] succeeded in 4.113848417999179s: None 2024-04-21T02:28:00.320180112Z [2024-04-21 02:28:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe08feb5-2684-46bd-87cb-c68266a4a06d] received 2024-04-21T02:28:00.325589146Z [2024-04-21 02:28:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa936ce7-1626-4c7b-b0b1-babf3c766add] received 2024-04-21T02:28:00.328238408Z [2024-04-21 02:28:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8a27a12-72ad-4259-8bf7-78e883f49535] received 2024-04-21T02:28:00.334787639Z [2024-04-21 02:28:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4500a6d6-d3b5-47dd-922f-1a5b687c052e] received 2024-04-21T02:28:00.342531136Z [2024-04-21 02:28:00,342: INFO/ForkPoolWorker-16] [aa936ce7-1626-4c7b-b0b1-babf3c766add] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:28:00.342944762Z [2024-04-21 02:28:00,342: INFO/ForkPoolWorker-15] [fe08feb5-2684-46bd-87cb-c68266a4a06d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:28:00.343240989Z [2024-04-21 02:28:00,343: INFO/ForkPoolWorker-2] [4500a6d6-d3b5-47dd-922f-1a5b687c052e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:28:00.344422271Z [2024-04-21 02:28:00,344: INFO/ForkPoolWorker-1] [b8a27a12-72ad-4259-8bf7-78e883f49535] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:28:00.660950282Z [2024-04-21 02:28:00,657: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:28:00.680217580Z [2024-04-21 02:28:00,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:28:00.697826614Z [2024-04-21 02:28:00,694: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:28:00.722011994Z [2024-04-21 02:28:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:28:00.890236860Z [2024-04-21 02:28:00,889: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:28:00.895712042Z [2024-04-21 02:28:00,895: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:28:00.909267983Z [2024-04-21 02:28:00,909: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:28:00.925579410Z [2024-04-21 02:28:00,925: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:28:00.926678822Z [2024-04-21 02:28:00,926: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:28:00.926717370Z [2024-04-21 02:28:00,926: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:28:00.926775393Z [2024-04-21 02:28:00,926: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:28:00.926993341Z [2024-04-21 02:28:00,926: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:28:01.034020368Z [2024-04-21 02:28:01,033: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:28:01.475157929Z [2024-04-21 02:28:01,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aa936ce7-1626-4c7b-b0b1-babf3c766add] succeeded in 1.146907659000135s: None 2024-04-21T02:28:01.681097592Z [2024-04-21 02:28:01,680: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe08feb5-2684-46bd-87cb-c68266a4a06d] succeeded in 1.358483324998815s: None 2024-04-21T02:28:02.085799544Z [2024-04-21 02:28:02,085: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:28:02.089121170Z [2024-04-21 02:28:02,088: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:28:02.109467578Z [2024-04-21 02:28:02,109: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:28:02.112775119Z [2024-04-21 02:28:02,112: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:28:02.113345992Z [2024-04-21 02:28:02,112: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:28:02.117647125Z [2024-04-21 02:28:02,117: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:28:02.117800994Z [2024-04-21 02:28:02,117: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:28:02.117995112Z [2024-04-21 02:28:02,117: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:28:02.118118214Z [2024-04-21 02:28:02,118: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:28:02.118417846Z [2024-04-21 02:28:02,118: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:28:02.118942962Z [2024-04-21 02:28:02,118: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:28:02.130767220Z [2024-04-21 02:28:02,130: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:28:02.131930446Z [2024-04-21 02:28:02,131: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:28:02.132052030Z [2024-04-21 02:28:02,131: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:28:02.132229067Z [2024-04-21 02:28:02,132: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:28:02.132336990Z [2024-04-21 02:28:02,132: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:28:02.132640040Z [2024-04-21 02:28:02,132: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:28:02.132815752Z [2024-04-21 02:28:02,132: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:28:02.203568826Z [2024-04-21 02:28:02,203: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:28:02.224453816Z [2024-04-21 02:28:02,224: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:28:03.788034211Z [2024-04-21 02:28:03,787: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b8a27a12-72ad-4259-8bf7-78e883f49535] succeeded in 3.4550981569991563s: None 2024-04-21T02:28:04.165773683Z [2024-04-21 02:28:04,164: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4500a6d6-d3b5-47dd-922f-1a5b687c052e] succeeded in 3.8283793099999457s: None 2024-04-21T02:29:00.723704204Z [2024-04-21 02:29:00,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3865df8-9d99-4780-93b5-63064a1e3f56] received 2024-04-21T02:29:00.732747548Z [2024-04-21 02:29:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8ad0e63-a009-4b50-bb70-e476de11da1a] received 2024-04-21T02:29:00.740779951Z [2024-04-21 02:29:00,740: INFO/ForkPoolWorker-15] [d3865df8-9d99-4780-93b5-63064a1e3f56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:29:00.742143387Z [2024-04-21 02:29:00,741: INFO/ForkPoolWorker-16] [a8ad0e63-a009-4b50-bb70-e476de11da1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:29:00.744196958Z [2024-04-21 02:29:00,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad4bd62a-f5ef-41ba-8211-9e95f4bceb52] received 2024-04-21T02:29:00.762755419Z [2024-04-21 02:29:00,762: INFO/ForkPoolWorker-1] [ad4bd62a-f5ef-41ba-8211-9e95f4bceb52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:29:01.119530816Z [2024-04-21 02:29:01,106: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:29:01.119557468Z [2024-04-21 02:29:01,114: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:29:01.123801501Z [2024-04-21 02:29:01,117: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:29:01.283540964Z [2024-04-21 02:29:01,283: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:29:01.287935684Z [2024-04-21 02:29:01,287: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:29:01.314562035Z [2024-04-21 02:29:01,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:29:01.315937212Z [2024-04-21 02:29:01,315: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:29:01.316268952Z [2024-04-21 02:29:01,316: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:29:01.316434869Z [2024-04-21 02:29:01,316: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:29:01.316796508Z [2024-04-21 02:29:01,316: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:29:01.404368155Z [2024-04-21 02:29:01,404: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:29:01.984832675Z [2024-04-21 02:29:01,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3865df8-9d99-4780-93b5-63064a1e3f56] succeeded in 1.2592865959995834s: None 2024-04-21T02:29:02.436910213Z [2024-04-21 02:29:02,436: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:29:02.440260736Z [2024-04-21 02:29:02,439: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:29:02.454158156Z [2024-04-21 02:29:02,453: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:29:02.457435814Z [2024-04-21 02:29:02,456: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:29:02.466724330Z [2024-04-21 02:29:02,466: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:29:02.468433379Z [2024-04-21 02:29:02,468: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:29:02.468641754Z [2024-04-21 02:29:02,468: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:29:02.468902305Z [2024-04-21 02:29:02,468: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:29:02.469068340Z [2024-04-21 02:29:02,468: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:29:02.469447122Z [2024-04-21 02:29:02,469: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:29:02.469459139Z [2024-04-21 02:29:02,469: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:29:02.494014812Z [2024-04-21 02:29:02,493: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:29:02.496347039Z [2024-04-21 02:29:02,495: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:29:02.496533074Z [2024-04-21 02:29:02,496: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:29:02.496962032Z [2024-04-21 02:29:02,496: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:29:02.497212245Z [2024-04-21 02:29:02,496: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:29:02.498198816Z [2024-04-21 02:29:02,497: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:29:02.498451364Z [2024-04-21 02:29:02,498: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:29:02.568104889Z [2024-04-21 02:29:02,567: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:29:02.610315879Z [2024-04-21 02:29:02,610: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:29:04.494371864Z [2024-04-21 02:29:04,493: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a8ad0e63-a009-4b50-bb70-e476de11da1a] succeeded in 3.760033390000899s: None 2024-04-21T02:29:04.566014098Z [2024-04-21 02:29:04,564: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ad4bd62a-f5ef-41ba-8211-9e95f4bceb52] succeeded in 3.818698217999554s: None 2024-04-21T02:30:01.240999132Z [2024-04-21 02:30:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d858eb6-791d-4f95-93d5-6ed21ce26e43] received 2024-04-21T02:30:01.248422752Z [2024-04-21 02:30:01,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a063aa6a-9676-433b-9bb2-059f8d584b6b] received 2024-04-21T02:30:01.257257783Z [2024-04-21 02:30:01,256: INFO/ForkPoolWorker-15] [4d858eb6-791d-4f95-93d5-6ed21ce26e43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:30:01.266028767Z [2024-04-21 02:30:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41af4b5e-42ff-4a2e-a53c-87e9d4069685] received 2024-04-21T02:30:01.268638369Z [2024-04-21 02:30:01,268: INFO/ForkPoolWorker-16] [a063aa6a-9676-433b-9bb2-059f8d584b6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:30:01.274195706Z [2024-04-21 02:30:01,273: INFO/ForkPoolWorker-1] [41af4b5e-42ff-4a2e-a53c-87e9d4069685] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:30:01.283079813Z [2024-04-21 02:30:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[008201da-3c5f-41a4-9f36-408fb4fc5376] received 2024-04-21T02:30:01.298216071Z [2024-04-21 02:30:01,297: INFO/ForkPoolWorker-2] [008201da-3c5f-41a4-9f36-408fb4fc5376] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:30:01.320868783Z [2024-04-21 02:30:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65c487a9-53d3-4bd8-96eb-692db4c26ce0] received 2024-04-21T02:30:01.344864977Z [2024-04-21 02:30:01,344: INFO/ForkPoolWorker-3] [65c487a9-53d3-4bd8-96eb-692db4c26ce0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:30:01.775315561Z [2024-04-21 02:30:01,770: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:30:01.842253459Z [2024-04-21 02:30:01,838: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:30:02.171131160Z [2024-04-21 02:30:02,167: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:30:02.198696961Z [2024-04-21 02:30:02,198: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:30:02.470254116Z [2024-04-21 02:30:02,467: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:30:02.658954457Z [2024-04-21 02:30:02,658: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:30:02.662027358Z [2024-04-21 02:30:02,654: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:30:02.663191384Z [2024-04-21 02:30:02,662: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:30:02.728107388Z [2024-04-21 02:30:02,727: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:30:02.730757645Z [2024-04-21 02:30:02,730: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:30:02.731029226Z [2024-04-21 02:30:02,730: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:30:02.731149931Z [2024-04-21 02:30:02,731: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:30:02.731503536Z [2024-04-21 02:30:02,731: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:30:02.864296487Z [2024-04-21 02:30:02,864: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:30:03.131962564Z [2024-04-21 02:30:03,131: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a063aa6a-9676-433b-9bb2-059f8d584b6b] succeeded in 1.8738879550001002s: None 2024-04-21T02:30:04.075780236Z [2024-04-21 02:30:04,072: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41af4b5e-42ff-4a2e-a53c-87e9d4069685] succeeded in 2.8051976440001454s: None 2024-04-21T02:30:04.408367126Z [2024-04-21 02:30:04,408: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T02:30:04.412734487Z [2024-04-21 02:30:04,412: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:30:04.457400591Z [2024-04-21 02:30:04,457: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T02:30:04.459861948Z [2024-04-21 02:30:04,459: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:30:04.460193228Z [2024-04-21 02:30:04,459: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:30:04.460651896Z [2024-04-21 02:30:04,460: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:30:04.460840739Z [2024-04-21 02:30:04,460: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T02:30:04.461312820Z [2024-04-21 02:30:04,461: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:30:04.461636697Z [2024-04-21 02:30:04,461: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:30:04.560370244Z [2024-04-21 02:30:04,558: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:30:04.666897803Z [2024-04-21 02:30:04,666: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:30:04.673285736Z [2024-04-21 02:30:04,672: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:30:04.702202060Z [2024-04-21 02:30:04,702: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:30:04.704518239Z [2024-04-21 02:30:04,704: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:30:04.705286185Z [2024-04-21 02:30:04,705: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:30:04.706271923Z [2024-04-21 02:30:04,706: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:30:04.707178066Z [2024-04-21 02:30:04,706: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:30:04.707475568Z [2024-04-21 02:30:04,707: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:30:04.708951278Z [2024-04-21 02:30:04,708: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:30:04.823894856Z [2024-04-21 02:30:04,823: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:30:05.144775140Z [2024-04-21 02:30:05,144: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:30:05.148047782Z [2024-04-21 02:30:05,147: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:30:05.188537776Z [2024-04-21 02:30:05,185: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:30:05.190658429Z [2024-04-21 02:30:05,190: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:30:05.191866477Z [2024-04-21 02:30:05,191: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:30:05.192192931Z [2024-04-21 02:30:05,191: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:30:05.192456642Z [2024-04-21 02:30:05,192: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:30:05.193071394Z [2024-04-21 02:30:05,192: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:30:05.193280097Z [2024-04-21 02:30:05,193: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:30:05.286097086Z [2024-04-21 02:30:05,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:30:05.856135399Z [2024-04-21 02:30:05,855: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64320cde-3d3b-41f3-ac35-f74ea02f798a] received 2024-04-21T02:30:05.868799788Z [2024-04-21 02:30:05,868: INFO/ForkPoolWorker-16] [64320cde-3d3b-41f3-ac35-f74ea02f798a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:30:05.920267613Z [2024-04-21 02:30:05,919: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d858eb6-791d-4f95-93d5-6ed21ce26e43] succeeded in 4.6698713730002055s: None 2024-04-21T02:30:06.092294389Z [2024-04-21 02:30:06,091: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[65c487a9-53d3-4bd8-96eb-692db4c26ce0] succeeded in 4.766808973001389s: None 2024-04-21T02:30:06.167401952Z [2024-04-21 02:30:06,164: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:30:07.314478336Z [2024-04-21 02:30:07,314: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:30:07.317669506Z [2024-04-21 02:30:07,317: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:30:07.342990387Z [2024-04-21 02:30:07,342: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:30:07.344372081Z [2024-04-21 02:30:07,344: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:30:07.344406689Z [2024-04-21 02:30:07,344: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:30:07.344571091Z [2024-04-21 02:30:07,344: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:30:07.344590597Z [2024-04-21 02:30:07,344: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:30:07.344893694Z [2024-04-21 02:30:07,344: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:30:07.344909885Z [2024-04-21 02:30:07,344: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:30:07.440036310Z [2024-04-21 02:30:07,439: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:30:07.844956129Z [2024-04-21 02:30:07,844: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[008201da-3c5f-41a4-9f36-408fb4fc5376] succeeded in 6.556802790999427s: None 2024-04-21T02:30:08.173361414Z [2024-04-21 02:30:08,172: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[64320cde-3d3b-41f3-ac35-f74ea02f798a] succeeded in 2.3135167000000365s: None 2024-04-21T02:30:08.263561438Z [2024-04-21 02:30:08,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5e42227-3354-4218-91f7-b2343615c3ea] received 2024-04-21T02:30:08.271779957Z [2024-04-21 02:30:08,271: INFO/ForkPoolWorker-15] [a5e42227-3354-4218-91f7-b2343615c3ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:30:08.551328721Z [2024-04-21 02:30:08,548: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:30:09.717073296Z [2024-04-21 02:30:09,716: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:30:09.720152406Z [2024-04-21 02:30:09,719: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:30:09.751742026Z [2024-04-21 02:30:09,751: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:30:09.753285672Z [2024-04-21 02:30:09,752: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:30:09.753319578Z [2024-04-21 02:30:09,753: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:30:09.753760603Z [2024-04-21 02:30:09,753: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:30:09.754032974Z [2024-04-21 02:30:09,753: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:30:09.754621218Z [2024-04-21 02:30:09,754: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:30:09.754734824Z [2024-04-21 02:30:09,754: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:30:09.871784898Z [2024-04-21 02:30:09,871: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:30:11.443624199Z [2024-04-21 02:30:11,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5e42227-3354-4218-91f7-b2343615c3ea] succeeded in 3.1765820670007088s: None 2024-04-21T02:30:12.306332202Z [2024-04-21 02:30:12,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8be3182a-e317-46b5-a98f-d587ac5e95ec] received 2024-04-21T02:30:12.317383128Z [2024-04-21 02:30:12,316: INFO/ForkPoolWorker-15] [8be3182a-e317-46b5-a98f-d587ac5e95ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:30:12.614940660Z [2024-04-21 02:30:12,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:30:13.817143026Z [2024-04-21 02:30:13,816: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:30:13.820465547Z [2024-04-21 02:30:13,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:30:13.846295081Z [2024-04-21 02:30:13,846: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:30:13.848011094Z [2024-04-21 02:30:13,847: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:30:13.848292215Z [2024-04-21 02:30:13,848: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:30:13.848602860Z [2024-04-21 02:30:13,848: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:30:13.848807563Z [2024-04-21 02:30:13,848: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:30:13.849322897Z [2024-04-21 02:30:13,849: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:30:13.849523074Z [2024-04-21 02:30:13,849: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:30:13.961380362Z [2024-04-21 02:30:13,960: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:30:14.633432618Z [2024-04-21 02:30:14,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8be3182a-e317-46b5-a98f-d587ac5e95ec] succeeded in 2.323951038000814s: None 2024-04-21T02:31:01.182482435Z [2024-04-21 02:31:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec284058-0df2-4e0c-8aec-0bcbbeafb0af] received 2024-04-21T02:31:01.194896139Z [2024-04-21 02:31:01,193: INFO/ForkPoolWorker-15] [ec284058-0df2-4e0c-8aec-0bcbbeafb0af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:31:01.204295951Z [2024-04-21 02:31:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4ff77f1-d4e5-48d7-848a-6e9a0f797244] received 2024-04-21T02:31:01.210719953Z [2024-04-21 02:31:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fc1dcdb-2f86-4c40-a4dc-8c005ed3ad2c] received 2024-04-21T02:31:01.226992785Z [2024-04-21 02:31:01,225: INFO/ForkPoolWorker-16] [a4ff77f1-d4e5-48d7-848a-6e9a0f797244] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:31:01.227018567Z [2024-04-21 02:31:01,226: INFO/ForkPoolWorker-1] [9fc1dcdb-2f86-4c40-a4dc-8c005ed3ad2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:31:01.534751665Z [2024-04-21 02:31:01,530: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:31:01.672280096Z [2024-04-21 02:31:01,668: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:31:01.816016362Z [2024-04-21 02:31:01,811: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:31:01.878359260Z [2024-04-21 02:31:01,877: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:31:01.882533923Z [2024-04-21 02:31:01,882: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:31:01.937030473Z [2024-04-21 02:31:01,936: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:31:01.940641757Z [2024-04-21 02:31:01,940: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:31:01.940935215Z [2024-04-21 02:31:01,940: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:31:01.941126960Z [2024-04-21 02:31:01,941: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:31:01.941493634Z [2024-04-21 02:31:01,941: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:31:02.088002259Z [2024-04-21 02:31:02,087: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:31:02.748762879Z [2024-04-21 02:31:02,748: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4ff77f1-d4e5-48d7-848a-6e9a0f797244] succeeded in 1.5428639580004528s: None 2024-04-21T02:31:03.112307023Z [2024-04-21 02:31:03,111: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:31:03.115564197Z [2024-04-21 02:31:03,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:31:03.141118226Z [2024-04-21 02:31:03,140: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:31:03.144135199Z [2024-04-21 02:31:03,143: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:31:03.144263155Z [2024-04-21 02:31:03,144: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:31:03.144469810Z [2024-04-21 02:31:03,144: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:31:03.144713523Z [2024-04-21 02:31:03,144: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:31:03.145212303Z [2024-04-21 02:31:03,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:31:03.145296353Z [2024-04-21 02:31:03,145: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:31:03.244333442Z [2024-04-21 02:31:03,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:31:03.395918082Z [2024-04-21 02:31:03,395: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:31:03.399371318Z [2024-04-21 02:31:03,398: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:31:03.434694516Z [2024-04-21 02:31:03,434: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:31:03.436728802Z [2024-04-21 02:31:03,436: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:31:03.436814272Z [2024-04-21 02:31:03,436: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:31:03.437068495Z [2024-04-21 02:31:03,436: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:31:03.437197353Z [2024-04-21 02:31:03,437: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:31:03.438228306Z [2024-04-21 02:31:03,437: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:31:03.438437541Z [2024-04-21 02:31:03,438: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:31:03.543294489Z [2024-04-21 02:31:03,542: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:31:04.968769444Z [2024-04-21 02:31:04,968: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec284058-0df2-4e0c-8aec-0bcbbeafb0af] succeeded in 3.7852104060002603s: None 2024-04-21T02:31:06.041124948Z [2024-04-21 02:31:06,040: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9fc1dcdb-2f86-4c40-a4dc-8c005ed3ad2c] succeeded in 4.82875323799999s: None 2024-04-21T02:32:01.085363333Z [2024-04-21 02:32:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d38032fb-c462-4a46-b89e-b2f6a670907e] received 2024-04-21T02:32:01.087984336Z [2024-04-21 02:32:01,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc0f62f7-2c4e-4101-8a72-3fad02fee6ea] received 2024-04-21T02:32:01.099751688Z [2024-04-21 02:32:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db383531-e0cb-45eb-a5ea-98c26419f6b8] received 2024-04-21T02:32:01.099797638Z [2024-04-21 02:32:01,096: INFO/ForkPoolWorker-15] [d38032fb-c462-4a46-b89e-b2f6a670907e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:32:01.107755679Z [2024-04-21 02:32:01,100: INFO/ForkPoolWorker-16] [bc0f62f7-2c4e-4101-8a72-3fad02fee6ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:32:01.107782136Z [2024-04-21 02:32:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ac38b4f-8eb7-4df7-a8cc-b404356db64e] received 2024-04-21T02:32:01.118082296Z [2024-04-21 02:32:01,117: INFO/ForkPoolWorker-1] [db383531-e0cb-45eb-a5ea-98c26419f6b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:32:01.139772479Z [2024-04-21 02:32:01,139: INFO/ForkPoolWorker-2] [2ac38b4f-8eb7-4df7-a8cc-b404356db64e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:32:01.503856940Z [2024-04-21 02:32:01,497: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:32:01.508896843Z [2024-04-21 02:32:01,500: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:32:01.602635457Z [2024-04-21 02:32:01,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:32:01.715048649Z [2024-04-21 02:32:01,711: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:32:01.767015376Z [2024-04-21 02:32:01,766: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:32:01.771079359Z [2024-04-21 02:32:01,770: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:32:01.802489544Z [2024-04-21 02:32:01,802: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:32:01.809218575Z [2024-04-21 02:32:01,808: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:32:01.809404662Z [2024-04-21 02:32:01,809: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:32:01.809516435Z [2024-04-21 02:32:01,809: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:32:01.809802252Z [2024-04-21 02:32:01,809: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:32:01.906124971Z [2024-04-21 02:32:01,905: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:32:02.005524019Z [2024-04-21 02:32:02,005: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:32:02.726827595Z [2024-04-21 02:32:02,726: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc0f62f7-2c4e-4101-8a72-3fad02fee6ea] succeeded in 1.640337267999712s: None 2024-04-21T02:32:02.950385021Z [2024-04-21 02:32:02,949: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d38032fb-c462-4a46-b89e-b2f6a670907e] succeeded in 1.8664206180001202s: None 2024-04-21T02:32:03.300024859Z [2024-04-21 02:32:03,299: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:32:03.303371097Z [2024-04-21 02:32:03,302: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:32:03.329412304Z [2024-04-21 02:32:03,329: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:32:03.332829177Z [2024-04-21 02:32:03,332: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:32:03.333045992Z [2024-04-21 02:32:03,332: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:32:03.333291652Z [2024-04-21 02:32:03,333: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:32:03.333431170Z [2024-04-21 02:32:03,333: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:32:03.333786995Z [2024-04-21 02:32:03,333: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:32:03.334287796Z [2024-04-21 02:32:03,334: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:32:03.391291832Z [2024-04-21 02:32:03,390: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:32:03.401672616Z [2024-04-21 02:32:03,401: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:32:03.459458419Z [2024-04-21 02:32:03,459: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:32:03.469901246Z [2024-04-21 02:32:03,469: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:32:03.471445536Z [2024-04-21 02:32:03,471: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:32:03.472787462Z [2024-04-21 02:32:03,471: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:32:03.473048944Z [2024-04-21 02:32:03,472: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:32:03.473202293Z [2024-04-21 02:32:03,473: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:32:03.473497663Z [2024-04-21 02:32:03,473: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:32:03.474066549Z [2024-04-21 02:32:03,473: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:32:03.558699289Z [2024-04-21 02:32:03,558: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:32:05.808440011Z [2024-04-21 02:32:05,808: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2ac38b4f-8eb7-4df7-a8cc-b404356db64e] succeeded in 4.696231263998925s: None 2024-04-21T02:32:07.087463209Z [2024-04-21 02:32:07,086: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db383531-e0cb-45eb-a5ea-98c26419f6b8] succeeded in 5.989552287001061s: None 2024-04-21T02:32:07.681049897Z [2024-04-21 02:32:07,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76ec00dc-acd0-4712-9aea-1edeb7fb4830] received 2024-04-21T02:32:07.693293695Z [2024-04-21 02:32:07,692: INFO/ForkPoolWorker-15] [76ec00dc-acd0-4712-9aea-1edeb7fb4830] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240421023206_901021', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-21T02:32:08.028887002Z [2024-04-21 02:32:08,025: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-21T02:32:08.411286468Z [2024-04-21 02:32:08,410: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:32:09.056192073Z [2024-04-21 02:32:09,055: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76ec00dc-acd0-4712-9aea-1edeb7fb4830] succeeded in 1.3711145119996218s: None 2024-04-21T02:33:00.393618894Z [2024-04-21 02:33:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[700bcb2b-6da0-4d1d-a999-c92ccd3fdd12] received 2024-04-21T02:33:00.398420184Z [2024-04-21 02:33:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4132729f-b1be-48bd-964b-cd300863eac6] received 2024-04-21T02:33:00.403280364Z [2024-04-21 02:33:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3fa30ab-ce2c-4b54-a9f8-225f426e76b6] received 2024-04-21T02:33:00.406632457Z [2024-04-21 02:33:00,406: INFO/ForkPoolWorker-16] [4132729f-b1be-48bd-964b-cd300863eac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:33:00.415123917Z [2024-04-21 02:33:00,414: INFO/ForkPoolWorker-15] [700bcb2b-6da0-4d1d-a999-c92ccd3fdd12] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:33:00.417241881Z [2024-04-21 02:33:00,416: INFO/ForkPoolWorker-1] [b3fa30ab-ce2c-4b54-a9f8-225f426e76b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:33:00.709187595Z [2024-04-21 02:33:00,705: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:33:00.725718269Z [2024-04-21 02:33:00,722: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:33:00.755647495Z [2024-04-21 02:33:00,751: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:33:00.876270683Z [2024-04-21 02:33:00,875: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:33:00.880198721Z [2024-04-21 02:33:00,879: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:33:00.910561426Z [2024-04-21 02:33:00,910: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:33:00.911826461Z [2024-04-21 02:33:00,911: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:33:00.912032932Z [2024-04-21 02:33:00,911: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:33:00.912131239Z [2024-04-21 02:33:00,911: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:33:00.912361575Z [2024-04-21 02:33:00,912: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:33:01.005913186Z [2024-04-21 02:33:01,005: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:33:01.577001359Z [2024-04-21 02:33:01,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[700bcb2b-6da0-4d1d-a999-c92ccd3fdd12] succeeded in 1.178705837999587s: None 2024-04-21T02:33:01.989612244Z [2024-04-21 02:33:01,989: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:33:01.992926440Z [2024-04-21 02:33:01,992: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:33:02.014385146Z [2024-04-21 02:33:02,014: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:33:02.015486685Z [2024-04-21 02:33:02,015: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:33:02.015664684Z [2024-04-21 02:33:02,015: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:33:02.015914425Z [2024-04-21 02:33:02,015: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:33:02.016040833Z [2024-04-21 02:33:02,015: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:33:02.016443551Z [2024-04-21 02:33:02,016: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:33:02.016607611Z [2024-04-21 02:33:02,016: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:33:02.036533592Z [2024-04-21 02:33:02,036: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:33:02.040115919Z [2024-04-21 02:33:02,039: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:33:02.070312039Z [2024-04-21 02:33:02,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:33:02.073072391Z [2024-04-21 02:33:02,072: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:33:02.073448184Z [2024-04-21 02:33:02,072: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:33:02.073833366Z [2024-04-21 02:33:02,073: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:33:02.074018686Z [2024-04-21 02:33:02,073: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:33:02.074383691Z [2024-04-21 02:33:02,074: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:33:02.074661363Z [2024-04-21 02:33:02,074: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:33:02.116752992Z [2024-04-21 02:33:02,116: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:33:02.149589304Z [2024-04-21 02:33:02,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:33:03.720878632Z [2024-04-21 02:33:03,720: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4132729f-b1be-48bd-964b-cd300863eac6] succeeded in 3.320508200000404s: None 2024-04-21T02:33:04.329268505Z [2024-04-21 02:33:04,328: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b3fa30ab-ce2c-4b54-a9f8-225f426e76b6] succeeded in 3.922698873999252s: None 2024-04-21T02:34:00.762969442Z [2024-04-21 02:34:00,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae2197a2-ff08-4c9f-bbaf-bd6838de3f94] received 2024-04-21T02:34:00.771300262Z [2024-04-21 02:34:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a997206-98ea-4a5c-8d5a-224aa08b98f6] received 2024-04-21T02:34:00.779584865Z [2024-04-21 02:34:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a91dc36d-3bda-48fd-8f99-624abdffa2ec] received 2024-04-21T02:34:00.779824046Z [2024-04-21 02:34:00,779: INFO/ForkPoolWorker-16] [5a997206-98ea-4a5c-8d5a-224aa08b98f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:34:00.792510191Z [2024-04-21 02:34:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9191e09c-b9a2-4c56-aa86-8de20b23d07b] received 2024-04-21T02:34:00.792772204Z [2024-04-21 02:34:00,792: INFO/ForkPoolWorker-1] [a91dc36d-3bda-48fd-8f99-624abdffa2ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:34:00.811156015Z [2024-04-21 02:34:00,810: INFO/ForkPoolWorker-15] [ae2197a2-ff08-4c9f-bbaf-bd6838de3f94] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:34:00.818287061Z [2024-04-21 02:34:00,817: INFO/ForkPoolWorker-2] [9191e09c-b9a2-4c56-aa86-8de20b23d07b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:34:01.201394963Z [2024-04-21 02:34:01,197: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:34:01.353663059Z [2024-04-21 02:34:01,349: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:34:01.394538654Z [2024-04-21 02:34:01,389: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:34:01.476239326Z [2024-04-21 02:34:01,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:34:01.551820889Z [2024-04-21 02:34:01,545: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:34:01.878116746Z [2024-04-21 02:34:01,877: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:34:01.882203436Z [2024-04-21 02:34:01,881: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:34:01.959524125Z [2024-04-21 02:34:01,959: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:34:01.961473404Z [2024-04-21 02:34:01,961: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:34:01.961670425Z [2024-04-21 02:34:01,961: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:34:01.962592980Z [2024-04-21 02:34:01,961: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:34:01.962965132Z [2024-04-21 02:34:01,962: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:34:02.109034997Z [2024-04-21 02:34:02,108: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:34:02.346761258Z [2024-04-21 02:34:02,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae2197a2-ff08-4c9f-bbaf-bd6838de3f94] succeeded in 1.5718773560001864s: None 2024-04-21T02:34:02.927707549Z [2024-04-21 02:34:02,927: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:34:02.930679396Z [2024-04-21 02:34:02,930: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a997206-98ea-4a5c-8d5a-224aa08b98f6] succeeded in 2.157824156998686s: None 2024-04-21T02:34:02.931599544Z [2024-04-21 02:34:02,931: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:34:02.956652808Z [2024-04-21 02:34:02,956: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:34:02.959340037Z [2024-04-21 02:34:02,959: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:34:02.959828312Z [2024-04-21 02:34:02,959: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:34:02.960153081Z [2024-04-21 02:34:02,959: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:34:02.960390393Z [2024-04-21 02:34:02,960: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:34:02.960905773Z [2024-04-21 02:34:02,960: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:34:02.961163501Z [2024-04-21 02:34:02,961: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:34:03.046373279Z [2024-04-21 02:34:03,046: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:34:03.301366290Z [2024-04-21 02:34:03,300: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:34:03.305015572Z [2024-04-21 02:34:03,304: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:34:03.335052620Z [2024-04-21 02:34:03,334: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:34:03.336354123Z [2024-04-21 02:34:03,336: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:34:03.336366708Z [2024-04-21 02:34:03,336: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:34:03.336571129Z [2024-04-21 02:34:03,336: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:34:03.336578820Z [2024-04-21 02:34:03,336: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:34:03.336800405Z [2024-04-21 02:34:03,336: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:34:03.336969351Z [2024-04-21 02:34:03,336: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:34:03.451945257Z [2024-04-21 02:34:03,451: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:34:05.728723370Z [2024-04-21 02:34:05,728: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9191e09c-b9a2-4c56-aa86-8de20b23d07b] succeeded in 4.933273253000152s: None 2024-04-21T02:34:06.566400361Z [2024-04-21 02:34:06,565: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a91dc36d-3bda-48fd-8f99-624abdffa2ec] succeeded in 5.784548866999103s: None 2024-04-21T02:35:00.883754017Z [2024-04-21 02:35:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f2b8200-74bc-40e8-9cc4-b750d979e5c5] received 2024-04-21T02:35:00.888861623Z [2024-04-21 02:35:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5187e635-ba7a-4fd7-a2ba-b98444e4ec5b] received 2024-04-21T02:35:00.894693011Z [2024-04-21 02:35:00,894: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[795eb553-02eb-4cf2-80b0-57d95928ab3a] received 2024-04-21T02:35:00.898618851Z [2024-04-21 02:35:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb9f5fb7-a834-45ba-a0c8-1347d61e2567] received 2024-04-21T02:35:00.902726989Z [2024-04-21 02:35:00,902: INFO/ForkPoolWorker-15] [4f2b8200-74bc-40e8-9cc4-b750d979e5c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:35:00.905056014Z [2024-04-21 02:35:00,903: INFO/ForkPoolWorker-16] [5187e635-ba7a-4fd7-a2ba-b98444e4ec5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:35:00.914915558Z [2024-04-21 02:35:00,914: INFO/ForkPoolWorker-1] [795eb553-02eb-4cf2-80b0-57d95928ab3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:35:00.915633428Z [2024-04-21 02:35:00,915: INFO/ForkPoolWorker-2] [fb9f5fb7-a834-45ba-a0c8-1347d61e2567] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:35:01.316305586Z [2024-04-21 02:35:01,313: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:35:01.321641379Z [2024-04-21 02:35:01,317: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:35:01.336097976Z [2024-04-21 02:35:01,314: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:35:01.374060901Z [2024-04-21 02:35:01,370: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:35:01.733044280Z [2024-04-21 02:35:01,732: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:35:01.743638405Z [2024-04-21 02:35:01,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:35:01.798667792Z [2024-04-21 02:35:01,798: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:35:01.800861420Z [2024-04-21 02:35:01,800: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:35:01.801166772Z [2024-04-21 02:35:01,800: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:35:01.801275695Z [2024-04-21 02:35:01,801: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:35:01.801576404Z [2024-04-21 02:35:01,801: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:35:01.912054057Z [2024-04-21 02:35:01,911: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:35:02.535144321Z [2024-04-21 02:35:02,534: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5187e635-ba7a-4fd7-a2ba-b98444e4ec5b] succeeded in 1.6416417370001s: None 2024-04-21T02:35:02.685374818Z [2024-04-21 02:35:02,685: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:35:02.688616313Z [2024-04-21 02:35:02,688: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:35:02.742578032Z [2024-04-21 02:35:02,742: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:35:02.747732458Z [2024-04-21 02:35:02,747: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:35:02.752199561Z [2024-04-21 02:35:02,750: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:35:02.753565458Z [2024-04-21 02:35:02,753: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:35:02.754523606Z [2024-04-21 02:35:02,754: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:35:02.755433242Z [2024-04-21 02:35:02,755: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:35:02.756195686Z [2024-04-21 02:35:02,756: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:35:02.871018396Z [2024-04-21 02:35:02,870: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:35:02.878419593Z [2024-04-21 02:35:02,877: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:35:02.881271732Z [2024-04-21 02:35:02,881: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:35:02.933941150Z [2024-04-21 02:35:02,933: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:35:02.935344751Z [2024-04-21 02:35:02,935: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:35:02.935467471Z [2024-04-21 02:35:02,935: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:35:02.935645337Z [2024-04-21 02:35:02,935: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:35:02.935767104Z [2024-04-21 02:35:02,935: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:35:02.936114772Z [2024-04-21 02:35:02,935: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:35:02.936229186Z [2024-04-21 02:35:02,936: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:35:03.047930171Z [2024-04-21 02:35:03,047: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:35:03.118686852Z [2024-04-21 02:35:03,118: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:35:03.122170095Z [2024-04-21 02:35:03,121: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:35:03.173487289Z [2024-04-21 02:35:03,173: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:35:03.184853696Z [2024-04-21 02:35:03,184: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:35:03.189731379Z [2024-04-21 02:35:03,184: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:35:03.190005104Z [2024-04-21 02:35:03,189: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:35:03.191974841Z [2024-04-21 02:35:03,189: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:35:03.192331077Z [2024-04-21 02:35:03,192: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:35:03.195976741Z [2024-04-21 02:35:03,192: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:35:03.321363222Z [2024-04-21 02:35:03,321: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:35:04.251058283Z [2024-04-21 02:35:04,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f2b8200-74bc-40e8-9cc4-b750d979e5c5] succeeded in 3.3620507899995573s: None 2024-04-21T02:35:04.714781421Z [2024-04-21 02:35:04,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[317e56ba-0885-45f6-a3f0-b19b51fa60eb] received 2024-04-21T02:35:04.726332585Z [2024-04-21 02:35:04,725: INFO/ForkPoolWorker-15] [317e56ba-0885-45f6-a3f0-b19b51fa60eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:35:05.039420140Z [2024-04-21 02:35:05,036: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:35:05.595663537Z [2024-04-21 02:35:05,595: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fb9f5fb7-a834-45ba-a0c8-1347d61e2567] succeeded in 4.694485938998696s: None 2024-04-21T02:35:06.163761836Z [2024-04-21 02:35:06,163: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:35:06.166813822Z [2024-04-21 02:35:06,166: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:35:06.183100858Z [2024-04-21 02:35:06,182: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:35:06.188182896Z [2024-04-21 02:35:06,187: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:35:06.188216399Z [2024-04-21 02:35:06,188: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:35:06.188304121Z [2024-04-21 02:35:06,188: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:35:06.188339844Z [2024-04-21 02:35:06,188: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:35:06.188789725Z [2024-04-21 02:35:06,188: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:35:06.188801197Z [2024-04-21 02:35:06,188: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:35:06.351737209Z [2024-04-21 02:35:06,351: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:35:06.650051087Z [2024-04-21 02:35:06,649: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[795eb553-02eb-4cf2-80b0-57d95928ab3a] succeeded in 5.747658464999404s: None 2024-04-21T02:35:07.070706571Z [2024-04-21 02:35:07,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[317e56ba-0885-45f6-a3f0-b19b51fa60eb] succeeded in 2.3515451530001883s: None 2024-04-21T02:35:07.433417950Z [2024-04-21 02:35:07,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f310cf48-e84a-4049-9cf1-43ca9ebeba84] received 2024-04-21T02:35:07.453313453Z [2024-04-21 02:35:07,452: INFO/ForkPoolWorker-15] [f310cf48-e84a-4049-9cf1-43ca9ebeba84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:35:07.794821016Z [2024-04-21 02:35:07,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:35:09.026309424Z [2024-04-21 02:35:09,025: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:35:09.031963006Z [2024-04-21 02:35:09,031: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:35:09.058302064Z [2024-04-21 02:35:09,057: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:35:09.060858675Z [2024-04-21 02:35:09,060: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:35:09.060920226Z [2024-04-21 02:35:09,060: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:35:09.061209849Z [2024-04-21 02:35:09,060: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:35:09.061334221Z [2024-04-21 02:35:09,061: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:35:09.061906015Z [2024-04-21 02:35:09,061: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:35:09.062019260Z [2024-04-21 02:35:09,061: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:35:09.184797052Z [2024-04-21 02:35:09,184: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:35:11.158497098Z [2024-04-21 02:35:11,157: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f310cf48-e84a-4049-9cf1-43ca9ebeba84] succeeded in 3.7228416670004663s: None 2024-04-21T02:35:11.787867142Z [2024-04-21 02:35:11,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf3a8460-bac6-4bd3-94ca-7c21b6d282f1] received 2024-04-21T02:35:11.801799931Z [2024-04-21 02:35:11,801: INFO/ForkPoolWorker-15] [cf3a8460-bac6-4bd3-94ca-7c21b6d282f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:35:12.154400650Z [2024-04-21 02:35:12,149: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:35:13.417574485Z [2024-04-21 02:35:13,416: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:35:13.421000688Z [2024-04-21 02:35:13,420: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:35:13.449035183Z [2024-04-21 02:35:13,448: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:35:13.451283777Z [2024-04-21 02:35:13,450: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:35:13.451397725Z [2024-04-21 02:35:13,451: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:35:13.451663226Z [2024-04-21 02:35:13,451: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:35:13.451937958Z [2024-04-21 02:35:13,451: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:35:13.452359964Z [2024-04-21 02:35:13,452: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:35:13.452538106Z [2024-04-21 02:35:13,452: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:35:13.593053350Z [2024-04-21 02:35:13,592: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:35:14.325945269Z [2024-04-21 02:35:14,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf3a8460-bac6-4bd3-94ca-7c21b6d282f1] succeeded in 2.5340936239990697s: None 2024-04-21T02:36:00.961902318Z [2024-04-21 02:36:00,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e045b08-031a-435d-bb01-9715b3bf1d5d] received 2024-04-21T02:36:00.965883803Z [2024-04-21 02:36:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3266798-23ad-4fb9-bcff-b84d591e3c92] received 2024-04-21T02:36:00.976657657Z [2024-04-21 02:36:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1830833-a8bd-446d-9086-df5e8a1e54f4] received 2024-04-21T02:36:00.979837665Z [2024-04-21 02:36:00,979: INFO/ForkPoolWorker-16] [f3266798-23ad-4fb9-bcff-b84d591e3c92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:36:00.980867128Z [2024-04-21 02:36:00,980: INFO/ForkPoolWorker-15] [6e045b08-031a-435d-bb01-9715b3bf1d5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:36:00.985097586Z [2024-04-21 02:36:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3f040b6-7ef2-408a-a90f-9257c44f9953] received 2024-04-21T02:36:00.995321514Z [2024-04-21 02:36:00,994: INFO/ForkPoolWorker-2] [f3f040b6-7ef2-408a-a90f-9257c44f9953] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:36:00.998265015Z [2024-04-21 02:36:00,997: INFO/ForkPoolWorker-1] [a1830833-a8bd-446d-9086-df5e8a1e54f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:36:01.325742146Z [2024-04-21 02:36:01,322: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:36:01.365846717Z [2024-04-21 02:36:01,362: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:36:01.395725772Z [2024-04-21 02:36:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:36:01.538206317Z [2024-04-21 02:36:01,537: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T02:36:01.544947411Z [2024-04-21 02:36:01,543: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:36:01.596904927Z [2024-04-21 02:36:01,596: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:36:01.601371128Z [2024-04-21 02:36:01,600: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:36:01.601575941Z [2024-04-21 02:36:01,601: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:36:01.601768860Z [2024-04-21 02:36:01,601: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T02:36:01.602057487Z [2024-04-21 02:36:01,601: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:36:01.648013600Z [2024-04-21 02:36:01,643: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:36:01.760934955Z [2024-04-21 02:36:01,760: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:36:01.966822303Z [2024-04-21 02:36:01,966: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:36:02.499527086Z [2024-04-21 02:36:02,499: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f3f040b6-7ef2-408a-a90f-9257c44f9953] succeeded in 1.5120623069997237s: None 2024-04-21T02:36:02.724726409Z [2024-04-21 02:36:02,724: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a1830833-a8bd-446d-9086-df5e8a1e54f4] succeeded in 1.7402748740005336s: None 2024-04-21T02:36:02.732991987Z [2024-04-21 02:36:02,732: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:36:02.736254510Z [2024-04-21 02:36:02,735: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:36:02.753234696Z [2024-04-21 02:36:02,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:36:02.754361546Z [2024-04-21 02:36:02,754: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:36:02.754415594Z [2024-04-21 02:36:02,754: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:36:02.754557056Z [2024-04-21 02:36:02,754: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:36:02.754614813Z [2024-04-21 02:36:02,754: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:36:02.754855321Z [2024-04-21 02:36:02,754: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:36:02.755397350Z [2024-04-21 02:36:02,754: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:36:02.849955431Z [2024-04-21 02:36:02,849: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:36:03.191823466Z [2024-04-21 02:36:03,191: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:36:03.195112100Z [2024-04-21 02:36:03,194: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:36:03.229350996Z [2024-04-21 02:36:03,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:36:03.232742115Z [2024-04-21 02:36:03,232: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:36:03.233741314Z [2024-04-21 02:36:03,233: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:36:03.234135267Z [2024-04-21 02:36:03,233: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:36:03.234326178Z [2024-04-21 02:36:03,234: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:36:03.234934449Z [2024-04-21 02:36:03,234: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:36:03.237190798Z [2024-04-21 02:36:03,234: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:36:03.330135637Z [2024-04-21 02:36:03,329: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:36:05.276160842Z [2024-04-21 02:36:05,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e045b08-031a-435d-bb01-9715b3bf1d5d] succeeded in 4.307637284999146s: None 2024-04-21T02:36:05.345903128Z [2024-04-21 02:36:05,345: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3266798-23ad-4fb9-bcff-b84d591e3c92] succeeded in 4.376799018999009s: None 2024-04-21T02:37:00.590622411Z [2024-04-21 02:37:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aefc70ac-3288-4ef3-9acb-8d4c38792d55] received 2024-04-21T02:37:00.596451121Z [2024-04-21 02:37:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6824bc7-f44a-45f2-b577-522e2922ec83] received 2024-04-21T02:37:00.600202605Z [2024-04-21 02:37:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e475d064-6b60-4ea4-b653-13d2d35a4c29] received 2024-04-21T02:37:00.623332072Z [2024-04-21 02:37:00,622: INFO/ForkPoolWorker-1] [e475d064-6b60-4ea4-b653-13d2d35a4c29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:37:00.626108889Z [2024-04-21 02:37:00,625: INFO/ForkPoolWorker-16] [d6824bc7-f44a-45f2-b577-522e2922ec83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:37:00.632901738Z [2024-04-21 02:37:00,632: INFO/ForkPoolWorker-15] [aefc70ac-3288-4ef3-9acb-8d4c38792d55] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:37:00.934716648Z [2024-04-21 02:37:00,931: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:37:00.941903048Z [2024-04-21 02:37:00,938: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:37:00.986528760Z [2024-04-21 02:37:00,983: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:37:01.164918771Z [2024-04-21 02:37:01,164: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:37:01.168785632Z [2024-04-21 02:37:01,168: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:37:01.198147530Z [2024-04-21 02:37:01,197: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:37:01.199805055Z [2024-04-21 02:37:01,199: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:37:01.199964319Z [2024-04-21 02:37:01,199: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:37:01.200080277Z [2024-04-21 02:37:01,199: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:37:01.200799106Z [2024-04-21 02:37:01,200: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:37:01.280436918Z [2024-04-21 02:37:01,280: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:37:01.930351030Z [2024-04-21 02:37:01,929: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aefc70ac-3288-4ef3-9acb-8d4c38792d55] succeeded in 1.3319804689999728s: None 2024-04-21T02:37:02.194525113Z [2024-04-21 02:37:02,194: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:37:02.198270229Z [2024-04-21 02:37:02,197: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:37:02.219514381Z [2024-04-21 02:37:02,219: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:37:02.221075642Z [2024-04-21 02:37:02,220: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:37:02.221195752Z [2024-04-21 02:37:02,221: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:37:02.221367895Z [2024-04-21 02:37:02,221: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:37:02.221464176Z [2024-04-21 02:37:02,221: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:37:02.221741673Z [2024-04-21 02:37:02,221: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:37:02.221848768Z [2024-04-21 02:37:02,221: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:37:02.293444058Z [2024-04-21 02:37:02,293: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:37:02.342794988Z [2024-04-21 02:37:02,342: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:37:02.346821339Z [2024-04-21 02:37:02,346: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:37:02.364605212Z [2024-04-21 02:37:02,364: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:37:02.365711240Z [2024-04-21 02:37:02,365: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:37:02.365723574Z [2024-04-21 02:37:02,365: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:37:02.365819298Z [2024-04-21 02:37:02,365: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:37:02.365828961Z [2024-04-21 02:37:02,365: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:37:02.366033814Z [2024-04-21 02:37:02,365: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:37:02.366060177Z [2024-04-21 02:37:02,365: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:37:02.459926417Z [2024-04-21 02:37:02,459: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:37:04.868778740Z [2024-04-21 02:37:04,868: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d6824bc7-f44a-45f2-b577-522e2922ec83] succeeded in 4.267997632001425s: None 2024-04-21T02:37:05.624341896Z [2024-04-21 02:37:05,623: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e475d064-6b60-4ea4-b653-13d2d35a4c29] succeeded in 5.012866315000792s: None 2024-04-21T02:38:00.571668243Z [2024-04-21 02:38:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[163006fb-ee4e-405c-b768-3b6fcd6669de] received 2024-04-21T02:38:00.578501517Z [2024-04-21 02:38:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfd4c915-f1af-4fdc-81a2-b3fb79f2df12] received 2024-04-21T02:38:00.589316203Z [2024-04-21 02:38:00,589: INFO/ForkPoolWorker-16] [cfd4c915-f1af-4fdc-81a2-b3fb79f2df12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:38:00.589351178Z [2024-04-21 02:38:00,589: INFO/ForkPoolWorker-15] [163006fb-ee4e-405c-b768-3b6fcd6669de] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:38:00.589557513Z [2024-04-21 02:38:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be1d5a6f-75b8-4dd6-b65f-8fcf13584e84] received 2024-04-21T02:38:00.596338261Z [2024-04-21 02:38:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb3723c8-b95a-4032-b9b5-96c0627181d3] received 2024-04-21T02:38:00.602288431Z [2024-04-21 02:38:00,601: INFO/ForkPoolWorker-1] [be1d5a6f-75b8-4dd6-b65f-8fcf13584e84] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:38:00.614876808Z [2024-04-21 02:38:00,614: INFO/ForkPoolWorker-2] [cb3723c8-b95a-4032-b9b5-96c0627181d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:38:00.944357002Z [2024-04-21 02:38:00,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:38:01.150760972Z [2024-04-21 02:38:01,143: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:38:01.170490507Z [2024-04-21 02:38:01,167: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:38:01.216918035Z [2024-04-21 02:38:01,213: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:38:01.217262191Z [2024-04-21 02:38:01,217: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:38:01.403479513Z [2024-04-21 02:38:01,402: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:38:01.408275858Z [2024-04-21 02:38:01,407: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:38:01.462983507Z [2024-04-21 02:38:01,462: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:38:01.464499438Z [2024-04-21 02:38:01,464: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:38:01.464615090Z [2024-04-21 02:38:01,464: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:38:01.464677163Z [2024-04-21 02:38:01,464: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:38:01.464926362Z [2024-04-21 02:38:01,464: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:38:01.621151855Z [2024-04-21 02:38:01,620: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:38:01.983998272Z [2024-04-21 02:38:01,983: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[163006fb-ee4e-405c-b768-3b6fcd6669de] succeeded in 1.4036570740008756s: None 2024-04-21T02:38:02.401350616Z [2024-04-21 02:38:02,400: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[be1d5a6f-75b8-4dd6-b65f-8fcf13584e84] succeeded in 1.8101760999998078s: None 2024-04-21T02:38:02.568089379Z [2024-04-21 02:38:02,567: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:38:02.571953914Z [2024-04-21 02:38:02,571: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:38:02.606211363Z [2024-04-21 02:38:02,605: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:38:02.609571272Z [2024-04-21 02:38:02,608: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:38:02.609848965Z [2024-04-21 02:38:02,609: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:38:02.610192016Z [2024-04-21 02:38:02,609: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:38:02.610335539Z [2024-04-21 02:38:02,610: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:38:02.610754363Z [2024-04-21 02:38:02,610: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:38:02.610897522Z [2024-04-21 02:38:02,610: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:38:02.631454872Z [2024-04-21 02:38:02,631: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:38:02.634703051Z [2024-04-21 02:38:02,634: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:38:02.653884978Z [2024-04-21 02:38:02,653: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:38:02.655274742Z [2024-04-21 02:38:02,655: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:38:02.655287378Z [2024-04-21 02:38:02,655: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:38:02.655471886Z [2024-04-21 02:38:02,655: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:38:02.655546804Z [2024-04-21 02:38:02,655: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:38:02.655959711Z [2024-04-21 02:38:02,655: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:38:02.655971464Z [2024-04-21 02:38:02,655: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:38:02.720116881Z [2024-04-21 02:38:02,719: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:38:02.760339059Z [2024-04-21 02:38:02,760: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:38:05.421197364Z [2024-04-21 02:38:05,420: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cb3723c8-b95a-4032-b9b5-96c0627181d3] succeeded in 4.823229567000453s: None 2024-04-21T02:38:06.940787480Z [2024-04-21 02:38:06,940: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cfd4c915-f1af-4fdc-81a2-b3fb79f2df12] succeeded in 6.360229322999658s: None 2024-04-21T02:38:07.205349288Z [2024-04-21 02:38:07,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fda8b8fd-f5b4-4f16-8e06-5cd9ce315f89] received 2024-04-21T02:38:07.214097155Z [2024-04-21 02:38:07,213: INFO/ForkPoolWorker-15] [fda8b8fd-f5b4-4f16-8e06-5cd9ce315f89] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240421023806_675088', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-21T02:38:07.532418545Z [2024-04-21 02:38:07,529: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-21T02:38:07.849218808Z [2024-04-21 02:38:07,848: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:38:08.495931868Z [2024-04-21 02:38:08,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fda8b8fd-f5b4-4f16-8e06-5cd9ce315f89] succeeded in 1.2883778639989032s: None 2024-04-21T02:39:00.582943794Z [2024-04-21 02:39:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c717e55e-9ecd-41e3-a801-0c879491899d] received 2024-04-21T02:39:00.589939867Z [2024-04-21 02:39:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeece3da-b28a-4871-83c3-3fafcca32cac] received 2024-04-21T02:39:00.592063256Z [2024-04-21 02:39:00,591: INFO/ForkPoolWorker-15] [c717e55e-9ecd-41e3-a801-0c879491899d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:39:00.600320580Z [2024-04-21 02:39:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b550cba4-159c-441e-952e-7a8159a215e7] received 2024-04-21T02:39:00.603453308Z [2024-04-21 02:39:00,603: INFO/ForkPoolWorker-16] [aeece3da-b28a-4871-83c3-3fafcca32cac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:39:00.616552177Z [2024-04-21 02:39:00,616: INFO/ForkPoolWorker-1] [b550cba4-159c-441e-952e-7a8159a215e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:39:00.881042042Z [2024-04-21 02:39:00,878: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:39:00.910399820Z [2024-04-21 02:39:00,907: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:39:01.043111219Z [2024-04-21 02:39:01,038: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:39:01.128897758Z [2024-04-21 02:39:01,124: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:39:01.135019860Z [2024-04-21 02:39:01,129: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:39:01.177126876Z [2024-04-21 02:39:01,176: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:39:01.178180833Z [2024-04-21 02:39:01,177: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:39:01.178274704Z [2024-04-21 02:39:01,178: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:39:01.178329678Z [2024-04-21 02:39:01,178: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:39:01.178518449Z [2024-04-21 02:39:01,178: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:39:01.276185442Z [2024-04-21 02:39:01,275: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:39:02.024919461Z [2024-04-21 02:39:02,024: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c717e55e-9ecd-41e3-a801-0c879491899d] succeeded in 1.440334527000232s: None 2024-04-21T02:39:02.385195293Z [2024-04-21 02:39:02,384: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:39:02.388551030Z [2024-04-21 02:39:02,388: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:39:02.411817197Z [2024-04-21 02:39:02,411: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:39:02.413185943Z [2024-04-21 02:39:02,412: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:39:02.413198869Z [2024-04-21 02:39:02,412: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:39:02.413206669Z [2024-04-21 02:39:02,413: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:39:02.413215947Z [2024-04-21 02:39:02,413: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:39:02.413415281Z [2024-04-21 02:39:02,413: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:39:02.413443329Z [2024-04-21 02:39:02,413: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:39:02.507024894Z [2024-04-21 02:39:02,506: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:39:02.509069055Z [2024-04-21 02:39:02,508: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:39:02.513490708Z [2024-04-21 02:39:02,513: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:39:02.555124289Z [2024-04-21 02:39:02,554: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:39:02.557657590Z [2024-04-21 02:39:02,557: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:39:02.558202918Z [2024-04-21 02:39:02,557: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:39:02.558592585Z [2024-04-21 02:39:02,558: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:39:02.558874636Z [2024-04-21 02:39:02,558: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:39:02.559415429Z [2024-04-21 02:39:02,559: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:39:02.560273101Z [2024-04-21 02:39:02,560: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:39:02.699545633Z [2024-04-21 02:39:02,699: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:39:04.232646503Z [2024-04-21 02:39:04,232: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b550cba4-159c-441e-952e-7a8159a215e7] succeeded in 3.6297511200009467s: None 2024-04-21T02:39:04.599135033Z [2024-04-21 02:39:04,598: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aeece3da-b28a-4871-83c3-3fafcca32cac] succeeded in 4.006185718000779s: None 2024-04-21T02:40:00.662641327Z [2024-04-21 02:40:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1589a2b-22cf-4210-93b2-e2b0b8075a93] received 2024-04-21T02:40:00.669634235Z [2024-04-21 02:40:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fec27c83-06d1-4ee9-b5c1-2472c9e226f9] received 2024-04-21T02:40:00.679292875Z [2024-04-21 02:40:00,679: INFO/ForkPoolWorker-16] [fec27c83-06d1-4ee9-b5c1-2472c9e226f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:40:00.683129674Z [2024-04-21 02:40:00,682: INFO/ForkPoolWorker-15] [d1589a2b-22cf-4210-93b2-e2b0b8075a93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:40:00.684847034Z [2024-04-21 02:40:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a980eca-9c2b-45ca-adf6-22737f78615d] received 2024-04-21T02:40:00.690686513Z [2024-04-21 02:40:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f63ed371-82f2-4c64-9e46-79218c288ca9] received 2024-04-21T02:40:00.692704852Z [2024-04-21 02:40:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[670b6721-bffc-43c8-ac96-ee46fe4cc79d] received 2024-04-21T02:40:00.692781541Z [2024-04-21 02:40:00,692: INFO/ForkPoolWorker-1] [5a980eca-9c2b-45ca-adf6-22737f78615d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:40:00.710497938Z [2024-04-21 02:40:00,710: INFO/ForkPoolWorker-3] [670b6721-bffc-43c8-ac96-ee46fe4cc79d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:40:00.713403932Z [2024-04-21 02:40:00,713: INFO/ForkPoolWorker-2] [f63ed371-82f2-4c64-9e46-79218c288ca9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:40:01.160394362Z [2024-04-21 02:40:01,156: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:40:01.185867645Z [2024-04-21 02:40:01,182: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:40:01.230995178Z [2024-04-21 02:40:01,227: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:40:01.328492252Z [2024-04-21 02:40:01,328: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T02:40:01.332496461Z [2024-04-21 02:40:01,332: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:40:01.369016714Z [2024-04-21 02:40:01,368: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:40:01.370904391Z [2024-04-21 02:40:01,370: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:40:01.371056081Z [2024-04-21 02:40:01,370: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:40:01.371149829Z [2024-04-21 02:40:01,371: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T02:40:01.371384738Z [2024-04-21 02:40:01,371: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:40:01.395579800Z [2024-04-21 02:40:01,390: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:40:01.474081838Z [2024-04-21 02:40:01,451: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:40:01.481371350Z [2024-04-21 02:40:01,476: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:02.077179096Z [2024-04-21 02:40:02,076: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:02.198627716Z [2024-04-21 02:40:02,198: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f63ed371-82f2-4c64-9e46-79218c288ca9] succeeded in 1.5011749860004784s: None 2024-04-21T02:40:02.610724467Z [2024-04-21 02:40:02,610: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fec27c83-06d1-4ee9-b5c1-2472c9e226f9] succeeded in 1.9377463269993314s: None 2024-04-21T02:40:02.892493632Z [2024-04-21 02:40:02,892: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:40:02.895740714Z [2024-04-21 02:40:02,895: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:40:02.949224095Z [2024-04-21 02:40:02,948: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:40:02.953171268Z [2024-04-21 02:40:02,952: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:40:02.953226268Z [2024-04-21 02:40:02,953: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:40:02.953446787Z [2024-04-21 02:40:02,953: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:40:02.953533549Z [2024-04-21 02:40:02,953: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:40:02.954195128Z [2024-04-21 02:40:02,953: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:40:02.954260515Z [2024-04-21 02:40:02,954: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:40:02.986937353Z [2024-04-21 02:40:02,986: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T02:40:02.995161666Z [2024-04-21 02:40:02,994: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:40:03.024784199Z [2024-04-21 02:40:03,024: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T02:40:03.026597237Z [2024-04-21 02:40:03,026: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:40:03.026734990Z [2024-04-21 02:40:03,026: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:40:03.026960006Z [2024-04-21 02:40:03,026: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:40:03.027099399Z [2024-04-21 02:40:03,026: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T02:40:03.027502441Z [2024-04-21 02:40:03,027: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:40:03.027657712Z [2024-04-21 02:40:03,027: INFO/ForkPoolWorker-3] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:40:03.029064608Z [2024-04-21 02:40:03,028: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:40:03.032499618Z [2024-04-21 02:40:03,032: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:40:03.043698003Z [2024-04-21 02:40:03,043: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:03.054963235Z [2024-04-21 02:40:03,054: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:40:03.056223638Z [2024-04-21 02:40:03,056: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:40:03.056242229Z [2024-04-21 02:40:03,056: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:40:03.056452301Z [2024-04-21 02:40:03,056: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:40:03.056484684Z [2024-04-21 02:40:03,056: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:40:03.056743689Z [2024-04-21 02:40:03,056: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:40:03.056813269Z [2024-04-21 02:40:03,056: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:40:03.131781061Z [2024-04-21 02:40:03,131: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:03.168446577Z [2024-04-21 02:40:03,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:03.919636875Z [2024-04-21 02:40:03,918: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1589a2b-22cf-4210-93b2-e2b0b8075a93] succeeded in 3.2524161099991034s: None 2024-04-21T02:40:03.999280088Z [2024-04-21 02:40:03,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4bad02e-76da-422a-a902-54cfa6f34644] received 2024-04-21T02:40:04.020784342Z [2024-04-21 02:40:04,019: INFO/ForkPoolWorker-15] [b4bad02e-76da-422a-a902-54cfa6f34644] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:40:04.489234263Z [2024-04-21 02:40:04,485: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:40:05.094568264Z [2024-04-21 02:40:05,093: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[670b6721-bffc-43c8-ac96-ee46fe4cc79d] succeeded in 4.3989164079994225s: None 2024-04-21T02:40:05.296868169Z [2024-04-21 02:40:05,296: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a980eca-9c2b-45ca-adf6-22737f78615d] succeeded in 4.609952250000788s: None 2024-04-21T02:40:05.652255261Z [2024-04-21 02:40:05,651: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:40:05.655452039Z [2024-04-21 02:40:05,654: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:40:05.682938265Z [2024-04-21 02:40:05,682: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:40:05.688163593Z [2024-04-21 02:40:05,687: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:40:05.688246078Z [2024-04-21 02:40:05,687: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:40:05.688528547Z [2024-04-21 02:40:05,688: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:40:05.688552503Z [2024-04-21 02:40:05,688: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:40:05.688956098Z [2024-04-21 02:40:05,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:40:05.689088254Z [2024-04-21 02:40:05,688: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:40:05.796588748Z [2024-04-21 02:40:05,796: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:06.525066805Z [2024-04-21 02:40:06,524: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4bad02e-76da-422a-a902-54cfa6f34644] succeeded in 2.525185322998368s: None 2024-04-21T02:40:07.663759617Z [2024-04-21 02:40:07,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e9e97b3-0d33-4242-8e7f-a436c04d45f7] received 2024-04-21T02:40:07.671636265Z [2024-04-21 02:40:07,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5817cb39-2498-4b5d-848b-18d702a266dd] received 2024-04-21T02:40:07.673400474Z [2024-04-21 02:40:07,673: INFO/ForkPoolWorker-15] [0e9e97b3-0d33-4242-8e7f-a436c04d45f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240421024006_539016', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-21T02:40:07.678465822Z [2024-04-21 02:40:07,678: INFO/ForkPoolWorker-16] [5817cb39-2498-4b5d-848b-18d702a266dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:40:07.949571274Z [2024-04-21 02:40:07,946: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-21T02:40:08.027319036Z [2024-04-21 02:40:08,024: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:40:08.233304550Z [2024-04-21 02:40:08,232: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:08.850424722Z [2024-04-21 02:40:08,849: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e9e97b3-0d33-4242-8e7f-a436c04d45f7] succeeded in 1.185172916000738s: None 2024-04-21T02:40:09.139965704Z [2024-04-21 02:40:09,139: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:40:09.143010222Z [2024-04-21 02:40:09,142: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:40:09.170400559Z [2024-04-21 02:40:09,170: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:40:09.172761299Z [2024-04-21 02:40:09,172: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:40:09.172962756Z [2024-04-21 02:40:09,172: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:40:09.173325286Z [2024-04-21 02:40:09,172: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:40:09.173512292Z [2024-04-21 02:40:09,173: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:40:09.174103751Z [2024-04-21 02:40:09,173: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:40:09.174298458Z [2024-04-21 02:40:09,174: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:40:09.291394509Z [2024-04-21 02:40:09,290: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:10.709205301Z [2024-04-21 02:40:10,708: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5817cb39-2498-4b5d-848b-18d702a266dd] succeeded in 3.035487016000843s: None 2024-04-21T02:40:11.284284861Z [2024-04-21 02:40:11,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68d1ba16-a0fc-4b3e-884d-18aa47e04277] received 2024-04-21T02:40:11.296452557Z [2024-04-21 02:40:11,296: INFO/ForkPoolWorker-15] [68d1ba16-a0fc-4b3e-884d-18aa47e04277] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:40:11.688772176Z [2024-04-21 02:40:11,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:40:12.896758541Z [2024-04-21 02:40:12,896: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:40:12.900091726Z [2024-04-21 02:40:12,899: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:40:12.924853511Z [2024-04-21 02:40:12,924: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:40:12.927278429Z [2024-04-21 02:40:12,926: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:40:12.927370149Z [2024-04-21 02:40:12,927: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:40:12.927640297Z [2024-04-21 02:40:12,927: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:40:12.927885539Z [2024-04-21 02:40:12,927: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:40:12.928354894Z [2024-04-21 02:40:12,928: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:40:12.928499978Z [2024-04-21 02:40:12,928: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:40:13.036113481Z [2024-04-21 02:40:13,035: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:40:13.678828740Z [2024-04-21 02:40:13,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68d1ba16-a0fc-4b3e-884d-18aa47e04277] succeeded in 2.391723748000004s: None 2024-04-21T02:41:00.684544190Z [2024-04-21 02:41:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c20180f2-17a4-438a-9678-b142e2486f76] received 2024-04-21T02:41:00.695486102Z [2024-04-21 02:41:00,695: INFO/ForkPoolWorker-15] [c20180f2-17a4-438a-9678-b142e2486f76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:41:00.696048822Z [2024-04-21 02:41:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59587392-7eed-4a71-b5ad-78b24ccbe746] received 2024-04-21T02:41:00.702215717Z [2024-04-21 02:41:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08eb43ac-3436-4303-ba7b-ad91e89b7559] received 2024-04-21T02:41:00.707172631Z [2024-04-21 02:41:00,706: INFO/ForkPoolWorker-16] [59587392-7eed-4a71-b5ad-78b24ccbe746] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:41:00.720412512Z [2024-04-21 02:41:00,720: INFO/ForkPoolWorker-1] [08eb43ac-3436-4303-ba7b-ad91e89b7559] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:41:01.030169165Z [2024-04-21 02:41:01,026: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:41:01.061134127Z [2024-04-21 02:41:01,058: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:41:01.076801363Z [2024-04-21 02:41:01,066: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:41:01.276783887Z [2024-04-21 02:41:01,276: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:41:01.283112332Z [2024-04-21 02:41:01,282: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:41:01.336887044Z [2024-04-21 02:41:01,336: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:41:01.340839031Z [2024-04-21 02:41:01,340: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:41:01.340995919Z [2024-04-21 02:41:01,340: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:41:01.341082462Z [2024-04-21 02:41:01,340: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:41:01.341577817Z [2024-04-21 02:41:01,341: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:41:01.450788336Z [2024-04-21 02:41:01,450: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:41:02.202103634Z [2024-04-21 02:41:02,199: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08eb43ac-3436-4303-ba7b-ad91e89b7559] succeeded in 1.4959963479996077s: None 2024-04-21T02:41:02.456759933Z [2024-04-21 02:41:02,456: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:41:02.460004051Z [2024-04-21 02:41:02,459: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:41:02.465077396Z [2024-04-21 02:41:02,464: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:41:02.468713648Z [2024-04-21 02:41:02,468: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:41:02.477345790Z [2024-04-21 02:41:02,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:41:02.478620925Z [2024-04-21 02:41:02,478: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:41:02.478651732Z [2024-04-21 02:41:02,478: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:41:02.478811763Z [2024-04-21 02:41:02,478: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:41:02.478891338Z [2024-04-21 02:41:02,478: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:41:02.479131017Z [2024-04-21 02:41:02,479: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:41:02.479573413Z [2024-04-21 02:41:02,479: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:41:02.496072981Z [2024-04-21 02:41:02,495: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:41:02.497456919Z [2024-04-21 02:41:02,497: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:41:02.497472356Z [2024-04-21 02:41:02,497: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:41:02.497625201Z [2024-04-21 02:41:02,497: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:41:02.497634887Z [2024-04-21 02:41:02,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:41:02.497873531Z [2024-04-21 02:41:02,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:41:02.497883463Z [2024-04-21 02:41:02,497: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:41:02.567104379Z [2024-04-21 02:41:02,566: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:41:02.575069931Z [2024-04-21 02:41:02,574: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:41:04.180716617Z [2024-04-21 02:41:04,180: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59587392-7eed-4a71-b5ad-78b24ccbe746] succeeded in 3.4815690019986505s: None 2024-04-21T02:41:04.735107750Z [2024-04-21 02:41:04,734: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c20180f2-17a4-438a-9678-b142e2486f76] succeeded in 4.0476877839992085s: None 2024-04-21T02:42:00.703030349Z [2024-04-21 02:42:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7353f96-c12d-41a4-95c9-9ed72858e7ab] received 2024-04-21T02:42:00.705115389Z [2024-04-21 02:42:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[314ba43f-3c09-4034-9023-fcb5e364ee6a] received 2024-04-21T02:42:00.717231760Z [2024-04-21 02:42:00,716: INFO/ForkPoolWorker-15] [b7353f96-c12d-41a4-95c9-9ed72858e7ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:42:00.725473030Z [2024-04-21 02:42:00,725: INFO/ForkPoolWorker-16] [314ba43f-3c09-4034-9023-fcb5e364ee6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:42:00.735639491Z [2024-04-21 02:42:00,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[599ad3f2-6ca2-4bba-9787-4be13479a178] received 2024-04-21T02:42:00.737450836Z [2024-04-21 02:42:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83c099ee-ccb2-463e-a89a-b91922438c8e] received 2024-04-21T02:42:00.747872747Z [2024-04-21 02:42:00,747: INFO/ForkPoolWorker-2] [83c099ee-ccb2-463e-a89a-b91922438c8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:42:00.752007541Z [2024-04-21 02:42:00,751: INFO/ForkPoolWorker-1] [599ad3f2-6ca2-4bba-9787-4be13479a178] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:42:01.121434586Z [2024-04-21 02:42:01,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:42:01.150974494Z [2024-04-21 02:42:01,147: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:42:01.158773560Z [2024-04-21 02:42:01,150: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:42:01.173765568Z [2024-04-21 02:42:01,170: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:42:01.356378088Z [2024-04-21 02:42:01,355: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:42:01.361424164Z [2024-04-21 02:42:01,360: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:42:01.390150502Z [2024-04-21 02:42:01,389: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:42:01.391203202Z [2024-04-21 02:42:01,390: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:42:01.391353395Z [2024-04-21 02:42:01,391: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:42:01.391476697Z [2024-04-21 02:42:01,391: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:42:01.391749526Z [2024-04-21 02:42:01,391: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:42:01.406805664Z [2024-04-21 02:42:01,406: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:42:01.571993782Z [2024-04-21 02:42:01,571: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:42:02.175507122Z [2024-04-21 02:42:02,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7353f96-c12d-41a4-95c9-9ed72858e7ab] succeeded in 1.4675094249996619s: None 2024-04-21T02:42:02.233037847Z [2024-04-21 02:42:02,232: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[599ad3f2-6ca2-4bba-9787-4be13479a178] succeeded in 1.4942565050005214s: None 2024-04-21T02:42:02.673215474Z [2024-04-21 02:42:02,672: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:42:02.676699643Z [2024-04-21 02:42:02,676: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:42:02.699565612Z [2024-04-21 02:42:02,699: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:42:02.700915016Z [2024-04-21 02:42:02,700: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:42:02.701144958Z [2024-04-21 02:42:02,700: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:42:02.701337595Z [2024-04-21 02:42:02,701: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:42:02.701485304Z [2024-04-21 02:42:02,701: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:42:02.701717209Z [2024-04-21 02:42:02,701: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:42:02.701776418Z [2024-04-21 02:42:02,701: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:42:02.778326889Z [2024-04-21 02:42:02,778: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:42:02.832726595Z [2024-04-21 02:42:02,832: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:42:02.836534947Z [2024-04-21 02:42:02,835: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:42:02.885202298Z [2024-04-21 02:42:02,884: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:42:02.886771022Z [2024-04-21 02:42:02,886: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:42:02.886783084Z [2024-04-21 02:42:02,886: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:42:02.886897720Z [2024-04-21 02:42:02,886: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:42:02.886902825Z [2024-04-21 02:42:02,886: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:42:02.887168405Z [2024-04-21 02:42:02,887: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:42:02.887173458Z [2024-04-21 02:42:02,887: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:42:02.994292558Z [2024-04-21 02:42:02,993: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:42:05.316020772Z [2024-04-21 02:42:05,315: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[83c099ee-ccb2-463e-a89a-b91922438c8e] succeeded in 4.576637142999971s: None 2024-04-21T02:42:06.081112066Z [2024-04-21 02:42:06,080: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[314ba43f-3c09-4034-9023-fcb5e364ee6a] succeeded in 5.372995429999719s: None 2024-04-21T02:43:00.603132694Z [2024-04-21 02:43:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5ff967e-340d-483f-8798-b84c9fcb2ed4] received 2024-04-21T02:43:00.606517793Z [2024-04-21 02:43:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac7b5281-f17d-415d-a858-fd57a014f09b] received 2024-04-21T02:43:00.612425593Z [2024-04-21 02:43:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7b21cc9-5e33-4866-a2e9-b2c77fdabf02] received 2024-04-21T02:43:00.620822335Z [2024-04-21 02:43:00,620: INFO/ForkPoolWorker-15] [b5ff967e-340d-483f-8798-b84c9fcb2ed4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:43:00.630502419Z [2024-04-21 02:43:00,630: INFO/ForkPoolWorker-16] [ac7b5281-f17d-415d-a858-fd57a014f09b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:43:00.633712927Z [2024-04-21 02:43:00,633: INFO/ForkPoolWorker-1] [b7b21cc9-5e33-4866-a2e9-b2c77fdabf02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:43:00.930040514Z [2024-04-21 02:43:00,926: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:43:00.985812172Z [2024-04-21 02:43:00,981: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:43:01.014913167Z [2024-04-21 02:43:01,011: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:43:01.092061766Z [2024-04-21 02:43:01,083: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:43:01.092092599Z [2024-04-21 02:43:01,087: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:43:01.158592203Z [2024-04-21 02:43:01,155: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:43:01.160314950Z [2024-04-21 02:43:01,159: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:43:01.160337783Z [2024-04-21 02:43:01,159: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:43:01.160344872Z [2024-04-21 02:43:01,160: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:43:01.160860648Z [2024-04-21 02:43:01,160: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:43:01.259204037Z [2024-04-21 02:43:01,258: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:43:01.980113422Z [2024-04-21 02:43:01,979: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5ff967e-340d-483f-8798-b84c9fcb2ed4] succeeded in 1.3723473110003397s: None 2024-04-21T02:43:02.294529940Z [2024-04-21 02:43:02,293: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:43:02.297886208Z [2024-04-21 02:43:02,297: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:43:02.326315566Z [2024-04-21 02:43:02,326: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:43:02.327507107Z [2024-04-21 02:43:02,327: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:43:02.327634887Z [2024-04-21 02:43:02,327: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:43:02.327841039Z [2024-04-21 02:43:02,327: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:43:02.327907986Z [2024-04-21 02:43:02,327: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:43:02.328252357Z [2024-04-21 02:43:02,328: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:43:02.328259824Z [2024-04-21 02:43:02,328: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:43:02.424812213Z [2024-04-21 02:43:02,424: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:43:02.583333839Z [2024-04-21 02:43:02,582: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:43:02.586858151Z [2024-04-21 02:43:02,586: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:43:02.610518623Z [2024-04-21 02:43:02,610: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:43:02.611857380Z [2024-04-21 02:43:02,611: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:43:02.612023936Z [2024-04-21 02:43:02,611: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:43:02.612254316Z [2024-04-21 02:43:02,612: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:43:02.612440306Z [2024-04-21 02:43:02,612: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:43:02.612853495Z [2024-04-21 02:43:02,612: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:43:02.613004236Z [2024-04-21 02:43:02,612: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:43:02.688881078Z [2024-04-21 02:43:02,688: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:43:04.574321801Z [2024-04-21 02:43:04,573: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac7b5281-f17d-415d-a858-fd57a014f09b] succeeded in 3.9661864250010694s: None 2024-04-21T02:43:04.577917886Z [2024-04-21 02:43:04,577: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b7b21cc9-5e33-4866-a2e9-b2c77fdabf02] succeeded in 3.960738185000082s: None 2024-04-21T02:44:00.408944042Z [2024-04-21 02:44:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fc375ef-b6f1-499e-984d-8f1e6d60913d] received 2024-04-21T02:44:00.413061684Z [2024-04-21 02:44:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef3323f3-e86e-4918-99a0-0d4bafdc067c] received 2024-04-21T02:44:00.418720640Z [2024-04-21 02:44:00,418: INFO/ForkPoolWorker-15] [5fc375ef-b6f1-499e-984d-8f1e6d60913d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:44:00.419581595Z [2024-04-21 02:44:00,419: INFO/ForkPoolWorker-16] [ef3323f3-e86e-4918-99a0-0d4bafdc067c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:44:00.420226038Z [2024-04-21 02:44:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12e5b73c-78fe-488f-a9f6-10de9673d485] received 2024-04-21T02:44:00.426337207Z [2024-04-21 02:44:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd824308-50b8-4991-b1ac-7d4498c7b284] received 2024-04-21T02:44:00.437092419Z [2024-04-21 02:44:00,436: INFO/ForkPoolWorker-1] [12e5b73c-78fe-488f-a9f6-10de9673d485] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:44:00.448905729Z [2024-04-21 02:44:00,448: INFO/ForkPoolWorker-2] [fd824308-50b8-4991-b1ac-7d4498c7b284] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:44:00.789826345Z [2024-04-21 02:44:00,786: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:44:00.802892034Z [2024-04-21 02:44:00,798: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:44:00.848747701Z [2024-04-21 02:44:00,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:44:00.947224343Z [2024-04-21 02:44:00,944: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:44:01.038897158Z [2024-04-21 02:44:01,038: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:44:01.176796963Z [2024-04-21 02:44:01,176: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:44:01.180888457Z [2024-04-21 02:44:01,180: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:44:01.227644973Z [2024-04-21 02:44:01,224: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:44:01.234847770Z [2024-04-21 02:44:01,234: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:44:01.235788681Z [2024-04-21 02:44:01,234: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:44:01.235808776Z [2024-04-21 02:44:01,235: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:44:01.235812899Z [2024-04-21 02:44:01,235: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:44:01.401381316Z [2024-04-21 02:44:01,401: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:44:01.959301578Z [2024-04-21 02:44:01,958: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef3323f3-e86e-4918-99a0-0d4bafdc067c] succeeded in 1.5447303069995542s: None 2024-04-21T02:44:02.182015617Z [2024-04-21 02:44:02,181: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[12e5b73c-78fe-488f-a9f6-10de9673d485] succeeded in 1.7581485970003996s: None 2024-04-21T02:44:02.361231104Z [2024-04-21 02:44:02,360: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:44:02.364565656Z [2024-04-21 02:44:02,364: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:44:02.390263587Z [2024-04-21 02:44:02,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:44:02.391651776Z [2024-04-21 02:44:02,391: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:44:02.391720576Z [2024-04-21 02:44:02,391: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:44:02.391888154Z [2024-04-21 02:44:02,391: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:44:02.391968452Z [2024-04-21 02:44:02,391: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:44:02.392230659Z [2024-04-21 02:44:02,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:44:02.392694686Z [2024-04-21 02:44:02,392: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:44:02.483741899Z [2024-04-21 02:44:02,483: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:44:02.506072142Z [2024-04-21 02:44:02,504: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:44:02.509385903Z [2024-04-21 02:44:02,508: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:44:02.532363896Z [2024-04-21 02:44:02,531: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:44:02.536324585Z [2024-04-21 02:44:02,536: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:44:02.536366063Z [2024-04-21 02:44:02,536: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:44:02.536581317Z [2024-04-21 02:44:02,536: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:44:02.536709462Z [2024-04-21 02:44:02,536: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:44:02.536968702Z [2024-04-21 02:44:02,536: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:44:02.537358710Z [2024-04-21 02:44:02,537: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:44:02.633324178Z [2024-04-21 02:44:02,632: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:44:04.822773219Z [2024-04-21 02:44:04,822: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd824308-50b8-4991-b1ac-7d4498c7b284] succeeded in 4.391165572000318s: None 2024-04-21T02:44:05.594436344Z [2024-04-21 02:44:05,593: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fc375ef-b6f1-499e-984d-8f1e6d60913d] succeeded in 5.181872702998589s: None 2024-04-21T02:45:01.191440939Z [2024-04-21 02:45:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b887b8f-4c7d-4b1a-a0f1-b077a7c9d562] received 2024-04-21T02:45:01.193212298Z [2024-04-21 02:45:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6342888f-5091-4399-b2c5-1b244786c9d5] received 2024-04-21T02:45:01.194312143Z [2024-04-21 02:45:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f4cd82d-bbb3-420b-b748-dbb8228a32b4] received 2024-04-21T02:45:01.197648529Z [2024-04-21 02:45:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d31e21be-7f43-40ac-b986-71d344b147a4] received 2024-04-21T02:45:01.201990555Z [2024-04-21 02:45:01,201: INFO/ForkPoolWorker-16] [6342888f-5091-4399-b2c5-1b244786c9d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:45:01.203598243Z [2024-04-21 02:45:01,203: INFO/ForkPoolWorker-15] [7b887b8f-4c7d-4b1a-a0f1-b077a7c9d562] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:45:01.232189027Z [2024-04-21 02:45:01,231: INFO/ForkPoolWorker-1] [2f4cd82d-bbb3-420b-b748-dbb8228a32b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:45:01.232816263Z [2024-04-21 02:45:01,232: INFO/ForkPoolWorker-2] [d31e21be-7f43-40ac-b986-71d344b147a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:45:01.624282257Z [2024-04-21 02:45:01,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:45:01.752320260Z [2024-04-21 02:45:01,748: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:45:01.869733834Z [2024-04-21 02:45:01,866: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:45:01.925066760Z [2024-04-21 02:45:01,916: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:45:02.146676407Z [2024-04-21 02:45:02,146: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T02:45:02.150590870Z [2024-04-21 02:45:02,150: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:45:02.205316426Z [2024-04-21 02:45:02,205: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:45:02.208706435Z [2024-04-21 02:45:02,208: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:45:02.208749392Z [2024-04-21 02:45:02,208: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:45:02.208802782Z [2024-04-21 02:45:02,208: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T02:45:02.208987286Z [2024-04-21 02:45:02,208: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:45:02.330679004Z [2024-04-21 02:45:02,330: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:45:02.966535442Z [2024-04-21 02:45:02,966: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:45:02.978937917Z [2024-04-21 02:45:02,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:45:03.032344837Z [2024-04-21 02:45:03,032: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:45:03.036432434Z [2024-04-21 02:45:03,036: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d31e21be-7f43-40ac-b986-71d344b147a4] succeeded in 1.8334572060011851s: None 2024-04-21T02:45:03.038603560Z [2024-04-21 02:45:03,038: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:45:03.039876066Z [2024-04-21 02:45:03,038: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:45:03.040139179Z [2024-04-21 02:45:03,039: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:45:03.040605065Z [2024-04-21 02:45:03,040: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:45:03.040995497Z [2024-04-21 02:45:03,040: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:45:03.041393322Z [2024-04-21 02:45:03,040: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:45:03.221932649Z [2024-04-21 02:45:03,221: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:45:03.342306914Z [2024-04-21 02:45:03,341: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:45:03.345437323Z [2024-04-21 02:45:03,344: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:45:03.395261049Z [2024-04-21 02:45:03,395: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:45:03.396554192Z [2024-04-21 02:45:03,396: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:45:03.396568943Z [2024-04-21 02:45:03,396: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:45:03.396667358Z [2024-04-21 02:45:03,396: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:45:03.396677149Z [2024-04-21 02:45:03,396: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:45:03.396905220Z [2024-04-21 02:45:03,396: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:45:03.396916081Z [2024-04-21 02:45:03,396: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:45:03.478806327Z [2024-04-21 02:45:03,478: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:45:03.598055855Z [2024-04-21 02:45:03,597: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:45:03.601649711Z [2024-04-21 02:45:03,601: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:45:03.640146952Z [2024-04-21 02:45:03,639: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:45:03.641726716Z [2024-04-21 02:45:03,641: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:45:03.641796179Z [2024-04-21 02:45:03,641: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:45:03.641945333Z [2024-04-21 02:45:03,641: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:45:03.643374641Z [2024-04-21 02:45:03,643: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:45:03.643735970Z [2024-04-21 02:45:03,643: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:45:03.643822728Z [2024-04-21 02:45:03,643: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:45:03.759248381Z [2024-04-21 02:45:03,758: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:45:04.065748909Z [2024-04-21 02:45:04,065: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f4cd82d-bbb3-420b-b748-dbb8228a32b4] succeeded in 2.867839480000839s: None 2024-04-21T02:45:04.184148292Z [2024-04-21 02:45:04,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8de12661-658e-4061-ace1-db4debe2da8b] received 2024-04-21T02:45:04.191165847Z [2024-04-21 02:45:04,190: INFO/ForkPoolWorker-1] [8de12661-658e-4061-ace1-db4debe2da8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:45:04.507828580Z [2024-04-21 02:45:04,504: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:45:05.539944148Z [2024-04-21 02:45:05,539: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6342888f-5091-4399-b2c5-1b244786c9d5] succeeded in 4.344407147000311s: None 2024-04-21T02:45:05.648084115Z [2024-04-21 02:45:05,647: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:45:05.651400000Z [2024-04-21 02:45:05,650: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:45:05.672505792Z [2024-04-21 02:45:05,672: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:45:05.674425954Z [2024-04-21 02:45:05,674: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:45:05.674737416Z [2024-04-21 02:45:05,674: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:45:05.674908936Z [2024-04-21 02:45:05,674: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:45:05.675050667Z [2024-04-21 02:45:05,674: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:45:05.675395758Z [2024-04-21 02:45:05,675: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:45:05.675506471Z [2024-04-21 02:45:05,675: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:45:05.783359356Z [2024-04-21 02:45:05,783: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:45:06.008999030Z [2024-04-21 02:45:06,008: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b887b8f-4c7d-4b1a-a0f1-b077a7c9d562] succeeded in 4.815041913998357s: None 2024-04-21T02:45:06.565890823Z [2024-04-21 02:45:06,565: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8de12661-658e-4061-ace1-db4debe2da8b] succeeded in 2.3804359780006052s: None 2024-04-21T02:45:06.776078046Z [2024-04-21 02:45:06,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3538b68f-5cf6-41c9-87d4-39f5a307c08d] received 2024-04-21T02:45:06.784301987Z [2024-04-21 02:45:06,783: INFO/ForkPoolWorker-15] [3538b68f-5cf6-41c9-87d4-39f5a307c08d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:45:07.091118979Z [2024-04-21 02:45:07,087: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:45:08.349575113Z [2024-04-21 02:45:08,349: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:45:08.352686148Z [2024-04-21 02:45:08,352: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:45:08.372190597Z [2024-04-21 02:45:08,371: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:45:08.373779099Z [2024-04-21 02:45:08,373: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:45:08.373798138Z [2024-04-21 02:45:08,373: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:45:08.373964524Z [2024-04-21 02:45:08,373: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:45:08.373979073Z [2024-04-21 02:45:08,373: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:45:08.374221096Z [2024-04-21 02:45:08,374: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:45:08.374320421Z [2024-04-21 02:45:08,374: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:45:08.457542224Z [2024-04-21 02:45:08,457: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:45:09.792629555Z [2024-04-21 02:45:09,792: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3538b68f-5cf6-41c9-87d4-39f5a307c08d] succeeded in 3.0144787520002865s: None 2024-04-21T02:45:10.501201209Z [2024-04-21 02:45:10,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b00af965-dba4-47f9-8bd0-d02cf9e054e6] received 2024-04-21T02:45:10.508184281Z [2024-04-21 02:45:10,507: INFO/ForkPoolWorker-15] [b00af965-dba4-47f9-8bd0-d02cf9e054e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:45:10.838860065Z [2024-04-21 02:45:10,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:45:11.991320862Z [2024-04-21 02:45:11,990: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:45:11.997832034Z [2024-04-21 02:45:11,997: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:45:12.033441815Z [2024-04-21 02:45:12,033: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:45:12.035395211Z [2024-04-21 02:45:12,035: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:45:12.035426288Z [2024-04-21 02:45:12,035: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:45:12.035628929Z [2024-04-21 02:45:12,035: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:45:12.035763962Z [2024-04-21 02:45:12,035: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:45:12.036096546Z [2024-04-21 02:45:12,035: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:45:12.036120579Z [2024-04-21 02:45:12,035: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:45:12.124210920Z [2024-04-21 02:45:12,123: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:45:12.741748736Z [2024-04-21 02:45:12,740: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b00af965-dba4-47f9-8bd0-d02cf9e054e6] succeeded in 2.238078817999849s: None 2024-04-21T02:46:01.194982221Z [2024-04-21 02:46:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edeb8919-cce1-4591-aff8-cc65827970f6] received 2024-04-21T02:46:01.198479674Z [2024-04-21 02:46:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bf2b9f9-7946-4934-aa41-525737354eac] received 2024-04-21T02:46:01.205868238Z [2024-04-21 02:46:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f7310b8-0e92-4b68-a8d9-4d58c4c611fb] received 2024-04-21T02:46:01.206398324Z [2024-04-21 02:46:01,206: INFO/ForkPoolWorker-15] [edeb8919-cce1-4591-aff8-cc65827970f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:46:01.210829256Z [2024-04-21 02:46:01,210: INFO/ForkPoolWorker-16] [9bf2b9f9-7946-4934-aa41-525737354eac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:46:01.218985786Z [2024-04-21 02:46:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eed340aa-11eb-42b8-97d9-5dbcd5fb8aef] received 2024-04-21T02:46:01.225071198Z [2024-04-21 02:46:01,224: INFO/ForkPoolWorker-1] [8f7310b8-0e92-4b68-a8d9-4d58c4c611fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:46:01.225915536Z [2024-04-21 02:46:01,225: INFO/ForkPoolWorker-2] [eed340aa-11eb-42b8-97d9-5dbcd5fb8aef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:46:01.633444440Z [2024-04-21 02:46:01,629: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:46:01.671703201Z [2024-04-21 02:46:01,668: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:46:01.747328260Z [2024-04-21 02:46:01,741: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:46:01.784706073Z [2024-04-21 02:46:01,775: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:46:02.041200061Z [2024-04-21 02:46:02,040: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:46:02.048754090Z [2024-04-21 02:46:02,048: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:46:02.102894473Z [2024-04-21 02:46:02,102: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:46:02.104589961Z [2024-04-21 02:46:02,104: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:46:02.104910262Z [2024-04-21 02:46:02,104: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:46:02.105118187Z [2024-04-21 02:46:02,104: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:46:02.105505456Z [2024-04-21 02:46:02,105: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:46:02.175370496Z [2024-04-21 02:46:02,175: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:46:02.216785776Z [2024-04-21 02:46:02,216: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:46:02.876577580Z [2024-04-21 02:46:02,876: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f7310b8-0e92-4b68-a8d9-4d58c4c611fb] succeeded in 1.6589431489992421s: None 2024-04-21T02:46:02.897727029Z [2024-04-21 02:46:02,897: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edeb8919-cce1-4591-aff8-cc65827970f6] succeeded in 1.700629069999195s: None 2024-04-21T02:46:03.266713503Z [2024-04-21 02:46:03,266: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:46:03.270329602Z [2024-04-21 02:46:03,269: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:46:03.288179333Z [2024-04-21 02:46:03,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:46:03.289734776Z [2024-04-21 02:46:03,289: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:46:03.289855598Z [2024-04-21 02:46:03,289: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:46:03.290055682Z [2024-04-21 02:46:03,289: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:46:03.290189752Z [2024-04-21 02:46:03,290: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:46:03.290646517Z [2024-04-21 02:46:03,290: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:46:03.290802933Z [2024-04-21 02:46:03,290: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:46:03.302049870Z [2024-04-21 02:46:03,301: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:46:03.305175233Z [2024-04-21 02:46:03,304: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:46:03.321316548Z [2024-04-21 02:46:03,321: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:46:03.322285033Z [2024-04-21 02:46:03,322: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:46:03.322295928Z [2024-04-21 02:46:03,322: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:46:03.322381952Z [2024-04-21 02:46:03,322: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:46:03.322428060Z [2024-04-21 02:46:03,322: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:46:03.322603963Z [2024-04-21 02:46:03,322: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:46:03.322644486Z [2024-04-21 02:46:03,322: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:46:03.375084561Z [2024-04-21 02:46:03,374: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:46:03.398970687Z [2024-04-21 02:46:03,398: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:46:05.630298334Z [2024-04-21 02:46:05,629: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[eed340aa-11eb-42b8-97d9-5dbcd5fb8aef] succeeded in 4.409588259999509s: None 2024-04-21T02:46:06.535058008Z [2024-04-21 02:46:06,534: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9bf2b9f9-7946-4934-aa41-525737354eac] succeeded in 5.333744319999823s: None 2024-04-21T02:46:58.778295755Z [2024-04-21 02:46:58,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d314d767-24aa-4368-9a52-ff8edd229963] received 2024-04-21T02:46:58.790306280Z [2024-04-21 02:46:58,790: INFO/ForkPoolWorker-15] [d314d767-24aa-4368-9a52-ff8edd229963] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240421024658_671468', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-21T02:46:59.145845441Z [2024-04-21 02:46:59,142: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-21T02:46:59.382497229Z [2024-04-21 02:46:59,382: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:47:00.062463314Z [2024-04-21 02:47:00,061: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d314d767-24aa-4368-9a52-ff8edd229963] succeeded in 1.282552812999711s: None 2024-04-21T02:47:00.245733841Z [2024-04-21 02:47:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b17409e-63cb-42c1-8be5-d4283299a045] received 2024-04-21T02:47:00.250075682Z [2024-04-21 02:47:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1120f460-639a-4619-91ae-ffba527c1af4] received 2024-04-21T02:47:00.257954048Z [2024-04-21 02:47:00,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52a97fa2-06bc-4ecd-82d0-1a2dd16ed0e2] received 2024-04-21T02:47:00.257990090Z [2024-04-21 02:47:00,257: INFO/ForkPoolWorker-16] [1120f460-639a-4619-91ae-ffba527c1af4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:47:00.273592355Z [2024-04-21 02:47:00,271: INFO/ForkPoolWorker-1] [52a97fa2-06bc-4ecd-82d0-1a2dd16ed0e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:47:00.279066417Z [2024-04-21 02:47:00,278: INFO/ForkPoolWorker-15] [1b17409e-63cb-42c1-8be5-d4283299a045] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:47:00.527390468Z [2024-04-21 02:47:00,524: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:47:00.684151715Z [2024-04-21 02:47:00,683: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:47:00.687813451Z [2024-04-21 02:47:00,687: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:47:00.719096213Z [2024-04-21 02:47:00,718: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:47:00.720423301Z [2024-04-21 02:47:00,720: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:47:00.720604815Z [2024-04-21 02:47:00,720: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:47:00.720766801Z [2024-04-21 02:47:00,720: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:47:00.720992106Z [2024-04-21 02:47:00,720: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:47:00.787748329Z [2024-04-21 02:47:00,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:47:00.814165318Z [2024-04-21 02:47:00,813: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:47:00.820682712Z [2024-04-21 02:47:00,817: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:47:01.429480632Z [2024-04-21 02:47:01,429: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1120f460-639a-4619-91ae-ffba527c1af4] succeeded in 1.1781511749995843s: None 2024-04-21T02:47:02.143414692Z [2024-04-21 02:47:02,143: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:47:02.147018803Z [2024-04-21 02:47:02,146: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:47:02.172203515Z [2024-04-21 02:47:02,171: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:47:02.176731908Z [2024-04-21 02:47:02,175: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:47:02.181762436Z [2024-04-21 02:47:02,181: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:47:02.183384046Z [2024-04-21 02:47:02,183: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:47:02.183667490Z [2024-04-21 02:47:02,183: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:47:02.184048619Z [2024-04-21 02:47:02,183: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:47:02.184419206Z [2024-04-21 02:47:02,184: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:47:02.184926326Z [2024-04-21 02:47:02,184: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:47:02.185191005Z [2024-04-21 02:47:02,185: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:47:02.198134176Z [2024-04-21 02:47:02,197: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:47:02.199525362Z [2024-04-21 02:47:02,199: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:47:02.199733129Z [2024-04-21 02:47:02,199: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:47:02.199881615Z [2024-04-21 02:47:02,199: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:47:02.200025572Z [2024-04-21 02:47:02,199: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:47:02.200410292Z [2024-04-21 02:47:02,200: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:47:02.200586790Z [2024-04-21 02:47:02,200: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:47:02.277525243Z [2024-04-21 02:47:02,277: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:47:02.280997850Z [2024-04-21 02:47:02,280: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:47:03.878857929Z [2024-04-21 02:47:03,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52a97fa2-06bc-4ecd-82d0-1a2dd16ed0e2] succeeded in 3.618645546999687s: None 2024-04-21T02:47:04.737286048Z [2024-04-21 02:47:04,736: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b17409e-63cb-42c1-8be5-d4283299a045] succeeded in 4.489062251999712s: None 2024-04-21T02:48:01.232534861Z [2024-04-21 02:48:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b433cce4-f620-4b56-a5ef-ae40e7a2f3be] received 2024-04-21T02:48:01.236437765Z [2024-04-21 02:48:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3047f33d-95c1-409e-a17d-2968a3fd48fc] received 2024-04-21T02:48:01.242687210Z [2024-04-21 02:48:01,242: INFO/ForkPoolWorker-15] [b433cce4-f620-4b56-a5ef-ae40e7a2f3be] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:48:01.243378446Z [2024-04-21 02:48:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1af72fea-ce5a-4198-ba99-2424cf499213] received 2024-04-21T02:48:01.244434885Z [2024-04-21 02:48:01,244: INFO/ForkPoolWorker-16] [3047f33d-95c1-409e-a17d-2968a3fd48fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:48:01.249416858Z [2024-04-21 02:48:01,249: INFO/ForkPoolWorker-1] [1af72fea-ce5a-4198-ba99-2424cf499213] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:48:01.250027621Z [2024-04-21 02:48:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c04a0a00-03c0-4946-89f5-79f73159aae6] received 2024-04-21T02:48:01.268384381Z [2024-04-21 02:48:01,267: INFO/ForkPoolWorker-2] [c04a0a00-03c0-4946-89f5-79f73159aae6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:48:01.807954173Z [2024-04-21 02:48:01,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:48:01.825830968Z [2024-04-21 02:48:01,822: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:48:01.987639581Z [2024-04-21 02:48:01,984: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:48:02.018156597Z [2024-04-21 02:48:02,007: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:48:02.436018295Z [2024-04-21 02:48:02,435: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:48:02.439898097Z [2024-04-21 02:48:02,439: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:48:02.474523460Z [2024-04-21 02:48:02,474: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:48:02.480056287Z [2024-04-21 02:48:02,479: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:48:02.480423732Z [2024-04-21 02:48:02,480: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:48:02.480585315Z [2024-04-21 02:48:02,480: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:48:02.480841273Z [2024-04-21 02:48:02,480: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:48:02.494862335Z [2024-04-21 02:48:02,494: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:48:02.716612246Z [2024-04-21 02:48:02,716: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:48:03.569452579Z [2024-04-21 02:48:03,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3047f33d-95c1-409e-a17d-2968a3fd48fc] succeeded in 2.330314394999732s: None 2024-04-21T02:48:03.702517195Z [2024-04-21 02:48:03,699: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b433cce4-f620-4b56-a5ef-ae40e7a2f3be] succeeded in 2.464891551000619s: None 2024-04-21T02:48:04.070696783Z [2024-04-21 02:48:04,070: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:48:04.080744460Z [2024-04-21 02:48:04,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:48:04.136745178Z [2024-04-21 02:48:04,136: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:48:04.139770231Z [2024-04-21 02:48:04,139: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:48:04.139965664Z [2024-04-21 02:48:04,139: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:48:04.140221562Z [2024-04-21 02:48:04,140: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:48:04.140377356Z [2024-04-21 02:48:04,140: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:48:04.140708737Z [2024-04-21 02:48:04,140: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:48:04.140860334Z [2024-04-21 02:48:04,140: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:48:04.244019132Z [2024-04-21 02:48:04,243: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:48:04.323051774Z [2024-04-21 02:48:04,322: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:48:04.330429476Z [2024-04-21 02:48:04,329: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:48:04.386674590Z [2024-04-21 02:48:04,386: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:48:04.387785610Z [2024-04-21 02:48:04,387: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:48:04.387797947Z [2024-04-21 02:48:04,387: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:48:04.387865963Z [2024-04-21 02:48:04,387: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:48:04.390709239Z [2024-04-21 02:48:04,388: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:48:04.390900038Z [2024-04-21 02:48:04,390: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:48:04.390914220Z [2024-04-21 02:48:04,390: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:48:04.547060560Z [2024-04-21 02:48:04,542: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:48:06.505356268Z [2024-04-21 02:48:06,504: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c04a0a00-03c0-4946-89f5-79f73159aae6] succeeded in 5.252309980000064s: None 2024-04-21T02:48:06.668913020Z [2024-04-21 02:48:06,667: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1af72fea-ce5a-4198-ba99-2424cf499213] succeeded in 5.4227429410002514s: None 2024-04-21T02:49:00.885750113Z [2024-04-21 02:49:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dee681bf-b20a-4c4c-a4a5-a8aac3adbe59] received 2024-04-21T02:49:00.891254593Z [2024-04-21 02:49:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61462f1a-42b1-4ce8-b205-ccc0f13c0f7c] received 2024-04-21T02:49:00.900392922Z [2024-04-21 02:49:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6637e481-5095-4143-9301-5d1c267d8efe] received 2024-04-21T02:49:00.901181527Z [2024-04-21 02:49:00,900: INFO/ForkPoolWorker-16] [61462f1a-42b1-4ce8-b205-ccc0f13c0f7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:49:00.919774113Z [2024-04-21 02:49:00,900: INFO/ForkPoolWorker-15] [dee681bf-b20a-4c4c-a4a5-a8aac3adbe59] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:49:00.919809847Z [2024-04-21 02:49:00,908: INFO/ForkPoolWorker-1] [6637e481-5095-4143-9301-5d1c267d8efe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:49:01.240506933Z [2024-04-21 02:49:01,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:49:01.277765123Z [2024-04-21 02:49:01,274: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:49:01.454803589Z [2024-04-21 02:49:01,447: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:49:01.629476427Z [2024-04-21 02:49:01,629: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:49:01.633655621Z [2024-04-21 02:49:01,633: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:49:01.700728062Z [2024-04-21 02:49:01,700: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:49:01.702136580Z [2024-04-21 02:49:01,701: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:49:01.702432488Z [2024-04-21 02:49:01,702: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:49:01.702575406Z [2024-04-21 02:49:01,702: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:49:01.702853087Z [2024-04-21 02:49:01,702: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:49:01.856050098Z [2024-04-21 02:49:01,855: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:49:02.579962245Z [2024-04-21 02:49:02,579: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dee681bf-b20a-4c4c-a4a5-a8aac3adbe59] succeeded in 1.6874766960008856s: None 2024-04-21T02:49:02.883108261Z [2024-04-21 02:49:02,882: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:49:02.886504066Z [2024-04-21 02:49:02,886: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:49:02.921391095Z [2024-04-21 02:49:02,921: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:49:02.924935384Z [2024-04-21 02:49:02,924: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:49:02.925171418Z [2024-04-21 02:49:02,925: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:49:02.925433162Z [2024-04-21 02:49:02,925: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:49:02.925628123Z [2024-04-21 02:49:02,925: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:49:02.926160340Z [2024-04-21 02:49:02,925: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:49:02.926371628Z [2024-04-21 02:49:02,926: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:49:02.987757562Z [2024-04-21 02:49:02,987: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:49:02.990998469Z [2024-04-21 02:49:02,990: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:49:03.013771869Z [2024-04-21 02:49:03,013: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:49:03.036254886Z [2024-04-21 02:49:03,035: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:49:03.040871123Z [2024-04-21 02:49:03,040: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:49:03.040890871Z [2024-04-21 02:49:03,040: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:49:03.041069793Z [2024-04-21 02:49:03,040: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:49:03.041153434Z [2024-04-21 02:49:03,041: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:49:03.041509447Z [2024-04-21 02:49:03,041: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:49:03.041519888Z [2024-04-21 02:49:03,041: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:49:03.164416960Z [2024-04-21 02:49:03,164: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:49:05.704268380Z [2024-04-21 02:49:05,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6637e481-5095-4143-9301-5d1c267d8efe] succeeded in 4.801718040998821s: None 2024-04-21T02:49:06.656125816Z [2024-04-21 02:49:06,655: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61462f1a-42b1-4ce8-b205-ccc0f13c0f7c] succeeded in 5.764609093999752s: None 2024-04-21T02:50:00.301022837Z [2024-04-21 02:50:00,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fecb8e46-5d73-4c3f-9660-0b89b8cd5a9d] received 2024-04-21T02:50:00.302995278Z [2024-04-21 02:50:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3425e570-10a0-490f-a413-653b0113c358] received 2024-04-21T02:50:00.304454848Z [2024-04-21 02:50:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a2a5f4e-32db-40eb-ab35-4f9922c08c0b] received 2024-04-21T02:50:00.319340629Z [2024-04-21 02:50:00,318: INFO/ForkPoolWorker-16] [3425e570-10a0-490f-a413-653b0113c358] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:50:00.320470699Z [2024-04-21 02:50:00,320: INFO/ForkPoolWorker-15] [fecb8e46-5d73-4c3f-9660-0b89b8cd5a9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:50:00.321846186Z [2024-04-21 02:50:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[510ac3ad-22a8-426f-940d-7b5e9c09cee1] received 2024-04-21T02:50:00.323031445Z [2024-04-21 02:50:00,322: INFO/ForkPoolWorker-1] [4a2a5f4e-32db-40eb-ab35-4f9922c08c0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:50:00.334636610Z [2024-04-21 02:50:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd52c367-bfed-41fd-91dc-06fbc9b137f9] received 2024-04-21T02:50:00.339642857Z [2024-04-21 02:50:00,336: INFO/ForkPoolWorker-2] [510ac3ad-22a8-426f-940d-7b5e9c09cee1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:50:00.363505364Z [2024-04-21 02:50:00,360: INFO/ForkPoolWorker-3] [dd52c367-bfed-41fd-91dc-06fbc9b137f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:50:00.651734471Z [2024-04-21 02:50:00,647: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:50:00.736723447Z [2024-04-21 02:50:00,732: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:50:00.762780033Z [2024-04-21 02:50:00,758: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:50:00.803118225Z [2024-04-21 02:50:00,799: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:50:00.806822754Z [2024-04-21 02:50:00,802: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:50:00.994587728Z [2024-04-21 02:50:00,994: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:50:00.999507714Z [2024-04-21 02:50:00,999: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:50:01.043994103Z [2024-04-21 02:50:01,038: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:50:01.048206538Z [2024-04-21 02:50:01,047: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:50:01.048769818Z [2024-04-21 02:50:01,048: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:50:01.048945325Z [2024-04-21 02:50:01,048: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:50:01.049215828Z [2024-04-21 02:50:01,049: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:50:01.302286748Z [2024-04-21 02:50:01,302: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:01.385406923Z [2024-04-21 02:50:01,385: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:02.153312266Z [2024-04-21 02:50:02,152: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3425e570-10a0-490f-a413-653b0113c358] succeeded in 1.8482531829995423s: None 2024-04-21T02:50:02.156030213Z [2024-04-21 02:50:02,155: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[dd52c367-bfed-41fd-91dc-06fbc9b137f9] succeeded in 1.8143224859995826s: None 2024-04-21T02:50:02.551038209Z [2024-04-21 02:50:02,550: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:50:02.571037093Z [2024-04-21 02:50:02,570: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:50:02.598726384Z [2024-04-21 02:50:02,598: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:50:02.601576529Z [2024-04-21 02:50:02,601: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:50:02.601821582Z [2024-04-21 02:50:02,601: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:50:02.602137309Z [2024-04-21 02:50:02,601: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:50:02.602420133Z [2024-04-21 02:50:02,602: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:50:02.603124810Z [2024-04-21 02:50:02,602: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:50:02.603267230Z [2024-04-21 02:50:02,603: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:50:02.725220985Z [2024-04-21 02:50:02,724: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:50:02.729124540Z [2024-04-21 02:50:02,728: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:50:02.765312637Z [2024-04-21 02:50:02,765: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:02.771872914Z [2024-04-21 02:50:02,771: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:50:02.774303522Z [2024-04-21 02:50:02,773: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:50:02.774322470Z [2024-04-21 02:50:02,774: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:50:02.774501251Z [2024-04-21 02:50:02,774: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:50:02.774506300Z [2024-04-21 02:50:02,774: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:50:02.774706908Z [2024-04-21 02:50:02,774: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:50:02.774747108Z [2024-04-21 02:50:02,774: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:50:02.855452549Z [2024-04-21 02:50:02,855: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:50:02.859756210Z [2024-04-21 02:50:02,859: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:50:02.892546209Z [2024-04-21 02:50:02,892: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:50:02.896671290Z [2024-04-21 02:50:02,896: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:50:02.896894164Z [2024-04-21 02:50:02,896: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:50:02.897148160Z [2024-04-21 02:50:02,896: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:50:02.897381304Z [2024-04-21 02:50:02,897: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:50:02.897717149Z [2024-04-21 02:50:02,897: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:50:02.897903126Z [2024-04-21 02:50:02,897: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:50:02.906639492Z [2024-04-21 02:50:02,906: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:03.061101514Z [2024-04-21 02:50:03,060: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:03.992488982Z [2024-04-21 02:50:03,990: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[510ac3ad-22a8-426f-940d-7b5e9c09cee1] succeeded in 3.6661165860004985s: None 2024-04-21T02:50:04.895617202Z [2024-04-21 02:50:04,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ad9e580-2a6a-486a-b5a2-f2427100abd6] received 2024-04-21T02:50:04.908730130Z [2024-04-21 02:50:04,908: INFO/ForkPoolWorker-16] [1ad9e580-2a6a-486a-b5a2-f2427100abd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:50:05.239222987Z [2024-04-21 02:50:05,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:50:05.244785021Z [2024-04-21 02:50:05,244: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fecb8e46-5d73-4c3f-9660-0b89b8cd5a9d] succeeded in 4.938052511999558s: None 2024-04-21T02:50:05.841600748Z [2024-04-21 02:50:05,841: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a2a5f4e-32db-40eb-ab35-4f9922c08c0b] succeeded in 5.532366571998864s: None 2024-04-21T02:50:06.468511676Z [2024-04-21 02:50:06,468: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:50:06.472756100Z [2024-04-21 02:50:06,472: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:50:06.491230853Z [2024-04-21 02:50:06,491: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:50:06.492739846Z [2024-04-21 02:50:06,492: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:50:06.492950258Z [2024-04-21 02:50:06,492: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:50:06.493180292Z [2024-04-21 02:50:06,493: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:50:06.493345606Z [2024-04-21 02:50:06,493: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:50:06.493754200Z [2024-04-21 02:50:06,493: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:50:06.493916765Z [2024-04-21 02:50:06,493: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:50:06.588543609Z [2024-04-21 02:50:06,588: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:07.357843668Z [2024-04-21 02:50:07,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ad9e580-2a6a-486a-b5a2-f2427100abd6] succeeded in 2.45686449599998s: None 2024-04-21T02:50:07.475962967Z [2024-04-21 02:50:07,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8004945-a299-445e-ad5a-4c0a490c6d4b] received 2024-04-21T02:50:07.488993676Z [2024-04-21 02:50:07,488: INFO/ForkPoolWorker-15] [e8004945-a299-445e-ad5a-4c0a490c6d4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:50:07.874135862Z [2024-04-21 02:50:07,870: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:50:09.218342335Z [2024-04-21 02:50:09,217: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:50:09.221914499Z [2024-04-21 02:50:09,221: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:50:09.243627734Z [2024-04-21 02:50:09,243: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:50:09.245184821Z [2024-04-21 02:50:09,244: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:50:09.245307147Z [2024-04-21 02:50:09,245: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:50:09.245524780Z [2024-04-21 02:50:09,245: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:50:09.245618405Z [2024-04-21 02:50:09,245: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:50:09.245959193Z [2024-04-21 02:50:09,245: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:50:09.245980188Z [2024-04-21 02:50:09,245: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:50:09.336136817Z [2024-04-21 02:50:09,335: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:09.927458457Z [2024-04-21 02:50:09,926: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8004945-a299-445e-ad5a-4c0a490c6d4b] succeeded in 2.4474659459992836s: None 2024-04-21T02:50:10.175955588Z [2024-04-21 02:50:10,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e67ef322-c016-4e25-8bcf-250451a3431e] received 2024-04-21T02:50:10.183340141Z [2024-04-21 02:50:10,183: INFO/ForkPoolWorker-15] [e67ef322-c016-4e25-8bcf-250451a3431e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:50:10.487001574Z [2024-04-21 02:50:10,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:50:11.554765788Z [2024-04-21 02:50:11,554: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:50:11.558111506Z [2024-04-21 02:50:11,557: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:50:11.595912982Z [2024-04-21 02:50:11,595: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:50:11.600492962Z [2024-04-21 02:50:11,600: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:50:11.600508944Z [2024-04-21 02:50:11,600: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:50:11.600619412Z [2024-04-21 02:50:11,600: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:50:11.600641930Z [2024-04-21 02:50:11,600: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:50:11.600887382Z [2024-04-21 02:50:11,600: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:50:11.600892046Z [2024-04-21 02:50:11,600: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:50:11.745952161Z [2024-04-21 02:50:11,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:12.435555114Z [2024-04-21 02:50:12,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e67ef322-c016-4e25-8bcf-250451a3431e] succeeded in 2.2577708789995086s: None 2024-04-21T02:50:58.502212520Z [2024-04-21 02:50:58,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20b78738-907c-476b-afa7-ff4936e3e261] received 2024-04-21T02:50:58.518573339Z [2024-04-21 02:50:58,518: INFO/ForkPoolWorker-15] [20b78738-907c-476b-afa7-ff4936e3e261] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240421025058_856258', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-21T02:50:58.851825097Z [2024-04-21 02:50:58,848: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-21T02:50:59.137366717Z [2024-04-21 02:50:59,137: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:50:59.830718105Z [2024-04-21 02:50:59,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20b78738-907c-476b-afa7-ff4936e3e261] succeeded in 1.3252721170010773s: None 2024-04-21T02:51:00.720821529Z [2024-04-21 02:51:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3e4f5b2-4b32-4c04-94a9-a2b03cda8d93] received 2024-04-21T02:51:00.731208786Z [2024-04-21 02:51:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00444f40-c7f7-4dd4-94b9-eb17c39a7f36] received 2024-04-21T02:51:00.733221504Z [2024-04-21 02:51:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9b42435-8aef-4a24-8fdc-5e2a61a9e3d6] received 2024-04-21T02:51:00.736601721Z [2024-04-21 02:51:00,736: INFO/ForkPoolWorker-15] [a3e4f5b2-4b32-4c04-94a9-a2b03cda8d93] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:51:00.743170401Z [2024-04-21 02:51:00,742: INFO/ForkPoolWorker-1] [d9b42435-8aef-4a24-8fdc-5e2a61a9e3d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:51:00.747710999Z [2024-04-21 02:51:00,747: INFO/ForkPoolWorker-16] [00444f40-c7f7-4dd4-94b9-eb17c39a7f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:51:01.017843808Z [2024-04-21 02:51:01,014: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:51:01.075720480Z [2024-04-21 02:51:01,070: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:51:01.122714047Z [2024-04-21 02:51:01,117: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:51:01.210949624Z [2024-04-21 02:51:01,210: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:51:01.215214785Z [2024-04-21 02:51:01,214: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:51:01.263031019Z [2024-04-21 02:51:01,262: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:51:01.268823592Z [2024-04-21 02:51:01,268: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:51:01.269056044Z [2024-04-21 02:51:01,268: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:51:01.269230860Z [2024-04-21 02:51:01,269: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:51:01.269601378Z [2024-04-21 02:51:01,269: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:51:01.408665510Z [2024-04-21 02:51:01,408: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:51:02.275569282Z [2024-04-21 02:51:02,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3e4f5b2-4b32-4c04-94a9-a2b03cda8d93] succeeded in 1.5531093520003196s: None 2024-04-21T02:51:02.553799362Z [2024-04-21 02:51:02,553: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:51:02.557286348Z [2024-04-21 02:51:02,556: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:51:02.578698036Z [2024-04-21 02:51:02,578: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:51:02.579820555Z [2024-04-21 02:51:02,579: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:51:02.579837728Z [2024-04-21 02:51:02,579: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:51:02.579952607Z [2024-04-21 02:51:02,579: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:51:02.580024715Z [2024-04-21 02:51:02,579: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:51:02.580344278Z [2024-04-21 02:51:02,580: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:51:02.580448869Z [2024-04-21 02:51:02,580: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:51:02.659153799Z [2024-04-21 02:51:02,658: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:51:02.669475489Z [2024-04-21 02:51:02,669: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:51:02.673141285Z [2024-04-21 02:51:02,672: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:51:02.697034143Z [2024-04-21 02:51:02,696: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:51:02.700790463Z [2024-04-21 02:51:02,700: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:51:02.700834929Z [2024-04-21 02:51:02,700: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:51:02.700984009Z [2024-04-21 02:51:02,700: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:51:02.701360622Z [2024-04-21 02:51:02,701: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:51:02.702095295Z [2024-04-21 02:51:02,701: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:51:02.702270068Z [2024-04-21 02:51:02,702: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:51:02.845908558Z [2024-04-21 02:51:02,845: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:51:04.885707472Z [2024-04-21 02:51:04,885: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9b42435-8aef-4a24-8fdc-5e2a61a9e3d6] succeeded in 4.1510044320002635s: None 2024-04-21T02:51:06.010009046Z [2024-04-21 02:51:06,008: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[00444f40-c7f7-4dd4-94b9-eb17c39a7f36] succeeded in 5.273673237999901s: None 2024-04-21T02:52:01.062753102Z [2024-04-21 02:52:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[daf8143b-0ac3-43b4-9416-34eb953842db] received 2024-04-21T02:52:01.076153634Z [2024-04-21 02:52:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c23c5697-4a5b-46c0-9d60-8f15c1745c87] received 2024-04-21T02:52:01.099748600Z [2024-04-21 02:52:01,082: INFO/ForkPoolWorker-16] [c23c5697-4a5b-46c0-9d60-8f15c1745c87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:52:01.099773131Z [2024-04-21 02:52:01,091: INFO/ForkPoolWorker-15] [daf8143b-0ac3-43b4-9416-34eb953842db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:52:01.104653882Z [2024-04-21 02:52:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb3b3530-05f1-4d83-ae21-1ac987a66517] received 2024-04-21T02:52:01.104682682Z [2024-04-21 02:52:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4b31694-b813-49c5-a162-b08516eb4d49] received 2024-04-21T02:52:01.115982248Z [2024-04-21 02:52:01,112: INFO/ForkPoolWorker-1] [cb3b3530-05f1-4d83-ae21-1ac987a66517] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:52:01.122922620Z [2024-04-21 02:52:01,120: INFO/ForkPoolWorker-2] [d4b31694-b813-49c5-a162-b08516eb4d49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:52:01.491879556Z [2024-04-21 02:52:01,484: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:52:01.645572133Z [2024-04-21 02:52:01,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:52:01.706457047Z [2024-04-21 02:52:01,700: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:52:01.799736988Z [2024-04-21 02:52:01,791: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:52:01.927436529Z [2024-04-21 02:52:01,927: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:52:02.168627767Z [2024-04-21 02:52:02,168: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:52:02.178726381Z [2024-04-21 02:52:02,178: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:52:02.222755243Z [2024-04-21 02:52:02,222: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:52:02.223895098Z [2024-04-21 02:52:02,223: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:52:02.223952287Z [2024-04-21 02:52:02,223: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:52:02.223989540Z [2024-04-21 02:52:02,223: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:52:02.224393983Z [2024-04-21 02:52:02,224: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:52:02.324757126Z [2024-04-21 02:52:02,324: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:52:02.492660545Z [2024-04-21 02:52:02,492: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[daf8143b-0ac3-43b4-9416-34eb953842db] succeeded in 1.4196106430008513s: None 2024-04-21T02:52:02.994526268Z [2024-04-21 02:52:02,994: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb3b3530-05f1-4d83-ae21-1ac987a66517] succeeded in 1.896673211000234s: None 2024-04-21T02:52:03.048573788Z [2024-04-21 02:52:03,048: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:52:03.051852185Z [2024-04-21 02:52:03,051: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:52:03.072795996Z [2024-04-21 02:52:03,072: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:52:03.074211982Z [2024-04-21 02:52:03,073: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:52:03.074279760Z [2024-04-21 02:52:03,074: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:52:03.074486638Z [2024-04-21 02:52:03,074: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:52:03.074572327Z [2024-04-21 02:52:03,074: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:52:03.075200348Z [2024-04-21 02:52:03,075: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:52:03.075275627Z [2024-04-21 02:52:03,075: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:52:03.159501037Z [2024-04-21 02:52:03,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:52:03.253499062Z [2024-04-21 02:52:03,253: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:52:03.259761770Z [2024-04-21 02:52:03,258: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:52:03.289234818Z [2024-04-21 02:52:03,289: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:52:03.290848009Z [2024-04-21 02:52:03,290: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:52:03.290980809Z [2024-04-21 02:52:03,290: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:52:03.291225508Z [2024-04-21 02:52:03,291: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:52:03.291349590Z [2024-04-21 02:52:03,291: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:52:03.291796375Z [2024-04-21 02:52:03,291: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:52:03.291942520Z [2024-04-21 02:52:03,291: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:52:03.397566497Z [2024-04-21 02:52:03,397: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:52:05.472364033Z [2024-04-21 02:52:05,471: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d4b31694-b813-49c5-a162-b08516eb4d49] succeeded in 4.362601530001484s: None 2024-04-21T02:52:06.171409619Z [2024-04-21 02:52:06,170: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c23c5697-4a5b-46c0-9d60-8f15c1745c87] succeeded in 5.097773620998851s: None 2024-04-21T02:53:00.392422258Z [2024-04-21 02:53:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f62d04bd-075d-45a9-a138-a2f8cef14375] received 2024-04-21T02:53:00.417363421Z [2024-04-21 02:53:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e8d6b2e-aea7-4dc9-b131-65e35c0ac003] received 2024-04-21T02:53:00.419772256Z [2024-04-21 02:53:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[964433ed-a664-4236-98ae-1cf95d44632a] received 2024-04-21T02:53:00.426154825Z [2024-04-21 02:53:00,425: INFO/ForkPoolWorker-15] [f62d04bd-075d-45a9-a138-a2f8cef14375] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:53:00.434963545Z [2024-04-21 02:53:00,434: INFO/ForkPoolWorker-16] [5e8d6b2e-aea7-4dc9-b131-65e35c0ac003] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:53:00.444698762Z [2024-04-21 02:53:00,444: INFO/ForkPoolWorker-1] [964433ed-a664-4236-98ae-1cf95d44632a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:53:00.739371398Z [2024-04-21 02:53:00,736: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:53:00.766492416Z [2024-04-21 02:53:00,761: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:53:00.777732294Z [2024-04-21 02:53:00,773: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:53:00.904973654Z [2024-04-21 02:53:00,904: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:53:00.908976821Z [2024-04-21 02:53:00,908: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:53:00.942124602Z [2024-04-21 02:53:00,941: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:53:00.943780727Z [2024-04-21 02:53:00,943: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:53:00.943968575Z [2024-04-21 02:53:00,943: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:53:00.944011752Z [2024-04-21 02:53:00,943: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:53:00.944313844Z [2024-04-21 02:53:00,944: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:53:01.034091793Z [2024-04-21 02:53:01,033: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:53:01.618264450Z [2024-04-21 02:53:01,617: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e8d6b2e-aea7-4dc9-b131-65e35c0ac003] succeeded in 1.1975946069997008s: None 2024-04-21T02:53:02.161104579Z [2024-04-21 02:53:02,160: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:53:02.164451096Z [2024-04-21 02:53:02,164: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:53:02.228223687Z [2024-04-21 02:53:02,227: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:53:02.230817128Z [2024-04-21 02:53:02,230: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:53:02.231079323Z [2024-04-21 02:53:02,230: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:53:02.231350377Z [2024-04-21 02:53:02,231: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:53:02.231504859Z [2024-04-21 02:53:02,231: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:53:02.231955076Z [2024-04-21 02:53:02,231: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:53:02.232234133Z [2024-04-21 02:53:02,231: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:53:02.331641748Z [2024-04-21 02:53:02,331: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:53:02.335009017Z [2024-04-21 02:53:02,334: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:53:02.374104543Z [2024-04-21 02:53:02,373: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:53:02.382513438Z [2024-04-21 02:53:02,382: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:53:02.382573981Z [2024-04-21 02:53:02,382: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:53:02.382707676Z [2024-04-21 02:53:02,382: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:53:02.382777201Z [2024-04-21 02:53:02,382: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:53:02.383123458Z [2024-04-21 02:53:02,382: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:53:02.383187981Z [2024-04-21 02:53:02,383: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:53:02.413551505Z [2024-04-21 02:53:02,413: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:53:02.535223747Z [2024-04-21 02:53:02,534: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:53:05.812967485Z [2024-04-21 02:53:05,812: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[964433ed-a664-4236-98ae-1cf95d44632a] succeeded in 5.388610649999464s: None 2024-04-21T02:53:06.536045856Z [2024-04-21 02:53:06,535: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f62d04bd-075d-45a9-a138-a2f8cef14375] succeeded in 6.124876976000451s: None 2024-04-21T02:54:00.242498328Z [2024-04-21 02:54:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aad13214-3427-4e86-8cb8-c90729dd2fae] received 2024-04-21T02:54:00.245647314Z [2024-04-21 02:54:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cd8a221-26ec-4d99-a6eb-9c290cf12f2d] received 2024-04-21T02:54:00.254961794Z [2024-04-21 02:54:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42398960-efee-4528-8130-efb54793e349] received 2024-04-21T02:54:00.255693473Z [2024-04-21 02:54:00,255: INFO/ForkPoolWorker-16] [9cd8a221-26ec-4d99-a6eb-9c290cf12f2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:54:00.264850405Z [2024-04-21 02:54:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9c38a04-955c-461a-b52c-86b08e1e7d91] received 2024-04-21T02:54:00.269377237Z [2024-04-21 02:54:00,268: INFO/ForkPoolWorker-15] [aad13214-3427-4e86-8cb8-c90729dd2fae] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:54:00.271030636Z [2024-04-21 02:54:00,270: INFO/ForkPoolWorker-1] [42398960-efee-4528-8130-efb54793e349] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:54:00.279439461Z [2024-04-21 02:54:00,278: INFO/ForkPoolWorker-2] [d9c38a04-955c-461a-b52c-86b08e1e7d91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:54:00.667943463Z [2024-04-21 02:54:00,664: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:54:00.676591466Z [2024-04-21 02:54:00,673: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:54:00.689347152Z [2024-04-21 02:54:00,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:54:00.850995845Z [2024-04-21 02:54:00,845: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:54:00.871964514Z [2024-04-21 02:54:00,871: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T02:54:00.876535283Z [2024-04-21 02:54:00,876: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:54:00.911088718Z [2024-04-21 02:54:00,910: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:54:00.912541083Z [2024-04-21 02:54:00,912: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:54:00.912746119Z [2024-04-21 02:54:00,912: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:54:00.912891114Z [2024-04-21 02:54:00,912: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T02:54:00.913232982Z [2024-04-21 02:54:00,913: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:54:01.002500624Z [2024-04-21 02:54:01,002: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:54:01.021735369Z [2024-04-21 02:54:01,021: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:54:01.640441852Z [2024-04-21 02:54:01,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aad13214-3427-4e86-8cb8-c90729dd2fae] succeeded in 1.3931130940000003s: None 2024-04-21T02:54:01.773444940Z [2024-04-21 02:54:01,773: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9cd8a221-26ec-4d99-a6eb-9c290cf12f2d] succeeded in 1.5245605670006626s: None 2024-04-21T02:54:02.172723331Z [2024-04-21 02:54:02,171: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:54:02.176157692Z [2024-04-21 02:54:02,175: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:54:02.200602299Z [2024-04-21 02:54:02,200: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:54:02.204640681Z [2024-04-21 02:54:02,204: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:54:02.204805450Z [2024-04-21 02:54:02,204: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:54:02.205015195Z [2024-04-21 02:54:02,204: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:54:02.205186826Z [2024-04-21 02:54:02,204: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:54:02.205516145Z [2024-04-21 02:54:02,205: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:54:02.205681032Z [2024-04-21 02:54:02,205: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:54:02.281802244Z [2024-04-21 02:54:02,281: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:54:02.340812369Z [2024-04-21 02:54:02,340: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:54:02.344668553Z [2024-04-21 02:54:02,344: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:54:02.377918900Z [2024-04-21 02:54:02,377: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:54:02.379887562Z [2024-04-21 02:54:02,379: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:54:02.380016299Z [2024-04-21 02:54:02,379: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:54:02.380228855Z [2024-04-21 02:54:02,379: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:54:02.380344468Z [2024-04-21 02:54:02,380: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:54:02.380744999Z [2024-04-21 02:54:02,380: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:54:02.380863777Z [2024-04-21 02:54:02,380: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:54:02.465149189Z [2024-04-21 02:54:02,464: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:54:04.468402503Z [2024-04-21 02:54:04,467: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d9c38a04-955c-461a-b52c-86b08e1e7d91] succeeded in 4.200164670999584s: None 2024-04-21T02:54:04.669931560Z [2024-04-21 02:54:04,669: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42398960-efee-4528-8130-efb54793e349] succeeded in 4.4051805090002745s: None 2024-04-21T02:55:01.059486192Z [2024-04-21 02:55:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12dde0fc-86a4-49b0-825f-dfdc763f04ab] received 2024-04-21T02:55:01.071063924Z [2024-04-21 02:55:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6bb8486-0c1f-4f9b-85e1-8e681187ccea] received 2024-04-21T02:55:01.074952574Z [2024-04-21 02:55:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fb2e63c-da29-496a-8d6f-09ab3fb748fd] received 2024-04-21T02:55:01.080884226Z [2024-04-21 02:55:01,079: INFO/ForkPoolWorker-15] [12dde0fc-86a4-49b0-825f-dfdc763f04ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:55:01.080951855Z [2024-04-21 02:55:01,080: INFO/ForkPoolWorker-16] [b6bb8486-0c1f-4f9b-85e1-8e681187ccea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:55:01.100371183Z [2024-04-21 02:55:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae51be8b-31e6-4fcd-b553-f467a3c3dfa1] received 2024-04-21T02:55:01.107597779Z [2024-04-21 02:55:01,107: INFO/ForkPoolWorker-1] [0fb2e63c-da29-496a-8d6f-09ab3fb748fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:55:01.107621421Z [2024-04-21 02:55:01,107: INFO/ForkPoolWorker-2] [ae51be8b-31e6-4fcd-b553-f467a3c3dfa1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:55:01.438729606Z [2024-04-21 02:55:01,433: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:55:01.624020553Z [2024-04-21 02:55:01,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:55:01.625689738Z [2024-04-21 02:55:01,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:55:01.686909803Z [2024-04-21 02:55:01,682: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:55:01.937153409Z [2024-04-21 02:55:01,936: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T02:55:01.945554557Z [2024-04-21 02:55:01,945: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:55:02.012718265Z [2024-04-21 02:55:02,012: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:55:02.023681938Z [2024-04-21 02:55:02,023: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:55:02.023711820Z [2024-04-21 02:55:02,023: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:55:02.023761708Z [2024-04-21 02:55:02,023: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T02:55:02.024050701Z [2024-04-21 02:55:02,023: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:55:02.144355868Z [2024-04-21 02:55:02,144: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:55:03.017231999Z [2024-04-21 02:55:03,016: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0fb2e63c-da29-496a-8d6f-09ab3fb748fd] succeeded in 1.9370427499998186s: None 2024-04-21T02:55:03.227860308Z [2024-04-21 02:55:03,226: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T02:55:03.233385543Z [2024-04-21 02:55:03,232: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:55:03.275745265Z [2024-04-21 02:55:03,275: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:55:03.277184369Z [2024-04-21 02:55:03,276: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:55:03.278036269Z [2024-04-21 02:55:03,277: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:55:03.278273678Z [2024-04-21 02:55:03,278: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:55:03.278343999Z [2024-04-21 02:55:03,278: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T02:55:03.279108685Z [2024-04-21 02:55:03,278: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:55:03.279137816Z [2024-04-21 02:55:03,279: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:55:03.303717053Z [2024-04-21 02:55:03,303: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:55:03.307101173Z [2024-04-21 02:55:03,306: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:55:03.341881414Z [2024-04-21 02:55:03,341: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:55:03.343360930Z [2024-04-21 02:55:03,343: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:55:03.343487277Z [2024-04-21 02:55:03,343: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:55:03.343692277Z [2024-04-21 02:55:03,343: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:55:03.343819381Z [2024-04-21 02:55:03,343: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:55:03.344239432Z [2024-04-21 02:55:03,343: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:55:03.344318343Z [2024-04-21 02:55:03,344: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:55:03.390536539Z [2024-04-21 02:55:03,390: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:55:03.500624389Z [2024-04-21 02:55:03,500: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:55:03.504809812Z [2024-04-21 02:55:03,504: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:55:03.513443266Z [2024-04-21 02:55:03,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:55:03.545979848Z [2024-04-21 02:55:03,545: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:55:03.549936762Z [2024-04-21 02:55:03,549: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:55:03.549966318Z [2024-04-21 02:55:03,549: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:55:03.550142027Z [2024-04-21 02:55:03,549: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:55:03.550199336Z [2024-04-21 02:55:03,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:55:03.550413119Z [2024-04-21 02:55:03,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:55:03.550426520Z [2024-04-21 02:55:03,550: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:55:03.650576278Z [2024-04-21 02:55:03,650: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:55:04.481482923Z [2024-04-21 02:55:04,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12dde0fc-86a4-49b0-825f-dfdc763f04ab] succeeded in 3.4178671540012147s: None 2024-04-21T02:55:05.177433365Z [2024-04-21 02:55:05,176: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ae51be8b-31e6-4fcd-b553-f467a3c3dfa1] succeeded in 4.07705156800148s: None 2024-04-21T02:55:05.393626263Z [2024-04-21 02:55:05,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f4446e7-e573-4cf9-9e24-935a1c21e62e] received 2024-04-21T02:55:05.400726226Z [2024-04-21 02:55:05,400: INFO/ForkPoolWorker-15] [1f4446e7-e573-4cf9-9e24-935a1c21e62e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:55:05.708508774Z [2024-04-21 02:55:05,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:55:05.877888244Z [2024-04-21 02:55:05,877: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6bb8486-0c1f-4f9b-85e1-8e681187ccea] succeeded in 4.804062142999101s: None 2024-04-21T02:55:06.891075129Z [2024-04-21 02:55:06,890: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:55:06.894338830Z [2024-04-21 02:55:06,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:55:06.918128004Z [2024-04-21 02:55:06,917: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:55:06.919620422Z [2024-04-21 02:55:06,919: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:55:06.919636326Z [2024-04-21 02:55:06,919: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:55:06.919922508Z [2024-04-21 02:55:06,919: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:55:06.919936348Z [2024-04-21 02:55:06,919: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:55:06.920752191Z [2024-04-21 02:55:06,920: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:55:06.920833120Z [2024-04-21 02:55:06,920: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:55:07.025888237Z [2024-04-21 02:55:07,025: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:55:07.740308131Z [2024-04-21 02:55:07,739: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f4446e7-e573-4cf9-9e24-935a1c21e62e] succeeded in 2.3441673920005996s: None 2024-04-21T02:55:07.863470207Z [2024-04-21 02:55:07,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eef3f6b7-18e6-437f-bd16-a50fc0229acf] received 2024-04-21T02:55:07.875792476Z [2024-04-21 02:55:07,875: INFO/ForkPoolWorker-15] [eef3f6b7-18e6-437f-bd16-a50fc0229acf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T02:55:08.215817172Z [2024-04-21 02:55:08,212: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:55:09.391070474Z [2024-04-21 02:55:09,390: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:55:09.394332670Z [2024-04-21 02:55:09,393: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:55:09.422406980Z [2024-04-21 02:55:09,422: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:55:09.423948492Z [2024-04-21 02:55:09,423: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:55:09.424000538Z [2024-04-21 02:55:09,423: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:55:09.424312816Z [2024-04-21 02:55:09,423: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:55:09.424386035Z [2024-04-21 02:55:09,424: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:55:09.424887740Z [2024-04-21 02:55:09,424: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:55:09.424918557Z [2024-04-21 02:55:09,424: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:55:09.529008516Z [2024-04-21 02:55:09,528: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:55:10.228899824Z [2024-04-21 02:55:10,228: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eef3f6b7-18e6-437f-bd16-a50fc0229acf] succeeded in 2.3627274570008012s: None 2024-04-21T02:55:10.247348629Z [2024-04-21 02:55:10,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3c15db2-f0b4-47e6-b386-3a2c28896cc2] received 2024-04-21T02:55:10.258131912Z [2024-04-21 02:55:10,257: INFO/ForkPoolWorker-15] [d3c15db2-f0b4-47e6-b386-3a2c28896cc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T02:55:10.545415459Z [2024-04-21 02:55:10,542: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T02:55:11.662144513Z [2024-04-21 02:55:11,661: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:55:11.666816754Z [2024-04-21 02:55:11,666: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:55:11.696123157Z [2024-04-21 02:55:11,695: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:55:11.699042217Z [2024-04-21 02:55:11,698: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:55:11.699180358Z [2024-04-21 02:55:11,699: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:55:11.699396685Z [2024-04-21 02:55:11,699: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:55:11.699530657Z [2024-04-21 02:55:11,699: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:55:11.700009466Z [2024-04-21 02:55:11,699: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T02:55:11.700099794Z [2024-04-21 02:55:11,699: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:55:11.831320644Z [2024-04-21 02:55:11,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:55:12.588835913Z [2024-04-21 02:55:12,587: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3c15db2-f0b4-47e6-b386-3a2c28896cc2] succeeded in 2.33804651599894s: None 2024-04-21T02:56:00.231103466Z [2024-04-21 02:56:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc09f185-dd65-4b8c-8774-014c60127239] received 2024-04-21T02:56:00.233412945Z [2024-04-21 02:56:00,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[425492aa-fa71-4978-8186-1d76cae75b18] received 2024-04-21T02:56:00.240017389Z [2024-04-21 02:56:00,239: INFO/ForkPoolWorker-15] [cc09f185-dd65-4b8c-8774-014c60127239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:56:00.241540305Z [2024-04-21 02:56:00,241: INFO/ForkPoolWorker-16] [425492aa-fa71-4978-8186-1d76cae75b18] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:56:00.246996359Z [2024-04-21 02:56:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[839a3d3b-9f45-416d-bb3c-ff5afb2d2f67] received 2024-04-21T02:56:00.252558621Z [2024-04-21 02:56:00,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a80d2e96-cb47-4432-a863-a7a3ca506d4f] received 2024-04-21T02:56:00.269023054Z [2024-04-21 02:56:00,268: INFO/ForkPoolWorker-1] [839a3d3b-9f45-416d-bb3c-ff5afb2d2f67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:56:00.278490143Z [2024-04-21 02:56:00,277: INFO/ForkPoolWorker-2] [a80d2e96-cb47-4432-a863-a7a3ca506d4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:56:00.616115239Z [2024-04-21 02:56:00,613: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:56:00.685489835Z [2024-04-21 02:56:00,682: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:56:00.692909869Z [2024-04-21 02:56:00,686: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:56:00.761593101Z [2024-04-21 02:56:00,758: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:56:00.870068783Z [2024-04-21 02:56:00,869: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:56:01.012600963Z [2024-04-21 02:56:01,012: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T02:56:01.029177202Z [2024-04-21 02:56:01,028: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:56:01.064624586Z [2024-04-21 02:56:01,064: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:56:01.069212094Z [2024-04-21 02:56:01,068: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:56:01.069410248Z [2024-04-21 02:56:01,069: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:56:01.069521973Z [2024-04-21 02:56:01,069: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T02:56:01.069801405Z [2024-04-21 02:56:01,069: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:56:01.230430121Z [2024-04-21 02:56:01,230: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:56:01.570347099Z [2024-04-21 02:56:01,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[425492aa-fa71-4978-8186-1d76cae75b18] succeeded in 1.335390799000379s: None 2024-04-21T02:56:01.982789790Z [2024-04-21 02:56:01,982: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a80d2e96-cb47-4432-a863-a7a3ca506d4f] succeeded in 1.714121877999787s: None 2024-04-21T02:56:02.371577879Z [2024-04-21 02:56:02,371: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:56:02.374803938Z [2024-04-21 02:56:02,374: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:56:02.436451004Z [2024-04-21 02:56:02,436: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:56:02.442343344Z [2024-04-21 02:56:02,442: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:56:02.442398883Z [2024-04-21 02:56:02,442: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:56:02.442472280Z [2024-04-21 02:56:02,442: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:56:02.442543612Z [2024-04-21 02:56:02,442: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:56:02.442807545Z [2024-04-21 02:56:02,442: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:56:02.442874009Z [2024-04-21 02:56:02,442: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:56:02.531004856Z [2024-04-21 02:56:02,530: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:56:02.546077307Z [2024-04-21 02:56:02,545: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:56:02.549654972Z [2024-04-21 02:56:02,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:56:02.576800458Z [2024-04-21 02:56:02,576: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:56:02.579811166Z [2024-04-21 02:56:02,579: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:56:02.579842074Z [2024-04-21 02:56:02,579: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:56:02.579932666Z [2024-04-21 02:56:02,579: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:56:02.579946343Z [2024-04-21 02:56:02,579: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:56:02.580214418Z [2024-04-21 02:56:02,580: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:56:02.580245966Z [2024-04-21 02:56:02,580: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:56:02.673176961Z [2024-04-21 02:56:02,672: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:56:04.211529388Z [2024-04-21 02:56:04,209: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[839a3d3b-9f45-416d-bb3c-ff5afb2d2f67] succeeded in 3.9550233879999723s: None 2024-04-21T02:56:05.425818254Z [2024-04-21 02:56:05,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc09f185-dd65-4b8c-8774-014c60127239] succeeded in 5.1929910050002945s: None 2024-04-21T02:57:01.258848091Z [2024-04-21 02:57:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf8ae69b-914d-45bc-bb9b-ee36c5c272c4] received 2024-04-21T02:57:01.262238876Z [2024-04-21 02:57:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94d4a56e-7e86-47c2-baf2-79099e632310] received 2024-04-21T02:57:01.273459883Z [2024-04-21 02:57:01,272: INFO/ForkPoolWorker-16] [94d4a56e-7e86-47c2-baf2-79099e632310] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:57:01.277318455Z [2024-04-21 02:57:01,276: INFO/ForkPoolWorker-15] [cf8ae69b-914d-45bc-bb9b-ee36c5c272c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:57:01.279908359Z [2024-04-21 02:57:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da456ad4-eb76-40e8-aee5-1d9865cf2864] received 2024-04-21T02:57:01.309630050Z [2024-04-21 02:57:01,309: INFO/ForkPoolWorker-1] [da456ad4-eb76-40e8-aee5-1d9865cf2864] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:57:01.783521771Z [2024-04-21 02:57:01,779: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:57:01.817385791Z [2024-04-21 02:57:01,793: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:57:01.891640085Z [2024-04-21 02:57:01,888: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:57:02.005715317Z [2024-04-21 02:57:02,005: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:57:02.009638072Z [2024-04-21 02:57:02,009: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:57:02.042424812Z [2024-04-21 02:57:02,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:57:02.044210989Z [2024-04-21 02:57:02,043: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:57:02.044413657Z [2024-04-21 02:57:02,044: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:57:02.044514714Z [2024-04-21 02:57:02,044: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:57:02.045211429Z [2024-04-21 02:57:02,045: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:57:02.138441934Z [2024-04-21 02:57:02,138: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:57:02.839803558Z [2024-04-21 02:57:02,839: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf8ae69b-914d-45bc-bb9b-ee36c5c272c4] succeeded in 1.5783438859998569s: None 2024-04-21T02:57:03.282610693Z [2024-04-21 02:57:03,282: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:57:03.285851963Z [2024-04-21 02:57:03,285: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:57:03.311691455Z [2024-04-21 02:57:03,311: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:57:03.316815607Z [2024-04-21 02:57:03,316: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:57:03.316903315Z [2024-04-21 02:57:03,316: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:57:03.317073159Z [2024-04-21 02:57:03,316: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:57:03.317152579Z [2024-04-21 02:57:03,317: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:57:03.317466056Z [2024-04-21 02:57:03,317: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:57:03.317585492Z [2024-04-21 02:57:03,317: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:57:03.386619405Z [2024-04-21 02:57:03,386: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:57:03.389634129Z [2024-04-21 02:57:03,389: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:57:03.403376579Z [2024-04-21 02:57:03,403: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:57:03.431193819Z [2024-04-21 02:57:03,430: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:57:03.433424570Z [2024-04-21 02:57:03,433: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:57:03.434124436Z [2024-04-21 02:57:03,433: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:57:03.434261297Z [2024-04-21 02:57:03,434: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:57:03.434331305Z [2024-04-21 02:57:03,434: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:57:03.434586403Z [2024-04-21 02:57:03,434: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:57:03.434670077Z [2024-04-21 02:57:03,434: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:57:03.554390395Z [2024-04-21 02:57:03,554: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:57:05.523902241Z [2024-04-21 02:57:05,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da456ad4-eb76-40e8-aee5-1d9865cf2864] succeeded in 4.239614101999905s: None 2024-04-21T02:57:06.116975701Z [2024-04-21 02:57:06,116: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94d4a56e-7e86-47c2-baf2-79099e632310] succeeded in 4.851653656998678s: None 2024-04-21T02:58:00.440851326Z [2024-04-21 02:58:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7f4b0eb-2983-4e39-bc7e-e93af10a268f] received 2024-04-21T02:58:00.442890822Z [2024-04-21 02:58:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[849d3ce4-2d15-4d4a-a4fa-c51d7b19a2d6] received 2024-04-21T02:58:00.443867525Z [2024-04-21 02:58:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16ee6843-5abd-4faa-a196-3c1841312d65] received 2024-04-21T02:58:00.453900969Z [2024-04-21 02:58:00,453: INFO/ForkPoolWorker-15] [f7f4b0eb-2983-4e39-bc7e-e93af10a268f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:58:00.454562542Z [2024-04-21 02:58:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[628ed07a-c7dc-4b5e-ac60-a0f926f60b80] received 2024-04-21T02:58:00.456790993Z [2024-04-21 02:58:00,456: INFO/ForkPoolWorker-1] [16ee6843-5abd-4faa-a196-3c1841312d65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:58:00.463048808Z [2024-04-21 02:58:00,461: INFO/ForkPoolWorker-16] [849d3ce4-2d15-4d4a-a4fa-c51d7b19a2d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T02:58:00.470904351Z [2024-04-21 02:58:00,470: INFO/ForkPoolWorker-2] [628ed07a-c7dc-4b5e-ac60-a0f926f60b80] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:58:00.871377710Z [2024-04-21 02:58:00,868: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:58:00.872699979Z [2024-04-21 02:58:00,869: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T02:58:00.964074484Z [2024-04-21 02:58:00,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:58:01.032497902Z [2024-04-21 02:58:01,029: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:58:01.162281174Z [2024-04-21 02:58:01,162: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:58:01.273773699Z [2024-04-21 02:58:01,273: INFO/ForkPoolWorker-2] Getting SDNC list 2024-04-21T02:58:01.277892656Z [2024-04-21 02:58:01,277: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:58:01.308040607Z [2024-04-21 02:58:01,307: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T02:58:01.313331630Z [2024-04-21 02:58:01,313: INFO/ForkPoolWorker-2] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:58:01.313508736Z [2024-04-21 02:58:01,313: INFO/ForkPoolWorker-2] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:58:01.313580830Z [2024-04-21 02:58:01,313: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-04-21T02:58:01.313818851Z [2024-04-21 02:58:01,313: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:58:01.400224079Z [2024-04-21 02:58:01,399: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:58:01.929912990Z [2024-04-21 02:58:01,922: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[849d3ce4-2d15-4d4a-a4fa-c51d7b19a2d6] succeeded in 1.4777522900003532s: None 2024-04-21T02:58:02.115755663Z [2024-04-21 02:58:02,115: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[628ed07a-c7dc-4b5e-ac60-a0f926f60b80] succeeded in 1.6564343469999585s: None 2024-04-21T02:58:02.345919078Z [2024-04-21 02:58:02,345: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:58:02.349214112Z [2024-04-21 02:58:02,348: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:58:02.376953092Z [2024-04-21 02:58:02,376: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:58:02.378926925Z [2024-04-21 02:58:02,378: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:58:02.379126376Z [2024-04-21 02:58:02,378: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:58:02.379396296Z [2024-04-21 02:58:02,379: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:58:02.379589390Z [2024-04-21 02:58:02,379: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:58:02.380425005Z [2024-04-21 02:58:02,380: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:58:02.380606184Z [2024-04-21 02:58:02,380: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:58:02.461862647Z [2024-04-21 02:58:02,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T02:58:02.465018544Z [2024-04-21 02:58:02,464: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:58:02.469248109Z [2024-04-21 02:58:02,469: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:58:02.492201935Z [2024-04-21 02:58:02,491: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:58:02.493508112Z [2024-04-21 02:58:02,493: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:58:02.493524164Z [2024-04-21 02:58:02,493: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:58:02.493641056Z [2024-04-21 02:58:02,493: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:58:02.493673693Z [2024-04-21 02:58:02,493: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T02:58:02.493871222Z [2024-04-21 02:58:02,493: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:58:02.493901339Z [2024-04-21 02:58:02,493: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:58:02.579044234Z [2024-04-21 02:58:02,578: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:58:03.997441802Z [2024-04-21 02:58:03,997: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[16ee6843-5abd-4faa-a196-3c1841312d65] succeeded in 3.5470874549992004s: None 2024-04-21T02:58:04.707251733Z [2024-04-21 02:58:04,706: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7f4b0eb-2983-4e39-bc7e-e93af10a268f] succeeded in 4.264019062999068s: None 2024-04-21T02:59:00.660499751Z [2024-04-21 02:59:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc007a87-6528-492e-b213-b60e9fe1f426] received 2024-04-21T02:59:00.669820568Z [2024-04-21 02:59:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f23b0911-07f1-4039-9fe8-d7ed2a8d599f] received 2024-04-21T02:59:00.672041191Z [2024-04-21 02:59:00,671: INFO/ForkPoolWorker-15] [cc007a87-6528-492e-b213-b60e9fe1f426] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T02:59:00.676704155Z [2024-04-21 02:59:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0391af89-b8e0-4593-81c0-65111cf4a627] received 2024-04-21T02:59:00.685645594Z [2024-04-21 02:59:00,685: INFO/ForkPoolWorker-16] [f23b0911-07f1-4039-9fe8-d7ed2a8d599f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T02:59:00.694158291Z [2024-04-21 02:59:00,693: INFO/ForkPoolWorker-1] [0391af89-b8e0-4593-81c0-65111cf4a627] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T02:59:01.006064680Z [2024-04-21 02:59:01,002: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T02:59:01.007223156Z [2024-04-21 02:59:00,998: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T02:59:01.012230325Z [2024-04-21 02:59:01,008: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T02:59:01.183766414Z [2024-04-21 02:59:01,183: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T02:59:01.188495073Z [2024-04-21 02:59:01,187: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:59:01.222212167Z [2024-04-21 02:59:01,222: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T02:59:01.223546579Z [2024-04-21 02:59:01,223: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T02:59:01.223710456Z [2024-04-21 02:59:01,223: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T02:59:01.223763248Z [2024-04-21 02:59:01,223: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T02:59:01.223985283Z [2024-04-21 02:59:01,223: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T02:59:01.338413584Z [2024-04-21 02:59:01,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:59:02.003727245Z [2024-04-21 02:59:02,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc007a87-6528-492e-b213-b60e9fe1f426] succeeded in 1.3402322710007866s: None 2024-04-21T02:59:02.415649121Z [2024-04-21 02:59:02,415: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T02:59:02.421761419Z [2024-04-21 02:59:02,421: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:59:02.456709618Z [2024-04-21 02:59:02,456: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T02:59:02.458421952Z [2024-04-21 02:59:02,458: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:59:02.458631785Z [2024-04-21 02:59:02,458: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:59:02.458971932Z [2024-04-21 02:59:02,458: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:59:02.459179166Z [2024-04-21 02:59:02,459: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T02:59:02.459582847Z [2024-04-21 02:59:02,459: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T02:59:02.459851757Z [2024-04-21 02:59:02,459: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:59:02.554155168Z [2024-04-21 02:59:02,553: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:59:02.557086396Z [2024-04-21 02:59:02,556: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T02:59:02.561268580Z [2024-04-21 02:59:02,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T02:59:02.583925805Z [2024-04-21 02:59:02,583: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T02:59:02.585019907Z [2024-04-21 02:59:02,584: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T02:59:02.585033892Z [2024-04-21 02:59:02,584: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T02:59:02.585165825Z [2024-04-21 02:59:02,584: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T02:59:02.585180849Z [2024-04-21 02:59:02,585: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T02:59:02.585398876Z [2024-04-21 02:59:02,585: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T02:59:02.585409506Z [2024-04-21 02:59:02,585: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T02:59:02.688718588Z [2024-04-21 02:59:02,688: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T02:59:04.821759172Z [2024-04-21 02:59:04,821: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f23b0911-07f1-4039-9fe8-d7ed2a8d599f] succeeded in 4.150592131998565s: None 2024-04-21T02:59:05.542816685Z [2024-04-21 02:59:05,542: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0391af89-b8e0-4593-81c0-65111cf4a627] succeeded in 4.864393989999371s: None 2024-04-21T03:00:00.997350578Z [2024-04-21 03:00:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f6dbc74-d745-431e-9e5d-7bea3dcb1fe5] received 2024-04-21T03:00:01.000314488Z [2024-04-21 03:00:01,000: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baf1eac0-75e6-465f-94c5-446542519f21] received 2024-04-21T03:00:01.008555815Z [2024-04-21 03:00:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb665d2c-11b2-40c8-8d8f-8266bc21bc70] received 2024-04-21T03:00:01.011976280Z [2024-04-21 03:00:01,011: INFO/ForkPoolWorker-15] [8f6dbc74-d745-431e-9e5d-7bea3dcb1fe5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T03:00:01.015534488Z [2024-04-21 03:00:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d4bb96e-b1c5-4995-9bb6-413a21fe7626] received 2024-04-21T03:00:01.016492300Z [2024-04-21 03:00:01,016: INFO/ForkPoolWorker-1] [cb665d2c-11b2-40c8-8d8f-8266bc21bc70] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:00:01.019738018Z [2024-04-21 03:00:01,019: INFO/ForkPoolWorker-16] [baf1eac0-75e6-465f-94c5-446542519f21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:00:01.029128751Z [2024-04-21 03:00:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9366c797-c3b8-4bd4-8b48-470086238a58] received 2024-04-21T03:00:01.034023315Z [2024-04-21 03:00:01,033: INFO/ForkPoolWorker-2] [4d4bb96e-b1c5-4995-9bb6-413a21fe7626] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T03:00:01.049049685Z [2024-04-21 03:00:01,048: INFO/ForkPoolWorker-3] [9366c797-c3b8-4bd4-8b48-470086238a58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:00:01.457325870Z [2024-04-21 03:00:01,454: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T03:00:01.505628659Z [2024-04-21 03:00:01,500: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:00:01.559921491Z [2024-04-21 03:00:01,553: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:00:01.664721677Z [2024-04-21 03:00:01,657: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:00:01.672527908Z [2024-04-21 03:00:01,665: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T03:00:01.786521297Z [2024-04-21 03:00:01,786: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:00:02.125710151Z [2024-04-21 03:00:02,125: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T03:00:02.152278156Z [2024-04-21 03:00:02,143: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:00:02.226558580Z [2024-04-21 03:00:02,226: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:00:02.228501051Z [2024-04-21 03:00:02,228: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:00:02.228700301Z [2024-04-21 03:00:02,228: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:00:02.228848893Z [2024-04-21 03:00:02,228: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T03:00:02.229149676Z [2024-04-21 03:00:02,229: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:00:02.430131124Z [2024-04-21 03:00:02,429: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:00:02.671224359Z [2024-04-21 03:00:02,670: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4d4bb96e-b1c5-4995-9bb6-413a21fe7626] succeeded in 1.6479875550012366s: None 2024-04-21T03:00:03.041204596Z [2024-04-21 03:00:03,040: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T03:00:03.044633006Z [2024-04-21 03:00:03,044: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:00:03.064681720Z [2024-04-21 03:00:03,064: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:00:03.068788371Z [2024-04-21 03:00:03,068: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:00:03.068958545Z [2024-04-21 03:00:03,068: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:00:03.069133571Z [2024-04-21 03:00:03,068: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:00:03.069238790Z [2024-04-21 03:00:03,069: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T03:00:03.069555743Z [2024-04-21 03:00:03,069: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:00:03.069657334Z [2024-04-21 03:00:03,069: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:00:03.194680726Z [2024-04-21 03:00:03,194: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:00:03.201749241Z [2024-04-21 03:00:03,201: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:00:03.217782961Z [2024-04-21 03:00:03,217: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:00:03.303122551Z [2024-04-21 03:00:03,302: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:00:03.304965738Z [2024-04-21 03:00:03,304: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:00:03.305145846Z [2024-04-21 03:00:03,304: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:00:03.305359653Z [2024-04-21 03:00:03,305: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:00:03.305409489Z [2024-04-21 03:00:03,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:00:03.305936168Z [2024-04-21 03:00:03,305: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T03:00:03.306136486Z [2024-04-21 03:00:03,306: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:00:03.420426632Z [2024-04-21 03:00:03,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:00:03.426660805Z [2024-04-21 03:00:03,426: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb665d2c-11b2-40c8-8d8f-8266bc21bc70] succeeded in 2.4163964380004472s: None 2024-04-21T03:00:03.704882892Z [2024-04-21 03:00:03,704: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-21T03:00:03.708379887Z [2024-04-21 03:00:03,707: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:00:03.748231719Z [2024-04-21 03:00:03,747: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-21T03:00:03.751073107Z [2024-04-21 03:00:03,750: INFO/ForkPoolWorker-3] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:00:03.751205531Z [2024-04-21 03:00:03,751: INFO/ForkPoolWorker-3] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:00:03.751382464Z [2024-04-21 03:00:03,751: INFO/ForkPoolWorker-3] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:00:03.751430396Z [2024-04-21 03:00:03,751: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-21T03:00:03.751721508Z [2024-04-21 03:00:03,751: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:00:03.751886060Z [2024-04-21 03:00:03,751: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:00:03.856799641Z [2024-04-21 03:00:03,856: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:00:04.307903788Z [2024-04-21 03:00:04,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f6dbc74-d745-431e-9e5d-7bea3dcb1fe5] succeeded in 3.3027684349999618s: None 2024-04-21T03:00:04.366972374Z [2024-04-21 03:00:04,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc92c9fa-20b4-48ae-b2cc-5961b652c38d] received 2024-04-21T03:00:04.378109065Z [2024-04-21 03:00:04,377: INFO/ForkPoolWorker-15] [dc92c9fa-20b4-48ae-b2cc-5961b652c38d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T03:00:04.696282340Z [2024-04-21 03:00:04,693: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T03:00:05.118568371Z [2024-04-21 03:00:05,118: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[baf1eac0-75e6-465f-94c5-446542519f21] succeeded in 4.113451889999851s: None 2024-04-21T03:00:05.854761724Z [2024-04-21 03:00:05,854: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:00:05.858090774Z [2024-04-21 03:00:05,857: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:00:05.889121445Z [2024-04-21 03:00:05,888: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:00:05.891613679Z [2024-04-21 03:00:05,891: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:00:05.891661400Z [2024-04-21 03:00:05,891: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:00:05.891760135Z [2024-04-21 03:00:05,891: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:00:05.891781296Z [2024-04-21 03:00:05,891: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:00:05.892296545Z [2024-04-21 03:00:05,891: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T03:00:05.892318734Z [2024-04-21 03:00:05,892: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:00:05.987821034Z [2024-04-21 03:00:05,987: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:00:06.004683423Z [2024-04-21 03:00:06,004: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9366c797-c3b8-4bd4-8b48-470086238a58] succeeded in 4.97088268600055s: None 2024-04-21T03:00:06.725050887Z [2024-04-21 03:00:06,724: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc92c9fa-20b4-48ae-b2cc-5961b652c38d] succeeded in 2.3552396569994016s: None 2024-04-21T03:00:06.827389023Z [2024-04-21 03:00:06,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e1b72be-0b2e-48fb-b518-643e6c54dac0] received 2024-04-21T03:00:06.834801960Z [2024-04-21 03:00:06,834: INFO/ForkPoolWorker-15] [8e1b72be-0b2e-48fb-b518-643e6c54dac0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T03:00:07.216517280Z [2024-04-21 03:00:07,213: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T03:00:08.293614933Z [2024-04-21 03:00:08,293: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:00:08.296913420Z [2024-04-21 03:00:08,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:00:08.322151151Z [2024-04-21 03:00:08,321: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:00:08.323653954Z [2024-04-21 03:00:08,323: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:00:08.323888240Z [2024-04-21 03:00:08,323: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:00:08.324140501Z [2024-04-21 03:00:08,323: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:00:08.324262277Z [2024-04-21 03:00:08,324: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:00:08.324617159Z [2024-04-21 03:00:08,324: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T03:00:08.325139802Z [2024-04-21 03:00:08,324: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:00:08.406693101Z [2024-04-21 03:00:08,406: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:00:08.913028824Z [2024-04-21 03:00:08,912: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e1b72be-0b2e-48fb-b518-643e6c54dac0] succeeded in 2.0834518729989213s: None 2024-04-21T03:00:09.674201381Z [2024-04-21 03:00:09,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6f90a7d-3cbb-49ab-97fc-88e553376d88] received 2024-04-21T03:00:09.681920715Z [2024-04-21 03:00:09,681: INFO/ForkPoolWorker-15] [d6f90a7d-3cbb-49ab-97fc-88e553376d88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T03:00:09.973982932Z [2024-04-21 03:00:09,970: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T03:00:11.060296485Z [2024-04-21 03:00:11,059: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:00:11.063631215Z [2024-04-21 03:00:11,063: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:00:11.100632457Z [2024-04-21 03:00:11,100: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:00:11.102515908Z [2024-04-21 03:00:11,102: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:00:11.102666915Z [2024-04-21 03:00:11,102: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:00:11.102943368Z [2024-04-21 03:00:11,102: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:00:11.103110902Z [2024-04-21 03:00:11,103: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:00:11.103570870Z [2024-04-21 03:00:11,103: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T03:00:11.104198965Z [2024-04-21 03:00:11,104: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:00:11.202396911Z [2024-04-21 03:00:11,202: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:00:11.788235064Z [2024-04-21 03:00:11,787: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6f90a7d-3cbb-49ab-97fc-88e553376d88] succeeded in 2.1118853269999818s: None 2024-04-21T03:01:00.528417870Z [2024-04-21 03:01:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ac99221-ea9a-4a0c-bc78-66d162028b68] received 2024-04-21T03:01:00.534736517Z [2024-04-21 03:01:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af772ce1-b984-4800-934c-1e086c0c1c09] received 2024-04-21T03:01:00.539330386Z [2024-04-21 03:01:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8babe941-6976-4205-919d-76afd22d9262] received 2024-04-21T03:01:00.543839513Z [2024-04-21 03:01:00,543: INFO/ForkPoolWorker-15] [0ac99221-ea9a-4a0c-bc78-66d162028b68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:01:00.544711467Z [2024-04-21 03:01:00,544: INFO/ForkPoolWorker-16] [af772ce1-b984-4800-934c-1e086c0c1c09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:01:00.555632270Z [2024-04-21 03:01:00,555: INFO/ForkPoolWorker-1] [8babe941-6976-4205-919d-76afd22d9262] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:01:00.849474872Z [2024-04-21 03:01:00,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:01:00.861666971Z [2024-04-21 03:01:00,858: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:01:00.898884624Z [2024-04-21 03:01:00,894: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:01:01.066949755Z [2024-04-21 03:01:01,066: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T03:01:01.088313343Z [2024-04-21 03:01:01,082: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:01:01.138865697Z [2024-04-21 03:01:01,138: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:01:01.141209107Z [2024-04-21 03:01:01,140: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:01:01.141909840Z [2024-04-21 03:01:01,141: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:01:01.142057219Z [2024-04-21 03:01:01,141: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T03:01:01.142436660Z [2024-04-21 03:01:01,142: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:01:01.241014038Z [2024-04-21 03:01:01,240: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:01:02.023650420Z [2024-04-21 03:01:02,023: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8babe941-6976-4205-919d-76afd22d9262] succeeded in 1.4780677400012792s: None 2024-04-21T03:01:02.093935464Z [2024-04-21 03:01:02,093: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:01:02.099514016Z [2024-04-21 03:01:02,099: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:01:02.122077858Z [2024-04-21 03:01:02,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:01:02.123475775Z [2024-04-21 03:01:02,123: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:01:02.123601847Z [2024-04-21 03:01:02,123: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:01:02.123914998Z [2024-04-21 03:01:02,123: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:01:02.124085618Z [2024-04-21 03:01:02,123: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:01:02.124632724Z [2024-04-21 03:01:02,124: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:01:02.124841805Z [2024-04-21 03:01:02,124: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:01:02.203454714Z [2024-04-21 03:01:02,203: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T03:01:02.205743697Z [2024-04-21 03:01:02,205: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:01:02.207142882Z [2024-04-21 03:01:02,206: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:01:02.230164675Z [2024-04-21 03:01:02,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:01:02.231580047Z [2024-04-21 03:01:02,231: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:01:02.231758850Z [2024-04-21 03:01:02,231: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:01:02.231977375Z [2024-04-21 03:01:02,231: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:01:02.232145901Z [2024-04-21 03:01:02,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T03:01:02.232887074Z [2024-04-21 03:01:02,232: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:01:02.233100462Z [2024-04-21 03:01:02,232: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:01:02.341069533Z [2024-04-21 03:01:02,340: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:01:04.465933197Z [2024-04-21 03:01:04,465: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af772ce1-b984-4800-934c-1e086c0c1c09] succeeded in 3.9283223549991817s: None 2024-04-21T03:01:05.731732578Z [2024-04-21 03:01:05,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ac99221-ea9a-4a0c-bc78-66d162028b68] succeeded in 5.200577020001219s: None 2024-04-21T03:02:00.404393707Z [2024-04-21 03:02:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc755051-8283-48d1-917d-3cd1ba7d40df] received 2024-04-21T03:02:00.407826549Z [2024-04-21 03:02:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ea6d62c-3325-4880-b47b-2ca66778d5d1] received 2024-04-21T03:02:00.413305563Z [2024-04-21 03:02:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a60bc840-3fa4-4db4-9ef9-b8db7dde5153] received 2024-04-21T03:02:00.416668095Z [2024-04-21 03:02:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9724f5bb-1d5d-4275-901e-283d5be85c7a] received 2024-04-21T03:02:00.427042646Z [2024-04-21 03:02:00,426: INFO/ForkPoolWorker-2] [9724f5bb-1d5d-4275-901e-283d5be85c7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:02:00.427275816Z [2024-04-21 03:02:00,427: INFO/ForkPoolWorker-1] [a60bc840-3fa4-4db4-9ef9-b8db7dde5153] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:02:00.428383615Z [2024-04-21 03:02:00,427: INFO/ForkPoolWorker-16] [3ea6d62c-3325-4880-b47b-2ca66778d5d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:02:00.430276369Z [2024-04-21 03:02:00,429: INFO/ForkPoolWorker-15] [dc755051-8283-48d1-917d-3cd1ba7d40df] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T03:02:00.721258851Z [2024-04-21 03:02:00,717: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:02:00.742660758Z [2024-04-21 03:02:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:02:00.765776850Z [2024-04-21 03:02:00,761: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T03:02:00.769754173Z [2024-04-21 03:02:00,766: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:02:00.947199798Z [2024-04-21 03:02:00,946: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T03:02:00.955104825Z [2024-04-21 03:02:00,954: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:02:01.015235940Z [2024-04-21 03:02:01,013: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:02:01.018344182Z [2024-04-21 03:02:01,018: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:02:01.019576231Z [2024-04-21 03:02:01,019: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:02:01.019905578Z [2024-04-21 03:02:01,019: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T03:02:01.021997625Z [2024-04-21 03:02:01,021: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:02:01.041970214Z [2024-04-21 03:02:01,041: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:02:01.201310945Z [2024-04-21 03:02:01,201: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:02:01.913699542Z [2024-04-21 03:02:01,913: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc755051-8283-48d1-917d-3cd1ba7d40df] succeeded in 1.5060883180012752s: None 2024-04-21T03:02:01.959589545Z [2024-04-21 03:02:01,959: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ea6d62c-3325-4880-b47b-2ca66778d5d1] succeeded in 1.5481189170004654s: None 2024-04-21T03:02:02.357207376Z [2024-04-21 03:02:02,356: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T03:02:02.360653193Z [2024-04-21 03:02:02,360: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:02:02.388641927Z [2024-04-21 03:02:02,388: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T03:02:02.391774867Z [2024-04-21 03:02:02,391: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:02:02.391827504Z [2024-04-21 03:02:02,391: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:02:02.391947854Z [2024-04-21 03:02:02,391: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:02:02.391979750Z [2024-04-21 03:02:02,391: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T03:02:02.392234149Z [2024-04-21 03:02:02,392: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:02:02.392373404Z [2024-04-21 03:02:02,392: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:02:02.518269607Z [2024-04-21 03:02:02,518: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:02:02.540974999Z [2024-04-21 03:02:02,540: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T03:02:02.544615204Z [2024-04-21 03:02:02,544: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:02:02.600527367Z [2024-04-21 03:02:02,600: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:02:02.608560976Z [2024-04-21 03:02:02,608: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:02:02.611931323Z [2024-04-21 03:02:02,608: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:02:02.612168254Z [2024-04-21 03:02:02,611: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:02:02.615998128Z [2024-04-21 03:02:02,615: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T03:02:02.616600610Z [2024-04-21 03:02:02,616: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:02:02.619808272Z [2024-04-21 03:02:02,616: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:02:02.768782917Z [2024-04-21 03:02:02,768: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:02:05.046423699Z [2024-04-21 03:02:05,046: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9724f5bb-1d5d-4275-901e-283d5be85c7a] succeeded in 4.6267784550000215s: None 2024-04-21T03:02:05.178093911Z [2024-04-21 03:02:05,177: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a60bc840-3fa4-4db4-9ef9-b8db7dde5153] succeeded in 4.7630397910015745s: None 2024-04-21T03:03:00.670828035Z [2024-04-21 03:03:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e714cc0f-10d4-4f95-9cc9-9e674c5218fe] received 2024-04-21T03:03:00.681078986Z [2024-04-21 03:03:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[644d44f1-d0d2-4d8a-afc4-c7bb67c6482e] received 2024-04-21T03:03:00.681554267Z [2024-04-21 03:03:00,681: INFO/ForkPoolWorker-15] [e714cc0f-10d4-4f95-9cc9-9e674c5218fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:03:00.692251560Z [2024-04-21 03:03:00,691: INFO/ForkPoolWorker-16] [644d44f1-d0d2-4d8a-afc4-c7bb67c6482e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:03:00.698686003Z [2024-04-21 03:03:00,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1146e765-9c9e-4653-9bcb-1e6bac196076] received 2024-04-21T03:03:00.705360358Z [2024-04-21 03:03:00,705: INFO/ForkPoolWorker-1] [1146e765-9c9e-4653-9bcb-1e6bac196076] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:03:00.985407543Z [2024-04-21 03:03:00,982: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:03:01.028479154Z [2024-04-21 03:03:01,024: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:03:01.040529849Z [2024-04-21 03:03:01,037: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:03:01.211649148Z [2024-04-21 03:03:01,211: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T03:03:01.215437429Z [2024-04-21 03:03:01,214: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:03:01.256610461Z [2024-04-21 03:03:01,256: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:03:01.257858959Z [2024-04-21 03:03:01,257: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:03:01.257914425Z [2024-04-21 03:03:01,257: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:03:01.257975710Z [2024-04-21 03:03:01,257: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T03:03:01.258231544Z [2024-04-21 03:03:01,258: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:03:01.354373180Z [2024-04-21 03:03:01,354: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:03:01.997243365Z [2024-04-21 03:03:01,996: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[644d44f1-d0d2-4d8a-afc4-c7bb67c6482e] succeeded in 1.3142000829993776s: None 2024-04-21T03:03:02.295376558Z [2024-04-21 03:03:02,294: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T03:03:02.298602991Z [2024-04-21 03:03:02,298: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:03:02.327112800Z [2024-04-21 03:03:02,326: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:03:02.328874449Z [2024-04-21 03:03:02,328: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:03:02.329038400Z [2024-04-21 03:03:02,328: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:03:02.329336851Z [2024-04-21 03:03:02,328: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:03:02.329494167Z [2024-04-21 03:03:02,329: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T03:03:02.329905990Z [2024-04-21 03:03:02,329: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:03:02.330077165Z [2024-04-21 03:03:02,329: INFO/ForkPoolWorker-1] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:03:02.339927927Z [2024-04-21 03:03:02,339: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:03:02.343175801Z [2024-04-21 03:03:02,342: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:03:02.364871602Z [2024-04-21 03:03:02,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:03:02.365976046Z [2024-04-21 03:03:02,365: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:03:02.365986773Z [2024-04-21 03:03:02,365: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:03:02.366172610Z [2024-04-21 03:03:02,365: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:03:02.366181407Z [2024-04-21 03:03:02,366: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:03:02.366498454Z [2024-04-21 03:03:02,366: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:03:02.366559581Z [2024-04-21 03:03:02,366: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:03:02.438401860Z [2024-04-21 03:03:02,438: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:03:02.474499532Z [2024-04-21 03:03:02,474: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:03:04.315081950Z [2024-04-21 03:03:04,314: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1146e765-9c9e-4653-9bcb-1e6bac196076] succeeded in 3.6138149610014807s: None 2024-04-21T03:03:05.066541563Z [2024-04-21 03:03:05,065: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e714cc0f-10d4-4f95-9cc9-9e674c5218fe] succeeded in 4.3929336729997885s: None 2024-04-21T03:04:01.017729689Z [2024-04-21 03:04:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78b26d87-0adc-4201-ab60-143b646ee5f3] received 2024-04-21T03:04:01.022629770Z [2024-04-21 03:04:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ee90859-3833-4f1d-976f-b93698ceccda] received 2024-04-21T03:04:01.028534559Z [2024-04-21 03:04:01,028: INFO/ForkPoolWorker-15] [78b26d87-0adc-4201-ab60-143b646ee5f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T03:04:01.034851667Z [2024-04-21 03:04:01,034: INFO/ForkPoolWorker-16] [4ee90859-3833-4f1d-976f-b93698ceccda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:04:01.034873599Z [2024-04-21 03:04:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6676050f-35ab-491a-8070-4e9f4f4b12b7] received 2024-04-21T03:04:01.043767802Z [2024-04-21 03:04:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4ba9af6-c9b3-4565-9f02-4bc7e90467c6] received 2024-04-21T03:04:01.058965225Z [2024-04-21 03:04:01,058: INFO/ForkPoolWorker-2] [f4ba9af6-c9b3-4565-9f02-4bc7e90467c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:04:01.062425169Z [2024-04-21 03:04:01,061: INFO/ForkPoolWorker-1] [6676050f-35ab-491a-8070-4e9f4f4b12b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:04:01.377131409Z [2024-04-21 03:04:01,373: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T03:04:01.496238752Z [2024-04-21 03:04:01,479: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:04:01.651852985Z [2024-04-21 03:04:01,648: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:04:01.691692756Z [2024-04-21 03:04:01,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:04:01.799232651Z [2024-04-21 03:04:01,795: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:04:01.885021504Z [2024-04-21 03:04:01,884: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T03:04:01.889719778Z [2024-04-21 03:04:01,889: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:04:01.924417075Z [2024-04-21 03:04:01,924: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:04:01.928742926Z [2024-04-21 03:04:01,928: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:04:01.929264380Z [2024-04-21 03:04:01,928: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:04:01.929516809Z [2024-04-21 03:04:01,929: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T03:04:01.929773096Z [2024-04-21 03:04:01,929: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:04:02.090373390Z [2024-04-21 03:04:02,090: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:04:02.229091042Z [2024-04-21 03:04:02,228: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78b26d87-0adc-4201-ab60-143b646ee5f3] succeeded in 1.2090380619993084s: None 2024-04-21T03:04:02.708232329Z [2024-04-21 03:04:02,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6676050f-35ab-491a-8070-4e9f4f4b12b7] succeeded in 1.670449795001332s: None 2024-04-21T03:04:03.070087523Z [2024-04-21 03:04:03,069: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T03:04:03.073561856Z [2024-04-21 03:04:03,073: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:04:03.097894874Z [2024-04-21 03:04:03,097: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T03:04:03.099183142Z [2024-04-21 03:04:03,098: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:04:03.099307773Z [2024-04-21 03:04:03,099: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:04:03.099510044Z [2024-04-21 03:04:03,099: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:04:03.099635441Z [2024-04-21 03:04:03,099: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T03:04:03.099969961Z [2024-04-21 03:04:03,099: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:04:03.100181939Z [2024-04-21 03:04:03,099: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:04:03.172528380Z [2024-04-21 03:04:03,172: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T03:04:03.179116167Z [2024-04-21 03:04:03,176: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:04:03.191122746Z [2024-04-21 03:04:03,190: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:04:03.232602970Z [2024-04-21 03:04:03,232: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:04:03.235063427Z [2024-04-21 03:04:03,234: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:04:03.235082877Z [2024-04-21 03:04:03,234: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:04:03.235226275Z [2024-04-21 03:04:03,235: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:04:03.235253998Z [2024-04-21 03:04:03,235: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T03:04:03.235511581Z [2024-04-21 03:04:03,235: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:04:03.235530388Z [2024-04-21 03:04:03,235: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:04:03.331353332Z [2024-04-21 03:04:03,331: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:04:04.887665321Z [2024-04-21 03:04:04,886: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f4ba9af6-c9b3-4565-9f02-4bc7e90467c6] succeeded in 3.8398814640004275s: None 2024-04-21T03:04:05.772816382Z [2024-04-21 03:04:05,772: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ee90859-3833-4f1d-976f-b93698ceccda] succeeded in 4.748018831000081s: None 2024-04-21T03:05:01.222633728Z [2024-04-21 03:05:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b770f3a6-e594-4763-9310-a55bc901a6c2] received 2024-04-21T03:05:01.226946451Z [2024-04-21 03:05:01,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43a61789-8516-4940-9c10-9742b5f857e4] received 2024-04-21T03:05:01.230755224Z [2024-04-21 03:05:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86f8aff4-4513-4bce-9bf4-4d7dd7d7568d] received 2024-04-21T03:05:01.232466542Z [2024-04-21 03:05:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aca8c06-ecc7-478f-976c-8c903e3c8414] received 2024-04-21T03:05:01.240877178Z [2024-04-21 03:05:01,239: INFO/ForkPoolWorker-1] [86f8aff4-4513-4bce-9bf4-4d7dd7d7568d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T03:05:01.245764968Z [2024-04-21 03:05:01,245: INFO/ForkPoolWorker-16] [43a61789-8516-4940-9c10-9742b5f857e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:05:01.246388468Z [2024-04-21 03:05:01,246: INFO/ForkPoolWorker-15] [b770f3a6-e594-4763-9310-a55bc901a6c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:05:01.251437037Z [2024-04-21 03:05:01,250: INFO/ForkPoolWorker-2] [2aca8c06-ecc7-478f-976c-8c903e3c8414] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:05:01.659570116Z [2024-04-21 03:05:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:05:02.126695196Z [2024-04-21 03:05:02,123: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:05:02.245183243Z [2024-04-21 03:05:02,241: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:05:02.264342230Z [2024-04-21 03:05:02,260: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T03:05:02.331196028Z [2024-04-21 03:05:02,330: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T03:05:02.337159303Z [2024-04-21 03:05:02,336: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:05:02.414010844Z [2024-04-21 03:05:02,413: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:05:02.426579278Z [2024-04-21 03:05:02,426: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:05:02.428766404Z [2024-04-21 03:05:02,428: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:05:02.429698431Z [2024-04-21 03:05:02,429: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T03:05:02.432172691Z [2024-04-21 03:05:02,431: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:05:02.665525863Z [2024-04-21 03:05:02,664: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:05:03.221473306Z [2024-04-21 03:05:03,221: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T03:05:03.226243949Z [2024-04-21 03:05:03,225: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:05:03.287391251Z [2024-04-21 03:05:03,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:05:03.289211122Z [2024-04-21 03:05:03,288: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:05:03.289259981Z [2024-04-21 03:05:03,289: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:05:03.289492219Z [2024-04-21 03:05:03,289: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:05:03.289584950Z [2024-04-21 03:05:03,289: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T03:05:03.289871082Z [2024-04-21 03:05:03,289: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:05:03.289955592Z [2024-04-21 03:05:03,289: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:05:03.427307270Z [2024-04-21 03:05:03,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b770f3a6-e594-4763-9310-a55bc901a6c2] succeeded in 2.198523777000446s: None 2024-04-21T03:05:03.465400920Z [2024-04-21 03:05:03,465: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:05:03.976004131Z [2024-04-21 03:05:03,973: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T03:05:03.982774778Z [2024-04-21 03:05:03,982: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:05:04.021359232Z [2024-04-21 03:05:04,020: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T03:05:04.023639522Z [2024-04-21 03:05:04,022: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:05:04.023835430Z [2024-04-21 03:05:04,023: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:05:04.024078002Z [2024-04-21 03:05:04,023: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:05:04.024252682Z [2024-04-21 03:05:04,024: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T03:05:04.024661209Z [2024-04-21 03:05:04,024: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:05:04.024816586Z [2024-04-21 03:05:04,024: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:05:04.133144221Z [2024-04-21 03:05:04,132: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:05:04.179065230Z [2024-04-21 03:05:04,178: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T03:05:04.182175014Z [2024-04-21 03:05:04,181: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:05:04.209891953Z [2024-04-21 03:05:04,209: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:05:04.211735292Z [2024-04-21 03:05:04,211: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:05:04.211795041Z [2024-04-21 03:05:04,211: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:05:04.211961762Z [2024-04-21 03:05:04,211: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:05:04.212034271Z [2024-04-21 03:05:04,211: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T03:05:04.212739353Z [2024-04-21 03:05:04,212: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T03:05:04.212912370Z [2024-04-21 03:05:04,212: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:05:04.285279064Z [2024-04-21 03:05:04,285: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:05:04.921000372Z [2024-04-21 03:05:04,920: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86f8aff4-4513-4bce-9bf4-4d7dd7d7568d] succeeded in 3.6872315580003487s: None 2024-04-21T03:05:05.259961864Z [2024-04-21 03:05:05,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97c9130a-aa51-43d4-994d-90abbe2b70d8] received 2024-04-21T03:05:05.274047509Z [2024-04-21 03:05:05,273: INFO/ForkPoolWorker-15] [97c9130a-aa51-43d4-994d-90abbe2b70d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'split_metrics', 'scheduled__2024-04-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T03:05:05.590268747Z [2024-04-21 03:05:05,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T03:05:05.766061647Z [2024-04-21 03:05:05,765: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43a61789-8516-4940-9c10-9742b5f857e4] succeeded in 4.533936238998649s: None 2024-04-21T03:05:06.504772021Z [2024-04-21 03:05:06,504: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2aca8c06-ecc7-478f-976c-8c903e3c8414] succeeded in 5.267229736000445s: None 2024-04-21T03:05:06.941760388Z [2024-04-21 03:05:06,941: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:05:06.945157439Z [2024-04-21 03:05:06,944: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:05:06.966360379Z [2024-04-21 03:05:06,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:05:06.968602060Z [2024-04-21 03:05:06,968: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:05:06.968625461Z [2024-04-21 03:05:06,968: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:05:06.972077210Z [2024-04-21 03:05:06,968: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:05:06.972118891Z [2024-04-21 03:05:06,968: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:05:06.972126201Z [2024-04-21 03:05:06,969: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T03:05:06.972132273Z [2024-04-21 03:05:06,969: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:05:07.073969337Z [2024-04-21 03:05:07,073: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:05:07.825470598Z [2024-04-21 03:05:07,824: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97c9130a-aa51-43d4-994d-90abbe2b70d8] succeeded in 2.5611434720012767s: None 2024-04-21T03:05:07.933296584Z [2024-04-21 03:05:07,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f8b6dba-70c3-4408-86cc-ddd5f344437e] received 2024-04-21T03:05:07.940761907Z [2024-04-21 03:05:07,940: INFO/ForkPoolWorker-15] [8f8b6dba-70c3-4408-86cc-ddd5f344437e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'collect_metrics', 'scheduled__2024-04-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-21T03:05:08.240047164Z [2024-04-21 03:05:08,236: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T03:05:09.399809607Z [2024-04-21 03:05:09,398: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:05:09.402111504Z [2024-04-21 03:05:09,401: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:05:09.420652490Z [2024-04-21 03:05:09,420: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:05:09.421776588Z [2024-04-21 03:05:09,421: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:05:09.421822525Z [2024-04-21 03:05:09,421: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:05:09.421951200Z [2024-04-21 03:05:09,421: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:05:09.421997061Z [2024-04-21 03:05:09,421: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:05:09.422202306Z [2024-04-21 03:05:09,422: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T03:05:09.422298348Z [2024-04-21 03:05:09,422: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:05:09.504246144Z [2024-04-21 03:05:09,503: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:05:10.177848638Z [2024-04-21 03:05:10,177: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f8b6dba-70c3-4408-86cc-ddd5f344437e] succeeded in 2.2423795180002344s: None 2024-04-21T03:05:10.294946676Z [2024-04-21 03:05:10,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[568e4574-515c-44be-a962-f90bc07f8edf] received 2024-04-21T03:05:10.305188235Z [2024-04-21 03:05:10,304: INFO/ForkPoolWorker-15] [568e4574-515c-44be-a962-f90bc07f8edf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'send_prometheus', 'scheduled__2024-04-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-21T03:05:10.618313516Z [2024-04-21 03:05:10,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-21T03:05:11.753579744Z [2024-04-21 03:05:11,752: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:05:11.757032211Z [2024-04-21 03:05:11,756: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:05:11.784977023Z [2024-04-21 03:05:11,784: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:05:11.787101581Z [2024-04-21 03:05:11,786: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:05:11.787136331Z [2024-04-21 03:05:11,786: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:05:11.787348998Z [2024-04-21 03:05:11,787: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:05:11.787428257Z [2024-04-21 03:05:11,787: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:05:11.787826201Z [2024-04-21 03:05:11,787: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-21T03:05:11.788006660Z [2024-04-21 03:05:11,787: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:05:11.927909537Z [2024-04-21 03:05:11,927: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:05:12.630048220Z [2024-04-21 03:05:12,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[568e4574-515c-44be-a962-f90bc07f8edf] succeeded in 2.332665893001831s: None 2024-04-21T03:06:00.459187535Z [2024-04-21 03:06:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[107066e8-1d8a-4dd7-8a1e-2d37fc96f3a5] received 2024-04-21T03:06:00.464823421Z [2024-04-21 03:06:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17d33646-a4ab-4383-b482-0b4071bca51b] received 2024-04-21T03:06:00.470888424Z [2024-04-21 03:06:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f4e343d-7b96-428d-8ccf-785fd36b8b3c] received 2024-04-21T03:06:00.473932001Z [2024-04-21 03:06:00,473: INFO/ForkPoolWorker-15] [107066e8-1d8a-4dd7-8a1e-2d37fc96f3a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T03:06:00.476180689Z [2024-04-21 03:06:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa6a4905-cae1-498d-9de1-8eddb13f6032] received 2024-04-21T03:06:00.478996162Z [2024-04-21 03:06:00,478: INFO/ForkPoolWorker-1] [5f4e343d-7b96-428d-8ccf-785fd36b8b3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:06:00.483606850Z [2024-04-21 03:06:00,483: INFO/ForkPoolWorker-2] [fa6a4905-cae1-498d-9de1-8eddb13f6032] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:06:00.490424677Z [2024-04-21 03:06:00,490: INFO/ForkPoolWorker-16] [17d33646-a4ab-4383-b482-0b4071bca51b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:06:00.779090253Z [2024-04-21 03:06:00,775: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T03:06:00.856791574Z [2024-04-21 03:06:00,853: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:06:00.872479837Z [2024-04-21 03:06:00,869: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:06:00.996040315Z [2024-04-21 03:06:00,984: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:06:01.027727754Z [2024-04-21 03:06:01,027: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-21T03:06:01.031505709Z [2024-04-21 03:06:01,031: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:06:01.038485760Z [2024-04-21 03:06:01,038: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:06:01.111787141Z [2024-04-21 03:06:01,106: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:06:01.111807531Z [2024-04-21 03:06:01,108: INFO/ForkPoolWorker-16] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:06:01.111812214Z [2024-04-21 03:06:01,108: INFO/ForkPoolWorker-16] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:06:01.111816536Z [2024-04-21 03:06:01,108: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-21T03:06:01.111819962Z [2024-04-21 03:06:01,109: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:06:01.240096840Z [2024-04-21 03:06:01,239: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:06:01.995219772Z [2024-04-21 03:06:01,994: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[107066e8-1d8a-4dd7-8a1e-2d37fc96f3a5] succeeded in 1.5335097370007134s: None 2024-04-21T03:06:02.143774871Z [2024-04-21 03:06:02,143: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17d33646-a4ab-4383-b482-0b4071bca51b] succeeded in 1.6766370779987483s: None 2024-04-21T03:06:02.619489001Z [2024-04-21 03:06:02,619: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T03:06:02.623551530Z [2024-04-21 03:06:02,622: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:06:02.681823134Z [2024-04-21 03:06:02,681: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T03:06:02.684752614Z [2024-04-21 03:06:02,684: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:06:02.684771807Z [2024-04-21 03:06:02,684: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:06:02.684888548Z [2024-04-21 03:06:02,684: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:06:02.684901083Z [2024-04-21 03:06:02,684: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T03:06:02.685162850Z [2024-04-21 03:06:02,685: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:06:02.685175333Z [2024-04-21 03:06:02,685: INFO/ForkPoolWorker-2] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:06:02.786100832Z [2024-04-21 03:06:02,785: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T03:06:02.790339768Z [2024-04-21 03:06:02,789: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:06:02.830543525Z [2024-04-21 03:06:02,830: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:06:02.839015079Z [2024-04-21 03:06:02,838: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:06:02.842271244Z [2024-04-21 03:06:02,842: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:06:02.842303002Z [2024-04-21 03:06:02,842: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:06:02.842480288Z [2024-04-21 03:06:02,842: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:06:02.842492056Z [2024-04-21 03:06:02,842: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T03:06:02.842723842Z [2024-04-21 03:06:02,842: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:06:02.842761941Z [2024-04-21 03:06:02,842: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:06:03.013295397Z [2024-04-21 03:06:03,013: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:06:06.363529197Z [2024-04-21 03:06:06,363: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fa6a4905-cae1-498d-9de1-8eddb13f6032] succeeded in 5.886009348996595s: None 2024-04-21T03:06:07.402057876Z [2024-04-21 03:06:07,401: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f4e343d-7b96-428d-8ccf-785fd36b8b3c] succeeded in 6.928705325000919s: None 2024-04-21T03:07:01.085712879Z [2024-04-21 03:07:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f77d668-251b-41bd-8064-a4e00b2944a9] received 2024-04-21T03:07:01.094666622Z [2024-04-21 03:07:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[052c0c02-22ad-4798-bf7d-b04fee714f8f] received 2024-04-21T03:07:01.099548229Z [2024-04-21 03:07:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaf5ef06-0ab1-42cb-a2f2-00e10caf1eac] received 2024-04-21T03:07:01.111781070Z [2024-04-21 03:07:01,101: INFO/ForkPoolWorker-16] [052c0c02-22ad-4798-bf7d-b04fee714f8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:07:01.111799233Z [2024-04-21 03:07:01,109: INFO/ForkPoolWorker-15] [4f77d668-251b-41bd-8064-a4e00b2944a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:07:01.115944134Z [2024-04-21 03:07:01,111: INFO/ForkPoolWorker-1] [eaf5ef06-0ab1-42cb-a2f2-00e10caf1eac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:07:01.432869573Z [2024-04-21 03:07:01,430: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:07:01.439053396Z [2024-04-21 03:07:01,435: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:07:01.448660147Z [2024-04-21 03:07:01,445: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:07:01.636013218Z [2024-04-21 03:07:01,635: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T03:07:01.640440036Z [2024-04-21 03:07:01,639: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:07:01.674870023Z [2024-04-21 03:07:01,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:07:01.681162088Z [2024-04-21 03:07:01,680: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:07:01.681342237Z [2024-04-21 03:07:01,681: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:07:01.681460704Z [2024-04-21 03:07:01,681: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T03:07:01.681752347Z [2024-04-21 03:07:01,681: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:07:01.784951268Z [2024-04-21 03:07:01,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:07:02.335748918Z [2024-04-21 03:07:02,335: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f77d668-251b-41bd-8064-a4e00b2944a9] succeeded in 1.251642956998694s: None 2024-04-21T03:07:02.698178695Z [2024-04-21 03:07:02,697: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T03:07:02.701623549Z [2024-04-21 03:07:02,701: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:07:02.769735001Z [2024-04-21 03:07:02,769: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:07:02.778912158Z [2024-04-21 03:07:02,778: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:07:02.778929812Z [2024-04-21 03:07:02,778: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:07:02.781322085Z [2024-04-21 03:07:02,778: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:07:02.783122348Z [2024-04-21 03:07:02,781: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T03:07:02.785292051Z [2024-04-21 03:07:02,785: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:07:02.787961718Z [2024-04-21 03:07:02,785: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:07:02.806182601Z [2024-04-21 03:07:02,805: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-21T03:07:02.809270484Z [2024-04-21 03:07:02,808: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:07:02.834084005Z [2024-04-21 03:07:02,833: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:07:02.835968315Z [2024-04-21 03:07:02,835: INFO/ForkPoolWorker-1] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:07:02.836116163Z [2024-04-21 03:07:02,835: INFO/ForkPoolWorker-1] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:07:02.836240351Z [2024-04-21 03:07:02,836: INFO/ForkPoolWorker-1] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:07:02.836263043Z [2024-04-21 03:07:02,836: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-21T03:07:02.836558605Z [2024-04-21 03:07:02,836: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:07:02.836570283Z [2024-04-21 03:07:02,836: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:07:02.886165598Z [2024-04-21 03:07:02,885: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:07:02.945066375Z [2024-04-21 03:07:02,944: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:07:04.743303149Z [2024-04-21 03:07:04,742: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[052c0c02-22ad-4798-bf7d-b04fee714f8f] succeeded in 3.648075677003362s: None 2024-04-21T03:07:05.646112825Z [2024-04-21 03:07:05,645: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eaf5ef06-0ab1-42cb-a2f2-00e10caf1eac] succeeded in 4.538995058999717s: None 2024-04-21T03:08:00.444264198Z [2024-04-21 03:08:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7949493-270d-4bf6-a372-f7a3f643dc97] received 2024-04-21T03:08:00.448854687Z [2024-04-21 03:08:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[370563ac-a854-414a-8363-7acb266c6199] received 2024-04-21T03:08:00.451828784Z [2024-04-21 03:08:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79094766-6f72-4641-8723-da385eaf6d21] received 2024-04-21T03:08:00.454000018Z [2024-04-21 03:08:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28c90342-707d-4c22-a0cf-d0f91d67c1dd] received 2024-04-21T03:08:00.460234880Z [2024-04-21 03:08:00,459: INFO/ForkPoolWorker-16] [370563ac-a854-414a-8363-7acb266c6199] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:08:00.462286310Z [2024-04-21 03:08:00,461: INFO/ForkPoolWorker-1] [79094766-6f72-4641-8723-da385eaf6d21] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-21T03:08:00.462839380Z [2024-04-21 03:08:00,462: INFO/ForkPoolWorker-2] [28c90342-707d-4c22-a0cf-d0f91d67c1dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:08:00.464711805Z [2024-04-21 03:08:00,464: INFO/ForkPoolWorker-15] [a7949493-270d-4bf6-a372-f7a3f643dc97] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:08:00.850685859Z [2024-04-21 03:08:00,842: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:08:00.868658543Z [2024-04-21 03:08:00,865: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:08:00.877746002Z [2024-04-21 03:08:00,873: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-21T03:08:00.990373499Z [2024-04-21 03:08:00,977: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:08:01.358774451Z [2024-04-21 03:08:01,358: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:08:01.581749660Z [2024-04-21 03:08:01,581: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-21T03:08:01.586039837Z [2024-04-21 03:08:01,585: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:08:01.638443225Z [2024-04-21 03:08:01,638: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:08:01.644392100Z [2024-04-21 03:08:01,644: INFO/ForkPoolWorker-15] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:08:01.644687024Z [2024-04-21 03:08:01,644: INFO/ForkPoolWorker-15] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:08:01.644913555Z [2024-04-21 03:08:01,644: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-21T03:08:01.645383770Z [2024-04-21 03:08:01,645: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:08:01.746698345Z [2024-04-21 03:08:01,746: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:08:02.196078911Z [2024-04-21 03:08:02,195: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[79094766-6f72-4641-8723-da385eaf6d21] succeeded in 1.742619476000982s: None 2024-04-21T03:08:02.514341700Z [2024-04-21 03:08:02,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7949493-270d-4bf6-a372-f7a3f643dc97] succeeded in 2.067315547999897s: None 2024-04-21T03:08:02.538793963Z [2024-04-21 03:08:02,538: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-21T03:08:02.542579113Z [2024-04-21 03:08:02,542: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T03:08:02.543337408Z [2024-04-21 03:08:02,542: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:08:02.546226695Z [2024-04-21 03:08:02,545: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:08:02.571873461Z [2024-04-21 03:08:02,571: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-21T03:08:02.573369658Z [2024-04-21 03:08:02,573: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:08:02.574649186Z [2024-04-21 03:08:02,574: INFO/ForkPoolWorker-2] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:08:02.574843085Z [2024-04-21 03:08:02,574: INFO/ForkPoolWorker-2] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:08:02.575108253Z [2024-04-21 03:08:02,574: INFO/ForkPoolWorker-2] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:08:02.575295019Z [2024-04-21 03:08:02,575: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-21T03:08:02.575428769Z [2024-04-21 03:08:02,575: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:08:02.575595657Z [2024-04-21 03:08:02,575: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:08:02.575809834Z [2024-04-21 03:08:02,575: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:08:02.576178818Z [2024-04-21 03:08:02,576: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T03:08:02.576244869Z [2024-04-21 03:08:02,575: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:08:02.576411999Z [2024-04-21 03:08:02,576: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:08:02.576819475Z [2024-04-21 03:08:02,576: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:08:02.577010834Z [2024-04-21 03:08:02,576: INFO/ForkPoolWorker-16] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:08:02.686087502Z [2024-04-21 03:08:02,685: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:08:02.687915947Z [2024-04-21 03:08:02,687: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:08:04.830211595Z [2024-04-21 03:08:04,829: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[370563ac-a854-414a-8363-7acb266c6199] succeeded in 4.378583453999454s: None 2024-04-21T03:08:05.783468321Z [2024-04-21 03:08:05,782: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[28c90342-707d-4c22-a0cf-d0f91d67c1dd] succeeded in 5.327323063000222s: None 2024-04-21T03:09:00.762984838Z [2024-04-21 03:09:00,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[347c1694-6ee8-4a26-b283-5274a6c27002] received 2024-04-21T03:09:00.771193357Z [2024-04-21 03:09:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0799f5bd-09fe-44b5-9e70-9e1fdbb40d02] received 2024-04-21T03:09:00.774345716Z [2024-04-21 03:09:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[548acab8-56b0-4636-b4e1-9d7f4ba7ea40] received 2024-04-21T03:09:00.779566516Z [2024-04-21 03:09:00,777: INFO/ForkPoolWorker-15] [347c1694-6ee8-4a26-b283-5274a6c27002] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-21T03:09:00.783478354Z [2024-04-21 03:09:00,783: INFO/ForkPoolWorker-1] [548acab8-56b0-4636-b4e1-9d7f4ba7ea40] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-21T03:09:00.786971104Z [2024-04-21 03:09:00,786: INFO/ForkPoolWorker-16] [0799f5bd-09fe-44b5-9e70-9e1fdbb40d02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-21T03:09:01.107978048Z [2024-04-21 03:09:01,088: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-21T03:09:01.142341296Z [2024-04-21 03:09:01,132: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-21T03:09:01.218409164Z [2024-04-21 03:09:01,213: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-21T03:09:01.357748262Z [2024-04-21 03:09:01,357: INFO/ForkPoolWorker-1] Getting SDNC list 2024-04-21T03:09:01.363814340Z [2024-04-21 03:09:01,363: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:09:01.401376578Z [2024-04-21 03:09:01,401: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-21T03:09:01.403351065Z [2024-04-21 03:09:01,403: INFO/ForkPoolWorker-1] Read SDNC 2e54a59f-9590-4a79-a1a9-d9397758ccbd (sdnc-osm) 2024-04-21T03:09:01.403560637Z [2024-04-21 03:09:01,403: INFO/ForkPoolWorker-1] [{'_id': '2e54a59f-9590-4a79-a1a9-d9397758ccbd', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-04-21T03:09:01.407206944Z [2024-04-21 03:09:01,406: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-04-21T03:09:01.408557417Z [2024-04-21 03:09:01,408: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_2e54a59f-9590-4a79-a1a9-d9397758ccbd 2024-04-21T03:09:01.539782016Z [2024-04-21 03:09:01,533: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:09:02.277243422Z [2024-04-21 03:09:02,276: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[548acab8-56b0-4636-b4e1-9d7f4ba7ea40] succeeded in 1.500980939999863s: None 2024-04-21T03:09:02.388094283Z [2024-04-21 03:09:02,387: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-21T03:09:02.391395204Z [2024-04-21 03:09:02,390: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:09:02.408755283Z [2024-04-21 03:09:02,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-21T03:09:02.410415302Z [2024-04-21 03:09:02,410: INFO/ForkPoolWorker-15] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:09:02.410426903Z [2024-04-21 03:09:02,410: INFO/ForkPoolWorker-15] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:09:02.410595542Z [2024-04-21 03:09:02,410: INFO/ForkPoolWorker-15] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:09:02.410669203Z [2024-04-21 03:09:02,410: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-21T03:09:02.410925859Z [2024-04-21 03:09:02,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-21T03:09:02.411020417Z [2024-04-21 03:09:02,410: INFO/ForkPoolWorker-15] Creating DAG vim_status_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:09:02.504256829Z [2024-04-21 03:09:02,503: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:09:02.627289885Z [2024-04-21 03:09:02,626: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-21T03:09:02.630524055Z [2024-04-21 03:09:02,630: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'M8CC6nlViYy9kh0O4wRcmjJ2nbuPMu9H'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-21T03:09:02.648650450Z [2024-04-21 03:09:02,648: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-21T03:09:02.649940491Z [2024-04-21 03:09:02,649: INFO/ForkPoolWorker-16] Read VIM 68b17bb7-da9c-4237-b0e8-1103d169c212 (_system-osm-vim) 2024-04-21T03:09:02.650010886Z [2024-04-21 03:09:02,649: INFO/ForkPoolWorker-16] Read VIM 937467fa-a816-40b8-82c7-ffcd6573ce58 (osm) 2024-04-21T03:09:02.650143873Z [2024-04-21 03:09:02,649: INFO/ForkPoolWorker-16] [{'_id': '68b17bb7-da9c-4237-b0e8-1103d169c212', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '937467fa-a816-40b8-82c7-ffcd6573ce58', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-21T03:09:02.650215103Z [2024-04-21 03:09:02,650: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-21T03:09:02.650601694Z [2024-04-21 03:09:02,650: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-21T03:09:02.650886414Z [2024-04-21 03:09:02,650: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_937467fa-a816-40b8-82c7-ffcd6573ce58 2024-04-21T03:09:02.770070403Z [2024-04-21 03:09:02,769: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-21T03:09:04.473379812Z [2024-04-21 03:09:04,472: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[347c1694-6ee8-4a26-b283-5274a6c27002] succeeded in 3.706222501001321s: None 2024-04-21T03:09:05.296486620Z [2024-04-21 03:09:05,296: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0799f5bd-09fe-44b5-9e70-9e1fdbb40d02] succeeded in 4.522509302998515s: None 2024-04-20T22:42:13.835015919Z 2024-04-20T22:42:13.851886483Z Cleaning logs every 900 seconds 2024-04-20T22:42:13.851902173Z Trimming airflow logs to 15 days. 2024-04-20T22:45:00.916313696Z Trimming airflow logs to 15 days. 2024-04-20T22:45:01.946506275Z Trimming airflow logs to 15 days. 2024-04-20T23:00:00.975841194Z Trimming airflow logs to 15 days. 2024-04-20T23:15:00.023012301Z Trimming airflow logs to 15 days. 2024-04-20T23:15:01.073624082Z Trimming airflow logs to 15 days. 2024-04-20T23:30:00.152422677Z Trimming airflow logs to 15 days. 2024-04-20T23:30:01.209120828Z Trimming airflow logs to 15 days. 2024-04-20T23:45:00.277083936Z Trimming airflow logs to 15 days. 2024-04-20T23:45:01.341848774Z Trimming airflow logs to 15 days. 2024-04-21T00:00:00.396403900Z Trimming airflow logs to 15 days. 2024-04-21T00:00:01.441628288Z Trimming airflow logs to 15 days. 2024-04-21T00:15:00.546837562Z Trimming airflow logs to 15 days. 2024-04-21T00:15:01.603011848Z Trimming airflow logs to 15 days. 2024-04-21T00:30:00.660751169Z Trimming airflow logs to 15 days. 2024-04-21T00:30:01.746473694Z Trimming airflow logs to 15 days. 2024-04-21T00:45:00.828386262Z Trimming airflow logs to 15 days. 2024-04-21T00:45:01.912278582Z Trimming airflow logs to 15 days. 2024-04-21T01:00:00.984609660Z Trimming airflow logs to 15 days. 2024-04-21T01:15:00.157136681Z Trimming airflow logs to 15 days. 2024-04-21T01:15:01.241534069Z Trimming airflow logs to 15 days. 2024-04-21T01:30:00.330973017Z Trimming airflow logs to 15 days. 2024-04-21T01:30:01.393772762Z Trimming airflow logs to 15 days. 2024-04-21T01:45:00.502823533Z Trimming airflow logs to 15 days. 2024-04-21T01:45:01.804011855Z Trimming airflow logs to 15 days. 2024-04-21T02:00:00.939362026Z Trimming airflow logs to 15 days. 2024-04-21T02:15:00.077008885Z Trimming airflow logs to 15 days. 2024-04-21T02:15:01.212244399Z Trimming airflow logs to 15 days. 2024-04-21T02:30:00.314433741Z Trimming airflow logs to 15 days. 2024-04-21T02:30:01.401012122Z Trimming airflow logs to 15 days. 2024-04-21T02:45:00.530836895Z Trimming airflow logs to 15 days. 2024-04-21T02:45:01.622917411Z Trimming airflow logs to 15 days. 2024-04-21T03:00:00.721211954Z Trimming airflow logs to 15 days. 2024-04-21T03:00:01.806335466Z Trimming airflow logs to 15 days.