2024-04-03T01:25:33.448997259Z 2024-04-03T01:25:34.619993238Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-03T01:25:38.307929928Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-03T01:25:49.281466605Z [2024-04-03T01:25:49.275+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-03T01:25:50.291289526Z [2024-04-03T01:25:50.290+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-03T01:25:51.295521070Z [2024-04-03T01:25:51.293+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-04-03T01:26:15.786380692Z 2024-04-03T01:26:17.656974061Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-03T01:26:21.565339843Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-03T01:26:37.714496316Z [2024-04-03 01:26:37 +0000] [27] [INFO] Starting gunicorn 20.1.0 2024-04-03T01:26:37.768264196Z [2024-04-03 01:26:37 +0000] [27] [INFO] Listening at: http://[::]:8793 (27) 2024-04-03T01:26:37.768279807Z [2024-04-03 01:26:37 +0000] [27] [INFO] Using worker: sync 2024-04-03T01:26:37.881865624Z [2024-04-03 01:26:37 +0000] [28] [INFO] Booting worker with pid: 28 2024-04-03T01:26:37.945758493Z [2024-04-03 01:26:37 +0000] [29] [INFO] Booting worker with pid: 29 2024-04-03T01:26:39.290359129Z 2024-04-03T01:26:39.290378430Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-04-03T01:26:39.290382882Z --- ***** ----- 2024-04-03T01:26:39.290386637Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-04-03 01:26:39 2024-04-03T01:26:39.290389686Z - *** --- * --- 2024-04-03T01:26:39.290393070Z - ** ---------- [config] 2024-04-03T01:26:39.290396668Z - ** ---------- .> app: airflow.executors.celery_executor:0x7fc185ccc220 2024-04-03T01:26:39.290399793Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-04-03T01:26:39.290403311Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-04-03T01:26:39.290407302Z - *** --- * --- .> concurrency: 16 (prefork) 2024-04-03T01:26:39.290410286Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-04-03T01:26:39.290413403Z --- ***** ----- 2024-04-03T01:26:39.290416353Z -------------- [queues] 2024-04-03T01:26:39.290419366Z .> default exchange=default(direct) key=default 2024-04-03T01:26:39.290422476Z 2024-04-03T01:26:39.290425299Z 2024-04-03T01:26:39.290428277Z [tasks] 2024-04-03T01:26:39.290431712Z . airflow.executors.celery_executor.execute_command 2024-04-03T01:26:39.290434572Z 2024-04-03T01:26:56.294506332Z [2024-04-03 01:26:56,228: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-04-03T01:26:56.329703824Z [2024-04-03 01:26:56,329: INFO/MainProcess] mingle: searching for neighbors 2024-04-03T01:26:57.372501645Z [2024-04-03 01:26:57,371: INFO/MainProcess] mingle: all alone 2024-04-03T01:26:57.417366330Z [2024-04-03 01:26:57,417: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-04-03T01:26:57.428481534Z [2024-04-03 01:26:57,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22829b79-786d-427d-b4db-893abd1da5b4] received 2024-04-03T01:26:57.542971482Z [2024-04-03 01:26:57,541: INFO/ForkPoolWorker-15] [22829b79-786d-427d-b4db-893abd1da5b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:26:58.094925973Z [2024-04-03 01:26:58,087: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:26:58.718686820Z [2024-04-03 01:26:58,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:26:59.965267367Z [2024-04-03 01:26:59,964: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22829b79-786d-427d-b4db-893abd1da5b4] succeeded in 2.523647811999922s: None 2024-04-03T01:27:09.869880679Z [2024-04-03 01:27:09,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19ba3695-f27a-4245-a7a5-683874c40ddd] received 2024-04-03T01:27:09.891503110Z [2024-04-03 01:27:09,891: INFO/ForkPoolWorker-15] [19ba3695-f27a-4245-a7a5-683874c40ddd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:27:10.492429483Z [2024-04-03 01:27:10,488: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:27:11.011911825Z [2024-04-03 01:27:11,011: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:27:12.155925226Z [2024-04-03 01:27:12,147: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19ba3695-f27a-4245-a7a5-683874c40ddd] succeeded in 2.2741656379999995s: None 2024-04-03T01:28:01.139834533Z [2024-04-03 01:28:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6d0e275-f370-47b3-bd29-d4e94603a31e] received 2024-04-03T01:28:01.230468790Z [2024-04-03 01:28:01,230: INFO/ForkPoolWorker-15] [a6d0e275-f370-47b3-bd29-d4e94603a31e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:28:01.895904056Z [2024-04-03 01:28:01,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:28:02.344589062Z [2024-04-03 01:28:02,344: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:28:03.357503654Z [2024-04-03 01:28:03,357: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6d0e275-f370-47b3-bd29-d4e94603a31e] succeeded in 2.2051390640000363s: None 2024-04-03T01:30:00.930961125Z [2024-04-03 01:30:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57e24518-b7a6-460c-be6f-965063151a0f] received 2024-04-03T01:30:00.988268255Z [2024-04-03 01:30:00,986: INFO/ForkPoolWorker-15] [57e24518-b7a6-460c-be6f-965063151a0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:30:01.483712599Z [2024-04-03 01:30:01,476: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:30:01.869582927Z [2024-04-03 01:30:01,869: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:30:02.560259383Z [2024-04-03 01:30:02,559: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57e24518-b7a6-460c-be6f-965063151a0f] succeeded in 1.6112998969999808s: None 2024-04-03T01:32:00.670142863Z [2024-04-03 01:32:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18594e17-4b89-44fe-884b-a74fc0840783] received 2024-04-03T01:32:00.705881011Z [2024-04-03 01:32:00,705: INFO/ForkPoolWorker-15] [18594e17-4b89-44fe-884b-a74fc0840783] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:32:01.234100717Z [2024-04-03 01:32:01,226: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:32:01.664633082Z [2024-04-03 01:32:01,664: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:32:02.386272849Z [2024-04-03 01:32:02,384: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18594e17-4b89-44fe-884b-a74fc0840783] succeeded in 1.7085088110000015s: None 2024-04-03T01:33:43.102535409Z [2024-04-03 01:33:43,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf380a74-d94f-4fa3-b394-64e901fb6ba0] received 2024-04-03T01:33:43.126497600Z [2024-04-03 01:33:43,124: INFO/ForkPoolWorker-15] [bf380a74-d94f-4fa3-b394-64e901fb6ba0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:33:43.612338633Z [2024-04-03 01:33:43,603: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:33:44.541212937Z [2024-04-03 01:33:44,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db02786b-5066-4570-9682-5dfe8c04de89] received 2024-04-03T01:33:44.617230902Z [2024-04-03 01:33:44,616: INFO/ForkPoolWorker-16] [db02786b-5066-4570-9682-5dfe8c04de89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:33:45.053613072Z [2024-04-03 01:33:45,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:33:45.518102512Z [2024-04-03 01:33:45,517: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:33:45.522175891Z [2024-04-03 01:33:45,521: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:33:45.570038301Z [2024-04-03 01:33:45,569: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:33:45.580972641Z [2024-04-03 01:33:45,580: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:33:45.581138208Z [2024-04-03 01:33:45,580: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:33:45.581413922Z [2024-04-03 01:33:45,581: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:33:45.581527240Z [2024-04-03 01:33:45,581: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:33:45.581825225Z [2024-04-03 01:33:45,581: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:33:45.581958746Z [2024-04-03 01:33:45,581: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:33:45.667552789Z [2024-04-03 01:33:45,667: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:33:46.555374947Z [2024-04-03 01:33:46,554: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:33:46.558868702Z [2024-04-03 01:33:46,558: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:33:46.595019247Z [2024-04-03 01:33:46,594: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:33:46.597221304Z [2024-04-03 01:33:46,596: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:33:46.597353819Z [2024-04-03 01:33:46,597: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:33:46.597596871Z [2024-04-03 01:33:46,597: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:33:46.597701351Z [2024-04-03 01:33:46,597: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:33:46.597999404Z [2024-04-03 01:33:46,597: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:33:46.598090824Z [2024-04-03 01:33:46,597: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:33:46.735562870Z [2024-04-03 01:33:46,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:33:47.512616598Z [2024-04-03 01:33:47,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf380a74-d94f-4fa3-b394-64e901fb6ba0] succeeded in 4.406368553999982s: None 2024-04-03T01:33:48.353352374Z [2024-04-03 01:33:48,350: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db02786b-5066-4570-9682-5dfe8c04de89] succeeded in 3.8060688230000324s: None 2024-04-03T01:33:51.441888824Z [2024-04-03 01:33:51,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60040a47-4e92-468a-97e4-08a83d02c3c0] received 2024-04-03T01:33:51.445135624Z [2024-04-03 01:33:51,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61e083ba-452c-4d27-9050-671ead7a5072] received 2024-04-03T01:33:51.455822944Z [2024-04-03 01:33:51,455: INFO/ForkPoolWorker-15] [60040a47-4e92-468a-97e4-08a83d02c3c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:33:51.469914398Z [2024-04-03 01:33:51,469: INFO/ForkPoolWorker-16] [61e083ba-452c-4d27-9050-671ead7a5072] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:33:51.869943398Z [2024-04-03 01:33:51,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:33:51.874924060Z [2024-04-03 01:33:51,871: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:33:53.440386166Z [2024-04-03 01:33:53,440: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:33:53.444479055Z [2024-04-03 01:33:53,443: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:33:53.456523072Z [2024-04-03 01:33:53,456: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:33:53.461270688Z [2024-04-03 01:33:53,460: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:33:53.503447959Z [2024-04-03 01:33:53,503: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:33:53.506028117Z [2024-04-03 01:33:53,505: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:33:53.506040916Z [2024-04-03 01:33:53,505: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:33:53.506080689Z [2024-04-03 01:33:53,505: INFO/ForkPoolWorker-16] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:33:53.506241735Z [2024-04-03 01:33:53,506: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:33:53.506248291Z [2024-04-03 01:33:53,506: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:33:53.506465447Z [2024-04-03 01:33:53,506: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:33:53.506474857Z [2024-04-03 01:33:53,506: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:33:53.518730436Z [2024-04-03 01:33:53,518: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:33:53.520168025Z [2024-04-03 01:33:53,519: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:33:53.520180808Z [2024-04-03 01:33:53,520: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:33:53.520226778Z [2024-04-03 01:33:53,520: INFO/ForkPoolWorker-15] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:33:53.520388344Z [2024-04-03 01:33:53,520: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:33:53.520433157Z [2024-04-03 01:33:53,520: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:33:53.520692636Z [2024-04-03 01:33:53,520: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:33:53.520703034Z [2024-04-03 01:33:53,520: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:33:53.527719814Z [2024-04-03 01:33:53,527: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:33:53.528768645Z [2024-04-03 01:33:53,528: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:33:53.618965437Z [2024-04-03 01:33:53,618: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:33:53.639539716Z [2024-04-03 01:33:53,639: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:33:54.243617088Z [2024-04-03 01:33:54,243: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61e083ba-452c-4d27-9050-671ead7a5072] succeeded in 2.7966117510000004s: None 2024-04-03T01:33:54.378535958Z [2024-04-03 01:33:54,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60040a47-4e92-468a-97e4-08a83d02c3c0] succeeded in 2.9347182040000916s: None 2024-04-03T01:33:54.776439231Z [2024-04-03 01:33:54,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78024678-c1ad-4145-9c8f-f581fe70f5cd] received 2024-04-03T01:33:54.784453072Z [2024-04-03 01:33:54,784: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72e5e62b-6397-4c35-9dca-d6b21548a836] received 2024-04-03T01:33:54.792690154Z [2024-04-03 01:33:54,792: INFO/ForkPoolWorker-15] [78024678-c1ad-4145-9c8f-f581fe70f5cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:33:54.798396000Z [2024-04-03 01:33:54,798: INFO/ForkPoolWorker-16] [72e5e62b-6397-4c35-9dca-d6b21548a836] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'split_metrics', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:33:55.142312829Z [2024-04-03 01:33:55,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:33:55.252803990Z [2024-04-03 01:33:55,249: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:33:56.530736371Z [2024-04-03 01:33:56,530: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:33:56.534434676Z [2024-04-03 01:33:56,533: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:33:56.545391043Z [2024-04-03 01:33:56,545: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:33:56.555695952Z [2024-04-03 01:33:56,555: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:33:56.562098136Z [2024-04-03 01:33:56,561: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:33:56.563049884Z [2024-04-03 01:33:56,562: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:33:56.563151224Z [2024-04-03 01:33:56,562: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:33:56.563245214Z [2024-04-03 01:33:56,563: INFO/ForkPoolWorker-16] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:33:56.563430077Z [2024-04-03 01:33:56,563: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:33:56.563466589Z [2024-04-03 01:33:56,563: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:33:56.563707039Z [2024-04-03 01:33:56,563: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:33:56.563757166Z [2024-04-03 01:33:56,563: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:33:56.570377589Z [2024-04-03 01:33:56,570: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:33:56.580790777Z [2024-04-03 01:33:56,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:33:56.581827917Z [2024-04-03 01:33:56,581: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:33:56.581918468Z [2024-04-03 01:33:56,581: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:33:56.581999457Z [2024-04-03 01:33:56,581: INFO/ForkPoolWorker-15] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:33:56.582173309Z [2024-04-03 01:33:56,582: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:33:56.582221088Z [2024-04-03 01:33:56,582: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:33:56.582530421Z [2024-04-03 01:33:56,582: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:33:56.584144762Z [2024-04-03 01:33:56,583: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:33:56.589631998Z [2024-04-03 01:33:56,589: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:33:56.681333448Z [2024-04-03 01:33:56,680: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:33:56.727579301Z [2024-04-03 01:33:56,727: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:33:57.323644247Z [2024-04-03 01:33:57,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78024678-c1ad-4145-9c8f-f581fe70f5cd] succeeded in 2.540676787999928s: None 2024-04-03T01:33:57.325383898Z [2024-04-03 01:33:57,325: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[72e5e62b-6397-4c35-9dca-d6b21548a836] succeeded in 2.534618808999994s: None 2024-04-03T01:33:58.376832588Z [2024-04-03 01:33:58,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff213e43-488c-432b-9b36-3ecf5c5e2779] received 2024-04-03T01:33:58.388458109Z [2024-04-03 01:33:58,388: INFO/ForkPoolWorker-15] [ff213e43-488c-432b-9b36-3ecf5c5e2779] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'collect_metrics', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:33:58.389824077Z [2024-04-03 01:33:58,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[339c0dd2-b9f6-4853-8ebd-58674da1fb9c] received 2024-04-03T01:33:58.400828247Z [2024-04-03 01:33:58,400: INFO/ForkPoolWorker-16] [339c0dd2-b9f6-4853-8ebd-58674da1fb9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:33:58.851570559Z [2024-04-03 01:33:58,845: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:33:58.863724000Z [2024-04-03 01:33:58,856: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:34:00.802705343Z [2024-04-03 01:34:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6daaa08b-2da2-4c81-82bd-3676aed44204] received 2024-04-03T01:34:00.884166163Z [2024-04-03 01:34:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7feb237d-b6db-4c77-8ba4-56aa77059c69] received 2024-04-03T01:34:00.889598159Z [2024-04-03 01:34:00,889: INFO/ForkPoolWorker-1] [6daaa08b-2da2-4c81-82bd-3676aed44204] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:34:00.934437420Z [2024-04-03 01:34:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f2998b8-b94b-4063-9435-234f18619596] received 2024-04-03T01:34:00.998176001Z [2024-04-03 01:34:00,997: INFO/ForkPoolWorker-2] [7feb237d-b6db-4c77-8ba4-56aa77059c69] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:34:01.022996658Z [2024-04-03 01:34:01,022: INFO/ForkPoolWorker-3] [4f2998b8-b94b-4063-9435-234f18619596] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:34:01.781065703Z [2024-04-03 01:34:01,780: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:34:01.867485985Z [2024-04-03 01:34:01,859: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:34:01.917704965Z [2024-04-03 01:34:01,913: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:34:01.994914693Z [2024-04-03 01:34:01,994: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:34:02.030704581Z [2024-04-03 01:34:02,030: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:34:02.121335883Z [2024-04-03 01:34:02,111: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:34:02.128018128Z [2024-04-03 01:34:02,127: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:34:02.143809858Z [2024-04-03 01:34:02,143: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:34:02.143850693Z [2024-04-03 01:34:02,143: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:34:02.143900020Z [2024-04-03 01:34:02,143: INFO/ForkPoolWorker-15] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:34:02.144021684Z [2024-04-03 01:34:02,143: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:34:02.144082763Z [2024-04-03 01:34:02,143: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:34:02.144311418Z [2024-04-03 01:34:02,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:34:02.144325635Z [2024-04-03 01:34:02,144: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:34:02.152262470Z [2024-04-03 01:34:02,151: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:34:02.286027072Z [2024-04-03 01:34:02,285: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:34:02.292316558Z [2024-04-03 01:34:02,291: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:34:02.292499974Z [2024-04-03 01:34:02,292: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:34:02.297120978Z [2024-04-03 01:34:02,296: INFO/ForkPoolWorker-16] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:34:02.297572508Z [2024-04-03 01:34:02,297: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:34:02.297752306Z [2024-04-03 01:34:02,297: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:34:02.300166461Z [2024-04-03 01:34:02,299: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:34:02.300597532Z [2024-04-03 01:34:02,300: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:34:02.319023188Z [2024-04-03 01:34:02,318: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:02.338781465Z [2024-04-03 01:34:02,338: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:34:02.425837728Z [2024-04-03 01:34:02,421: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:34:02.790701649Z [2024-04-03 01:34:02,790: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:03.171817527Z [2024-04-03 01:34:03,171: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:04.471792640Z [2024-04-03 01:34:04,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff213e43-488c-432b-9b36-3ecf5c5e2779] succeeded in 6.091137986999911s: None 2024-04-03T01:34:05.042167925Z [2024-04-03 01:34:05,041: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7feb237d-b6db-4c77-8ba4-56aa77059c69] succeeded in 4.151238464000016s: None 2024-04-03T01:34:05.332896141Z [2024-04-03 01:34:05,332: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[339c0dd2-b9f6-4853-8ebd-58674da1fb9c] succeeded in 6.940109901999904s: None 2024-04-03T01:34:05.349059472Z [2024-04-03 01:34:05,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bffcb82b-0993-4ea6-9d85-4dd64d393bff] received 2024-04-03T01:34:05.372229960Z [2024-04-03 01:34:05,371: INFO/ForkPoolWorker-15] [bffcb82b-0993-4ea6-9d85-4dd64d393bff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:34:05.391332674Z [2024-04-03 01:34:05,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84a473e2-a656-46ef-81aa-426f310580e6] received 2024-04-03T01:34:05.427702781Z [2024-04-03 01:34:05,427: INFO/ForkPoolWorker-16] [84a473e2-a656-46ef-81aa-426f310580e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'send_prometheus', 'scheduled__2024-04-03T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:34:06.009702089Z [2024-04-03 01:34:06,009: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-03T01:34:06.013702879Z [2024-04-03 01:34:06,013: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:34:06.030447931Z [2024-04-03 01:34:06,030: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:34:06.044241785Z [2024-04-03 01:34:06,043: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:34:06.079708041Z [2024-04-03 01:34:06,079: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-03T01:34:06.085889835Z [2024-04-03 01:34:06,085: INFO/ForkPoolWorker-3] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:34:06.086015729Z [2024-04-03 01:34:06,085: INFO/ForkPoolWorker-3] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:34:06.086113923Z [2024-04-03 01:34:06,085: INFO/ForkPoolWorker-3] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:34:06.086304276Z [2024-04-03 01:34:06,086: INFO/ForkPoolWorker-3] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:34:06.086359617Z [2024-04-03 01:34:06,086: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-03T01:34:06.092685986Z [2024-04-03 01:34:06,090: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:34:06.092826486Z [2024-04-03 01:34:06,092: INFO/ForkPoolWorker-3] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:34:06.098464426Z [2024-04-03 01:34:06,098: INFO/ForkPoolWorker-3] Creating DAG vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:34:06.103459763Z [2024-04-03 01:34:06,103: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:34:06.105395924Z [2024-04-03 01:34:06,105: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:34:06.105757341Z [2024-04-03 01:34:06,105: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:34:06.105957319Z [2024-04-03 01:34:06,105: INFO/ForkPoolWorker-1] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:34:06.106200077Z [2024-04-03 01:34:06,105: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:34:06.106250318Z [2024-04-03 01:34:06,106: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:34:06.106620419Z [2024-04-03 01:34:06,106: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:34:06.106783356Z [2024-04-03 01:34:06,106: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:34:06.114080498Z [2024-04-03 01:34:06,113: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:34:06.216218006Z [2024-04-03 01:34:06,211: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:34:06.364836304Z [2024-04-03 01:34:06,364: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:06.366657861Z [2024-04-03 01:34:06,366: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:06.441538802Z [2024-04-03 01:34:06,420: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:34:08.164038390Z [2024-04-03 01:34:08,163: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:34:08.168079240Z [2024-04-03 01:34:08,167: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:34:08.208281775Z [2024-04-03 01:34:08,208: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:34:08.210513356Z [2024-04-03 01:34:08,210: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:34:08.210804624Z [2024-04-03 01:34:08,210: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:34:08.210987693Z [2024-04-03 01:34:08,210: INFO/ForkPoolWorker-16] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:34:08.211209470Z [2024-04-03 01:34:08,210: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:34:08.211365794Z [2024-04-03 01:34:08,211: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:34:08.211789833Z [2024-04-03 01:34:08,211: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:34:08.211906621Z [2024-04-03 01:34:08,211: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:34:08.221664148Z [2024-04-03 01:34:08,221: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:34:08.289730720Z [2024-04-03 01:34:08,289: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:34:08.295160025Z [2024-04-03 01:34:08,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:34:08.332936149Z [2024-04-03 01:34:08,332: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:08.358972895Z [2024-04-03 01:34:08,358: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:34:08.360201969Z [2024-04-03 01:34:08,360: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:34:08.360221393Z [2024-04-03 01:34:08,360: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:34:08.360291125Z [2024-04-03 01:34:08,360: INFO/ForkPoolWorker-15] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:34:08.360436250Z [2024-04-03 01:34:08,360: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:34:08.360447216Z [2024-04-03 01:34:08,360: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:34:08.360676164Z [2024-04-03 01:34:08,360: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:34:08.360701965Z [2024-04-03 01:34:08,360: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:34:08.367476894Z [2024-04-03 01:34:08,367: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:34:08.535958435Z [2024-04-03 01:34:08,535: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:08.580995986Z [2024-04-03 01:34:08,580: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4f2998b8-b94b-4063-9435-234f18619596] succeeded in 7.640385573999993s: None 2024-04-03T01:34:08.715811316Z [2024-04-03 01:34:08,715: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6daaa08b-2da2-4c81-82bd-3676aed44204] succeeded in 7.910295557999916s: None 2024-04-03T01:34:09.309448109Z [2024-04-03 01:34:09,308: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[84a473e2-a656-46ef-81aa-426f310580e6] succeeded in 3.91338388500003s: None 2024-04-03T01:34:09.325857388Z [2024-04-03 01:34:09,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bffcb82b-0993-4ea6-9d85-4dd64d393bff] succeeded in 3.9703495449998627s: None 2024-04-03T01:34:16.485849959Z [2024-04-03 01:34:16,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5424714-0772-43a6-b057-bb344a6237ff] received 2024-04-03T01:34:16.508079164Z [2024-04-03 01:34:16,506: INFO/ForkPoolWorker-15] [c5424714-0772-43a6-b057-bb344a6237ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:34:16.924955551Z [2024-04-03 01:34:16,921: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:34:17.880170817Z [2024-04-03 01:34:17,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86ff32ba-de91-4e30-96ad-2b4543834d86] received 2024-04-03T01:34:17.891522029Z [2024-04-03 01:34:17,891: INFO/ForkPoolWorker-16] [86ff32ba-de91-4e30-96ad-2b4543834d86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:34:18.319478809Z [2024-04-03 01:34:18,315: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:34:18.401171441Z [2024-04-03 01:34:18,400: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:34:18.404820207Z [2024-04-03 01:34:18,404: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:34:18.445742389Z [2024-04-03 01:34:18,445: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:34:18.447136321Z [2024-04-03 01:34:18,446: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:34:18.447349506Z [2024-04-03 01:34:18,447: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:34:18.447504993Z [2024-04-03 01:34:18,447: INFO/ForkPoolWorker-15] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:34:18.447680924Z [2024-04-03 01:34:18,447: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:34:18.447840985Z [2024-04-03 01:34:18,447: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:34:18.448201982Z [2024-04-03 01:34:18,448: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:34:18.448327030Z [2024-04-03 01:34:18,448: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:34:18.452944513Z [2024-04-03 01:34:18,452: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:34:18.556532329Z [2024-04-03 01:34:18,556: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:20.285194984Z [2024-04-03 01:34:20,284: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:34:20.312269094Z [2024-04-03 01:34:20,309: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:34:20.488056926Z [2024-04-03 01:34:20,487: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:34:20.490327476Z [2024-04-03 01:34:20,490: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:34:20.490565769Z [2024-04-03 01:34:20,490: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:34:20.490773979Z [2024-04-03 01:34:20,490: INFO/ForkPoolWorker-16] Read VIM 5af9ecc6-b0f9-4b4c-af84-697f61824f4c (basic01_258205) 2024-04-03T01:34:20.491007993Z [2024-04-03 01:34:20,490: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'name': 'basic01_258205', 'vim_type': 'openstack'}] 2024-04-03T01:34:20.491193299Z [2024-04-03 01:34:20,491: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:34:20.491537588Z [2024-04-03 01:34:20,491: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:34:20.492222846Z [2024-04-03 01:34:20,492: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:34:20.501314860Z [2024-04-03 01:34:20,501: INFO/ForkPoolWorker-16] Creating DAG vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c 2024-04-03T01:34:20.621763322Z [2024-04-03 01:34:20,621: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5424714-0772-43a6-b057-bb344a6237ff] succeeded in 4.128717563000009s: None 2024-04-03T01:34:20.848853519Z [2024-04-03 01:34:20,848: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:34:22.936976797Z [2024-04-03 01:34:22,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86ff32ba-de91-4e30-96ad-2b4543834d86] succeeded in 5.0546946660001595s: None 2024-04-03T01:35:01.299366654Z [2024-04-03 01:35:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd65fd13-bf90-42a4-9d52-dd00ae5f851a] received 2024-04-03T01:35:01.303037608Z [2024-04-03 01:35:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2be5c43a-a271-4d6c-9732-6d00f0e2755b] received 2024-04-03T01:35:01.313130716Z [2024-04-03 01:35:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b591eea5-7672-480a-bdfa-5786e4fac921] received 2024-04-03T01:35:01.314017985Z [2024-04-03 01:35:01,313: INFO/ForkPoolWorker-16] [2be5c43a-a271-4d6c-9732-6d00f0e2755b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:01.320085209Z [2024-04-03 01:35:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[123ab188-8ad0-40ab-b5f5-65c9e756e433] received 2024-04-03T01:35:01.322325623Z [2024-04-03 01:35:01,321: INFO/ForkPoolWorker-15] [bd65fd13-bf90-42a4-9d52-dd00ae5f851a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:35:01.331544954Z [2024-04-03 01:35:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57029698-37a1-4719-9e93-0890129ac3c9] received 2024-04-03T01:35:01.335890266Z [2024-04-03 01:35:01,335: INFO/ForkPoolWorker-1] [b591eea5-7672-480a-bdfa-5786e4fac921] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:35:01.338409220Z [2024-04-03 01:35:01,337: INFO/ForkPoolWorker-2] [123ab188-8ad0-40ab-b5f5-65c9e756e433] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:35:01.354681538Z [2024-04-03 01:35:01,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a050e2f-bec2-4ea7-91e5-c429e49754d5] received 2024-04-03T01:35:01.371989437Z [2024-04-03 01:35:01,371: INFO/ForkPoolWorker-3] [57029698-37a1-4719-9e93-0890129ac3c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:01.437122647Z [2024-04-03 01:35:01,436: INFO/ForkPoolWorker-4] [3a050e2f-bec2-4ea7-91e5-c429e49754d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:35:01.755851534Z [2024-04-03 01:35:01,750: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:35:01.833495599Z [2024-04-03 01:35:01,829: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:01.937700068Z [2024-04-03 01:35:01,934: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:01.977115760Z [2024-04-03 01:35:01,972: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:35:02.022261443Z [2024-04-03 01:35:02,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:35:02.135585637Z [2024-04-03 01:35:02,131: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:35:04.294748175Z [2024-04-03 01:35:04,291: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:35:04.296705907Z [2024-04-03 01:35:04,295: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:04.331368587Z [2024-04-03 01:35:04,330: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-03T01:35:04.337691483Z [2024-04-03 01:35:04,336: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:04.339757686Z [2024-04-03 01:35:04,339: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:35:04.340887971Z [2024-04-03 01:35:04,340: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:04.340982575Z [2024-04-03 01:35:04,340: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:04.341994568Z [2024-04-03 01:35:04,341: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:04.342092574Z [2024-04-03 01:35:04,341: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:35:04.342804608Z [2024-04-03 01:35:04,342: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:35:04.342818245Z [2024-04-03 01:35:04,342: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:04.356465775Z [2024-04-03 01:35:04,356: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:04.357641839Z [2024-04-03 01:35:04,356: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:04.359004304Z [2024-04-03 01:35:04,358: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:35:04.362757056Z [2024-04-03 01:35:04,362: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:04.424283901Z [2024-04-03 01:35:04,424: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-03T01:35:04.426553497Z [2024-04-03 01:35:04,425: INFO/ForkPoolWorker-3] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:04.429212892Z [2024-04-03 01:35:04,426: INFO/ForkPoolWorker-3] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:04.429509732Z [2024-04-03 01:35:04,429: INFO/ForkPoolWorker-3] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:04.430031647Z [2024-04-03 01:35:04,429: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-03T01:35:04.431330273Z [2024-04-03 01:35:04,431: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:35:04.432801412Z [2024-04-03 01:35:04,431: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:04.542762148Z [2024-04-03 01:35:04,542: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:35:04.548552335Z [2024-04-03 01:35:04,548: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:04.549334938Z [2024-04-03 01:35:04,548: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:04.549750900Z [2024-04-03 01:35:04,549: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:04.549881843Z [2024-04-03 01:35:04,549: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:35:04.555588927Z [2024-04-03 01:35:04,551: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:35:04.555964544Z [2024-04-03 01:35:04,555: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:04.565020017Z [2024-04-03 01:35:04,564: ERROR/ForkPoolWorker-16] [2be5c43a-a271-4d6c-9732-6d00f0e2755b] Failed to execute task Dag 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:35:04.565125526Z Traceback (most recent call last): 2024-04-03T01:35:04.565130285Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:35:04.565133972Z args.func(args) 2024-04-03T01:35:04.565138864Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:35:04.565142799Z return func(*args, **kwargs) 2024-04-03T01:35:04.565145915Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:35:04.565149000Z return f(*args, **kwargs) 2024-04-03T01:35:04.565152045Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:35:04.565155202Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:35:04.565170029Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:35:04.565173388Z raise AirflowException( 2024-04-03T01:35:04.565177117Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:35:04.719007068Z [2024-04-03 01:35:04,718: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2be5c43a-a271-4d6c-9732-6d00f0e2755b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2be5c43a-a271-4d6c-9732-6d00f0e2755b') 2024-04-03T01:35:04.719024086Z Traceback (most recent call last): 2024-04-03T01:35:04.719028253Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:35:04.719031829Z R = retval = fun(*args, **kwargs) 2024-04-03T01:35:04.719034843Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:35:04.719037939Z return self.run(*args, **kwargs) 2024-04-03T01:35:04.719041961Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:35:04.719045929Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:35:04.719049148Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:35:04.719052943Z raise AirflowException(msg) 2024-04-03T01:35:04.719056570Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2be5c43a-a271-4d6c-9732-6d00f0e2755b 2024-04-03T01:35:04.812015861Z [2024-04-03 01:35:04,811: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:35:04.816349401Z [2024-04-03 01:35:04,815: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-03T01:35:04.819890025Z [2024-04-03 01:35:04,819: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:04.846246619Z [2024-04-03 01:35:04,845: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:35:04.871458633Z [2024-04-03 01:35:04,866: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:04.911695754Z [2024-04-03 01:35:04,911: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-03T01:35:04.914897079Z [2024-04-03 01:35:04,914: INFO/ForkPoolWorker-4] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:04.915069591Z [2024-04-03 01:35:04,914: INFO/ForkPoolWorker-4] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:04.915273435Z [2024-04-03 01:35:04,915: INFO/ForkPoolWorker-4] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:04.915385312Z [2024-04-03 01:35:04,915: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-03T01:35:04.915746671Z [2024-04-03 01:35:04,915: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:35:04.915771796Z [2024-04-03 01:35:04,915: INFO/ForkPoolWorker-4] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:04.982401968Z [2024-04-03 01:35:04,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:35:04.987258684Z [2024-04-03 01:35:04,986: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:04.987299725Z [2024-04-03 01:35:04,987: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:04.987414178Z [2024-04-03 01:35:04,987: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:04.987455693Z [2024-04-03 01:35:04,987: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:35:04.987728833Z [2024-04-03 01:35:04,987: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:35:04.987766632Z [2024-04-03 01:35:04,987: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:05.105497318Z [2024-04-03 01:35:05,105: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:35:05.183445045Z [2024-04-03 01:35:05,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:35:05.288554869Z [2024-04-03 01:35:05,288: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T01:35:05.293055295Z [2024-04-03 01:35:05,292: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:05.437481498Z [2024-04-03 01:35:05,436: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:35:05.442137930Z [2024-04-03 01:35:05,441: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:05.483856997Z [2024-04-03 01:35:05,483: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T01:35:05.491613928Z [2024-04-03 01:35:05,491: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:05.491652441Z [2024-04-03 01:35:05,491: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:05.491798881Z [2024-04-03 01:35:05,491: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:05.491873020Z [2024-04-03 01:35:05,491: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T01:35:05.492177773Z [2024-04-03 01:35:05,492: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:35:05.492196795Z [2024-04-03 01:35:05,492: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:05.510713065Z [2024-04-03 01:35:05,510: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:35:05.511873957Z [2024-04-03 01:35:05,510: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:35:05.512810395Z [2024-04-03 01:35:05,512: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T01:35:05.569213737Z [2024-04-03 01:35:05,562: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:05.613957391Z [2024-04-03 01:35:05,613: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:35:05.640804806Z [2024-04-03 01:35:05,640: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:05.640816886Z [2024-04-03 01:35:05,640: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:05.640952441Z [2024-04-03 01:35:05,640: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:05.640961558Z [2024-04-03 01:35:05,640: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:35:05.647589460Z [2024-04-03 01:35:05,647: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:35:05.647796470Z [2024-04-03 01:35:05,647: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:05.670294639Z [2024-04-03 01:35:05,669: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T01:35:05.671519213Z [2024-04-03 01:35:05,671: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:05.671532088Z [2024-04-03 01:35:05,671: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:05.671657589Z [2024-04-03 01:35:05,671: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:05.671664431Z [2024-04-03 01:35:05,671: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T01:35:05.671922057Z [2024-04-03 01:35:05,671: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:35:05.671930674Z [2024-04-03 01:35:05,671: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:05.680044978Z [2024-04-03 01:35:05,679: ERROR/ForkPoolWorker-2] [123ab188-8ad0-40ab-b5f5-65c9e756e433] Failed to execute task Dag 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:35:05.680061223Z Traceback (most recent call last): 2024-04-03T01:35:05.680065512Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:35:05.680069400Z args.func(args) 2024-04-03T01:35:05.680073164Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:35:05.680076980Z return func(*args, **kwargs) 2024-04-03T01:35:05.680080046Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:35:05.680083258Z return f(*args, **kwargs) 2024-04-03T01:35:05.680086381Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:35:05.680126633Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:35:05.680130458Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:35:05.680133477Z raise AirflowException( 2024-04-03T01:35:05.680137183Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:35:05.681510229Z [2024-04-03 01:35:05,681: WARNING/ForkPoolWorker-1] Dag 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:35:05.690247870Z [2024-04-03 01:35:05,689: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:35:05.691799324Z [2024-04-03 01:35:05,691: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:35:05.698191719Z [2024-04-03 01:35:05,697: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:05.763312161Z [2024-04-03 01:35:05,762: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:35:05.764572458Z [2024-04-03 01:35:05,764: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:05.764585188Z [2024-04-03 01:35:05,764: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:05.764693438Z [2024-04-03 01:35:05,764: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:05.764699257Z [2024-04-03 01:35:05,764: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:35:05.764979965Z [2024-04-03 01:35:05,764: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:35:05.764986357Z [2024-04-03 01:35:05,764: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:05.778479285Z [2024-04-03 01:35:05,777: ERROR/ForkPoolWorker-1] [b591eea5-7672-480a-bdfa-5786e4fac921] Failed to execute task Dag 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:35:05.778537582Z Traceback (most recent call last): 2024-04-03T01:35:05.778542611Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:35:05.778546251Z args.func(args) 2024-04-03T01:35:05.778550115Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:35:05.778557536Z return func(*args, **kwargs) 2024-04-03T01:35:05.778560753Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:35:05.778563911Z return f(*args, **kwargs) 2024-04-03T01:35:05.778566917Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:35:05.778570146Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:35:05.778573277Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:35:05.778576271Z raise AirflowException( 2024-04-03T01:35:05.778580220Z airflow.exceptions.AirflowException: Dag 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:35:05.789426545Z [2024-04-03 01:35:05,788: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[123ab188-8ad0-40ab-b5f5-65c9e756e433] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 123ab188-8ad0-40ab-b5f5-65c9e756e433') 2024-04-03T01:35:05.789444261Z Traceback (most recent call last): 2024-04-03T01:35:05.789449077Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:35:05.789452192Z R = retval = fun(*args, **kwargs) 2024-04-03T01:35:05.789473996Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:35:05.789477453Z return self.run(*args, **kwargs) 2024-04-03T01:35:05.789487775Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:35:05.789492069Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:35:05.789500112Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:35:05.789504228Z raise AirflowException(msg) 2024-04-03T01:35:05.789507990Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 123ab188-8ad0-40ab-b5f5-65c9e756e433 2024-04-03T01:35:05.800095313Z [2024-04-03 01:35:05,799: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[57029698-37a1-4719-9e93-0890129ac3c9] succeeded in 4.458647110000129s: None 2024-04-03T01:35:05.858357440Z [2024-04-03 01:35:05,857: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b591eea5-7672-480a-bdfa-5786e4fac921] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b591eea5-7672-480a-bdfa-5786e4fac921') 2024-04-03T01:35:05.858377834Z Traceback (most recent call last): 2024-04-03T01:35:05.858386536Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:35:05.858389914Z R = retval = fun(*args, **kwargs) 2024-04-03T01:35:05.858436120Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:35:05.858471089Z return self.run(*args, **kwargs) 2024-04-03T01:35:05.858475720Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:35:05.858504216Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:35:05.858508133Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:35:05.858511755Z raise AirflowException(msg) 2024-04-03T01:35:05.858515843Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b591eea5-7672-480a-bdfa-5786e4fac921 2024-04-03T01:35:06.750426318Z [2024-04-03 01:35:06,749: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd69b266-6b4a-4f56-99f0-5598e0889ece] received 2024-04-03T01:35:06.764570044Z [2024-04-03 01:35:06,764: INFO/ForkPoolWorker-16] [cd69b266-6b4a-4f56-99f0-5598e0889ece] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:07.061196477Z [2024-04-03 01:35:07,057: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:07.584748284Z [2024-04-03 01:35:07,584: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[3a050e2f-bec2-4ea7-91e5-c429e49754d5] succeeded in 6.226221330000044s: None 2024-04-03T01:35:07.996083835Z [2024-04-03 01:35:07,995: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd65fd13-bf90-42a4-9d52-dd00ae5f851a] succeeded in 6.694031929000175s: None 2024-04-03T01:35:08.391334998Z [2024-04-03 01:35:08,390: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:35:08.395034266Z [2024-04-03 01:35:08,394: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:08.431769910Z [2024-04-03 01:35:08,431: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:35:08.433645841Z [2024-04-03 01:35:08,433: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:08.433661493Z [2024-04-03 01:35:08,433: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:08.433879811Z [2024-04-03 01:35:08,433: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:08.433953143Z [2024-04-03 01:35:08,433: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:35:08.435162936Z [2024-04-03 01:35:08,434: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:35:08.435230289Z [2024-04-03 01:35:08,435: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:08.536094812Z [2024-04-03 01:35:08,535: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:35:09.196545182Z [2024-04-03 01:35:09,196: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cd69b266-6b4a-4f56-99f0-5598e0889ece] succeeded in 2.4434161570000015s: None 2024-04-03T01:35:09.639498717Z [2024-04-03 01:35:09,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9723f860-9748-406e-9d76-14cfeed9284b] received 2024-04-03T01:35:09.648506701Z [2024-04-03 01:35:09,648: INFO/ForkPoolWorker-15] [9723f860-9748-406e-9d76-14cfeed9284b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:35:09.982964282Z [2024-04-03 01:35:09,978: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:11.484533672Z [2024-04-03 01:35:11,483: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:35:11.493794424Z [2024-04-03 01:35:11,492: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:11.550092678Z [2024-04-03 01:35:11,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:35:11.552989544Z [2024-04-03 01:35:11,552: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:11.553231860Z [2024-04-03 01:35:11,553: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:11.553483290Z [2024-04-03 01:35:11,553: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:11.553826996Z [2024-04-03 01:35:11,553: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:35:11.554250331Z [2024-04-03 01:35:11,554: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:35:11.554435770Z [2024-04-03 01:35:11,554: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:11.648617574Z [2024-04-03 01:35:11,648: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:35:12.297766566Z [2024-04-03 01:35:12,297: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9723f860-9748-406e-9d76-14cfeed9284b] succeeded in 2.655736557999944s: None 2024-04-03T01:35:13.064626748Z [2024-04-03 01:35:13,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24666cef-66bb-47b1-9c7b-58e2fc88cda0] received 2024-04-03T01:35:13.074466857Z [2024-04-03 01:35:13,074: INFO/ForkPoolWorker-15] [24666cef-66bb-47b1-9c7b-58e2fc88cda0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:13.478995491Z [2024-04-03 01:35:13,472: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:14.999518017Z [2024-04-03 01:35:14,999: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:35:15.005385134Z [2024-04-03 01:35:15,004: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:15.034126085Z [2024-04-03 01:35:15,033: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:35:15.035416529Z [2024-04-03 01:35:15,035: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:15.035533363Z [2024-04-03 01:35:15,035: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:15.035702528Z [2024-04-03 01:35:15,035: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:15.035793471Z [2024-04-03 01:35:15,035: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:35:15.036029308Z [2024-04-03 01:35:15,035: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:35:15.036124199Z [2024-04-03 01:35:15,036: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:15.118845037Z [2024-04-03 01:35:15,118: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:35:15.585990126Z [2024-04-03 01:35:15,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c76feeea-2abf-4cd3-ab80-006164b851c6] received 2024-04-03T01:35:15.601981872Z [2024-04-03 01:35:15,601: INFO/ForkPoolWorker-16] [c76feeea-2abf-4cd3-ab80-006164b851c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:35:15.783374842Z [2024-04-03 01:35:15,782: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24666cef-66bb-47b1-9c7b-58e2fc88cda0] succeeded in 2.7162845810000817s: None 2024-04-03T01:35:15.896936183Z [2024-04-03 01:35:15,893: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:16.871782194Z [2024-04-03 01:35:16,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ac80329-d2d4-4379-a09e-0e460d0f857a] received 2024-04-03T01:35:16.879999546Z [2024-04-03 01:35:16,879: INFO/ForkPoolWorker-15] [6ac80329-d2d4-4379-a09e-0e460d0f857a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:35:17.057445179Z [2024-04-03 01:35:17,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:35:17.059516115Z [2024-04-03 01:35:17,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a8a9ee3-b906-4b29-a241-b47d2e29adf4] received 2024-04-03T01:35:17.063260388Z [2024-04-03 01:35:17,062: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:17.086396769Z [2024-04-03 01:35:17,085: INFO/ForkPoolWorker-1] [1a8a9ee3-b906-4b29-a241-b47d2e29adf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:35:17.096349560Z [2024-04-03 01:35:17,096: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:35:17.097624514Z [2024-04-03 01:35:17,097: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:17.097710154Z [2024-04-03 01:35:17,097: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:17.097755967Z [2024-04-03 01:35:17,097: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:17.097823754Z [2024-04-03 01:35:17,097: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:35:17.098021950Z [2024-04-03 01:35:17,097: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:35:17.098054059Z [2024-04-03 01:35:17,097: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:17.107149804Z [2024-04-03 01:35:17,106: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:17.107798363Z [2024-04-03 01:35:17,107: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:35:17.108805271Z [2024-04-03 01:35:17,108: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:35:17.111845112Z [2024-04-03 01:35:17,111: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:17.140495414Z [2024-04-03 01:35:17,140: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:35:17.141462161Z [2024-04-03 01:35:17,141: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:17.141521777Z [2024-04-03 01:35:17,141: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:17.141638508Z [2024-04-03 01:35:17,141: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:17.141673668Z [2024-04-03 01:35:17,141: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:35:17.141863130Z [2024-04-03 01:35:17,141: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:35:17.141908212Z [2024-04-03 01:35:17,141: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:17.151190324Z [2024-04-03 01:35:17,146: ERROR/ForkPoolWorker-16] [c76feeea-2abf-4cd3-ab80-006164b851c6] Failed to execute task Dag 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:35:17.151208205Z Traceback (most recent call last): 2024-04-03T01:35:17.151216601Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:35:17.151224184Z args.func(args) 2024-04-03T01:35:17.151232559Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:35:17.151240206Z return func(*args, **kwargs) 2024-04-03T01:35:17.151247125Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:35:17.151286570Z return f(*args, **kwargs) 2024-04-03T01:35:17.151323125Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:35:17.151341076Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:35:17.151351958Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:35:17.151362114Z raise AirflowException( 2024-04-03T01:35:17.151378092Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:35:17.193791287Z [2024-04-03 01:35:17,193: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c76feeea-2abf-4cd3-ab80-006164b851c6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c76feeea-2abf-4cd3-ab80-006164b851c6') 2024-04-03T01:35:17.193812226Z Traceback (most recent call last): 2024-04-03T01:35:17.193817193Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:35:17.193821168Z R = retval = fun(*args, **kwargs) 2024-04-03T01:35:17.193824529Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:35:17.193827705Z return self.run(*args, **kwargs) 2024-04-03T01:35:17.193832590Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:35:17.193837222Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:35:17.193840639Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:35:17.193845588Z raise AirflowException(msg) 2024-04-03T01:35:17.193849820Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c76feeea-2abf-4cd3-ab80-006164b851c6 2024-04-03T01:35:17.233240609Z [2024-04-03 01:35:17,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:35:17.536831100Z [2024-04-03 01:35:17,533: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:35:18.880490739Z [2024-04-03 01:35:18,880: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:35:18.883754107Z [2024-04-03 01:35:18,883: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:18.927869420Z [2024-04-03 01:35:18,927: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:35:18.931163228Z [2024-04-03 01:35:18,930: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:18.931177020Z [2024-04-03 01:35:18,931: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:18.931554375Z [2024-04-03 01:35:18,931: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:18.931624000Z [2024-04-03 01:35:18,931: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:35:18.931908761Z [2024-04-03 01:35:18,931: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:35:18.931983495Z [2024-04-03 01:35:18,931: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:18.946368565Z [2024-04-03 01:35:18,946: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:35:18.947791907Z [2024-04-03 01:35:18,946: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:35:18.948816608Z [2024-04-03 01:35:18,948: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:35:18.953753260Z [2024-04-03 01:35:18,953: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:18.984856699Z [2024-04-03 01:35:18,984: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:35:18.989169910Z [2024-04-03 01:35:18,988: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:19.010824737Z [2024-04-03 01:35:19,010: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:35:19.015605944Z [2024-04-03 01:35:19,015: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:19.015624921Z [2024-04-03 01:35:19,015: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:19.017378037Z [2024-04-03 01:35:19,015: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:19.023786892Z [2024-04-03 01:35:19,017: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:35:19.026306997Z [2024-04-03 01:35:19,026: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:35:19.026375690Z [2024-04-03 01:35:19,026: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:19.035301668Z [2024-04-03 01:35:19,033: ERROR/ForkPoolWorker-1] [1a8a9ee3-b906-4b29-a241-b47d2e29adf4] Failed to execute task Dag 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:35:19.035313357Z Traceback (most recent call last): 2024-04-03T01:35:19.035320732Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:35:19.035325275Z args.func(args) 2024-04-03T01:35:19.035329273Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:35:19.035361353Z return func(*args, **kwargs) 2024-04-03T01:35:19.035370030Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:35:19.035373624Z return f(*args, **kwargs) 2024-04-03T01:35:19.035376813Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:35:19.035380003Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:35:19.035383427Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:35:19.035400601Z raise AirflowException( 2024-04-03T01:35:19.035405114Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:35:19.079524863Z [2024-04-03 01:35:19,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:35:19.083323582Z [2024-04-03 01:35:19,082: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:19.083475901Z [2024-04-03 01:35:19,083: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:19.083682369Z [2024-04-03 01:35:19,083: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:19.083829376Z [2024-04-03 01:35:19,083: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:35:19.084175793Z [2024-04-03 01:35:19,084: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:35:19.084400991Z [2024-04-03 01:35:19,084: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:19.110718397Z [2024-04-03 01:35:19,106: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a8a9ee3-b906-4b29-a241-b47d2e29adf4] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1a8a9ee3-b906-4b29-a241-b47d2e29adf4') 2024-04-03T01:35:19.110749030Z Traceback (most recent call last): 2024-04-03T01:35:19.110754162Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:35:19.110757437Z R = retval = fun(*args, **kwargs) 2024-04-03T01:35:19.110777640Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:35:19.110781345Z return self.run(*args, **kwargs) 2024-04-03T01:35:19.110785434Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:35:19.110794521Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:35:19.110797639Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:35:19.110802007Z raise AirflowException(msg) 2024-04-03T01:35:19.110806217Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1a8a9ee3-b906-4b29-a241-b47d2e29adf4 2024-04-03T01:35:19.116867298Z [2024-04-03 01:35:19,116: WARNING/ForkPoolWorker-15] Dag 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:35:19.118021415Z [2024-04-03 01:35:19,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:35:19.119436326Z [2024-04-03 01:35:19,119: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:35:19.129901287Z [2024-04-03 01:35:19,129: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:35:19.202234858Z [2024-04-03 01:35:19,195: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:35:19.202251139Z [2024-04-03 01:35:19,196: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:35:19.202255719Z [2024-04-03 01:35:19,197: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:35:19.202260021Z [2024-04-03 01:35:19,197: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:35:19.202264072Z [2024-04-03 01:35:19,197: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:35:19.202267205Z [2024-04-03 01:35:19,197: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:35:19.202270335Z [2024-04-03 01:35:19,197: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:35:19.202278574Z [2024-04-03 01:35:19,201: ERROR/ForkPoolWorker-15] [6ac80329-d2d4-4379-a09e-0e460d0f857a] Failed to execute task Dag 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:35:19.202290253Z Traceback (most recent call last): 2024-04-03T01:35:19.202293515Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:35:19.202297315Z args.func(args) 2024-04-03T01:35:19.202300456Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:35:19.202304234Z return func(*args, **kwargs) 2024-04-03T01:35:19.202307367Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:35:19.202310490Z return f(*args, **kwargs) 2024-04-03T01:35:19.202313601Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:35:19.202316571Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:35:19.202319568Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:35:19.202322605Z raise AirflowException( 2024-04-03T01:35:19.202326630Z airflow.exceptions.AirflowException: Dag 'vim_status_5af9ecc6-b0f9-4b4c-af84-697f61824f4c' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:35:19.320587461Z [2024-04-03 01:35:19,319: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ac80329-d2d4-4379-a09e-0e460d0f857a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6ac80329-d2d4-4379-a09e-0e460d0f857a') 2024-04-03T01:35:19.320617632Z Traceback (most recent call last): 2024-04-03T01:35:19.320623306Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:35:19.320626631Z R = retval = fun(*args, **kwargs) 2024-04-03T01:35:19.320630124Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:35:19.320633335Z return self.run(*args, **kwargs) 2024-04-03T01:35:19.320638310Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:35:19.320643185Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:35:19.320646231Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:35:19.320676192Z raise AirflowException(msg) 2024-04-03T01:35:19.320680877Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6ac80329-d2d4-4379-a09e-0e460d0f857a 2024-04-03T01:36:00.334132930Z [2024-04-03 01:36:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db72cbf1-7b71-4b2c-a963-01c5255043e9] received 2024-04-03T01:36:00.346677489Z [2024-04-03 01:36:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2f91ff5-882b-4785-9559-657d0149fcdb] received 2024-04-03T01:36:00.349206110Z [2024-04-03 01:36:00,348: INFO/ForkPoolWorker-15] [db72cbf1-7b71-4b2c-a963-01c5255043e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:36:00.357187930Z [2024-04-03 01:36:00,356: INFO/ForkPoolWorker-16] [a2f91ff5-882b-4785-9559-657d0149fcdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:36:00.372773649Z [2024-04-03 01:36:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d105ea0-6033-447a-9262-410b567e6a08] received 2024-04-03T01:36:00.392514626Z [2024-04-03 01:36:00,392: INFO/ForkPoolWorker-1] [9d105ea0-6033-447a-9262-410b567e6a08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:36:00.842695235Z [2024-04-03 01:36:00,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:36:00.910906113Z [2024-04-03 01:36:00,906: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:36:01.077438147Z [2024-04-03 01:36:01,073: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:36:01.151691877Z [2024-04-03 01:36:01,151: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:36:02.045546682Z [2024-04-03 01:36:02,045: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db72cbf1-7b71-4b2c-a963-01c5255043e9] succeeded in 1.708808825999995s: None 2024-04-03T01:36:02.417461878Z [2024-04-03 01:36:02,417: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:36:02.420744956Z [2024-04-03 01:36:02,420: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:36:02.442052362Z [2024-04-03 01:36:02,441: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:36:02.443957530Z [2024-04-03 01:36:02,443: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:36:02.444222360Z [2024-04-03 01:36:02,444: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:36:02.444398747Z [2024-04-03 01:36:02,444: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:36:02.444448548Z [2024-04-03 01:36:02,444: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:36:02.447282985Z [2024-04-03 01:36:02,447: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:36:02.447295823Z [2024-04-03 01:36:02,447: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:36:02.458969258Z [2024-04-03 01:36:02,458: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:36:02.462477469Z [2024-04-03 01:36:02,462: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:36:02.483170802Z [2024-04-03 01:36:02,482: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:36:02.484442202Z [2024-04-03 01:36:02,484: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:36:02.484698420Z [2024-04-03 01:36:02,484: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:36:02.484879239Z [2024-04-03 01:36:02,484: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:36:02.484986532Z [2024-04-03 01:36:02,484: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:36:02.485845842Z [2024-04-03 01:36:02,485: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:36:02.486290608Z [2024-04-03 01:36:02,485: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:36:02.522061946Z [2024-04-03 01:36:02,521: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:36:02.562754780Z [2024-04-03 01:36:02,562: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:36:04.078671398Z [2024-04-03 01:36:04,077: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a2f91ff5-882b-4785-9559-657d0149fcdb] succeeded in 3.7274905730000683s: None 2024-04-03T01:36:04.533044367Z [2024-04-03 01:36:04,532: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9d105ea0-6033-447a-9262-410b567e6a08] succeeded in 4.157033790000014s: None 2024-04-03T01:37:00.447173721Z [2024-04-03 01:37:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4592725-904e-485d-baba-252b9a0619fe] received 2024-04-03T01:37:00.459952939Z [2024-04-03 01:37:00,459: INFO/ForkPoolWorker-15] [e4592725-904e-485d-baba-252b9a0619fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:37:00.467256440Z [2024-04-03 01:37:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ca25494-7475-43a2-8432-15574e484231] received 2024-04-03T01:37:00.501561423Z [2024-04-03 01:37:00,501: INFO/ForkPoolWorker-16] [1ca25494-7475-43a2-8432-15574e484231] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:37:00.952941172Z [2024-04-03 01:37:00,943: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:37:01.048608179Z [2024-04-03 01:37:01,043: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:37:02.517526554Z [2024-04-03 01:37:02,517: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:37:02.522120322Z [2024-04-03 01:37:02,521: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:37:02.545436641Z [2024-04-03 01:37:02,545: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:37:02.549657522Z [2024-04-03 01:37:02,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:37:02.552845764Z [2024-04-03 01:37:02,552: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:37:02.554043089Z [2024-04-03 01:37:02,553: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:37:02.554067930Z [2024-04-03 01:37:02,553: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:37:02.554249089Z [2024-04-03 01:37:02,554: INFO/ForkPoolWorker-16] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:37:02.554385704Z [2024-04-03 01:37:02,554: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:37:02.554416775Z [2024-04-03 01:37:02,554: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:37:02.554728963Z [2024-04-03 01:37:02,554: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:37:02.554767842Z [2024-04-03 01:37:02,554: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:37:02.560301114Z [2024-04-03 01:37:02,560: INFO/ForkPoolWorker-16] Creating DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:37:02.581581693Z [2024-04-03 01:37:02,581: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:37:02.583190713Z [2024-04-03 01:37:02,582: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:37:02.583220854Z [2024-04-03 01:37:02,583: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:37:02.583308876Z [2024-04-03 01:37:02,583: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:37:02.583509066Z [2024-04-03 01:37:02,583: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:37:02.583608239Z [2024-04-03 01:37:02,583: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:37:02.583861411Z [2024-04-03 01:37:02,583: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:37:02.584048590Z [2024-04-03 01:37:02,583: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:37:02.590661262Z [2024-04-03 01:37:02,590: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:37:02.673862407Z [2024-04-03 01:37:02,673: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:37:02.676928470Z [2024-04-03 01:37:02,676: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:37:03.396214461Z [2024-04-03 01:37:03,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cd6c57e-d88d-4053-89fd-48b92f7dc04f] received 2024-04-03T01:37:03.409648331Z [2024-04-03 01:37:03,409: INFO/ForkPoolWorker-1] [7cd6c57e-d88d-4053-89fd-48b92f7dc04f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:37:03.711118902Z [2024-04-03 01:37:03,707: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:37:04.934673898Z [2024-04-03 01:37:04,934: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:37:04.937955606Z [2024-04-03 01:37:04,937: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:37:04.958391221Z [2024-04-03 01:37:04,958: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:37:04.959343572Z [2024-04-03 01:37:04,959: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:37:04.959388664Z [2024-04-03 01:37:04,959: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:37:04.959435755Z [2024-04-03 01:37:04,959: INFO/ForkPoolWorker-1] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:37:04.959554276Z [2024-04-03 01:37:04,959: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:37:04.959568240Z [2024-04-03 01:37:04,959: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:37:04.959779471Z [2024-04-03 01:37:04,959: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:37:04.959807810Z [2024-04-03 01:37:04,959: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:37:04.965401471Z [2024-04-03 01:37:04,965: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:37:05.028811881Z [2024-04-03 01:37:05,028: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:37:05.183637190Z [2024-04-03 01:37:05,183: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ca25494-7475-43a2-8432-15574e484231] succeeded in 4.712617429999909s: None 2024-04-03T01:37:05.218341586Z [2024-04-03 01:37:05,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4592725-904e-485d-baba-252b9a0619fe] succeeded in 4.767608439000014s: None 2024-04-03T01:37:05.507819376Z [2024-04-03 01:37:05,507: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7cd6c57e-d88d-4053-89fd-48b92f7dc04f] succeeded in 2.107456708999962s: None 2024-04-03T01:37:05.763205427Z [2024-04-03 01:37:05,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dca108c-99ca-4849-9f0e-6067172224e7] received 2024-04-03T01:37:05.769976045Z [2024-04-03 01:37:05,769: INFO/ForkPoolWorker-15] [9dca108c-99ca-4849-9f0e-6067172224e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'split_metrics', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:37:06.039685615Z [2024-04-03 01:37:06,036: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:37:07.120894417Z [2024-04-03 01:37:07,120: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:37:07.124175652Z [2024-04-03 01:37:07,123: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:37:07.150958151Z [2024-04-03 01:37:07,150: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:37:07.152752047Z [2024-04-03 01:37:07,152: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:37:07.152789252Z [2024-04-03 01:37:07,152: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:37:07.152932309Z [2024-04-03 01:37:07,152: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:37:07.153103337Z [2024-04-03 01:37:07,152: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:37:07.153497521Z [2024-04-03 01:37:07,153: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:37:07.153679726Z [2024-04-03 01:37:07,153: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:37:07.153690297Z [2024-04-03 01:37:07,153: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:37:07.162500331Z [2024-04-03 01:37:07,162: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:37:07.240991213Z [2024-04-03 01:37:07,240: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:37:07.838012759Z [2024-04-03 01:37:07,837: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9dca108c-99ca-4849-9f0e-6067172224e7] succeeded in 2.073295903999906s: None 2024-04-03T01:37:08.467481111Z [2024-04-03 01:37:08,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfc18b9c-f763-440b-8ef4-cd158ad1e6f1] received 2024-04-03T01:37:08.483384796Z [2024-04-03 01:37:08,483: INFO/ForkPoolWorker-15] [cfc18b9c-f763-440b-8ef4-cd158ad1e6f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'collect_metrics', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:37:08.769853029Z [2024-04-03 01:37:08,766: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:37:09.908109469Z [2024-04-03 01:37:09,907: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:37:09.911531489Z [2024-04-03 01:37:09,911: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:37:09.936129823Z [2024-04-03 01:37:09,935: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:37:09.937259397Z [2024-04-03 01:37:09,937: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:37:09.937292186Z [2024-04-03 01:37:09,937: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:37:09.937369855Z [2024-04-03 01:37:09,937: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:37:09.937502081Z [2024-04-03 01:37:09,937: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:37:09.937513073Z [2024-04-03 01:37:09,937: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:37:09.938241339Z [2024-04-03 01:37:09,938: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:37:09.938448396Z [2024-04-03 01:37:09,938: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:37:09.944480874Z [2024-04-03 01:37:09,944: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:37:10.029134476Z [2024-04-03 01:37:10,025: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:37:10.472970205Z [2024-04-03 01:37:10,472: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfc18b9c-f763-440b-8ef4-cd158ad1e6f1] succeeded in 2.001436033000118s: None 2024-04-03T01:37:10.715135452Z [2024-04-03 01:37:10,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef2e004d-1659-41c9-937a-223849b622d5] received 2024-04-03T01:37:10.725102480Z [2024-04-03 01:37:10,724: INFO/ForkPoolWorker-15] [ef2e004d-1659-41c9-937a-223849b622d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'send_prometheus', 'scheduled__2024-04-03T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:37:11.053926848Z [2024-04-03 01:37:11,050: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:37:12.214736198Z [2024-04-03 01:37:12,214: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:37:12.218452396Z [2024-04-03 01:37:12,217: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:37:12.253741345Z [2024-04-03 01:37:12,253: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:37:12.255071887Z [2024-04-03 01:37:12,254: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:37:12.255134835Z [2024-04-03 01:37:12,255: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:37:12.255247936Z [2024-04-03 01:37:12,255: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:37:12.255421918Z [2024-04-03 01:37:12,255: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:37:12.255436184Z [2024-04-03 01:37:12,255: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:37:12.255683537Z [2024-04-03 01:37:12,255: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:37:12.255750160Z [2024-04-03 01:37:12,255: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:37:12.262395990Z [2024-04-03 01:37:12,262: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:37:12.331314397Z [2024-04-03 01:37:12,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:37:12.830378359Z [2024-04-03 01:37:12,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef2e004d-1659-41c9-937a-223849b622d5] succeeded in 2.1132406199999423s: None 2024-04-03T01:37:28.900968126Z [2024-04-03 01:37:28,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f4faac3-5818-48b8-a2e0-a7a3662a0125] received 2024-04-03T01:37:28.909601425Z [2024-04-03 01:37:28,909: INFO/ForkPoolWorker-15] [9f4faac3-5818-48b8-a2e0-a7a3662a0125] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:37:28.912793157Z [2024-04-03 01:37:28,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cef3a518-eb4f-41c3-915e-23ded9a7d72f] received 2024-04-03T01:37:28.924632603Z [2024-04-03 01:37:28,924: INFO/ForkPoolWorker-16] [cef3a518-eb4f-41c3-915e-23ded9a7d72f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:37:29.214993389Z [2024-04-03 01:37:29,211: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:37:29.230486607Z [2024-04-03 01:37:29,227: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:37:30.440096079Z [2024-04-03 01:37:30,439: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:37:30.443601661Z [2024-04-03 01:37:30,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:37:30.445877884Z [2024-04-03 01:37:30,445: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:37:30.449568095Z [2024-04-03 01:37:30,449: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:37:30.473326674Z [2024-04-03 01:37:30,472: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:37:30.474477120Z [2024-04-03 01:37:30,474: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:37:30.474580243Z [2024-04-03 01:37:30,474: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:37:30.475222457Z [2024-04-03 01:37:30,475: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:37:30.475440026Z [2024-04-03 01:37:30,475: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:37:30.475589794Z [2024-04-03 01:37:30,475: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:37:30.476016111Z [2024-04-03 01:37:30,475: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:37:30.476288913Z [2024-04-03 01:37:30,475: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:37:30.481903251Z [2024-04-03 01:37:30,481: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:37:30.491609002Z [2024-04-03 01:37:30,491: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:37:30.492797646Z [2024-04-03 01:37:30,492: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:37:30.492962204Z [2024-04-03 01:37:30,492: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:37:30.493096221Z [2024-04-03 01:37:30,492: INFO/ForkPoolWorker-16] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:37:30.493305505Z [2024-04-03 01:37:30,493: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:37:30.493430524Z [2024-04-03 01:37:30,493: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:37:30.493721651Z [2024-04-03 01:37:30,493: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:37:30.496526389Z [2024-04-03 01:37:30,496: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:37:30.505136426Z [2024-04-03 01:37:30,504: INFO/ForkPoolWorker-16] Creating DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:37:30.584646103Z [2024-04-03 01:37:30,584: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:37:30.602523209Z [2024-04-03 01:37:30,602: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:37:32.112525133Z [2024-04-03 01:37:32,111: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cef3a518-eb4f-41c3-915e-23ded9a7d72f] succeeded in 3.196534842999881s: None 2024-04-03T01:37:32.637234099Z [2024-04-03 01:37:32,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f4faac3-5818-48b8-a2e0-a7a3662a0125] succeeded in 3.733408058999885s: None 2024-04-03T01:38:00.484984608Z [2024-04-03 01:38:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b912c30f-2960-49ca-9bac-116ec57c74b1] received 2024-04-03T01:38:00.487207918Z [2024-04-03 01:38:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6a559a9-b702-4684-a1f4-2b6bd41177c6] received 2024-04-03T01:38:00.498237534Z [2024-04-03 01:38:00,497: INFO/ForkPoolWorker-16] [a6a559a9-b702-4684-a1f4-2b6bd41177c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:38:00.499425473Z [2024-04-03 01:38:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc7c7963-136b-4a6f-9f80-b877bae8bed4] received 2024-04-03T01:38:00.507792171Z [2024-04-03 01:38:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49f6c099-6f9b-457c-86a3-6cad18ff4c18] received 2024-04-03T01:38:00.511237899Z [2024-04-03 01:38:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[517eb963-860a-40ce-a451-21dbd6c09e40] received 2024-04-03T01:38:00.528093975Z [2024-04-03 01:38:00,527: INFO/ForkPoolWorker-2] [49f6c099-6f9b-457c-86a3-6cad18ff4c18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:38:00.530495855Z [2024-04-03 01:38:00,530: INFO/ForkPoolWorker-15] [b912c30f-2960-49ca-9bac-116ec57c74b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:38:00.538735717Z [2024-04-03 01:38:00,538: INFO/ForkPoolWorker-1] [fc7c7963-136b-4a6f-9f80-b877bae8bed4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:38:00.561774045Z [2024-04-03 01:38:00,561: INFO/ForkPoolWorker-3] [517eb963-860a-40ce-a451-21dbd6c09e40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:38:00.994794357Z [2024-04-03 01:38:00,990: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:38:01.202553233Z [2024-04-03 01:38:01,198: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:38:01.601422049Z [2024-04-03 01:38:01,576: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:38:01.735987058Z [2024-04-03 01:38:01,731: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:38:01.748577832Z [2024-04-03 01:38:01,743: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:38:02.278686070Z [2024-04-03 01:38:02,278: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:38:02.623936102Z [2024-04-03 01:38:02,623: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:38:02.627775577Z [2024-04-03 01:38:02,627: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:38:02.702426427Z [2024-04-03 01:38:02,702: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:38:02.717193013Z [2024-04-03 01:38:02,716: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:38:02.722755196Z [2024-04-03 01:38:02,722: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:38:02.724324401Z [2024-04-03 01:38:02,724: INFO/ForkPoolWorker-1] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:38:02.726677888Z [2024-04-03 01:38:02,725: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:38:02.729305064Z [2024-04-03 01:38:02,727: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:38:02.730609794Z [2024-04-03 01:38:02,730: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:38:02.733144559Z [2024-04-03 01:38:02,732: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:38:02.786711049Z [2024-04-03 01:38:02,784: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:38:02.967898513Z [2024-04-03 01:38:02,967: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6a559a9-b702-4684-a1f4-2b6bd41177c6] succeeded in 2.4783528980001392s: None 2024-04-03T01:38:02.999622099Z [2024-04-03 01:38:02,999: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:38:03.134944235Z [2024-04-03 01:38:03,134: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T01:38:03.157181007Z [2024-04-03 01:38:03,156: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:38:03.265525158Z [2024-04-03 01:38:03,265: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T01:38:03.273951359Z [2024-04-03 01:38:03,273: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:38:03.274087366Z [2024-04-03 01:38:03,273: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:38:03.274241469Z [2024-04-03 01:38:03,274: INFO/ForkPoolWorker-2] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:38:03.274482632Z [2024-04-03 01:38:03,274: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:38:03.274875048Z [2024-04-03 01:38:03,274: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T01:38:03.275989619Z [2024-04-03 01:38:03,275: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:38:03.276103599Z [2024-04-03 01:38:03,275: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:38:03.281361272Z [2024-04-03 01:38:03,281: INFO/ForkPoolWorker-2] Creating DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:38:03.369159140Z [2024-04-03 01:38:03,368: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:38:03.691466767Z [2024-04-03 01:38:03,691: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-03T01:38:03.697341812Z [2024-04-03 01:38:03,696: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:38:03.742168449Z [2024-04-03 01:38:03,741: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-03T01:38:03.743409400Z [2024-04-03 01:38:03,743: INFO/ForkPoolWorker-3] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:38:03.743487663Z [2024-04-03 01:38:03,743: INFO/ForkPoolWorker-3] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:38:03.743566689Z [2024-04-03 01:38:03,743: INFO/ForkPoolWorker-3] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:38:03.743728893Z [2024-04-03 01:38:03,743: INFO/ForkPoolWorker-3] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:38:03.743833297Z [2024-04-03 01:38:03,743: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-03T01:38:03.744076800Z [2024-04-03 01:38:03,743: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:38:03.744154384Z [2024-04-03 01:38:03,744: INFO/ForkPoolWorker-3] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:38:03.751423117Z [2024-04-03 01:38:03,751: INFO/ForkPoolWorker-3] Creating DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:38:03.864588625Z [2024-04-03 01:38:03,863: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:38:03.880326591Z [2024-04-03 01:38:03,879: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:38:03.885786024Z [2024-04-03 01:38:03,885: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:38:03.953581957Z [2024-04-03 01:38:03,953: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:38:03.954950279Z [2024-04-03 01:38:03,954: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:38:03.954961567Z [2024-04-03 01:38:03,954: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:38:03.955095846Z [2024-04-03 01:38:03,954: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:38:03.955171511Z [2024-04-03 01:38:03,954: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:38:03.955259412Z [2024-04-03 01:38:03,955: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:38:03.955846286Z [2024-04-03 01:38:03,955: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:38:03.955922879Z [2024-04-03 01:38:03,955: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:38:03.960557738Z [2024-04-03 01:38:03,960: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:38:04.074010260Z [2024-04-03 01:38:04,073: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:38:05.419222090Z [2024-04-03 01:38:05,418: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[49f6c099-6f9b-457c-86a3-6cad18ff4c18] succeeded in 4.9072126360001675s: None 2024-04-03T01:38:05.812666311Z [2024-04-03 01:38:05,812: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc7c7963-136b-4a6f-9f80-b877bae8bed4] succeeded in 5.3054356289999305s: None 2024-04-03T01:38:06.761706401Z [2024-04-03 01:38:06,761: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b912c30f-2960-49ca-9bac-116ec57c74b1] succeeded in 6.271994749999976s: None 2024-04-03T01:38:06.811696819Z [2024-04-03 01:38:06,811: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[517eb963-860a-40ce-a451-21dbd6c09e40] succeeded in 6.297398321999935s: None 2024-04-03T01:39:00.390293633Z [2024-04-03 01:39:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d689d9f8-0b8b-4ae6-a516-ce187515d7ea] received 2024-04-03T01:39:00.393355684Z [2024-04-03 01:39:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7cb3d81-2f53-4a15-8e29-ee204ae645d2] received 2024-04-03T01:39:00.395507655Z [2024-04-03 01:39:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6903a49f-e464-4762-83a4-7162869e9b53] received 2024-04-03T01:39:00.407551969Z [2024-04-03 01:39:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f1bd438-240c-4c52-b729-0f732cc798eb] received 2024-04-03T01:39:00.418320011Z [2024-04-03 01:39:00,417: INFO/ForkPoolWorker-16] [f7cb3d81-2f53-4a15-8e29-ee204ae645d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:39:00.419466310Z [2024-04-03 01:39:00,419: INFO/ForkPoolWorker-1] [6903a49f-e464-4762-83a4-7162869e9b53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:39:00.430975882Z [2024-04-03 01:39:00,430: INFO/ForkPoolWorker-2] [1f1bd438-240c-4c52-b729-0f732cc798eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:39:00.434982553Z [2024-04-03 01:39:00,434: INFO/ForkPoolWorker-15] [d689d9f8-0b8b-4ae6-a516-ce187515d7ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:39:01.068843030Z [2024-04-03 01:39:01,064: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:39:01.076602023Z [2024-04-03 01:39:01,047: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:39:01.253852074Z [2024-04-03 01:39:01,248: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:39:01.287007563Z [2024-04-03 01:39:01,282: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:39:03.663109302Z [2024-04-03 01:39:03,662: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T01:39:03.667220444Z [2024-04-03 01:39:03,666: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:39:03.719462291Z [2024-04-03 01:39:03,719: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:39:03.723247109Z [2024-04-03 01:39:03,722: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:39:03.755121079Z [2024-04-03 01:39:03,754: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T01:39:03.757387691Z [2024-04-03 01:39:03,757: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:39:03.757596851Z [2024-04-03 01:39:03,757: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:39:03.757779753Z [2024-04-03 01:39:03,757: INFO/ForkPoolWorker-2] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:39:03.758038816Z [2024-04-03 01:39:03,757: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:39:03.758164128Z [2024-04-03 01:39:03,758: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T01:39:03.758527204Z [2024-04-03 01:39:03,758: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:39:03.759333743Z [2024-04-03 01:39:03,758: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:39:03.765375524Z [2024-04-03 01:39:03,765: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:39:03.766938258Z [2024-04-03 01:39:03,766: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:39:03.807824469Z [2024-04-03 01:39:03,792: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:39:03.830006163Z [2024-04-03 01:39:03,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:39:03.834668422Z [2024-04-03 01:39:03,834: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:39:03.834690677Z [2024-04-03 01:39:03,834: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:39:03.834700151Z [2024-04-03 01:39:03,834: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:39:03.834840875Z [2024-04-03 01:39:03,834: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:39:03.834852157Z [2024-04-03 01:39:03,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:39:03.835120779Z [2024-04-03 01:39:03,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:39:03.835132088Z [2024-04-03 01:39:03,835: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:39:03.856249769Z [2024-04-03 01:39:03,855: INFO/ForkPoolWorker-15] Creating DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:39:03.861786539Z [2024-04-03 01:39:03,861: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:39:03.922977636Z [2024-04-03 01:39:03,922: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:39:03.924794184Z [2024-04-03 01:39:03,924: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:39:03.924825162Z [2024-04-03 01:39:03,924: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:39:03.924848444Z [2024-04-03 01:39:03,924: INFO/ForkPoolWorker-16] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:39:03.925062514Z [2024-04-03 01:39:03,924: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:39:03.925077248Z [2024-04-03 01:39:03,924: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:39:03.925296106Z [2024-04-03 01:39:03,925: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:39:03.925315824Z [2024-04-03 01:39:03,925: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:39:03.952252294Z [2024-04-03 01:39:03,951: INFO/ForkPoolWorker-16] Creating DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:39:04.086261528Z [2024-04-03 01:39:04,085: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:39:04.230197711Z [2024-04-03 01:39:04,229: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:39:05.380930911Z [2024-04-03 01:39:05,380: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:39:05.384872154Z [2024-04-03 01:39:05,384: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:39:05.417783108Z [2024-04-03 01:39:05,417: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:39:05.420132298Z [2024-04-03 01:39:05,419: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:39:05.420507890Z [2024-04-03 01:39:05,420: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:39:05.420875534Z [2024-04-03 01:39:05,420: INFO/ForkPoolWorker-1] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:39:05.421113831Z [2024-04-03 01:39:05,420: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:39:05.421282720Z [2024-04-03 01:39:05,421: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:39:05.421535328Z [2024-04-03 01:39:05,421: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:39:05.421774210Z [2024-04-03 01:39:05,421: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:39:05.426421369Z [2024-04-03 01:39:05,426: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:39:05.506386188Z [2024-04-03 01:39:05,506: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:39:08.092412773Z [2024-04-03 01:39:08,084: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7cb3d81-2f53-4a15-8e29-ee204ae645d2] succeeded in 7.688012818000061s: None 2024-04-03T01:39:08.214139974Z [2024-04-03 01:39:08,213: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d689d9f8-0b8b-4ae6-a516-ce187515d7ea] succeeded in 7.819555536000053s: None 2024-04-03T01:39:08.784386580Z [2024-04-03 01:39:08,783: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6903a49f-e464-4762-83a4-7162869e9b53] succeeded in 8.385894045999976s: None 2024-04-03T01:39:09.253802053Z [2024-04-03 01:39:09,253: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1f1bd438-240c-4c52-b729-0f732cc798eb] succeeded in 8.839210704999914s: None 2024-04-03T01:40:00.485582018Z [2024-04-03 01:40:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cedc2ea-ba51-40a6-8647-5cfba6f8c9fa] received 2024-04-03T01:40:00.496163014Z [2024-04-03 01:40:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04ec1ff3-ccc3-42cd-a943-b0085e093d59] received 2024-04-03T01:40:00.496956814Z [2024-04-03 01:40:00,496: INFO/ForkPoolWorker-15] [7cedc2ea-ba51-40a6-8647-5cfba6f8c9fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:00.519325781Z [2024-04-03 01:40:00,518: INFO/ForkPoolWorker-16] [04ec1ff3-ccc3-42cd-a943-b0085e093d59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:00.527086165Z [2024-04-03 01:40:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[411f6867-547f-4e40-a0f7-d2ab34122a7e] received 2024-04-03T01:40:00.529717086Z [2024-04-03 01:40:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d7064ea-b6cb-4383-8b44-f67200164b08] received 2024-04-03T01:40:00.541565452Z [2024-04-03 01:40:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94a2b9e5-b456-4654-9de4-a9e7fe349900] received 2024-04-03T01:40:00.543630729Z [2024-04-03 01:40:00,543: INFO/ForkPoolWorker-2] [0d7064ea-b6cb-4383-8b44-f67200164b08] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:40:00.547682956Z [2024-04-03 01:40:00,547: INFO/ForkPoolWorker-1] [411f6867-547f-4e40-a0f7-d2ab34122a7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:40:00.552490619Z [2024-04-03 01:40:00,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95dced54-440c-4fcd-9c38-1512a2ef2f1b] received 2024-04-03T01:40:00.559306695Z [2024-04-03 01:40:00,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e575860-e33f-404d-a3ce-52cda22a7046] received 2024-04-03T01:40:00.636271074Z [2024-04-03 01:40:00,635: INFO/ForkPoolWorker-3] [94a2b9e5-b456-4654-9de4-a9e7fe349900] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:40:00.659745094Z [2024-04-03 01:40:00,659: INFO/ForkPoolWorker-4] [95dced54-440c-4fcd-9c38-1512a2ef2f1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:40:00.849442066Z [2024-04-03 01:40:00,848: INFO/ForkPoolWorker-5] [4e575860-e33f-404d-a3ce-52cda22a7046] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:40:01.355855219Z [2024-04-03 01:40:01,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:01.362714084Z [2024-04-03 01:40:01,341: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:40:01.520618259Z [2024-04-03 01:40:01,511: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:40:01.626439337Z [2024-04-03 01:40:01,621: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:40:01.789080183Z [2024-04-03 01:40:01,779: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:01.790845449Z [2024-04-03 01:40:01,765: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:40:02.375422543Z [2024-04-03 01:40:02,375: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:02.409921788Z [2024-04-03 01:40:02,382: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:40:03.319606690Z [2024-04-03 01:40:03,319: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0d7064ea-b6cb-4383-8b44-f67200164b08] succeeded in 2.7869555790000504s: None 2024-04-03T01:40:03.904257716Z [2024-04-03 01:40:03,889: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:40:03.926964549Z [2024-04-03 01:40:03,926: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:04.138893543Z [2024-04-03 01:40:04,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:40:04.140275592Z [2024-04-03 01:40:04,140: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:04.140452918Z [2024-04-03 01:40:04,140: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:04.140488639Z [2024-04-03 01:40:04,140: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:40:04.140574250Z [2024-04-03 01:40:04,140: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:40:04.140593990Z [2024-04-03 01:40:04,140: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:40:04.140846341Z [2024-04-03 01:40:04,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:04.140869748Z [2024-04-03 01:40:04,140: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:04.147743785Z [2024-04-03 01:40:04,147: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:40:04.254344047Z [2024-04-03 01:40:04,254: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:04.724577215Z [2024-04-03 01:40:04,724: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-03T01:40:04.728620700Z [2024-04-03 01:40:04,728: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:04.764913987Z [2024-04-03 01:40:04,764: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:40:04.770708104Z [2024-04-03 01:40:04,770: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:04.834147106Z [2024-04-03 01:40:04,833: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:40:04.835363207Z [2024-04-03 01:40:04,835: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:04.835483499Z [2024-04-03 01:40:04,835: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:04.835554688Z [2024-04-03 01:40:04,835: INFO/ForkPoolWorker-1] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:40:04.835714844Z [2024-04-03 01:40:04,835: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:40:04.835785204Z [2024-04-03 01:40:04,835: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:40:04.836070968Z [2024-04-03 01:40:04,835: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:40:04.836289241Z [2024-04-03 01:40:04,836: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:04.844165986Z [2024-04-03 01:40:04,843: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:40:04.865936842Z [2024-04-03 01:40:04,865: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-03T01:40:04.880089847Z [2024-04-03 01:40:04,879: INFO/ForkPoolWorker-4] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:04.880558080Z [2024-04-03 01:40:04,880: INFO/ForkPoolWorker-4] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:04.881142780Z [2024-04-03 01:40:04,880: INFO/ForkPoolWorker-4] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:40:04.881354197Z [2024-04-03 01:40:04,881: INFO/ForkPoolWorker-4] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:40:04.881437858Z [2024-04-03 01:40:04,881: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-03T01:40:04.881726658Z [2024-04-03 01:40:04,881: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:40:04.881860167Z [2024-04-03 01:40:04,881: INFO/ForkPoolWorker-4] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:04.888752616Z [2024-04-03 01:40:04,888: INFO/ForkPoolWorker-4] Creating DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:40:05.047722973Z [2024-04-03 01:40:05,047: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:05.096347974Z [2024-04-03 01:40:05,096: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:05.292080309Z [2024-04-03 01:40:05,291: INFO/ForkPoolWorker-5] Getting VIM list 2024-04-03T01:40:05.296735987Z [2024-04-03 01:40:05,296: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:05.308771128Z [2024-04-03 01:40:05,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7cedc2ea-ba51-40a6-8647-5cfba6f8c9fa] succeeded in 4.820872118000125s: None 2024-04-03T01:40:05.349708338Z [2024-04-03 01:40:05,349: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-04-03T01:40:05.351432051Z [2024-04-03 01:40:05,351: INFO/ForkPoolWorker-5] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:05.351481524Z [2024-04-03 01:40:05,351: INFO/ForkPoolWorker-5] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:05.351568818Z [2024-04-03 01:40:05,351: INFO/ForkPoolWorker-5] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:40:05.351796489Z [2024-04-03 01:40:05,351: INFO/ForkPoolWorker-5] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:40:05.351866398Z [2024-04-03 01:40:05,351: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-04-03T01:40:05.352158557Z [2024-04-03 01:40:05,352: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:40:05.352591228Z [2024-04-03 01:40:05,352: INFO/ForkPoolWorker-5] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:05.357934819Z [2024-04-03 01:40:05,357: INFO/ForkPoolWorker-5] Creating DAG vim_status_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:40:05.417164767Z [2024-04-03 01:40:05,416: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:40:05.443114476Z [2024-04-03 01:40:05,426: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:05.444248607Z [2024-04-03 01:40:05,444: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:05.491718157Z [2024-04-03 01:40:05,491: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-03T01:40:05.495301003Z [2024-04-03 01:40:05,494: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:05.552341158Z [2024-04-03 01:40:05,552: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-03T01:40:05.555958228Z [2024-04-03 01:40:05,555: INFO/ForkPoolWorker-3] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:05.556011360Z [2024-04-03 01:40:05,555: INFO/ForkPoolWorker-3] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:05.556107676Z [2024-04-03 01:40:05,556: INFO/ForkPoolWorker-3] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:40:05.556266483Z [2024-04-03 01:40:05,556: INFO/ForkPoolWorker-3] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:40:05.556347393Z [2024-04-03 01:40:05,556: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-03T01:40:05.556593394Z [2024-04-03 01:40:05,556: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:40:05.556690127Z [2024-04-03 01:40:05,556: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:05.561596189Z [2024-04-03 01:40:05,561: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:40:05.582927931Z [2024-04-03 01:40:05,580: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:40:05.588020300Z [2024-04-03 01:40:05,587: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:05.588100271Z [2024-04-03 01:40:05,587: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:05.588105711Z [2024-04-03 01:40:05,587: INFO/ForkPoolWorker-16] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:40:05.590586075Z [2024-04-03 01:40:05,588: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:40:05.590687277Z [2024-04-03 01:40:05,590: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:40:05.590930207Z [2024-04-03 01:40:05,590: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:05.590942907Z [2024-04-03 01:40:05,590: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:05.608118612Z [2024-04-03 01:40:05,607: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:40:05.664377003Z [2024-04-03 01:40:05,664: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:05.719707017Z [2024-04-03 01:40:05,719: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:06.334434715Z [2024-04-03 01:40:06,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[225696c0-73cd-4645-a1ee-fcab006e4509] received 2024-04-03T01:40:06.343431811Z [2024-04-03 01:40:06,343: INFO/ForkPoolWorker-15] [225696c0-73cd-4645-a1ee-fcab006e4509] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'split_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:06.449587070Z [2024-04-03 01:40:06,449: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04ec1ff3-ccc3-42cd-a943-b0085e093d59] succeeded in 5.946476245000213s: None 2024-04-03T01:40:06.628855536Z [2024-04-03 01:40:06,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e4e161f-b26d-420b-9719-0796675e65a2] received 2024-04-03T01:40:06.654111753Z [2024-04-03 01:40:06,644: INFO/ForkPoolWorker-16] [6e4e161f-b26d-420b-9719-0796675e65a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:06.766200627Z [2024-04-03 01:40:06,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:07.044438918Z [2024-04-03 01:40:07,029: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:07.908669957Z [2024-04-03 01:40:07,908: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[95dced54-440c-4fcd-9c38-1512a2ef2f1b] succeeded in 7.334200325999973s: None 2024-04-03T01:40:08.301872654Z [2024-04-03 01:40:08,301: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[4e575860-e33f-404d-a3ce-52cda22a7046] succeeded in 7.713631983999903s: None 2024-04-03T01:40:08.311886425Z [2024-04-03 01:40:08,311: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:40:08.315617382Z [2024-04-03 01:40:08,315: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:08.342438682Z [2024-04-03 01:40:08,342: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:40:08.348740284Z [2024-04-03 01:40:08,348: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:08.349092742Z [2024-04-03 01:40:08,348: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:08.349141430Z [2024-04-03 01:40:08,349: INFO/ForkPoolWorker-15] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:40:08.349294622Z [2024-04-03 01:40:08,349: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:40:08.349341714Z [2024-04-03 01:40:08,349: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:40:08.349599599Z [2024-04-03 01:40:08,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:08.349642605Z [2024-04-03 01:40:08,349: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:08.357654468Z [2024-04-03 01:40:08,357: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:40:08.423808963Z [2024-04-03 01:40:08,423: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:08.626976252Z [2024-04-03 01:40:08,622: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:40:08.628238414Z [2024-04-03 01:40:08,627: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:08.697860792Z [2024-04-03 01:40:08,697: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:40:08.699911835Z [2024-04-03 01:40:08,699: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:08.699928729Z [2024-04-03 01:40:08,699: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:08.700023700Z [2024-04-03 01:40:08,699: INFO/ForkPoolWorker-16] Read VIM c141e420-fb9e-461e-aff0-9b8604830218 (basic_08_vim_test) 2024-04-03T01:40:08.700163843Z [2024-04-03 01:40:08,699: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c141e420-fb9e-461e-aff0-9b8604830218', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-03T01:40:08.700572379Z [2024-04-03 01:40:08,700: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:40:08.700783883Z [2024-04-03 01:40:08,700: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:08.700827215Z [2024-04-03 01:40:08,700: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:08.708545126Z [2024-04-03 01:40:08,708: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218 2024-04-03T01:40:08.799873304Z [2024-04-03 01:40:08,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:09.250008929Z [2024-04-03 01:40:09,247: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[225696c0-73cd-4645-a1ee-fcab006e4509] succeeded in 2.911715531999789s: None 2024-04-03T01:40:09.312851346Z [2024-04-03 01:40:09,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8ad60b3-5f43-4184-b897-e2e90fd1e641] received 2024-04-03T01:40:09.328393533Z [2024-04-03 01:40:09,326: INFO/ForkPoolWorker-15] [a8ad60b3-5f43-4184-b897-e2e90fd1e641] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'collect_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:40:09.513974335Z [2024-04-03 01:40:09,513: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[411f6867-547f-4e40-a0f7-d2ab34122a7e] succeeded in 8.983567988999994s: None 2024-04-03T01:40:09.547548894Z [2024-04-03 01:40:09,547: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[94a2b9e5-b456-4654-9de4-a9e7fe349900] succeeded in 8.99600637399999s: None 2024-04-03T01:40:09.626529688Z [2024-04-03 01:40:09,625: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e4e161f-b26d-420b-9719-0796675e65a2] succeeded in 2.993937434999907s: None 2024-04-03T01:40:09.763881858Z [2024-04-03 01:40:09,760: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:10.677060960Z [2024-04-03 01:40:10,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a83223db-9c06-4690-97c3-d625539c6564] received 2024-04-03T01:40:10.687775610Z [2024-04-03 01:40:10,687: INFO/ForkPoolWorker-16] [a83223db-9c06-4690-97c3-d625539c6564] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:40:11.117195378Z [2024-04-03 01:40:11,112: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:11.223001243Z [2024-04-03 01:40:11,222: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:40:11.226678326Z [2024-04-03 01:40:11,226: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:11.261747071Z [2024-04-03 01:40:11,261: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:40:11.264827120Z [2024-04-03 01:40:11,264: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:11.264873011Z [2024-04-03 01:40:11,264: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:11.265146979Z [2024-04-03 01:40:11,264: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:40:11.265162769Z [2024-04-03 01:40:11,265: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:40:11.265421104Z [2024-04-03 01:40:11,265: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:11.265558889Z [2024-04-03 01:40:11,265: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:11.274734259Z [2024-04-03 01:40:11,274: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:11.275522856Z [2024-04-03 01:40:11,274: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:11.276466861Z [2024-04-03 01:40:11,276: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:40:11.279429923Z [2024-04-03 01:40:11,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:11.311459538Z [2024-04-03 01:40:11,311: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:40:11.312658298Z [2024-04-03 01:40:11,312: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:11.312722234Z [2024-04-03 01:40:11,312: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:11.312915900Z [2024-04-03 01:40:11,312: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:40:11.312997485Z [2024-04-03 01:40:11,312: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:40:11.313239455Z [2024-04-03 01:40:11,313: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:11.313274702Z [2024-04-03 01:40:11,313: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:11.317580121Z [2024-04-03 01:40:11,317: ERROR/ForkPoolWorker-15] [a8ad60b3-5f43-4184-b897-e2e90fd1e641] Failed to execute task Dag 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:40:11.317591025Z Traceback (most recent call last): 2024-04-03T01:40:11.317594921Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:40:11.317599535Z args.func(args) 2024-04-03T01:40:11.317603297Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:40:11.317621133Z return func(*args, **kwargs) 2024-04-03T01:40:11.317624204Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:40:11.317627078Z return f(*args, **kwargs) 2024-04-03T01:40:11.317630414Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:40:11.317633301Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:40:11.317636248Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:40:11.317639192Z raise AirflowException( 2024-04-03T01:40:11.317642678Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:40:11.364456980Z [2024-04-03 01:40:11,363: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8ad60b3-5f43-4184-b897-e2e90fd1e641] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a8ad60b3-5f43-4184-b897-e2e90fd1e641') 2024-04-03T01:40:11.364476348Z Traceback (most recent call last): 2024-04-03T01:40:11.364481394Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:40:11.364484550Z R = retval = fun(*args, **kwargs) 2024-04-03T01:40:11.364487566Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:40:11.364490749Z return self.run(*args, **kwargs) 2024-04-03T01:40:11.364494662Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:40:11.364498269Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:40:11.364501296Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:40:11.364504784Z raise AirflowException(msg) 2024-04-03T01:40:11.364508462Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a8ad60b3-5f43-4184-b897-e2e90fd1e641 2024-04-03T01:40:12.372685968Z [2024-04-03 01:40:12,372: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:40:12.376201397Z [2024-04-03 01:40:12,375: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:12.414446213Z [2024-04-03 01:40:12,414: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:40:12.416322149Z [2024-04-03 01:40:12,416: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:12.416443700Z [2024-04-03 01:40:12,416: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:12.416673702Z [2024-04-03 01:40:12,416: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:40:12.416814607Z [2024-04-03 01:40:12,416: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:40:12.417173173Z [2024-04-03 01:40:12,417: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:12.417298341Z [2024-04-03 01:40:12,417: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:12.518436689Z [2024-04-03 01:40:12,518: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:13.261132582Z [2024-04-03 01:40:13,260: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a83223db-9c06-4690-97c3-d625539c6564] succeeded in 2.5810611080000854s: None 2024-04-03T01:40:13.991088986Z [2024-04-03 01:40:13,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1937c548-37d0-45f0-9e9c-7b477e827e6c] received 2024-04-03T01:40:14.019049277Z [2024-04-03 01:40:14,018: INFO/ForkPoolWorker-15] [1937c548-37d0-45f0-9e9c-7b477e827e6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:40:14.505928447Z [2024-04-03 01:40:14,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:15.834609134Z [2024-04-03 01:40:15,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:40:15.838661942Z [2024-04-03 01:40:15,838: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:15.858130076Z [2024-04-03 01:40:15,857: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:40:15.860732720Z [2024-04-03 01:40:15,860: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:15.860828740Z [2024-04-03 01:40:15,860: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:15.861048030Z [2024-04-03 01:40:15,860: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:40:15.861265939Z [2024-04-03 01:40:15,861: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:40:15.862128706Z [2024-04-03 01:40:15,861: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:15.862824638Z [2024-04-03 01:40:15,862: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:15.934293868Z [2024-04-03 01:40:15,934: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:40:16.441974879Z [2024-04-03 01:40:16,441: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1937c548-37d0-45f0-9e9c-7b477e827e6c] succeeded in 2.447772033999854s: None 2024-04-03T01:40:21.842807540Z [2024-04-03 01:40:21,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bc83385-5c6c-4e1f-ab33-97543ffaf969] received 2024-04-03T01:40:21.854717959Z [2024-04-03 01:40:21,854: INFO/ForkPoolWorker-15] [3bc83385-5c6c-4e1f-ab33-97543ffaf969] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'collect_metrics', 'scheduled__2024-04-03T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:40:22.160770898Z [2024-04-03 01:40:22,157: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:23.361780467Z [2024-04-03 01:40:23,361: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:40:23.365168746Z [2024-04-03 01:40:23,364: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:23.393355938Z [2024-04-03 01:40:23,392: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:40:23.395118666Z [2024-04-03 01:40:23,394: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:23.395174586Z [2024-04-03 01:40:23,395: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:23.395359051Z [2024-04-03 01:40:23,395: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:40:23.395421456Z [2024-04-03 01:40:23,395: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:40:23.399388425Z [2024-04-03 01:40:23,399: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:23.399457455Z [2024-04-03 01:40:23,399: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:23.410446643Z [2024-04-03 01:40:23,410: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:23.411371385Z [2024-04-03 01:40:23,410: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:40:23.414095934Z [2024-04-03 01:40:23,413: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:40:23.417600978Z [2024-04-03 01:40:23,417: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:40:23.472356158Z [2024-04-03 01:40:23,472: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:40:23.473620309Z [2024-04-03 01:40:23,473: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:40:23.473632846Z [2024-04-03 01:40:23,473: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:40:23.473771814Z [2024-04-03 01:40:23,473: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:40:23.473817124Z [2024-04-03 01:40:23,473: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:40:23.474345479Z [2024-04-03 01:40:23,474: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:40:23.474381669Z [2024-04-03 01:40:23,474: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:40:23.479744565Z [2024-04-03 01:40:23,478: ERROR/ForkPoolWorker-15] [3bc83385-5c6c-4e1f-ab33-97543ffaf969] Failed to execute task Dag 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:40:23.479772799Z Traceback (most recent call last): 2024-04-03T01:40:23.479777035Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:40:23.479780664Z args.func(args) 2024-04-03T01:40:23.479784156Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:40:23.479787899Z return func(*args, **kwargs) 2024-04-03T01:40:23.479790833Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:40:23.479793812Z return f(*args, **kwargs) 2024-04-03T01:40:23.479797464Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:40:23.479800525Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:40:23.479803457Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:40:23.479806507Z raise AirflowException( 2024-04-03T01:40:23.479810007Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:40:23.514722221Z [2024-04-03 01:40:23,514: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3bc83385-5c6c-4e1f-ab33-97543ffaf969] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3bc83385-5c6c-4e1f-ab33-97543ffaf969') 2024-04-03T01:40:23.514748196Z Traceback (most recent call last): 2024-04-03T01:40:23.514755406Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:40:23.514761677Z R = retval = fun(*args, **kwargs) 2024-04-03T01:40:23.514767251Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:40:23.514772889Z return self.run(*args, **kwargs) 2024-04-03T01:40:23.514779359Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:40:23.514785660Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:40:23.514791315Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:40:23.514797498Z raise AirflowException(msg) 2024-04-03T01:40:23.514803751Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3bc83385-5c6c-4e1f-ab33-97543ffaf969 2024-04-03T01:41:00.868416009Z [2024-04-03 01:41:00,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e380443-a56f-475b-96be-e42b6f74a7be] received 2024-04-03T01:41:00.878813222Z [2024-04-03 01:41:00,878: INFO/ForkPoolWorker-15] [0e380443-a56f-475b-96be-e42b6f74a7be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:41:00.891157831Z [2024-04-03 01:41:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dc4b370-9fb7-46c0-8388-aee0068c46f3] received 2024-04-03T01:41:00.894074961Z [2024-04-03 01:41:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbd33849-57e9-4e13-9ad3-095ecdd584b6] received 2024-04-03T01:41:00.901680982Z [2024-04-03 01:41:00,901: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[473c2137-02b9-48b6-8a91-272133ca91d5] received 2024-04-03T01:41:00.907541125Z [2024-04-03 01:41:00,907: INFO/ForkPoolWorker-16] [5dc4b370-9fb7-46c0-8388-aee0068c46f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:41:00.923487702Z [2024-04-03 01:41:00,923: INFO/ForkPoolWorker-2] [473c2137-02b9-48b6-8a91-272133ca91d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:41:00.952822793Z [2024-04-03 01:41:00,952: INFO/ForkPoolWorker-1] [cbd33849-57e9-4e13-9ad3-095ecdd584b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:41:01.302245495Z [2024-04-03 01:41:01,294: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:41:01.359708910Z [2024-04-03 01:41:01,355: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:41:01.469156284Z [2024-04-03 01:41:01,465: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:41:01.594534649Z [2024-04-03 01:41:01,590: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:41:02.945369911Z [2024-04-03 01:41:02,945: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T01:41:02.968773050Z [2024-04-03 01:41:02,968: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:03.043155844Z [2024-04-03 01:41:03,042: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T01:41:03.051179478Z [2024-04-03 01:41:03,050: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:03.051239297Z [2024-04-03 01:41:03,051: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:03.051437295Z [2024-04-03 01:41:03,051: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:03.051497865Z [2024-04-03 01:41:03,051: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T01:41:03.051801473Z [2024-04-03 01:41:03,051: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:41:03.051893707Z [2024-04-03 01:41:03,051: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:03.059359391Z [2024-04-03 01:41:03,059: WARNING/ForkPoolWorker-2] Dag 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:41:03.060277257Z [2024-04-03 01:41:03,059: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:41:03.061209101Z [2024-04-03 01:41:03,061: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T01:41:03.064067445Z [2024-04-03 01:41:03,063: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:03.077680470Z [2024-04-03 01:41:03,077: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:41:03.081046230Z [2024-04-03 01:41:03,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:03.106841735Z [2024-04-03 01:41:03,106: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T01:41:03.108112161Z [2024-04-03 01:41:03,107: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:03.108124602Z [2024-04-03 01:41:03,108: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:03.108343086Z [2024-04-03 01:41:03,108: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:03.108355062Z [2024-04-03 01:41:03,108: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T01:41:03.108710727Z [2024-04-03 01:41:03,108: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:41:03.108798764Z [2024-04-03 01:41:03,108: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:03.112918324Z [2024-04-03 01:41:03,112: ERROR/ForkPoolWorker-2] [473c2137-02b9-48b6-8a91-272133ca91d5] Failed to execute task Dag 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:41:03.112931125Z Traceback (most recent call last): 2024-04-03T01:41:03.112935116Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:41:03.112938992Z args.func(args) 2024-04-03T01:41:03.112943564Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:41:03.112947163Z return func(*args, **kwargs) 2024-04-03T01:41:03.112950167Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:41:03.112960004Z return f(*args, **kwargs) 2024-04-03T01:41:03.112975134Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:41:03.112978310Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:41:03.112981328Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:41:03.112984226Z raise AirflowException( 2024-04-03T01:41:03.112988099Z airflow.exceptions.AirflowException: Dag 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:41:03.131183971Z [2024-04-03 01:41:03,130: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:41:03.132609520Z [2024-04-03 01:41:03,132: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:03.132620131Z [2024-04-03 01:41:03,132: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:03.132635571Z [2024-04-03 01:41:03,132: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:03.132646753Z [2024-04-03 01:41:03,132: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:41:03.132654846Z [2024-04-03 01:41:03,132: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:41:03.132662255Z [2024-04-03 01:41:03,132: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:03.188952951Z [2024-04-03 01:41:03,188: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[473c2137-02b9-48b6-8a91-272133ca91d5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 473c2137-02b9-48b6-8a91-272133ca91d5') 2024-04-03T01:41:03.188990856Z Traceback (most recent call last): 2024-04-03T01:41:03.189012589Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:41:03.189016221Z R = retval = fun(*args, **kwargs) 2024-04-03T01:41:03.189019742Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:41:03.189022816Z return self.run(*args, **kwargs) 2024-04-03T01:41:03.189026578Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:41:03.189030270Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:41:03.189033449Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:41:03.189037163Z raise AirflowException(msg) 2024-04-03T01:41:03.189046340Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 473c2137-02b9-48b6-8a91-272133ca91d5 2024-04-03T01:41:03.305432403Z [2024-04-03 01:41:03,305: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:41:03.309264207Z [2024-04-03 01:41:03,308: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:03.327271385Z [2024-04-03 01:41:03,326: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:41:03.330059379Z [2024-04-03 01:41:03,329: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:41:03.332015508Z [2024-04-03 01:41:03,331: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:03.361125296Z [2024-04-03 01:41:03,360: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:41:03.364185031Z [2024-04-03 01:41:03,363: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:03.364360982Z [2024-04-03 01:41:03,364: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:03.364750779Z [2024-04-03 01:41:03,364: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:03.364928612Z [2024-04-03 01:41:03,364: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:41:03.365255705Z [2024-04-03 01:41:03,365: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:41:03.365824181Z [2024-04-03 01:41:03,365: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:03.373405685Z [2024-04-03 01:41:03,373: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:41:03.374885509Z [2024-04-03 01:41:03,373: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:41:03.376067575Z [2024-04-03 01:41:03,375: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:41:03.380394752Z [2024-04-03 01:41:03,380: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:03.397794070Z [2024-04-03 01:41:03,397: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:41:03.400562553Z [2024-04-03 01:41:03,400: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:03.408054013Z [2024-04-03 01:41:03,407: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:03.408203133Z [2024-04-03 01:41:03,407: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:03.408278639Z [2024-04-03 01:41:03,408: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:41:03.408579453Z [2024-04-03 01:41:03,408: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:41:03.408617061Z [2024-04-03 01:41:03,408: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:03.431206890Z [2024-04-03 01:41:03,430: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:41:03.432703312Z [2024-04-03 01:41:03,432: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:03.432877654Z [2024-04-03 01:41:03,432: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:03.433103680Z [2024-04-03 01:41:03,432: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:03.433256935Z [2024-04-03 01:41:03,433: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:41:03.433553164Z [2024-04-03 01:41:03,433: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:41:03.434131266Z [2024-04-03 01:41:03,433: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:03.437557419Z [2024-04-03 01:41:03,437: ERROR/ForkPoolWorker-15] [0e380443-a56f-475b-96be-e42b6f74a7be] Failed to execute task Dag 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:41:03.437584909Z Traceback (most recent call last): 2024-04-03T01:41:03.437588807Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:41:03.437608568Z args.func(args) 2024-04-03T01:41:03.437613029Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:41:03.437617420Z return func(*args, **kwargs) 2024-04-03T01:41:03.437620402Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:41:03.437623266Z return f(*args, **kwargs) 2024-04-03T01:41:03.437626390Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:41:03.437629432Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:41:03.437632321Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:41:03.437635250Z raise AirflowException( 2024-04-03T01:41:03.437639145Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:41:03.494787993Z [2024-04-03 01:41:03,494: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:41:03.508694047Z [2024-04-03 01:41:03,506: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e380443-a56f-475b-96be-e42b6f74a7be] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0e380443-a56f-475b-96be-e42b6f74a7be') 2024-04-03T01:41:03.508716561Z Traceback (most recent call last): 2024-04-03T01:41:03.508721375Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:41:03.508724400Z R = retval = fun(*args, **kwargs) 2024-04-03T01:41:03.508727664Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:41:03.508730795Z return self.run(*args, **kwargs) 2024-04-03T01:41:03.508734699Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:41:03.508738370Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:41:03.508741320Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:41:03.508744906Z raise AirflowException(msg) 2024-04-03T01:41:03.508749212Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0e380443-a56f-475b-96be-e42b6f74a7be 2024-04-03T01:41:05.105456735Z [2024-04-03 01:41:05,105: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5dc4b370-9fb7-46c0-8388-aee0068c46f3] succeeded in 4.212176790000058s: None 2024-04-03T01:41:05.417166862Z [2024-04-03 01:41:05,416: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cbd33849-57e9-4e13-9ad3-095ecdd584b6] succeeded in 4.517980522000016s: None 2024-04-03T01:41:13.432581759Z [2024-04-03 01:41:13,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25ff04d8-1938-423b-9e5f-dcfd9d7a6a1f] received 2024-04-03T01:41:13.439555954Z [2024-04-03 01:41:13,439: INFO/ForkPoolWorker-15] [25ff04d8-1938-423b-9e5f-dcfd9d7a6a1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:41:13.755713308Z [2024-04-03 01:41:13,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:41:14.636524478Z [2024-04-03 01:41:14,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[174e48ec-8c85-4e64-b5a8-82ea8dba60af] received 2024-04-03T01:41:14.648065169Z [2024-04-03 01:41:14,646: INFO/ForkPoolWorker-16] [174e48ec-8c85-4e64-b5a8-82ea8dba60af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:41:14.940705383Z [2024-04-03 01:41:14,937: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:41:15.116686992Z [2024-04-03 01:41:15,116: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:41:15.120145048Z [2024-04-03 01:41:15,119: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:15.145629789Z [2024-04-03 01:41:15,145: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:41:15.146715697Z [2024-04-03 01:41:15,146: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:15.146793902Z [2024-04-03 01:41:15,146: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:15.146940351Z [2024-04-03 01:41:15,146: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:15.147043023Z [2024-04-03 01:41:15,146: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:41:15.147305615Z [2024-04-03 01:41:15,147: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:41:15.147417827Z [2024-04-03 01:41:15,147: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:15.154739031Z [2024-04-03 01:41:15,154: WARNING/ForkPoolWorker-15] Dag 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:41:15.156185171Z [2024-04-03 01:41:15,155: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:41:15.157032167Z [2024-04-03 01:41:15,156: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:41:15.160551893Z [2024-04-03 01:41:15,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:15.183408415Z [2024-04-03 01:41:15,183: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:41:15.184538350Z [2024-04-03 01:41:15,184: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:15.184680685Z [2024-04-03 01:41:15,184: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:15.184912931Z [2024-04-03 01:41:15,184: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:15.185066961Z [2024-04-03 01:41:15,184: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:41:15.185357226Z [2024-04-03 01:41:15,185: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:41:15.185533987Z [2024-04-03 01:41:15,185: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:15.189079166Z [2024-04-03 01:41:15,188: ERROR/ForkPoolWorker-15] [25ff04d8-1938-423b-9e5f-dcfd9d7a6a1f] Failed to execute task Dag 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:41:15.189091810Z Traceback (most recent call last): 2024-04-03T01:41:15.189095933Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:41:15.189099874Z args.func(args) 2024-04-03T01:41:15.189103762Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:41:15.189107603Z return func(*args, **kwargs) 2024-04-03T01:41:15.189111001Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:41:15.189114293Z return f(*args, **kwargs) 2024-04-03T01:41:15.189117775Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:41:15.189121109Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:41:15.189124761Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:41:15.189128867Z raise AirflowException( 2024-04-03T01:41:15.189132781Z airflow.exceptions.AirflowException: Dag 'vim_status_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:41:15.222246716Z [2024-04-03 01:41:15,221: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25ff04d8-1938-423b-9e5f-dcfd9d7a6a1f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 25ff04d8-1938-423b-9e5f-dcfd9d7a6a1f') 2024-04-03T01:41:15.222260367Z Traceback (most recent call last): 2024-04-03T01:41:15.222264360Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:41:15.222267474Z R = retval = fun(*args, **kwargs) 2024-04-03T01:41:15.222270653Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:41:15.222277977Z return self.run(*args, **kwargs) 2024-04-03T01:41:15.222297609Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:41:15.222301775Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:41:15.222304838Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:41:15.222308506Z raise AirflowException(msg) 2024-04-03T01:41:15.222312861Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 25ff04d8-1938-423b-9e5f-dcfd9d7a6a1f 2024-04-03T01:41:16.119365785Z [2024-04-03 01:41:16,118: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:41:16.122801605Z [2024-04-03 01:41:16,122: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:16.150900645Z [2024-04-03 01:41:16,150: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:41:16.152241429Z [2024-04-03 01:41:16,152: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:16.152346723Z [2024-04-03 01:41:16,152: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:16.152561410Z [2024-04-03 01:41:16,152: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:16.152663627Z [2024-04-03 01:41:16,152: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:41:16.152981757Z [2024-04-03 01:41:16,152: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:41:16.153121090Z [2024-04-03 01:41:16,152: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:16.160284553Z [2024-04-03 01:41:16,160: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:41:16.161166868Z [2024-04-03 01:41:16,160: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:41:16.161954850Z [2024-04-03 01:41:16,161: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:41:16.164565310Z [2024-04-03 01:41:16,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:41:16.193175035Z [2024-04-03 01:41:16,192: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:41:16.194704883Z [2024-04-03 01:41:16,194: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:41:16.194946084Z [2024-04-03 01:41:16,194: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:41:16.195191023Z [2024-04-03 01:41:16,194: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:41:16.195334154Z [2024-04-03 01:41:16,195: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:41:16.195639933Z [2024-04-03 01:41:16,195: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:41:16.195806341Z [2024-04-03 01:41:16,195: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:41:16.199938602Z [2024-04-03 01:41:16,199: ERROR/ForkPoolWorker-16] [174e48ec-8c85-4e64-b5a8-82ea8dba60af] Failed to execute task Dag 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse.. 2024-04-03T01:41:16.199952610Z Traceback (most recent call last): 2024-04-03T01:41:16.199958084Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T01:41:16.199978249Z args.func(args) 2024-04-03T01:41:16.199983343Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T01:41:16.199988470Z return func(*args, **kwargs) 2024-04-03T01:41:16.199992924Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T01:41:16.199996791Z return f(*args, **kwargs) 2024-04-03T01:41:16.200001135Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T01:41:16.200005099Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T01:41:16.200009197Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T01:41:16.200013530Z raise AirflowException( 2024-04-03T01:41:16.200021064Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_c141e420-fb9e-461e-aff0-9b8604830218' could not be found; either it does not exist or it failed to parse. 2024-04-03T01:41:16.237553544Z [2024-04-03 01:41:16,236: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[174e48ec-8c85-4e64-b5a8-82ea8dba60af] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 174e48ec-8c85-4e64-b5a8-82ea8dba60af') 2024-04-03T01:41:16.237567777Z Traceback (most recent call last): 2024-04-03T01:41:16.237572684Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T01:41:16.237576204Z R = retval = fun(*args, **kwargs) 2024-04-03T01:41:16.237579525Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T01:41:16.237582919Z return self.run(*args, **kwargs) 2024-04-03T01:41:16.237586818Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T01:41:16.237590399Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T01:41:16.237593865Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T01:41:16.237597390Z raise AirflowException(msg) 2024-04-03T01:41:16.237601004Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 174e48ec-8c85-4e64-b5a8-82ea8dba60af 2024-04-03T01:42:00.647584977Z [2024-04-03 01:42:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02755255-f045-41d5-92bc-b1c280666840] received 2024-04-03T01:42:00.656146989Z [2024-04-03 01:42:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[415f2df1-7031-4bdd-bd07-e62f5558b4a9] received 2024-04-03T01:42:00.659500939Z [2024-04-03 01:42:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bb5aabc-d9d4-4940-81ef-6bf17beefd6d] received 2024-04-03T01:42:00.667094817Z [2024-04-03 01:42:00,666: INFO/ForkPoolWorker-16] [415f2df1-7031-4bdd-bd07-e62f5558b4a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:42:00.668905860Z [2024-04-03 01:42:00,668: INFO/ForkPoolWorker-1] [7bb5aabc-d9d4-4940-81ef-6bf17beefd6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:42:00.680812545Z [2024-04-03 01:42:00,680: INFO/ForkPoolWorker-15] [02755255-f045-41d5-92bc-b1c280666840] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:42:01.158882926Z [2024-04-03 01:42:01,132: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:42:01.210448530Z [2024-04-03 01:42:01,206: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:42:01.260439048Z [2024-04-03 01:42:01,256: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:42:01.491277685Z [2024-04-03 01:42:01,490: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:42:02.252582163Z [2024-04-03 01:42:02,252: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[415f2df1-7031-4bdd-bd07-e62f5558b4a9] succeeded in 1.5941900150000947s: None 2024-04-03T01:42:02.766964521Z [2024-04-03 01:42:02,766: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:42:02.770115567Z [2024-04-03 01:42:02,769: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:42:02.782761682Z [2024-04-03 01:42:02,782: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:42:02.787740428Z [2024-04-03 01:42:02,786: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:42:02.805557823Z [2024-04-03 01:42:02,801: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:42:02.805581140Z [2024-04-03 01:42:02,802: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:42:02.805584579Z [2024-04-03 01:42:02,802: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:42:02.805588452Z [2024-04-03 01:42:02,802: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:42:02.805592507Z [2024-04-03 01:42:02,802: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:42:02.805595641Z [2024-04-03 01:42:02,803: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:42:02.805599058Z [2024-04-03 01:42:02,803: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:42:02.911162396Z [2024-04-03 01:42:02,910: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:42:02.915945910Z [2024-04-03 01:42:02,915: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:42:02.919247721Z [2024-04-03 01:42:02,918: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:42:02.919571496Z [2024-04-03 01:42:02,919: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:42:02.919820694Z [2024-04-03 01:42:02,919: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:42:02.919985426Z [2024-04-03 01:42:02,919: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:42:02.920381620Z [2024-04-03 01:42:02,920: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:42:02.920630744Z [2024-04-03 01:42:02,920: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:42:03.039907123Z [2024-04-03 01:42:03,039: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:42:04.576582889Z [2024-04-03 01:42:04,576: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7bb5aabc-d9d4-4940-81ef-6bf17beefd6d] succeeded in 3.913842397000053s: None 2024-04-03T01:42:05.065237473Z [2024-04-03 01:42:05,064: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02755255-f045-41d5-92bc-b1c280666840] succeeded in 4.4132860379997965s: None 2024-04-03T01:43:00.426119732Z [2024-04-03 01:43:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47f7c86f-cf86-48aa-b16e-e0e5f3f215dc] received 2024-04-03T01:43:00.430035646Z [2024-04-03 01:43:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[749267ad-d546-48f5-a6c7-1150b9acc43d] received 2024-04-03T01:43:00.452685687Z [2024-04-03 01:43:00,452: INFO/ForkPoolWorker-16] [749267ad-d546-48f5-a6c7-1150b9acc43d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:43:00.457209605Z [2024-04-03 01:43:00,456: INFO/ForkPoolWorker-15] [47f7c86f-cf86-48aa-b16e-e0e5f3f215dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:43:00.854581524Z [2024-04-03 01:43:00,850: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:43:00.958671982Z [2024-04-03 01:43:00,954: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:43:02.225285935Z [2024-04-03 01:43:02,224: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:43:02.229059703Z [2024-04-03 01:43:02,228: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:43:02.264523609Z [2024-04-03 01:43:02,264: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:43:02.266167238Z [2024-04-03 01:43:02,265: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:43:02.266224909Z [2024-04-03 01:43:02,266: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:43:02.266405056Z [2024-04-03 01:43:02,266: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:43:02.266465892Z [2024-04-03 01:43:02,266: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:43:02.266821541Z [2024-04-03 01:43:02,266: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:43:02.266923214Z [2024-04-03 01:43:02,266: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:43:02.380550421Z [2024-04-03 01:43:02,380: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:43:02.383947414Z [2024-04-03 01:43:02,383: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:43:02.385701035Z [2024-04-03 01:43:02,385: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:43:02.423074162Z [2024-04-03 01:43:02,422: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:43:02.424905093Z [2024-04-03 01:43:02,424: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:43:02.425130087Z [2024-04-03 01:43:02,424: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:43:02.425720974Z [2024-04-03 01:43:02,425: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:43:02.425888427Z [2024-04-03 01:43:02,425: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:43:02.426140481Z [2024-04-03 01:43:02,426: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:43:02.426265007Z [2024-04-03 01:43:02,426: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:43:02.503583961Z [2024-04-03 01:43:02,503: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:43:04.178327365Z [2024-04-03 01:43:04,177: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47f7c86f-cf86-48aa-b16e-e0e5f3f215dc] succeeded in 3.7418525489999865s: None 2024-04-03T01:43:04.786867707Z [2024-04-03 01:43:04,785: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[749267ad-d546-48f5-a6c7-1150b9acc43d] succeeded in 4.352379138999822s: None 2024-04-03T01:44:00.259637318Z [2024-04-03 01:44:00,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8337283f-7d7a-49f6-86d5-72250793b225] received 2024-04-03T01:44:00.269713240Z [2024-04-03 01:44:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e76b62d-968e-4158-898c-d7d08bb98c15] received 2024-04-03T01:44:00.275590903Z [2024-04-03 01:44:00,275: INFO/ForkPoolWorker-15] [8337283f-7d7a-49f6-86d5-72250793b225] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:44:00.280699380Z [2024-04-03 01:44:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d56c32bc-302d-4858-abfb-06819963ca36] received 2024-04-03T01:44:00.287568478Z [2024-04-03 01:44:00,287: INFO/ForkPoolWorker-16] [3e76b62d-968e-4158-898c-d7d08bb98c15] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:44:00.329724938Z [2024-04-03 01:44:00,326: INFO/ForkPoolWorker-1] [d56c32bc-302d-4858-abfb-06819963ca36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:44:00.626631188Z [2024-04-03 01:44:00,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:44:00.642666349Z [2024-04-03 01:44:00,638: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:44:00.895268134Z [2024-04-03 01:44:00,891: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:44:01.143265943Z [2024-04-03 01:44:01,143: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:44:01.856613218Z [2024-04-03 01:44:01,856: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e76b62d-968e-4158-898c-d7d08bb98c15] succeeded in 1.584536681000145s: None 2024-04-03T01:44:02.310701982Z [2024-04-03 01:44:02,310: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:44:02.314262296Z [2024-04-03 01:44:02,313: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:44:02.347683454Z [2024-04-03 01:44:02,347: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:44:02.348747551Z [2024-04-03 01:44:02,348: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:44:02.348787672Z [2024-04-03 01:44:02,348: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:44:02.348959663Z [2024-04-03 01:44:02,348: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:44:02.349050290Z [2024-04-03 01:44:02,348: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:44:02.349249268Z [2024-04-03 01:44:02,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:44:02.349278020Z [2024-04-03 01:44:02,349: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:44:02.408138068Z [2024-04-03 01:44:02,407: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:44:02.411442367Z [2024-04-03 01:44:02,410: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:44:02.434579616Z [2024-04-03 01:44:02,434: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:44:02.442827196Z [2024-04-03 01:44:02,442: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:44:02.446027243Z [2024-04-03 01:44:02,445: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:44:02.446091730Z [2024-04-03 01:44:02,445: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:44:02.446258103Z [2024-04-03 01:44:02,446: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:44:02.446507648Z [2024-04-03 01:44:02,446: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:44:02.447166224Z [2024-04-03 01:44:02,446: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:44:02.447269017Z [2024-04-03 01:44:02,447: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:44:02.525611631Z [2024-04-03 01:44:02,525: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:44:03.857283653Z [2024-04-03 01:44:03,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8337283f-7d7a-49f6-86d5-72250793b225] succeeded in 3.592037125999923s: None 2024-04-03T01:44:04.603541513Z [2024-04-03 01:44:04,603: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d56c32bc-302d-4858-abfb-06819963ca36] succeeded in 4.2865913389998695s: None 2024-04-03T01:45:00.632073213Z [2024-04-03 01:45:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6927d199-f09e-4bab-956f-a93971c603e2] received 2024-04-03T01:45:00.645820363Z [2024-04-03 01:45:00,645: INFO/ForkPoolWorker-15] [6927d199-f09e-4bab-956f-a93971c603e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:45:00.717472377Z [2024-04-03 01:45:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[127b5051-a251-426d-9b18-71103df34b6a] received 2024-04-03T01:45:00.735200931Z [2024-04-03 01:45:00,734: INFO/ForkPoolWorker-16] [127b5051-a251-426d-9b18-71103df34b6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:45:00.737792813Z [2024-04-03 01:45:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bb28ca7-e32c-42ce-8ce8-8ab65a46fdfd] received 2024-04-03T01:45:00.778450403Z [2024-04-03 01:45:00,770: INFO/ForkPoolWorker-1] [9bb28ca7-e32c-42ce-8ce8-8ab65a46fdfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:45:01.310103218Z [2024-04-03 01:45:01,305: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:45:01.382437861Z [2024-04-03 01:45:01,377: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:45:01.427893260Z [2024-04-03 01:45:01,423: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:45:03.056822251Z [2024-04-03 01:45:03,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:45:03.060561694Z [2024-04-03 01:45:03,060: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:45:03.076709424Z [2024-04-03 01:45:03,076: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:45:03.081153641Z [2024-04-03 01:45:03,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:45:03.125729751Z [2024-04-03 01:45:03,125: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:45:03.127197264Z [2024-04-03 01:45:03,126: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:45:03.127349162Z [2024-04-03 01:45:03,127: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:45:03.127582215Z [2024-04-03 01:45:03,127: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:45:03.127731583Z [2024-04-03 01:45:03,127: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:45:03.128031646Z [2024-04-03 01:45:03,127: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:45:03.128180282Z [2024-04-03 01:45:03,128: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:45:03.133000274Z [2024-04-03 01:45:03,132: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:45:03.147280390Z [2024-04-03 01:45:03,147: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:45:03.147575949Z [2024-04-03 01:45:03,147: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:45:03.147785538Z [2024-04-03 01:45:03,147: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:45:03.147917319Z [2024-04-03 01:45:03,147: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:45:03.151431239Z [2024-04-03 01:45:03,151: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:45:03.151646999Z [2024-04-03 01:45:03,151: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:45:03.236316512Z [2024-04-03 01:45:03,235: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:45:03.270096319Z [2024-04-03 01:45:03,269: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:45:03.508842038Z [2024-04-03 01:45:03,508: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:45:03.512350075Z [2024-04-03 01:45:03,511: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:45:03.602934832Z [2024-04-03 01:45:03,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:45:03.604602640Z [2024-04-03 01:45:03,604: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:45:03.604768038Z [2024-04-03 01:45:03,604: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:45:03.604987331Z [2024-04-03 01:45:03,604: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:45:03.605153970Z [2024-04-03 01:45:03,605: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:45:03.605589750Z [2024-04-03 01:45:03,605: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:45:03.605871994Z [2024-04-03 01:45:03,605: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:45:03.734415103Z [2024-04-03 01:45:03,734: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:45:04.462258686Z [2024-04-03 01:45:04,461: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6927d199-f09e-4bab-956f-a93971c603e2] succeeded in 3.8267910609999944s: None 2024-04-03T01:45:04.725801264Z [2024-04-03 01:45:04,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[788d59ad-7391-4255-9649-6d8b8fae9591] received 2024-04-03T01:45:04.735596503Z [2024-04-03 01:45:04,735: INFO/ForkPoolWorker-15] [788d59ad-7391-4255-9649-6d8b8fae9591] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:45:04.982726382Z [2024-04-03 01:45:04,982: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9bb28ca7-e32c-42ce-8ce8-8ab65a46fdfd] succeeded in 4.234731968999995s: None 2024-04-03T01:45:05.043132462Z [2024-04-03 01:45:05,039: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:45:05.282150761Z [2024-04-03 01:45:05,281: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[127b5051-a251-426d-9b18-71103df34b6a] succeeded in 4.561090807000028s: None 2024-04-03T01:45:06.345964737Z [2024-04-03 01:45:06,345: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:45:06.349600670Z [2024-04-03 01:45:06,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:45:06.390965513Z [2024-04-03 01:45:06,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:45:06.393634407Z [2024-04-03 01:45:06,393: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:45:06.393853703Z [2024-04-03 01:45:06,393: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:45:06.394163459Z [2024-04-03 01:45:06,393: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:45:06.394696357Z [2024-04-03 01:45:06,394: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:45:06.395286680Z [2024-04-03 01:45:06,395: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:45:06.395642231Z [2024-04-03 01:45:06,395: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:45:06.506777499Z [2024-04-03 01:45:06,506: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:45:07.233862283Z [2024-04-03 01:45:07,233: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[788d59ad-7391-4255-9649-6d8b8fae9591] succeeded in 2.5048810790001426s: None 2024-04-03T01:45:07.549084269Z [2024-04-03 01:45:07,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d754726c-3df9-4db9-9ef7-c535b1d260a9] received 2024-04-03T01:45:07.560104800Z [2024-04-03 01:45:07,559: INFO/ForkPoolWorker-15] [d754726c-3df9-4db9-9ef7-c535b1d260a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:45:07.880329380Z [2024-04-03 01:45:07,875: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:45:09.291431961Z [2024-04-03 01:45:09,287: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:45:09.291467504Z [2024-04-03 01:45:09,290: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:45:09.318205584Z [2024-04-03 01:45:09,317: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:45:09.319287430Z [2024-04-03 01:45:09,319: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:45:09.319304290Z [2024-04-03 01:45:09,319: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:45:09.319429957Z [2024-04-03 01:45:09,319: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:45:09.319457037Z [2024-04-03 01:45:09,319: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:45:09.319681848Z [2024-04-03 01:45:09,319: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:45:09.319711947Z [2024-04-03 01:45:09,319: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:45:09.412226355Z [2024-04-03 01:45:09,411: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:45:11.716863955Z [2024-04-03 01:45:11,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d754726c-3df9-4db9-9ef7-c535b1d260a9] succeeded in 4.165021661999845s: None 2024-04-03T01:45:12.716303982Z [2024-04-03 01:45:12,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44ceb505-6da6-43dc-a044-f28a0150d0ab] received 2024-04-03T01:45:12.735406378Z [2024-04-03 01:45:12,735: INFO/ForkPoolWorker-15] [44ceb505-6da6-43dc-a044-f28a0150d0ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:45:13.126167558Z [2024-04-03 01:45:13,123: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:45:14.807753756Z [2024-04-03 01:45:14,807: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:45:14.812018205Z [2024-04-03 01:45:14,811: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:45:14.853124424Z [2024-04-03 01:45:14,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:45:14.854724212Z [2024-04-03 01:45:14,854: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:45:14.854756801Z [2024-04-03 01:45:14,854: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:45:14.854930463Z [2024-04-03 01:45:14,854: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:45:14.854947788Z [2024-04-03 01:45:14,854: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:45:14.855348813Z [2024-04-03 01:45:14,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:45:14.855363144Z [2024-04-03 01:45:14,855: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:45:14.943695851Z [2024-04-03 01:45:14,943: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:45:15.497773436Z [2024-04-03 01:45:15,497: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44ceb505-6da6-43dc-a044-f28a0150d0ab] succeeded in 2.779179819000092s: None 2024-04-03T01:46:00.543395633Z [2024-04-03 01:46:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c12ee44-8466-4a28-a13c-92384cfd3b0b] received 2024-04-03T01:46:00.570978525Z [2024-04-03 01:46:00,570: INFO/ForkPoolWorker-15] [7c12ee44-8466-4a28-a13c-92384cfd3b0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:46:00.595767092Z [2024-04-03 01:46:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3862edf-c7a7-43ce-87e5-6cb76f791c74] received 2024-04-03T01:46:00.622230639Z [2024-04-03 01:46:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23aeab7c-64b9-42a3-acd3-c5e0e9d949ee] received 2024-04-03T01:46:00.632103124Z [2024-04-03 01:46:00,631: INFO/ForkPoolWorker-16] [f3862edf-c7a7-43ce-87e5-6cb76f791c74] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:46:00.657799680Z [2024-04-03 01:46:00,657: INFO/ForkPoolWorker-1] [23aeab7c-64b9-42a3-acd3-c5e0e9d949ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:46:01.259099254Z [2024-04-03 01:46:01,254: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:46:01.283408139Z [2024-04-03 01:46:01,257: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:46:01.357019261Z [2024-04-03 01:46:01,353: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:46:01.712585101Z [2024-04-03 01:46:01,712: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:46:02.647648608Z [2024-04-03 01:46:02,647: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3862edf-c7a7-43ce-87e5-6cb76f791c74] succeeded in 2.0462340950000453s: None 2024-04-03T01:46:03.179587847Z [2024-04-03 01:46:03,179: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:46:03.183425711Z [2024-04-03 01:46:03,182: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:46:03.187247219Z [2024-04-03 01:46:03,186: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:46:03.191091829Z [2024-04-03 01:46:03,190: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:46:03.224768002Z [2024-04-03 01:46:03,224: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:46:03.227242618Z [2024-04-03 01:46:03,227: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:46:03.227585318Z [2024-04-03 01:46:03,227: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:46:03.227787103Z [2024-04-03 01:46:03,227: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:46:03.227982439Z [2024-04-03 01:46:03,227: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:46:03.228871854Z [2024-04-03 01:46:03,228: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:46:03.228996782Z [2024-04-03 01:46:03,228: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:46:03.237877881Z [2024-04-03 01:46:03,237: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:46:03.240842428Z [2024-04-03 01:46:03,240: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:46:03.241002613Z [2024-04-03 01:46:03,240: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:46:03.241227729Z [2024-04-03 01:46:03,240: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:46:03.241382551Z [2024-04-03 01:46:03,241: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:46:03.241679224Z [2024-04-03 01:46:03,241: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:46:03.241828307Z [2024-04-03 01:46:03,241: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:46:03.324637357Z [2024-04-03 01:46:03,324: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:46:03.333335826Z [2024-04-03 01:46:03,333: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:46:05.179591508Z [2024-04-03 01:46:05,179: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c12ee44-8466-4a28-a13c-92384cfd3b0b] succeeded in 4.632976351000025s: None 2024-04-03T01:46:05.283531157Z [2024-04-03 01:46:05,282: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23aeab7c-64b9-42a3-acd3-c5e0e9d949ee] succeeded in 4.6540839909998795s: None 2024-04-03T01:47:00.332078639Z [2024-04-03 01:47:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fedd5fd1-c87f-4e62-8e2f-5cf2baffc67b] received 2024-04-03T01:47:00.334772593Z [2024-04-03 01:47:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a670e79b-22b4-422b-8035-15f5d0eb3c3e] received 2024-04-03T01:47:00.349622350Z [2024-04-03 01:47:00,349: INFO/ForkPoolWorker-16] [a670e79b-22b4-422b-8035-15f5d0eb3c3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:47:00.352646854Z [2024-04-03 01:47:00,352: INFO/ForkPoolWorker-15] [fedd5fd1-c87f-4e62-8e2f-5cf2baffc67b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:47:00.766791494Z [2024-04-03 01:47:00,743: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:47:01.063285208Z [2024-04-03 01:47:01,058: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:47:02.339540985Z [2024-04-03 01:47:02,339: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:47:02.343013819Z [2024-04-03 01:47:02,342: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:47:02.394657829Z [2024-04-03 01:47:02,394: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:47:02.399149664Z [2024-04-03 01:47:02,398: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:47:02.399170223Z [2024-04-03 01:47:02,399: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:47:02.399337010Z [2024-04-03 01:47:02,399: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:47:02.399387642Z [2024-04-03 01:47:02,399: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:47:02.399660462Z [2024-04-03 01:47:02,399: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:47:02.399747252Z [2024-04-03 01:47:02,399: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:47:02.473111827Z [2024-04-03 01:47:02,472: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:47:02.595063712Z [2024-04-03 01:47:02,594: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:47:02.599036693Z [2024-04-03 01:47:02,598: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:47:02.637635555Z [2024-04-03 01:47:02,637: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:47:02.639521069Z [2024-04-03 01:47:02,639: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:47:02.640206314Z [2024-04-03 01:47:02,639: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:47:02.640708207Z [2024-04-03 01:47:02,640: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:47:02.640953905Z [2024-04-03 01:47:02,640: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:47:02.641488790Z [2024-04-03 01:47:02,641: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:47:02.641713725Z [2024-04-03 01:47:02,641: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:47:02.721672113Z [2024-04-03 01:47:02,721: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:47:04.679059138Z [2024-04-03 01:47:04,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fedd5fd1-c87f-4e62-8e2f-5cf2baffc67b] succeeded in 4.339997870000161s: None 2024-04-03T01:47:06.430065612Z [2024-04-03 01:47:06,429: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a670e79b-22b4-422b-8035-15f5d0eb3c3e] succeeded in 6.0919495500002085s: None 2024-04-03T01:48:01.288724299Z [2024-04-03 01:48:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0686e248-7c91-46ce-985b-1d41e8f503d5] received 2024-04-03T01:48:01.291760581Z [2024-04-03 01:48:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac172c49-491f-4fc0-b1b9-330a89eb7f4a] received 2024-04-03T01:48:01.303064818Z [2024-04-03 01:48:01,302: INFO/ForkPoolWorker-16] [ac172c49-491f-4fc0-b1b9-330a89eb7f4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:48:01.307455110Z [2024-04-03 01:48:01,307: INFO/ForkPoolWorker-15] [0686e248-7c91-46ce-985b-1d41e8f503d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:48:01.317372368Z [2024-04-03 01:48:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4e2db5f-2ed0-42bb-a640-da5fe0060545] received 2024-04-03T01:48:01.366579147Z [2024-04-03 01:48:01,366: INFO/ForkPoolWorker-1] [c4e2db5f-2ed0-42bb-a640-da5fe0060545] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:48:01.613945867Z [2024-04-03 01:48:01,610: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:48:01.616773898Z [2024-04-03 01:48:01,613: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:48:01.739709957Z [2024-04-03 01:48:01,734: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:48:01.853892171Z [2024-04-03 01:48:01,853: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:48:02.437760556Z [2024-04-03 01:48:02,437: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac172c49-491f-4fc0-b1b9-330a89eb7f4a] succeeded in 1.143133250000119s: None 2024-04-03T01:48:02.884253139Z [2024-04-03 01:48:02,883: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:48:02.887884767Z [2024-04-03 01:48:02,887: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:48:02.943682004Z [2024-04-03 01:48:02,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:48:02.944839175Z [2024-04-03 01:48:02,944: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:48:02.944971692Z [2024-04-03 01:48:02,944: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:48:02.945150813Z [2024-04-03 01:48:02,944: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:48:02.945243746Z [2024-04-03 01:48:02,945: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:48:02.945537883Z [2024-04-03 01:48:02,945: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:48:02.945648938Z [2024-04-03 01:48:02,945: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:48:03.000227933Z [2024-04-03 01:48:02,999: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:48:03.003685387Z [2024-04-03 01:48:03,003: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:48:03.054880667Z [2024-04-03 01:48:03,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:48:03.066851046Z [2024-04-03 01:48:03,059: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:48:03.066886861Z [2024-04-03 01:48:03,059: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:48:03.066891193Z [2024-04-03 01:48:03,059: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:48:03.066895294Z [2024-04-03 01:48:03,059: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:48:03.066898347Z [2024-04-03 01:48:03,060: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:48:03.066901408Z [2024-04-03 01:48:03,060: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:48:03.078305711Z [2024-04-03 01:48:03,075: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:48:03.179067903Z [2024-04-03 01:48:03,178: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:48:05.212984808Z [2024-04-03 01:48:05,212: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0686e248-7c91-46ce-985b-1d41e8f503d5] succeeded in 3.91807109399997s: None 2024-04-03T01:48:05.628665316Z [2024-04-03 01:48:05,628: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4e2db5f-2ed0-42bb-a640-da5fe0060545] succeeded in 4.307193500000039s: None 2024-04-03T01:49:00.909452772Z [2024-04-03 01:49:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5f978b2-a3e7-49cb-bb2f-8923d275d063] received 2024-04-03T01:49:00.916818404Z [2024-04-03 01:49:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[445e133d-df26-4e33-9d48-5479b504f152] received 2024-04-03T01:49:00.928506641Z [2024-04-03 01:49:00,928: INFO/ForkPoolWorker-15] [e5f978b2-a3e7-49cb-bb2f-8923d275d063] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:49:00.940908858Z [2024-04-03 01:49:00,940: INFO/ForkPoolWorker-16] [445e133d-df26-4e33-9d48-5479b504f152] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:49:01.368882921Z [2024-04-03 01:49:01,364: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:49:01.408477758Z [2024-04-03 01:49:01,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:49:02.629517921Z [2024-04-03 01:49:02,628: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:49:02.632783097Z [2024-04-03 01:49:02,632: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:49:02.633263513Z [2024-04-03 01:49:02,632: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:49:02.639067945Z [2024-04-03 01:49:02,638: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:49:02.662487437Z [2024-04-03 01:49:02,662: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:49:02.664233997Z [2024-04-03 01:49:02,664: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:49:02.664250735Z [2024-04-03 01:49:02,664: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:49:02.664367142Z [2024-04-03 01:49:02,664: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:49:02.664397483Z [2024-04-03 01:49:02,664: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:49:02.664899914Z [2024-04-03 01:49:02,664: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:49:02.665179013Z [2024-04-03 01:49:02,664: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:49:02.671203713Z [2024-04-03 01:49:02,671: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:49:02.672498656Z [2024-04-03 01:49:02,672: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:49:02.672656759Z [2024-04-03 01:49:02,672: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:49:02.672833331Z [2024-04-03 01:49:02,672: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:49:02.673447812Z [2024-04-03 01:49:02,673: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:49:02.673766610Z [2024-04-03 01:49:02,673: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:49:02.673831640Z [2024-04-03 01:49:02,673: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:49:02.756313579Z [2024-04-03 01:49:02,756: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:49:02.795905612Z [2024-04-03 01:49:02,786: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:49:05.098139931Z [2024-04-03 01:49:05,097: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[445e133d-df26-4e33-9d48-5479b504f152] succeeded in 4.172470448000013s: None 2024-04-03T01:49:05.181939920Z [2024-04-03 01:49:05,179: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5f978b2-a3e7-49cb-bb2f-8923d275d063] succeeded in 4.266370998999946s: None 2024-04-03T01:50:00.802752917Z [2024-04-03 01:50:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61b37884-e947-4a8e-81ad-feb07a031672] received 2024-04-03T01:50:00.808776206Z [2024-04-03 01:50:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8edcb558-e4f3-4ab8-aa47-96bef2d3f616] received 2024-04-03T01:50:00.829832287Z [2024-04-03 01:50:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b9da594-c82c-4dd8-ac4c-3b0432278110] received 2024-04-03T01:50:00.831300849Z [2024-04-03 01:50:00,830: INFO/ForkPoolWorker-16] [8edcb558-e4f3-4ab8-aa47-96bef2d3f616] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:50:00.833445301Z [2024-04-03 01:50:00,833: INFO/ForkPoolWorker-15] [61b37884-e947-4a8e-81ad-feb07a031672] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:50:00.837311613Z [2024-04-03 01:50:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7dfa4d8-723b-4ea8-8b06-826872dc63c2] received 2024-04-03T01:50:00.866284640Z [2024-04-03 01:50:00,865: INFO/ForkPoolWorker-2] [c7dfa4d8-723b-4ea8-8b06-826872dc63c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:50:00.878467189Z [2024-04-03 01:50:00,877: INFO/ForkPoolWorker-1] [3b9da594-c82c-4dd8-ac4c-3b0432278110] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:50:01.335719903Z [2024-04-03 01:50:01,331: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:50:01.415867137Z [2024-04-03 01:50:01,403: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:50:01.600537900Z [2024-04-03 01:50:01,590: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:50:01.681640238Z [2024-04-03 01:50:01,673: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:50:01.773452882Z [2024-04-03 01:50:01,773: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:50:02.396997612Z [2024-04-03 01:50:02,396: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8edcb558-e4f3-4ab8-aa47-96bef2d3f616] succeeded in 1.5837807120001344s: None 2024-04-03T01:50:02.866009347Z [2024-04-03 01:50:02,865: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:50:02.869492815Z [2024-04-03 01:50:02,869: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:50:02.904633474Z [2024-04-03 01:50:02,904: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:50:02.906376632Z [2024-04-03 01:50:02,906: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:50:02.906390786Z [2024-04-03 01:50:02,906: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:50:02.906510665Z [2024-04-03 01:50:02,906: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:50:02.906532548Z [2024-04-03 01:50:02,906: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:50:02.906814456Z [2024-04-03 01:50:02,906: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:50:02.906858690Z [2024-04-03 01:50:02,906: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:50:03.015626305Z [2024-04-03 01:50:03,012: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:50:03.258079178Z [2024-04-03 01:50:03,257: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T01:50:03.261621597Z [2024-04-03 01:50:03,261: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:50:03.313584773Z [2024-04-03 01:50:03,313: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T01:50:03.314799826Z [2024-04-03 01:50:03,314: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:50:03.314828899Z [2024-04-03 01:50:03,314: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:50:03.314971877Z [2024-04-03 01:50:03,314: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:50:03.315084150Z [2024-04-03 01:50:03,314: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T01:50:03.318666866Z [2024-04-03 01:50:03,318: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:50:03.318687640Z [2024-04-03 01:50:03,318: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:50:03.508636956Z [2024-04-03 01:50:03,508: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:50:03.510341686Z [2024-04-03 01:50:03,510: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:50:03.515012165Z [2024-04-03 01:50:03,514: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:50:03.584588613Z [2024-04-03 01:50:03,584: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:50:03.588939156Z [2024-04-03 01:50:03,588: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:50:03.588965742Z [2024-04-03 01:50:03,588: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:50:03.589089084Z [2024-04-03 01:50:03,588: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:50:03.589154082Z [2024-04-03 01:50:03,589: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:50:03.589544662Z [2024-04-03 01:50:03,589: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:50:03.589568483Z [2024-04-03 01:50:03,589: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:50:03.699932504Z [2024-04-03 01:50:03,699: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:50:04.439042388Z [2024-04-03 01:50:04,438: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61b37884-e947-4a8e-81ad-feb07a031672] succeeded in 3.6279682780000257s: None 2024-04-03T01:50:04.620996503Z [2024-04-03 01:50:04,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c037603-2e0f-41fe-bf89-531f197cf8ae] received 2024-04-03T01:50:04.627071999Z [2024-04-03 01:50:04,626: INFO/ForkPoolWorker-15] [5c037603-2e0f-41fe-bf89-531f197cf8ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:50:04.911074180Z [2024-04-03 01:50:04,910: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b9da594-c82c-4dd8-ac4c-3b0432278110] succeeded in 4.07490281399987s: None 2024-04-03T01:50:04.925155617Z [2024-04-03 01:50:04,922: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:50:05.181924328Z [2024-04-03 01:50:05,181: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c7dfa4d8-723b-4ea8-8b06-826872dc63c2] succeeded in 4.329980761000115s: None 2024-04-03T01:50:06.041677201Z [2024-04-03 01:50:06,041: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:50:06.045208175Z [2024-04-03 01:50:06,044: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:50:06.067341535Z [2024-04-03 01:50:06,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:50:06.068292618Z [2024-04-03 01:50:06,068: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:50:06.068336324Z [2024-04-03 01:50:06,068: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:50:06.068464202Z [2024-04-03 01:50:06,068: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:50:06.068538811Z [2024-04-03 01:50:06,068: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:50:06.068816266Z [2024-04-03 01:50:06,068: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:50:06.068825165Z [2024-04-03 01:50:06,068: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:50:06.158722652Z [2024-04-03 01:50:06,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:50:06.776772394Z [2024-04-03 01:50:06,776: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c037603-2e0f-41fe-bf89-531f197cf8ae] succeeded in 2.1537406189995636s: None 2024-04-03T01:50:06.881464493Z [2024-04-03 01:50:06,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab2f12dd-3f39-49c2-8eda-267293d7bbaf] received 2024-04-03T01:50:06.888741508Z [2024-04-03 01:50:06,888: INFO/ForkPoolWorker-15] [ab2f12dd-3f39-49c2-8eda-267293d7bbaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:50:07.151436481Z [2024-04-03 01:50:07,148: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:50:08.281754066Z [2024-04-03 01:50:08,281: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:50:08.285648785Z [2024-04-03 01:50:08,284: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:50:08.313224769Z [2024-04-03 01:50:08,313: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:50:08.314154588Z [2024-04-03 01:50:08,313: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:50:08.314308166Z [2024-04-03 01:50:08,314: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:50:08.314341947Z [2024-04-03 01:50:08,314: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:50:08.314378277Z [2024-04-03 01:50:08,314: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:50:08.314555505Z [2024-04-03 01:50:08,314: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:50:08.314586395Z [2024-04-03 01:50:08,314: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:50:08.408281232Z [2024-04-03 01:50:08,407: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:50:08.949680254Z [2024-04-03 01:50:08,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab2f12dd-3f39-49c2-8eda-267293d7bbaf] succeeded in 2.066147052999895s: None 2024-04-03T01:50:09.158885164Z [2024-04-03 01:50:09,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab600d0a-8e81-4f7b-87a9-28dcdaff65f2] received 2024-04-03T01:50:09.166698441Z [2024-04-03 01:50:09,166: INFO/ForkPoolWorker-15] [ab600d0a-8e81-4f7b-87a9-28dcdaff65f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:50:09.474509273Z [2024-04-03 01:50:09,471: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:50:10.698761588Z [2024-04-03 01:50:10,698: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:50:10.702220206Z [2024-04-03 01:50:10,701: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:50:10.723941272Z [2024-04-03 01:50:10,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:50:10.725071471Z [2024-04-03 01:50:10,724: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:50:10.725157963Z [2024-04-03 01:50:10,725: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:50:10.725276731Z [2024-04-03 01:50:10,725: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:50:10.725378106Z [2024-04-03 01:50:10,725: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:50:10.725790336Z [2024-04-03 01:50:10,725: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:50:10.725857903Z [2024-04-03 01:50:10,725: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:50:10.866140395Z [2024-04-03 01:50:10,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:50:11.471509055Z [2024-04-03 01:50:11,468: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab600d0a-8e81-4f7b-87a9-28dcdaff65f2] succeeded in 2.306564858999991s: None 2024-04-03T01:51:00.497399740Z [2024-04-03 01:51:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ab43cd1-e732-4a71-b6bd-1da90055240e] received 2024-04-03T01:51:00.499734470Z [2024-04-03 01:51:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be2f079b-e45c-4aae-aee9-e649f388e632] received 2024-04-03T01:51:00.516385500Z [2024-04-03 01:51:00,515: INFO/ForkPoolWorker-16] [be2f079b-e45c-4aae-aee9-e649f388e632] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:51:00.519821015Z [2024-04-03 01:51:00,519: INFO/ForkPoolWorker-15] [0ab43cd1-e732-4a71-b6bd-1da90055240e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:51:00.915767497Z [2024-04-03 01:51:00,911: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:51:00.949329601Z [2024-04-03 01:51:00,945: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:51:02.255956743Z [2024-04-03 01:51:02,255: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:51:02.259851266Z [2024-04-03 01:51:02,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:51:02.296585381Z [2024-04-03 01:51:02,296: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:51:02.297539302Z [2024-04-03 01:51:02,297: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:51:02.297562513Z [2024-04-03 01:51:02,297: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:51:02.297697986Z [2024-04-03 01:51:02,297: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:51:02.297742709Z [2024-04-03 01:51:02,297: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:51:02.298102911Z [2024-04-03 01:51:02,297: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:51:02.298138529Z [2024-04-03 01:51:02,298: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:51:02.301733736Z [2024-04-03 01:51:02,301: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:51:02.305329360Z [2024-04-03 01:51:02,304: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:51:02.351979858Z [2024-04-03 01:51:02,351: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:51:02.352990532Z [2024-04-03 01:51:02,352: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:51:02.353152326Z [2024-04-03 01:51:02,353: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:51:02.353286247Z [2024-04-03 01:51:02,353: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:51:02.353291209Z [2024-04-03 01:51:02,353: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:51:02.353624355Z [2024-04-03 01:51:02,353: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:51:02.353699470Z [2024-04-03 01:51:02,353: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:51:02.388656634Z [2024-04-03 01:51:02,388: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:51:02.424243464Z [2024-04-03 01:51:02,423: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:51:03.922112176Z [2024-04-03 01:51:03,921: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be2f079b-e45c-4aae-aee9-e649f388e632] succeeded in 3.419745482000053s: None 2024-04-03T01:51:04.289855188Z [2024-04-03 01:51:04,289: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ab43cd1-e732-4a71-b6bd-1da90055240e] succeeded in 3.78798450100021s: None 2024-04-03T01:52:01.008149506Z [2024-04-03 01:52:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eeb8a509-c79e-4260-ac4e-e8c2c344ab6a] received 2024-04-03T01:52:01.012304310Z [2024-04-03 01:52:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0e5ba07-626b-4ba2-affa-7d997e981c13] received 2024-04-03T01:52:01.033883320Z [2024-04-03 01:52:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ebacecc-8e9d-429e-8d6a-15c54b5b35c3] received 2024-04-03T01:52:01.037798477Z [2024-04-03 01:52:01,037: INFO/ForkPoolWorker-16] [f0e5ba07-626b-4ba2-affa-7d997e981c13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:52:01.040555071Z [2024-04-03 01:52:01,039: INFO/ForkPoolWorker-15] [eeb8a509-c79e-4260-ac4e-e8c2c344ab6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:52:01.100082216Z [2024-04-03 01:52:01,099: INFO/ForkPoolWorker-1] [9ebacecc-8e9d-429e-8d6a-15c54b5b35c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:52:01.449808001Z [2024-04-03 01:52:01,443: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:52:01.457689910Z [2024-04-03 01:52:01,451: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:52:01.655585487Z [2024-04-03 01:52:01,649: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:52:01.985161888Z [2024-04-03 01:52:01,984: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:52:02.707578302Z [2024-04-03 01:52:02,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9ebacecc-8e9d-429e-8d6a-15c54b5b35c3] succeeded in 1.6670865539999795s: None 2024-04-03T01:52:03.086428635Z [2024-04-03 01:52:03,085: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:52:03.090128758Z [2024-04-03 01:52:03,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:52:03.159823858Z [2024-04-03 01:52:03,159: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:52:03.161538766Z [2024-04-03 01:52:03,161: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:52:03.161597293Z [2024-04-03 01:52:03,161: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:52:03.161691167Z [2024-04-03 01:52:03,161: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:52:03.161724105Z [2024-04-03 01:52:03,161: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:52:03.161973991Z [2024-04-03 01:52:03,161: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:52:03.162095530Z [2024-04-03 01:52:03,162: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:52:03.194509306Z [2024-04-03 01:52:03,194: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:52:03.199352279Z [2024-04-03 01:52:03,198: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:52:03.248419505Z [2024-04-03 01:52:03,248: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:52:03.255156801Z [2024-04-03 01:52:03,254: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:52:03.255311551Z [2024-04-03 01:52:03,255: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:52:03.255323230Z [2024-04-03 01:52:03,255: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:52:03.255330071Z [2024-04-03 01:52:03,255: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:52:03.255551775Z [2024-04-03 01:52:03,255: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:52:03.255587554Z [2024-04-03 01:52:03,255: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:52:03.269483757Z [2024-04-03 01:52:03,269: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:52:03.361958479Z [2024-04-03 01:52:03,361: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:52:05.213071690Z [2024-04-03 01:52:05,212: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0e5ba07-626b-4ba2-affa-7d997e981c13] succeeded in 4.1968899729999976s: None 2024-04-03T01:52:05.498073492Z [2024-04-03 01:52:05,497: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eeb8a509-c79e-4260-ac4e-e8c2c344ab6a] succeeded in 4.484169505999944s: None 2024-04-03T01:53:00.819274273Z [2024-04-03 01:53:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb38f86a-479f-4386-97b0-576a65ad692f] received 2024-04-03T01:53:00.822176477Z [2024-04-03 01:53:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efcdb372-2106-4366-a863-aba96b368efe] received 2024-04-03T01:53:00.847573532Z [2024-04-03 01:53:00,847: INFO/ForkPoolWorker-16] [efcdb372-2106-4366-a863-aba96b368efe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:53:00.870770867Z [2024-04-03 01:53:00,869: INFO/ForkPoolWorker-15] [bb38f86a-479f-4386-97b0-576a65ad692f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:53:01.263839645Z [2024-04-03 01:53:01,259: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:53:01.269832478Z [2024-04-03 01:53:01,264: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:53:02.730425489Z [2024-04-03 01:53:02,730: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:53:02.734137461Z [2024-04-03 01:53:02,733: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:53:02.753756977Z [2024-04-03 01:53:02,753: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:53:02.757544325Z [2024-04-03 01:53:02,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:53:02.779636778Z [2024-04-03 01:53:02,777: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:53:02.782390560Z [2024-04-03 01:53:02,781: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:53:02.782405671Z [2024-04-03 01:53:02,782: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:53:02.782409612Z [2024-04-03 01:53:02,782: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:53:02.783326712Z [2024-04-03 01:53:02,782: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:53:02.783339926Z [2024-04-03 01:53:02,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:53:02.783343048Z [2024-04-03 01:53:02,782: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:53:02.833149944Z [2024-04-03 01:53:02,832: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:53:02.834188073Z [2024-04-03 01:53:02,833: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:53:02.834227607Z [2024-04-03 01:53:02,834: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:53:02.834342815Z [2024-04-03 01:53:02,834: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:53:02.834383109Z [2024-04-03 01:53:02,834: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:53:02.834673031Z [2024-04-03 01:53:02,834: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:53:02.834708834Z [2024-04-03 01:53:02,834: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:53:02.916336314Z [2024-04-03 01:53:02,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:53:02.951456676Z [2024-04-03 01:53:02,951: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:53:04.987737622Z [2024-04-03 01:53:04,987: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb38f86a-479f-4386-97b0-576a65ad692f] succeeded in 4.152867542999957s: None 2024-04-03T01:53:05.318928052Z [2024-04-03 01:53:05,318: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efcdb372-2106-4366-a863-aba96b368efe] succeeded in 4.483282283000335s: None 2024-04-03T01:54:00.714767354Z [2024-04-03 01:54:00,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fa841a9-bff8-4945-9918-42b5250e3ada] received 2024-04-03T01:54:00.734086015Z [2024-04-03 01:54:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bed6058a-7074-441f-bfbf-a9f3cb22a52f] received 2024-04-03T01:54:00.734460769Z [2024-04-03 01:54:00,731: INFO/ForkPoolWorker-15] [5fa841a9-bff8-4945-9918-42b5250e3ada] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:54:00.747462681Z [2024-04-03 01:54:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5cf17c4-1497-4ff2-aca1-0f695de45127] received 2024-04-03T01:54:00.772617007Z [2024-04-03 01:54:00,769: INFO/ForkPoolWorker-1] [f5cf17c4-1497-4ff2-aca1-0f695de45127] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:54:00.778715135Z [2024-04-03 01:54:00,775: INFO/ForkPoolWorker-16] [bed6058a-7074-441f-bfbf-a9f3cb22a52f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:54:01.119529314Z [2024-04-03 01:54:01,115: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:54:01.300446227Z [2024-04-03 01:54:01,291: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:54:01.499288998Z [2024-04-03 01:54:01,494: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:54:01.829166881Z [2024-04-03 01:54:01,828: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:54:02.778774333Z [2024-04-03 01:54:02,777: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fa841a9-bff8-4945-9918-42b5250e3ada] succeeded in 2.0596313989999544s: None 2024-04-03T01:54:02.914208298Z [2024-04-03 01:54:02,913: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:54:02.920765257Z [2024-04-03 01:54:02,919: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:54:03.014344432Z [2024-04-03 01:54:03,014: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:54:03.020744633Z [2024-04-03 01:54:03,020: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:54:03.020762715Z [2024-04-03 01:54:03,020: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:54:03.020879646Z [2024-04-03 01:54:03,020: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:54:03.020967006Z [2024-04-03 01:54:03,020: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:54:03.021238110Z [2024-04-03 01:54:03,021: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:54:03.021270387Z [2024-04-03 01:54:03,021: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:54:03.202151131Z [2024-04-03 01:54:03,201: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:54:04.210429223Z [2024-04-03 01:54:04,209: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:54:04.214162171Z [2024-04-03 01:54:04,213: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:54:04.295313169Z [2024-04-03 01:54:04,295: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:54:04.299262658Z [2024-04-03 01:54:04,298: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:54:04.299298092Z [2024-04-03 01:54:04,299: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:54:04.299400192Z [2024-04-03 01:54:04,299: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:54:04.299421131Z [2024-04-03 01:54:04,299: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:54:04.299710302Z [2024-04-03 01:54:04,299: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:54:04.299717267Z [2024-04-03 01:54:04,299: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:54:04.450830470Z [2024-04-03 01:54:04,450: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:54:05.512797789Z [2024-04-03 01:54:05,511: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bed6058a-7074-441f-bfbf-a9f3cb22a52f] succeeded in 4.771814752999944s: None 2024-04-03T01:54:06.911487311Z [2024-04-03 01:54:06,910: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5cf17c4-1497-4ff2-aca1-0f695de45127] succeeded in 6.1600291340000695s: None 2024-04-03T01:55:00.446850007Z [2024-04-03 01:55:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c7e8c97-9d81-4beb-8969-b548d244a9e7] received 2024-04-03T01:55:00.471497192Z [2024-04-03 01:55:00,470: INFO/ForkPoolWorker-15] [5c7e8c97-9d81-4beb-8969-b548d244a9e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:55:00.522450967Z [2024-04-03 01:55:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f9d26c9-8765-432f-8719-0a0cd806ad76] received 2024-04-03T01:55:00.568738458Z [2024-04-03 01:55:00,568: INFO/ForkPoolWorker-16] [0f9d26c9-8765-432f-8719-0a0cd806ad76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:55:01.045434257Z [2024-04-03 01:55:01,040: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:55:01.115603757Z [2024-04-03 01:55:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[434a99d2-a73e-409e-8bcd-d072000bb79b] received 2024-04-03T01:55:01.163678646Z [2024-04-03 01:55:01,163: INFO/ForkPoolWorker-1] [434a99d2-a73e-409e-8bcd-d072000bb79b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:55:01.299019209Z [2024-04-03 01:55:01,294: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:55:02.076257471Z [2024-04-03 01:55:02,053: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:55:03.190045830Z [2024-04-03 01:55:03,189: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:55:03.194280921Z [2024-04-03 01:55:03,193: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:55:03.243460380Z [2024-04-03 01:55:03,242: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:55:03.243817669Z [2024-04-03 01:55:03,243: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:55:03.243878894Z [2024-04-03 01:55:03,243: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:55:03.244036902Z [2024-04-03 01:55:03,243: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:55:03.244082417Z [2024-04-03 01:55:03,244: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:55:03.244354364Z [2024-04-03 01:55:03,244: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:55:03.244399532Z [2024-04-03 01:55:03,244: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:55:03.340997518Z [2024-04-03 01:55:03,340: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:55:03.366864873Z [2024-04-03 01:55:03,366: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:55:03.372436534Z [2024-04-03 01:55:03,370: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:55:03.459554584Z [2024-04-03 01:55:03,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:55:03.462509805Z [2024-04-03 01:55:03,461: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:55:03.462768917Z [2024-04-03 01:55:03,462: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:55:03.463389072Z [2024-04-03 01:55:03,463: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:55:03.466002989Z [2024-04-03 01:55:03,465: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:55:03.466361388Z [2024-04-03 01:55:03,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:55:03.466633232Z [2024-04-03 01:55:03,466: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:55:03.636797707Z [2024-04-03 01:55:03,636: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:55:04.230375048Z [2024-04-03 01:55:04,229: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:55:04.241696364Z [2024-04-03 01:55:04,241: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:55:04.340450505Z [2024-04-03 01:55:04,340: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:55:04.342403959Z [2024-04-03 01:55:04,342: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:55:04.343263093Z [2024-04-03 01:55:04,342: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:55:04.343499467Z [2024-04-03 01:55:04,343: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:55:04.343644588Z [2024-04-03 01:55:04,343: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:55:04.343989181Z [2024-04-03 01:55:04,343: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:55:04.344893491Z [2024-04-03 01:55:04,344: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:55:04.518387170Z [2024-04-03 01:55:04,518: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:55:04.548777164Z [2024-04-03 01:55:04,543: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c7e8c97-9d81-4beb-8969-b548d244a9e7] succeeded in 4.088300487000197s: None 2024-04-03T01:55:04.807436933Z [2024-04-03 01:55:04,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cc9ca0a-57f6-473e-94a3-499dafd347a6] received 2024-04-03T01:55:04.832040626Z [2024-04-03 01:55:04,831: INFO/ForkPoolWorker-15] [6cc9ca0a-57f6-473e-94a3-499dafd347a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:55:05.172432902Z [2024-04-03 01:55:05,169: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:55:05.582925265Z [2024-04-03 01:55:05,582: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f9d26c9-8765-432f-8719-0a0cd806ad76] succeeded in 5.054556391999995s: None 2024-04-03T01:55:06.382832193Z [2024-04-03 01:55:06,382: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:55:06.386430714Z [2024-04-03 01:55:06,385: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:55:06.416903892Z [2024-04-03 01:55:06,416: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:55:06.419478763Z [2024-04-03 01:55:06,419: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:55:06.419495367Z [2024-04-03 01:55:06,419: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:55:06.419767770Z [2024-04-03 01:55:06,419: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:55:06.419779224Z [2024-04-03 01:55:06,419: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:55:06.420102528Z [2024-04-03 01:55:06,419: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:55:06.420110505Z [2024-04-03 01:55:06,420: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:55:06.505194506Z [2024-04-03 01:55:06,504: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:55:06.839621817Z [2024-04-03 01:55:06,839: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[434a99d2-a73e-409e-8bcd-d072000bb79b] succeeded in 5.716676251000081s: None 2024-04-03T01:55:07.193626112Z [2024-04-03 01:55:07,193: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cc9ca0a-57f6-473e-94a3-499dafd347a6] succeeded in 2.3702110120002544s: None 2024-04-03T01:55:08.082268454Z [2024-04-03 01:55:08,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15616d9a-546e-4bb4-9b26-9cf678cd6f73] received 2024-04-03T01:55:08.097646507Z [2024-04-03 01:55:08,097: INFO/ForkPoolWorker-15] [15616d9a-546e-4bb4-9b26-9cf678cd6f73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T01:55:08.377279963Z [2024-04-03 01:55:08,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:55:09.696626782Z [2024-04-03 01:55:09,696: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:55:09.700270990Z [2024-04-03 01:55:09,699: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:55:09.732476970Z [2024-04-03 01:55:09,732: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:55:09.734801826Z [2024-04-03 01:55:09,734: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:55:09.734821026Z [2024-04-03 01:55:09,734: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:55:09.734976429Z [2024-04-03 01:55:09,734: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:55:09.734993353Z [2024-04-03 01:55:09,734: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:55:09.735277894Z [2024-04-03 01:55:09,735: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:55:09.735291224Z [2024-04-03 01:55:09,735: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:55:09.870620593Z [2024-04-03 01:55:09,870: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:55:10.547291787Z [2024-04-03 01:55:10,546: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15616d9a-546e-4bb4-9b26-9cf678cd6f73] succeeded in 2.460213556999861s: None 2024-04-03T01:55:10.910832898Z [2024-04-03 01:55:10,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7113ec49-91bd-414b-a7aa-0fff3b5a0b34] received 2024-04-03T01:55:10.928715124Z [2024-04-03 01:55:10,928: INFO/ForkPoolWorker-15] [7113ec49-91bd-414b-a7aa-0fff3b5a0b34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T01:55:11.301234882Z [2024-04-03 01:55:11,297: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T01:55:12.628068170Z [2024-04-03 01:55:12,627: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:55:12.631889188Z [2024-04-03 01:55:12,631: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:55:12.674640599Z [2024-04-03 01:55:12,674: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:55:12.675881821Z [2024-04-03 01:55:12,675: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:55:12.676011406Z [2024-04-03 01:55:12,675: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:55:12.676210056Z [2024-04-03 01:55:12,676: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:55:12.676433347Z [2024-04-03 01:55:12,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:55:12.676781606Z [2024-04-03 01:55:12,676: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T01:55:12.677024419Z [2024-04-03 01:55:12,676: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:55:12.760117472Z [2024-04-03 01:55:12,759: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:55:13.413869387Z [2024-04-03 01:55:13,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7113ec49-91bd-414b-a7aa-0fff3b5a0b34] succeeded in 2.5003527060002853s: None 2024-04-03T01:56:00.319380537Z [2024-04-03 01:56:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[189659b7-768d-4ba6-81e6-c7299548dff9] received 2024-04-03T01:56:00.337402699Z [2024-04-03 01:56:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b497823-7072-4c7f-aa21-219bdd5c86b7] received 2024-04-03T01:56:00.343878643Z [2024-04-03 01:56:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[290edbfa-5305-4d7b-b4c6-72bda85d49e7] received 2024-04-03T01:56:00.374654356Z [2024-04-03 01:56:00,374: INFO/ForkPoolWorker-16] [0b497823-7072-4c7f-aa21-219bdd5c86b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:56:00.376689685Z [2024-04-03 01:56:00,376: INFO/ForkPoolWorker-15] [189659b7-768d-4ba6-81e6-c7299548dff9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:56:00.392558815Z [2024-04-03 01:56:00,391: INFO/ForkPoolWorker-1] [290edbfa-5305-4d7b-b4c6-72bda85d49e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:56:00.840211240Z [2024-04-03 01:56:00,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:56:00.893390434Z [2024-04-03 01:56:00,888: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:56:01.040305513Z [2024-04-03 01:56:01,035: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:56:01.341683572Z [2024-04-03 01:56:01,341: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:56:02.422977289Z [2024-04-03 01:56:02,422: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b497823-7072-4c7f-aa21-219bdd5c86b7] succeeded in 2.081916500999796s: None 2024-04-03T01:56:02.818402427Z [2024-04-03 01:56:02,811: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:56:02.834900096Z [2024-04-03 01:56:02,820: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:56:02.948388335Z [2024-04-03 01:56:02,947: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:56:02.949227203Z [2024-04-03 01:56:02,948: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:56:02.959438972Z [2024-04-03 01:56:02,959: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:56:02.959995945Z [2024-04-03 01:56:02,959: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:56:02.960188835Z [2024-04-03 01:56:02,960: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:56:02.960254174Z [2024-04-03 01:56:02,960: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:56:02.960589020Z [2024-04-03 01:56:02,960: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:56:02.960689325Z [2024-04-03 01:56:02,960: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:56:02.963765280Z [2024-04-03 01:56:02,963: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:56:03.027766240Z [2024-04-03 01:56:03,027: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:56:03.032761412Z [2024-04-03 01:56:03,032: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:56:03.033286906Z [2024-04-03 01:56:03,032: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:56:03.033563682Z [2024-04-03 01:56:03,033: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:56:03.033695855Z [2024-04-03 01:56:03,033: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:56:03.034070271Z [2024-04-03 01:56:03,033: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:56:03.034252152Z [2024-04-03 01:56:03,034: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:56:03.166827368Z [2024-04-03 01:56:03,166: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:56:03.185962330Z [2024-04-03 01:56:03,185: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:56:06.520898202Z [2024-04-03 01:56:06,520: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[189659b7-768d-4ba6-81e6-c7299548dff9] succeeded in 6.179596278999725s: None 2024-04-03T01:56:07.083286589Z [2024-04-03 01:56:07,082: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[290edbfa-5305-4d7b-b4c6-72bda85d49e7] succeeded in 6.729902450999816s: None 2024-04-03T01:57:00.452374196Z [2024-04-03 01:57:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84a01fa1-7b00-489a-83a9-1974e05ed2a5] received 2024-04-03T01:57:00.469013248Z [2024-04-03 01:57:00,468: INFO/ForkPoolWorker-15] [84a01fa1-7b00-489a-83a9-1974e05ed2a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:57:00.479150447Z [2024-04-03 01:57:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[022a67d7-0f38-4b0b-942b-747e7ec091af] received 2024-04-03T01:57:00.513397514Z [2024-04-03 01:57:00,512: INFO/ForkPoolWorker-16] [022a67d7-0f38-4b0b-942b-747e7ec091af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:57:00.975630088Z [2024-04-03 01:57:00,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:57:01.013598556Z [2024-04-03 01:57:01,008: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:57:02.332168985Z [2024-04-03 01:57:02,331: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:57:02.333912629Z [2024-04-03 01:57:02,333: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:57:02.335728523Z [2024-04-03 01:57:02,335: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:57:02.337955404Z [2024-04-03 01:57:02,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:57:02.365174027Z [2024-04-03 01:57:02,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:57:02.369215291Z [2024-04-03 01:57:02,368: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:57:02.369730688Z [2024-04-03 01:57:02,369: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:57:02.369870272Z [2024-04-03 01:57:02,369: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:57:02.369930951Z [2024-04-03 01:57:02,369: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:57:02.370180228Z [2024-04-03 01:57:02,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:57:02.370367887Z [2024-04-03 01:57:02,370: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:57:02.372783950Z [2024-04-03 01:57:02,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:57:02.373789800Z [2024-04-03 01:57:02,373: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:57:02.373805208Z [2024-04-03 01:57:02,373: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:57:02.373938458Z [2024-04-03 01:57:02,373: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:57:02.373974601Z [2024-04-03 01:57:02,373: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:57:02.374206997Z [2024-04-03 01:57:02,374: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:57:02.374316336Z [2024-04-03 01:57:02,374: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:57:02.442073164Z [2024-04-03 01:57:02,441: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:57:02.450087151Z [2024-04-03 01:57:02,449: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:57:03.985906197Z [2024-04-03 01:57:03,984: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[022a67d7-0f38-4b0b-942b-747e7ec091af] succeeded in 3.4970262470001217s: None 2024-04-03T01:57:04.304972344Z [2024-04-03 01:57:04,304: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84a01fa1-7b00-489a-83a9-1974e05ed2a5] succeeded in 3.849022956999761s: None 2024-04-03T01:58:00.876682168Z [2024-04-03 01:58:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[287eff60-d049-43d1-8447-3f19817fe0fa] received 2024-04-03T01:58:00.881386021Z [2024-04-03 01:58:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7468b1b3-5073-4b26-afb4-8519c8e0e37e] received 2024-04-03T01:58:00.892487478Z [2024-04-03 01:58:00,892: INFO/ForkPoolWorker-15] [287eff60-d049-43d1-8447-3f19817fe0fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T01:58:00.892530405Z [2024-04-03 01:58:00,892: INFO/ForkPoolWorker-16] [7468b1b3-5073-4b26-afb4-8519c8e0e37e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:58:00.968646663Z [2024-04-03 01:58:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1803c97b-ecb4-4f59-a7be-e884653c72d6] received 2024-04-03T01:58:01.012657202Z [2024-04-03 01:58:01,012: INFO/ForkPoolWorker-1] [1803c97b-ecb4-4f59-a7be-e884653c72d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:58:01.235734462Z [2024-04-03 01:58:01,232: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T01:58:01.383431364Z [2024-04-03 01:58:01,379: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:58:01.531026015Z [2024-04-03 01:58:01,530: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:58:01.622963736Z [2024-04-03 01:58:01,616: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:58:02.173662902Z [2024-04-03 01:58:02,168: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[287eff60-d049-43d1-8447-3f19817fe0fa] succeeded in 1.2892723139998452s: None 2024-04-03T01:58:02.794362564Z [2024-04-03 01:58:02,793: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:58:02.798089202Z [2024-04-03 01:58:02,797: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:58:02.865340963Z [2024-04-03 01:58:02,865: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:58:02.871409055Z [2024-04-03 01:58:02,871: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:58:02.871629181Z [2024-04-03 01:58:02,871: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:58:02.871846791Z [2024-04-03 01:58:02,871: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:58:02.872014616Z [2024-04-03 01:58:02,871: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:58:02.872365750Z [2024-04-03 01:58:02,872: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:58:02.872668305Z [2024-04-03 01:58:02,872: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:58:02.975051351Z [2024-04-03 01:58:02,974: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:58:03.186179424Z [2024-04-03 01:58:03,185: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T01:58:03.199593768Z [2024-04-03 01:58:03,198: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:58:03.234653580Z [2024-04-03 01:58:03,234: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T01:58:03.236674983Z [2024-04-03 01:58:03,236: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:58:03.237462392Z [2024-04-03 01:58:03,237: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:58:03.237854826Z [2024-04-03 01:58:03,237: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:58:03.237962114Z [2024-04-03 01:58:03,237: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T01:58:03.238261370Z [2024-04-03 01:58:03,238: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:58:03.238414647Z [2024-04-03 01:58:03,238: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:58:03.368305804Z [2024-04-03 01:58:03,368: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:58:05.341041046Z [2024-04-03 01:58:05,340: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7468b1b3-5073-4b26-afb4-8519c8e0e37e] succeeded in 4.456921779999902s: None 2024-04-03T01:58:05.698087727Z [2024-04-03 01:58:05,697: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1803c97b-ecb4-4f59-a7be-e884653c72d6] succeeded in 4.726317555000151s: None 2024-04-03T01:59:01.211581373Z [2024-04-03 01:59:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79d08cbc-d0a1-4877-9c15-781cdbf868a2] received 2024-04-03T01:59:01.220523819Z [2024-04-03 01:59:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f7492c1-dcf4-4d25-9268-665d25eb3070] received 2024-04-03T01:59:01.233329078Z [2024-04-03 01:59:01,232: INFO/ForkPoolWorker-15] [79d08cbc-d0a1-4877-9c15-781cdbf868a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T01:59:01.240176339Z [2024-04-03 01:59:01,239: INFO/ForkPoolWorker-16] [2f7492c1-dcf4-4d25-9268-665d25eb3070] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T01:59:01.584061443Z [2024-04-03 01:59:01,579: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T01:59:01.597395676Z [2024-04-03 01:59:01,593: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T01:59:02.760863743Z [2024-04-03 01:59:02,760: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T01:59:02.766148422Z [2024-04-03 01:59:02,763: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:59:02.768328830Z [2024-04-03 01:59:02,767: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T01:59:02.772638724Z [2024-04-03 01:59:02,772: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T01:59:02.822372729Z [2024-04-03 01:59:02,821: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T01:59:02.831011221Z [2024-04-03 01:59:02,822: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:59:02.831033671Z [2024-04-03 01:59:02,822: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:59:02.831037732Z [2024-04-03 01:59:02,823: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:59:02.831041736Z [2024-04-03 01:59:02,823: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T01:59:02.831044890Z [2024-04-03 01:59:02,823: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T01:59:02.831048076Z [2024-04-03 01:59:02,823: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:59:02.854560342Z [2024-04-03 01:59:02,851: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T01:59:02.854652600Z [2024-04-03 01:59:02,852: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T01:59:02.854658380Z [2024-04-03 01:59:02,852: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T01:59:02.854662156Z [2024-04-03 01:59:02,852: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T01:59:02.854666225Z [2024-04-03 01:59:02,853: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T01:59:02.854669194Z [2024-04-03 01:59:02,853: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T01:59:02.854672187Z [2024-04-03 01:59:02,853: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T01:59:02.935945122Z [2024-04-03 01:59:02,935: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:59:02.936396524Z [2024-04-03 01:59:02,936: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T01:59:05.496164748Z [2024-04-03 01:59:05,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79d08cbc-d0a1-4877-9c15-781cdbf868a2] succeeded in 4.2803899380000985s: None 2024-04-03T01:59:05.694942422Z [2024-04-03 01:59:05,694: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f7492c1-dcf4-4d25-9268-665d25eb3070] succeeded in 4.471741692999785s: None 2024-04-03T02:00:00.406681885Z [2024-04-03 02:00:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1b0739b-1afd-4956-bc29-50cf6bdec866] received 2024-04-03T02:00:00.409054044Z [2024-04-03 02:00:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f5a2cc9-c7bc-460d-829a-a04adf6d736b] received 2024-04-03T02:00:00.412466089Z [2024-04-03 02:00:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bb9b008-e04f-4f7f-a890-0180e970f812] received 2024-04-03T02:00:00.424884466Z [2024-04-03 02:00:00,424: INFO/ForkPoolWorker-15] [c1b0739b-1afd-4956-bc29-50cf6bdec866] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:00:00.426794555Z [2024-04-03 02:00:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb056635-deeb-4d98-a8ce-294db2ef906c] received 2024-04-03T02:00:00.437753829Z [2024-04-03 02:00:00,437: INFO/ForkPoolWorker-1] [3bb9b008-e04f-4f7f-a890-0180e970f812] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:00:00.443426349Z [2024-04-03 02:00:00,442: INFO/ForkPoolWorker-16] [5f5a2cc9-c7bc-460d-829a-a04adf6d736b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:00:00.466434338Z [2024-04-03 02:00:00,465: INFO/ForkPoolWorker-2] [bb056635-deeb-4d98-a8ce-294db2ef906c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:00:01.026280440Z [2024-04-03 02:00:01,021: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:00:01.155370586Z [2024-04-03 02:00:01,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:00:01.374674799Z [2024-04-03 02:00:01,370: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:00:01.589488180Z [2024-04-03 02:00:01,568: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:00:02.189810779Z [2024-04-03 02:00:02,189: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:00:02.925633637Z [2024-04-03 02:00:02,924: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T02:00:02.929998678Z [2024-04-03 02:00:02,929: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:00:02.970857027Z [2024-04-03 02:00:02,970: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3bb9b008-e04f-4f7f-a890-0180e970f812] succeeded in 2.5549868660000357s: None 2024-04-03T02:00:02.974841074Z [2024-04-03 02:00:02,974: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T02:00:02.980129451Z [2024-04-03 02:00:02,979: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:00:02.980556861Z [2024-04-03 02:00:02,980: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:00:02.980764097Z [2024-04-03 02:00:02,980: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:00:02.980947191Z [2024-04-03 02:00:02,980: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T02:00:02.981380799Z [2024-04-03 02:00:02,981: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:00:02.981828777Z [2024-04-03 02:00:02,981: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:00:03.094182263Z [2024-04-03 02:00:03,093: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:00:03.299752694Z [2024-04-03 02:00:03,299: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:00:03.305641591Z [2024-04-03 02:00:03,305: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:00:03.371157014Z [2024-04-03 02:00:03,370: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:00:03.372576825Z [2024-04-03 02:00:03,372: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:00:03.372960114Z [2024-04-03 02:00:03,372: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:00:03.373343065Z [2024-04-03 02:00:03,373: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:00:03.373481939Z [2024-04-03 02:00:03,373: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:00:03.373743047Z [2024-04-03 02:00:03,373: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:00:03.374285347Z [2024-04-03 02:00:03,373: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:00:03.437815136Z [2024-04-03 02:00:03,437: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:00:03.441104336Z [2024-04-03 02:00:03,440: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:00:03.539273424Z [2024-04-03 02:00:03,539: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:00:03.546477652Z [2024-04-03 02:00:03,546: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:00:03.546610845Z [2024-04-03 02:00:03,546: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:00:03.546812776Z [2024-04-03 02:00:03,546: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:00:03.547015253Z [2024-04-03 02:00:03,546: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:00:03.547335541Z [2024-04-03 02:00:03,547: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:00:03.547457282Z [2024-04-03 02:00:03,547: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:00:03.553139971Z [2024-04-03 02:00:03,552: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:00:03.652426579Z [2024-04-03 02:00:03,652: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:00:04.368583725Z [2024-04-03 02:00:04,367: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1b0739b-1afd-4956-bc29-50cf6bdec866] succeeded in 3.9582246579998355s: None 2024-04-03T02:00:04.845273681Z [2024-04-03 02:00:04,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfe60145-6121-4c95-9aa0-788dddd8c1f0] received 2024-04-03T02:00:04.860976587Z [2024-04-03 02:00:04,860: INFO/ForkPoolWorker-15] [bfe60145-6121-4c95-9aa0-788dddd8c1f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:00:05.009463839Z [2024-04-03 02:00:05,008: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bb056635-deeb-4d98-a8ce-294db2ef906c] succeeded in 4.5597779539998555s: None 2024-04-03T02:00:05.241368626Z [2024-04-03 02:00:05,237: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:00:05.661647882Z [2024-04-03 02:00:05,661: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5f5a2cc9-c7bc-460d-829a-a04adf6d736b] succeeded in 5.248010964000059s: None 2024-04-03T02:00:06.465504174Z [2024-04-03 02:00:06,465: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:00:06.469117447Z [2024-04-03 02:00:06,468: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:00:06.521982674Z [2024-04-03 02:00:06,521: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:00:06.523741048Z [2024-04-03 02:00:06,523: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:00:06.523852253Z [2024-04-03 02:00:06,523: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:00:06.524063389Z [2024-04-03 02:00:06,523: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:00:06.524209940Z [2024-04-03 02:00:06,524: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:00:06.524523143Z [2024-04-03 02:00:06,524: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:00:06.525058087Z [2024-04-03 02:00:06,524: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:00:06.615399144Z [2024-04-03 02:00:06,614: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:00:07.262843436Z [2024-04-03 02:00:07,262: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfe60145-6121-4c95-9aa0-788dddd8c1f0] succeeded in 2.4112231709996195s: None 2024-04-03T02:00:08.316432774Z [2024-04-03 02:00:08,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8742bd43-0d43-4676-9ed6-3c839d5d6051] received 2024-04-03T02:00:08.330708271Z [2024-04-03 02:00:08,330: INFO/ForkPoolWorker-15] [8742bd43-0d43-4676-9ed6-3c839d5d6051] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:00:08.632397458Z [2024-04-03 02:00:08,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:00:10.259885027Z [2024-04-03 02:00:10,255: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:00:10.261374929Z [2024-04-03 02:00:10,260: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:00:10.347074434Z [2024-04-03 02:00:10,346: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:00:10.350447374Z [2024-04-03 02:00:10,349: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:00:10.350469200Z [2024-04-03 02:00:10,349: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:00:10.350473664Z [2024-04-03 02:00:10,350: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:00:10.350477925Z [2024-04-03 02:00:10,350: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:00:10.353888434Z [2024-04-03 02:00:10,350: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:00:10.353896743Z [2024-04-03 02:00:10,350: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:00:10.444535467Z [2024-04-03 02:00:10,444: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:00:11.140450495Z [2024-04-03 02:00:11,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27b7697e-5356-4414-a57b-b0271568f86e] received 2024-04-03T02:00:11.160971001Z [2024-04-03 02:00:11,160: INFO/ForkPoolWorker-16] [27b7697e-5356-4414-a57b-b0271568f86e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:00:11.216017377Z [2024-04-03 02:00:11,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8742bd43-0d43-4676-9ed6-3c839d5d6051] succeeded in 2.896182817999943s: None 2024-04-03T02:00:11.592525952Z [2024-04-03 02:00:11,589: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:00:13.289716392Z [2024-04-03 02:00:13,289: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:00:13.296110447Z [2024-04-03 02:00:13,295: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:00:13.370473186Z [2024-04-03 02:00:13,370: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:00:13.381548876Z [2024-04-03 02:00:13,381: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:00:13.381761068Z [2024-04-03 02:00:13,381: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:00:13.382091093Z [2024-04-03 02:00:13,381: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:00:13.382292378Z [2024-04-03 02:00:13,382: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:00:13.382936466Z [2024-04-03 02:00:13,382: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:00:13.383201504Z [2024-04-03 02:00:13,382: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:00:13.511171650Z [2024-04-03 02:00:13,510: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:00:14.133267354Z [2024-04-03 02:00:14,132: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27b7697e-5356-4414-a57b-b0271568f86e] succeeded in 2.990701758999876s: None 2024-04-03T02:01:00.711217703Z [2024-04-03 02:01:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33694f3f-5dc7-46d1-9d12-d5a6ed9e6b15] received 2024-04-03T02:01:00.734807705Z [2024-04-03 02:01:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2c5b02f-9b76-47a6-95b2-b1db159fe1ff] received 2024-04-03T02:01:00.737551634Z [2024-04-03 02:01:00,736: INFO/ForkPoolWorker-15] [33694f3f-5dc7-46d1-9d12-d5a6ed9e6b15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:01:00.782442118Z [2024-04-03 02:01:00,775: INFO/ForkPoolWorker-16] [f2c5b02f-9b76-47a6-95b2-b1db159fe1ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:01:01.210384696Z [2024-04-03 02:01:01,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:01:01.254091742Z [2024-04-03 02:01:01,250: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:01:02.471117877Z [2024-04-03 02:01:02,470: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:01:02.474671960Z [2024-04-03 02:01:02,474: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:01:02.478983258Z [2024-04-03 02:01:02,478: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:01:02.482638541Z [2024-04-03 02:01:02,482: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:01:02.500024049Z [2024-04-03 02:01:02,499: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:01:02.501546644Z [2024-04-03 02:01:02,501: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:01:02.501748793Z [2024-04-03 02:01:02,501: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:01:02.501950276Z [2024-04-03 02:01:02,501: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:01:02.502034361Z [2024-04-03 02:01:02,501: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:01:02.502767265Z [2024-04-03 02:01:02,502: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:01:02.502838178Z [2024-04-03 02:01:02,502: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:01:02.511745959Z [2024-04-03 02:01:02,511: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:01:02.513464444Z [2024-04-03 02:01:02,513: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:01:02.513558389Z [2024-04-03 02:01:02,513: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:01:02.513707048Z [2024-04-03 02:01:02,513: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:01:02.513786621Z [2024-04-03 02:01:02,513: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:01:02.514081856Z [2024-04-03 02:01:02,513: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:01:02.514110176Z [2024-04-03 02:01:02,514: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:01:02.576660858Z [2024-04-03 02:01:02,576: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:01:02.594443524Z [2024-04-03 02:01:02,594: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:01:04.094366417Z [2024-04-03 02:01:04,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2c5b02f-9b76-47a6-95b2-b1db159fe1ff] succeeded in 3.3547500820000096s: None 2024-04-03T02:01:04.493602560Z [2024-04-03 02:01:04,493: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33694f3f-5dc7-46d1-9d12-d5a6ed9e6b15] succeeded in 3.7756725450003614s: None 2024-04-03T02:02:00.974013614Z [2024-04-03 02:02:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ad7918e-6f89-45ed-9fc9-6f7378e5c265] received 2024-04-03T02:02:00.977795234Z [2024-04-03 02:02:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e2f69db-5f6c-4635-9077-6ebab6a26e74] received 2024-04-03T02:02:00.995719534Z [2024-04-03 02:02:00,995: INFO/ForkPoolWorker-16] [8e2f69db-5f6c-4635-9077-6ebab6a26e74] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:02:00.996877820Z [2024-04-03 02:02:00,996: INFO/ForkPoolWorker-15] [2ad7918e-6f89-45ed-9fc9-6f7378e5c265] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:02:01.017780787Z [2024-04-03 02:02:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c54fc3d-30df-416c-b6f4-48cc16543ac4] received 2024-04-03T02:02:01.033865747Z [2024-04-03 02:02:01,033: INFO/ForkPoolWorker-1] [1c54fc3d-30df-416c-b6f4-48cc16543ac4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:02:01.444980235Z [2024-04-03 02:02:01,440: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:02:01.598641680Z [2024-04-03 02:02:01,594: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:02:01.631569546Z [2024-04-03 02:02:01,626: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:02:01.919288934Z [2024-04-03 02:02:01,918: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:02:02.488369911Z [2024-04-03 02:02:02,487: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e2f69db-5f6c-4635-9077-6ebab6a26e74] succeeded in 1.507730459999948s: None 2024-04-03T02:02:03.033377077Z [2024-04-03 02:02:03,033: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:02:03.037076883Z [2024-04-03 02:02:03,036: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:02:03.111047951Z [2024-04-03 02:02:03,110: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:02:03.114995856Z [2024-04-03 02:02:03,114: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:02:03.130224070Z [2024-04-03 02:02:03,129: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:02:03.133781987Z [2024-04-03 02:02:03,133: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:02:03.133988221Z [2024-04-03 02:02:03,133: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:02:03.134181522Z [2024-04-03 02:02:03,133: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:02:03.134319992Z [2024-04-03 02:02:03,134: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:02:03.134746941Z [2024-04-03 02:02:03,134: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:02:03.134756922Z [2024-04-03 02:02:03,134: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:02:03.181731804Z [2024-04-03 02:02:03,181: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:02:03.193372055Z [2024-04-03 02:02:03,193: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:02:03.193453664Z [2024-04-03 02:02:03,193: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:02:03.193598736Z [2024-04-03 02:02:03,193: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:02:03.193684808Z [2024-04-03 02:02:03,193: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:02:03.193966572Z [2024-04-03 02:02:03,193: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:02:03.194137634Z [2024-04-03 02:02:03,194: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:02:03.222615689Z [2024-04-03 02:02:03,222: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:02:03.357895025Z [2024-04-03 02:02:03,357: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:02:04.831156110Z [2024-04-03 02:02:04,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ad7918e-6f89-45ed-9fc9-6f7378e5c265] succeeded in 3.853081100000054s: None 2024-04-03T02:02:05.180964529Z [2024-04-03 02:02:05,180: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c54fc3d-30df-416c-b6f4-48cc16543ac4] succeeded in 4.159813964000023s: None 2024-04-03T02:03:01.158068805Z [2024-04-03 02:03:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95751f65-40bc-436f-9e51-4f9603ab0721] received 2024-04-03T02:03:01.171318651Z [2024-04-03 02:03:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8be56e7-f797-410d-b8d0-964a30ae7bd4] received 2024-04-03T02:03:01.181182097Z [2024-04-03 02:03:01,180: INFO/ForkPoolWorker-15] [95751f65-40bc-436f-9e51-4f9603ab0721] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:03:01.194865617Z [2024-04-03 02:03:01,194: INFO/ForkPoolWorker-16] [b8be56e7-f797-410d-b8d0-964a30ae7bd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:03:01.568988896Z [2024-04-03 02:03:01,564: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:03:01.715447194Z [2024-04-03 02:03:01,710: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:03:02.749507171Z [2024-04-03 02:03:02,749: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:03:02.753000709Z [2024-04-03 02:03:02,752: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:03:02.852849467Z [2024-04-03 02:03:02,852: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:03:02.858523805Z [2024-04-03 02:03:02,858: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:03:02.858581955Z [2024-04-03 02:03:02,858: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:03:02.858661001Z [2024-04-03 02:03:02,858: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:03:02.858711408Z [2024-04-03 02:03:02,858: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:03:02.858941954Z [2024-04-03 02:03:02,858: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:03:02.858996921Z [2024-04-03 02:03:02,858: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:03:02.937387026Z [2024-04-03 02:03:02,937: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:03:03.066025660Z [2024-04-03 02:03:03,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:03:03.069924603Z [2024-04-03 02:03:03,069: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:03:03.129292085Z [2024-04-03 02:03:03,129: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:03:03.131496737Z [2024-04-03 02:03:03,130: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:03:03.131511785Z [2024-04-03 02:03:03,131: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:03:03.131516269Z [2024-04-03 02:03:03,131: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:03:03.131520755Z [2024-04-03 02:03:03,131: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:03:03.140524563Z [2024-04-03 02:03:03,131: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:03:03.142283932Z [2024-04-03 02:03:03,140: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:03:03.285280271Z [2024-04-03 02:03:03,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:03:04.899106436Z [2024-04-03 02:03:04,898: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b8be56e7-f797-410d-b8d0-964a30ae7bd4] succeeded in 3.7225878259996534s: None 2024-04-03T02:03:06.045105406Z [2024-04-03 02:03:06,044: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95751f65-40bc-436f-9e51-4f9603ab0721] succeeded in 4.8755022579998695s: None 2024-04-03T02:04:00.436978966Z [2024-04-03 02:04:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83141179-bd44-482b-b3c2-34f5ffdb0ecb] received 2024-04-03T02:04:00.456102889Z [2024-04-03 02:04:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f7dcb0b-2cef-482a-9a3e-78535efad7db] received 2024-04-03T02:04:00.470271193Z [2024-04-03 02:04:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aefe131a-a225-48a9-a2c4-ecea7dd1cfe0] received 2024-04-03T02:04:00.472830350Z [2024-04-03 02:04:00,472: INFO/ForkPoolWorker-16] [7f7dcb0b-2cef-482a-9a3e-78535efad7db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:04:00.473062984Z [2024-04-03 02:04:00,470: INFO/ForkPoolWorker-15] [83141179-bd44-482b-b3c2-34f5ffdb0ecb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:04:00.497983560Z [2024-04-03 02:04:00,497: INFO/ForkPoolWorker-1] [aefe131a-a225-48a9-a2c4-ecea7dd1cfe0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:04:01.197122506Z [2024-04-03 02:04:01,189: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:04:01.256120551Z [2024-04-03 02:04:01,245: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:04:01.447008367Z [2024-04-03 02:04:01,441: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:04:01.678745596Z [2024-04-03 02:04:01,678: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:04:02.683396015Z [2024-04-03 02:04:02,683: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f7dcb0b-2cef-482a-9a3e-78535efad7db] succeeded in 2.2235791739999513s: None 2024-04-03T02:04:03.231525041Z [2024-04-03 02:04:03,231: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:04:03.240343968Z [2024-04-03 02:04:03,239: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:04:03.394714011Z [2024-04-03 02:04:03,392: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:04:03.399849734Z [2024-04-03 02:04:03,399: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:04:03.399968327Z [2024-04-03 02:04:03,399: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:04:03.400169291Z [2024-04-03 02:04:03,399: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:04:03.400270642Z [2024-04-03 02:04:03,400: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:04:03.400699879Z [2024-04-03 02:04:03,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:04:03.400817376Z [2024-04-03 02:04:03,400: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:04:03.585423368Z [2024-04-03 02:04:03,585: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:04:04.120025874Z [2024-04-03 02:04:04,119: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:04:04.123612516Z [2024-04-03 02:04:04,123: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:04:04.187166450Z [2024-04-03 02:04:04,186: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:04:04.191093672Z [2024-04-03 02:04:04,190: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:04:04.191221768Z [2024-04-03 02:04:04,191: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:04:04.191409253Z [2024-04-03 02:04:04,191: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:04:04.191509564Z [2024-04-03 02:04:04,191: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:04:04.191840054Z [2024-04-03 02:04:04,191: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:04:04.191986295Z [2024-04-03 02:04:04,191: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:04:04.272818101Z [2024-04-03 02:04:04,272: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:04:06.708780950Z [2024-04-03 02:04:06,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83141179-bd44-482b-b3c2-34f5ffdb0ecb] succeeded in 6.266817548999825s: None 2024-04-03T02:04:07.060635328Z [2024-04-03 02:04:07,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aefe131a-a225-48a9-a2c4-ecea7dd1cfe0] succeeded in 6.586104523999893s: None 2024-04-03T02:05:00.629180428Z [2024-04-03 02:05:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe362b74-a74b-49f6-943a-91fafc3181dd] received 2024-04-03T02:05:00.631796209Z [2024-04-03 02:05:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0af80cf9-e23d-4170-aaf3-0a36100174ef] received 2024-04-03T02:05:00.639164626Z [2024-04-03 02:05:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0da6edf1-cc84-464b-abb4-f2370bd05623] received 2024-04-03T02:05:00.652131787Z [2024-04-03 02:05:00,651: INFO/ForkPoolWorker-15] [fe362b74-a74b-49f6-943a-91fafc3181dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:05:00.654037089Z [2024-04-03 02:05:00,653: INFO/ForkPoolWorker-16] [0af80cf9-e23d-4170-aaf3-0a36100174ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:05:00.661280802Z [2024-04-03 02:05:00,660: INFO/ForkPoolWorker-1] [0da6edf1-cc84-464b-abb4-f2370bd05623] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:05:01.090784059Z [2024-04-03 02:05:01,086: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:05:01.255439694Z [2024-04-03 02:05:01,230: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:05:01.310299837Z [2024-04-03 02:05:01,306: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:05:02.570206869Z [2024-04-03 02:05:02,569: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:05:02.573705101Z [2024-04-03 02:05:02,573: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:05:02.640842677Z [2024-04-03 02:05:02,640: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:05:02.642101252Z [2024-04-03 02:05:02,641: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:05:02.642112956Z [2024-04-03 02:05:02,642: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:05:02.642356055Z [2024-04-03 02:05:02,642: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:05:02.642471285Z [2024-04-03 02:05:02,642: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:05:02.642771432Z [2024-04-03 02:05:02,642: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:05:02.642891342Z [2024-04-03 02:05:02,642: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:05:02.721013909Z [2024-04-03 02:05:02,720: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:05:02.747853282Z [2024-04-03 02:05:02,747: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:05:02.752898927Z [2024-04-03 02:05:02,752: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:05:02.862750880Z [2024-04-03 02:05:02,862: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:05:02.870969412Z [2024-04-03 02:05:02,870: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:05:02.878174582Z [2024-04-03 02:05:02,875: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:05:02.878199247Z [2024-04-03 02:05:02,877: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:05:02.878203154Z [2024-04-03 02:05:02,877: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:05:02.878209808Z [2024-04-03 02:05:02,877: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:05:02.878225605Z [2024-04-03 02:05:02,877: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:05:02.878228797Z [2024-04-03 02:05:02,877: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:05:02.878231999Z [2024-04-03 02:05:02,877: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:05:02.947225879Z [2024-04-03 02:05:02,947: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:05:02.948850023Z [2024-04-03 02:05:02,948: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:05:02.948970356Z [2024-04-03 02:05:02,948: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:05:02.949202929Z [2024-04-03 02:05:02,948: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:05:02.949309506Z [2024-04-03 02:05:02,949: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:05:02.949931086Z [2024-04-03 02:05:02,949: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:05:02.950126809Z [2024-04-03 02:05:02,949: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:05:03.018789287Z [2024-04-03 02:05:03,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:05:03.126103925Z [2024-04-03 02:05:03,125: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:05:04.010924174Z [2024-04-03 02:05:04,010: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe362b74-a74b-49f6-943a-91fafc3181dd] succeeded in 3.3766698029999134s: None 2024-04-03T02:05:04.493984359Z [2024-04-03 02:05:04,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4854dc93-c538-4c06-8ce4-1c8c29ebc33d] received 2024-04-03T02:05:04.504009405Z [2024-04-03 02:05:04,503: INFO/ForkPoolWorker-15] [4854dc93-c538-4c06-8ce4-1c8c29ebc33d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:05:04.768983150Z [2024-04-03 02:05:04,765: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:05:04.962872941Z [2024-04-03 02:05:04,962: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0af80cf9-e23d-4170-aaf3-0a36100174ef] succeeded in 4.326054691999616s: None 2024-04-03T02:05:05.340112543Z [2024-04-03 02:05:05,339: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0da6edf1-cc84-464b-abb4-f2370bd05623] succeeded in 4.6948473399997965s: None 2024-04-03T02:05:05.909499777Z [2024-04-03 02:05:05,909: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:05:05.913930041Z [2024-04-03 02:05:05,913: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:05:05.943462095Z [2024-04-03 02:05:05,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:05:05.944531215Z [2024-04-03 02:05:05,944: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:05:05.944612711Z [2024-04-03 02:05:05,944: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:05:05.944770085Z [2024-04-03 02:05:05,944: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:05:05.944846519Z [2024-04-03 02:05:05,944: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:05:05.945116127Z [2024-04-03 02:05:05,944: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:05:05.945142474Z [2024-04-03 02:05:05,945: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:05:06.015593574Z [2024-04-03 02:05:06,015: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:05:06.628769516Z [2024-04-03 02:05:06,626: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4854dc93-c538-4c06-8ce4-1c8c29ebc33d] succeeded in 2.131204543000422s: None 2024-04-03T02:05:07.154881587Z [2024-04-03 02:05:07,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[608f7513-d6b1-4ae1-b7d7-f2f768bc52e7] received 2024-04-03T02:05:07.163394529Z [2024-04-03 02:05:07,163: INFO/ForkPoolWorker-15] [608f7513-d6b1-4ae1-b7d7-f2f768bc52e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:05:07.449822421Z [2024-04-03 02:05:07,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:05:08.596047826Z [2024-04-03 02:05:08,595: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:05:08.602656844Z [2024-04-03 02:05:08,599: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:05:08.657161432Z [2024-04-03 02:05:08,656: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:05:08.658254940Z [2024-04-03 02:05:08,658: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:05:08.658400117Z [2024-04-03 02:05:08,658: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:05:08.658586059Z [2024-04-03 02:05:08,658: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:05:08.658717557Z [2024-04-03 02:05:08,658: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:05:08.659183551Z [2024-04-03 02:05:08,658: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:05:08.659189749Z [2024-04-03 02:05:08,659: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:05:08.752038937Z [2024-04-03 02:05:08,751: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:05:09.315934907Z [2024-04-03 02:05:09,315: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[608f7513-d6b1-4ae1-b7d7-f2f768bc52e7] succeeded in 2.159335679000378s: None 2024-04-03T02:05:09.484726899Z [2024-04-03 02:05:09,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bfc16e7-0058-4102-87f3-221869b305b0] received 2024-04-03T02:05:09.497049451Z [2024-04-03 02:05:09,496: INFO/ForkPoolWorker-15] [5bfc16e7-0058-4102-87f3-221869b305b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:05:09.790419545Z [2024-04-03 02:05:09,786: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:05:11.230914592Z [2024-04-03 02:05:11,230: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:05:11.234831081Z [2024-04-03 02:05:11,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:05:11.297109468Z [2024-04-03 02:05:11,296: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:05:11.299020800Z [2024-04-03 02:05:11,298: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:05:11.299281789Z [2024-04-03 02:05:11,298: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:05:11.299714900Z [2024-04-03 02:05:11,299: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:05:11.300098011Z [2024-04-03 02:05:11,299: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:05:11.300850355Z [2024-04-03 02:05:11,300: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:05:11.301159370Z [2024-04-03 02:05:11,300: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:05:11.413979414Z [2024-04-03 02:05:11,413: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:05:12.060070301Z [2024-04-03 02:05:12,059: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bfc16e7-0058-4102-87f3-221869b305b0] succeeded in 2.573094340999887s: None 2024-04-03T02:06:01.209807904Z [2024-04-03 02:06:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50d2281f-71fc-4f95-9879-04c3d23ae024] received 2024-04-03T02:06:01.212115707Z [2024-04-03 02:06:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84215948-d708-49e0-9773-fc98657bbbc1] received 2024-04-03T02:06:01.213453211Z [2024-04-03 02:06:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e39434a-0d7d-451d-8fc8-69138f5d06e0] received 2024-04-03T02:06:01.232300765Z [2024-04-03 02:06:01,231: INFO/ForkPoolWorker-1] [6e39434a-0d7d-451d-8fc8-69138f5d06e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:06:01.232865338Z [2024-04-03 02:06:01,232: INFO/ForkPoolWorker-15] [50d2281f-71fc-4f95-9879-04c3d23ae024] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:06:01.239325952Z [2024-04-03 02:06:01,238: INFO/ForkPoolWorker-16] [84215948-d708-49e0-9773-fc98657bbbc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:06:01.564449109Z [2024-04-03 02:06:01,559: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:06:01.591948622Z [2024-04-03 02:06:01,588: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:06:01.606482194Z [2024-04-03 02:06:01,602: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:06:01.888122861Z [2024-04-03 02:06:01,887: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:06:02.421931620Z [2024-04-03 02:06:02,421: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[84215948-d708-49e0-9773-fc98657bbbc1] succeeded in 1.2068550539997887s: None 2024-04-03T02:06:02.862912025Z [2024-04-03 02:06:02,856: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:06:02.867930850Z [2024-04-03 02:06:02,867: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:06:02.895807894Z [2024-04-03 02:06:02,895: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:06:02.899103799Z [2024-04-03 02:06:02,898: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:06:02.899290452Z [2024-04-03 02:06:02,898: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:06:02.899691947Z [2024-04-03 02:06:02,899: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:06:02.899918299Z [2024-04-03 02:06:02,899: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:06:02.900009089Z [2024-04-03 02:06:02,899: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:06:02.900260056Z [2024-04-03 02:06:02,900: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:06:02.900307548Z [2024-04-03 02:06:02,900: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:06:02.903492639Z [2024-04-03 02:06:02,903: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:06:02.947678911Z [2024-04-03 02:06:02,947: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:06:02.949692561Z [2024-04-03 02:06:02,949: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:06:02.949729202Z [2024-04-03 02:06:02,949: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:06:02.949914794Z [2024-04-03 02:06:02,949: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:06:02.949985286Z [2024-04-03 02:06:02,949: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:06:02.951672243Z [2024-04-03 02:06:02,951: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:06:02.951804118Z [2024-04-03 02:06:02,951: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:06:02.999122890Z [2024-04-03 02:06:02,996: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:06:03.072478752Z [2024-04-03 02:06:03,072: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:06:05.151800680Z [2024-04-03 02:06:05,151: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6e39434a-0d7d-451d-8fc8-69138f5d06e0] succeeded in 3.9357961099999557s: None 2024-04-03T02:06:06.379884268Z [2024-04-03 02:06:06,379: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50d2281f-71fc-4f95-9879-04c3d23ae024] succeeded in 5.16458620100002s: None 2024-04-03T02:07:01.091537970Z [2024-04-03 02:07:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34afedde-f4f3-4aaa-96e5-acd5301555ba] received 2024-04-03T02:07:01.119430314Z [2024-04-03 02:07:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8efc838-6914-44cd-8cba-a36810c82348] received 2024-04-03T02:07:01.120366793Z [2024-04-03 02:07:01,120: INFO/ForkPoolWorker-15] [34afedde-f4f3-4aaa-96e5-acd5301555ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:07:01.180670416Z [2024-04-03 02:07:01,180: INFO/ForkPoolWorker-16] [c8efc838-6914-44cd-8cba-a36810c82348] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:07:01.541630526Z [2024-04-03 02:07:01,537: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:07:01.542517750Z [2024-04-03 02:07:01,538: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:07:02.683239028Z [2024-04-03 02:07:02,682: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:07:02.686512461Z [2024-04-03 02:07:02,686: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:07:02.717192963Z [2024-04-03 02:07:02,716: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:07:02.718682143Z [2024-04-03 02:07:02,718: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:07:02.719157408Z [2024-04-03 02:07:02,718: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:07:02.719250192Z [2024-04-03 02:07:02,719: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:07:02.719417027Z [2024-04-03 02:07:02,719: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:07:02.719483074Z [2024-04-03 02:07:02,719: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:07:02.719780073Z [2024-04-03 02:07:02,719: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:07:02.719847687Z [2024-04-03 02:07:02,719: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:07:02.723095566Z [2024-04-03 02:07:02,722: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:07:02.759194227Z [2024-04-03 02:07:02,758: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:07:02.761845711Z [2024-04-03 02:07:02,761: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:07:02.762165363Z [2024-04-03 02:07:02,761: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:07:02.762672793Z [2024-04-03 02:07:02,762: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:07:02.763018731Z [2024-04-03 02:07:02,762: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:07:02.763578038Z [2024-04-03 02:07:02,763: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:07:02.763890794Z [2024-04-03 02:07:02,763: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:07:02.872704818Z [2024-04-03 02:07:02,872: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:07:02.954641359Z [2024-04-03 02:07:02,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:07:05.426527052Z [2024-04-03 02:07:05,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34afedde-f4f3-4aaa-96e5-acd5301555ba] succeeded in 4.3294220450002285s: None 2024-04-03T02:07:05.427512227Z [2024-04-03 02:07:05,426: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8efc838-6914-44cd-8cba-a36810c82348] succeeded in 4.297097997000037s: None 2024-04-03T02:08:00.994092903Z [2024-04-03 02:08:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a060e112-0703-47d2-889f-b70aa35995de] received 2024-04-03T02:08:01.019404561Z [2024-04-03 02:08:01,018: INFO/ForkPoolWorker-15] [a060e112-0703-47d2-889f-b70aa35995de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:08:01.023372340Z [2024-04-03 02:08:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b53cd7b8-f9a9-4321-86ed-65122ef977ca] received 2024-04-03T02:08:01.051139005Z [2024-04-03 02:08:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f95083d0-4d56-4bdc-a987-f7ae7e356916] received 2024-04-03T02:08:01.080164266Z [2024-04-03 02:08:01,079: INFO/ForkPoolWorker-16] [b53cd7b8-f9a9-4321-86ed-65122ef977ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:08:01.083390055Z [2024-04-03 02:08:01,082: INFO/ForkPoolWorker-1] [f95083d0-4d56-4bdc-a987-f7ae7e356916] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:08:01.397025345Z [2024-04-03 02:08:01,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:08:01.411623591Z [2024-04-03 02:08:01,407: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:08:01.581350425Z [2024-04-03 02:08:01,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:08:01.938014837Z [2024-04-03 02:08:01,937: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:08:02.695345629Z [2024-04-03 02:08:02,694: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f95083d0-4d56-4bdc-a987-f7ae7e356916] succeeded in 1.6412185789999967s: None 2024-04-03T02:08:03.053468985Z [2024-04-03 02:08:03,053: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:08:03.057387173Z [2024-04-03 02:08:03,056: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:08:03.097293056Z [2024-04-03 02:08:03,096: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:08:03.102521920Z [2024-04-03 02:08:03,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:08:03.123376627Z [2024-04-03 02:08:03,123: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:08:03.126855366Z [2024-04-03 02:08:03,126: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:08:03.129167542Z [2024-04-03 02:08:03,128: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:08:03.129396823Z [2024-04-03 02:08:03,129: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:08:03.129516856Z [2024-04-03 02:08:03,129: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:08:03.129890884Z [2024-04-03 02:08:03,129: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:08:03.130064079Z [2024-04-03 02:08:03,129: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:08:03.163403381Z [2024-04-03 02:08:03,163: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:08:03.167081554Z [2024-04-03 02:08:03,166: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:08:03.167111490Z [2024-04-03 02:08:03,166: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:08:03.167192383Z [2024-04-03 02:08:03,167: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:08:03.167235663Z [2024-04-03 02:08:03,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:08:03.168226852Z [2024-04-03 02:08:03,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:08:03.168242601Z [2024-04-03 02:08:03,168: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:08:03.287715659Z [2024-04-03 02:08:03,287: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:08:03.327581474Z [2024-04-03 02:08:03,327: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:08:06.173571627Z [2024-04-03 02:08:06,173: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a060e112-0703-47d2-889f-b70aa35995de] succeeded in 5.172868380000182s: None 2024-04-03T02:08:06.479134472Z [2024-04-03 02:08:06,478: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b53cd7b8-f9a9-4321-86ed-65122ef977ca] succeeded in 5.448014777000026s: None 2024-04-03T02:09:00.887491245Z [2024-04-03 02:09:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40b4524c-0456-4c3e-a686-94d2e201ebd9] received 2024-04-03T02:09:00.890317675Z [2024-04-03 02:09:00,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43d571c6-ef45-4e4c-a707-b7f307406164] received 2024-04-03T02:09:00.914475155Z [2024-04-03 02:09:00,913: INFO/ForkPoolWorker-15] [40b4524c-0456-4c3e-a686-94d2e201ebd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:09:00.917039434Z [2024-04-03 02:09:00,916: INFO/ForkPoolWorker-16] [43d571c6-ef45-4e4c-a707-b7f307406164] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:09:01.290649516Z [2024-04-03 02:09:01,286: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:09:01.347782358Z [2024-04-03 02:09:01,343: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:09:02.628443539Z [2024-04-03 02:09:02,628: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:09:02.632121428Z [2024-04-03 02:09:02,631: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:09:02.647652128Z [2024-04-03 02:09:02,647: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:09:02.652194865Z [2024-04-03 02:09:02,651: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:09:02.655420447Z [2024-04-03 02:09:02,655: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:09:02.656495079Z [2024-04-03 02:09:02,656: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:09:02.656716447Z [2024-04-03 02:09:02,656: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:09:02.656896571Z [2024-04-03 02:09:02,656: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:09:02.657016430Z [2024-04-03 02:09:02,656: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:09:02.657287339Z [2024-04-03 02:09:02,657: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:09:02.657455986Z [2024-04-03 02:09:02,657: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:09:02.672912274Z [2024-04-03 02:09:02,672: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:09:02.674241288Z [2024-04-03 02:09:02,674: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:09:02.674664755Z [2024-04-03 02:09:02,674: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:09:02.674817047Z [2024-04-03 02:09:02,674: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:09:02.674880504Z [2024-04-03 02:09:02,674: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:09:02.675444781Z [2024-04-03 02:09:02,675: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:09:02.675630388Z [2024-04-03 02:09:02,675: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:09:02.735198145Z [2024-04-03 02:09:02,734: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:09:02.755061288Z [2024-04-03 02:09:02,754: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:09:04.913941162Z [2024-04-03 02:09:04,913: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43d571c6-ef45-4e4c-a707-b7f307406164] succeeded in 4.016619308999907s: None 2024-04-03T02:09:05.192833763Z [2024-04-03 02:09:05,192: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[40b4524c-0456-4c3e-a686-94d2e201ebd9] succeeded in 4.296750399999837s: None 2024-04-03T02:10:00.731335888Z [2024-04-03 02:10:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd17179d-66d9-4b29-a2fc-a5ebead159f7] received 2024-04-03T02:10:00.735989406Z [2024-04-03 02:10:00,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee78e934-4a97-4376-944b-c1f85001e32b] received 2024-04-03T02:10:00.763334820Z [2024-04-03 02:10:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[105acf28-2891-42f4-91a2-d13525a1ba65] received 2024-04-03T02:10:00.765156188Z [2024-04-03 02:10:00,764: INFO/ForkPoolWorker-15] [fd17179d-66d9-4b29-a2fc-a5ebead159f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:10:00.770514138Z [2024-04-03 02:10:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb55f38d-cce8-421b-8500-67d62420038c] received 2024-04-03T02:10:00.787594519Z [2024-04-03 02:10:00,784: INFO/ForkPoolWorker-16] [ee78e934-4a97-4376-944b-c1f85001e32b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:10:00.792224589Z [2024-04-03 02:10:00,790: INFO/ForkPoolWorker-1] [105acf28-2891-42f4-91a2-d13525a1ba65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:10:00.810025623Z [2024-04-03 02:10:00,805: INFO/ForkPoolWorker-2] [bb55f38d-cce8-421b-8500-67d62420038c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:10:01.207415857Z [2024-04-03 02:10:01,203: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:10:01.340160452Z [2024-04-03 02:10:01,335: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:10:01.746336172Z [2024-04-03 02:10:01,720: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:10:01.805511018Z [2024-04-03 02:10:01,805: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:10:01.832540111Z [2024-04-03 02:10:01,825: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:10:02.666433478Z [2024-04-03 02:10:02,666: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:10:02.670957355Z [2024-04-03 02:10:02,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:10:02.736509684Z [2024-04-03 02:10:02,736: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:10:02.738079220Z [2024-04-03 02:10:02,737: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:10:02.738786897Z [2024-04-03 02:10:02,738: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:10:02.738934105Z [2024-04-03 02:10:02,738: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:10:02.739495267Z [2024-04-03 02:10:02,739: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:10:02.747443279Z [2024-04-03 02:10:02,747: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:10:02.747469435Z [2024-04-03 02:10:02,747: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:10:02.853318833Z [2024-04-03 02:10:02,852: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:10:02.899457988Z [2024-04-03 02:10:02,899: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bb55f38d-cce8-421b-8500-67d62420038c] succeeded in 2.1287502370000766s: None 2024-04-03T02:10:03.806906474Z [2024-04-03 02:10:03,806: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:10:03.816199387Z [2024-04-03 02:10:03,815: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:10:03.855500257Z [2024-04-03 02:10:03,855: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:10:03.857012994Z [2024-04-03 02:10:03,856: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:10:03.857138675Z [2024-04-03 02:10:03,856: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:10:03.857300937Z [2024-04-03 02:10:03,857: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:10:03.857357335Z [2024-04-03 02:10:03,857: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:10:03.857629887Z [2024-04-03 02:10:03,857: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:10:03.857796351Z [2024-04-03 02:10:03,857: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:10:03.871241692Z [2024-04-03 02:10:03,870: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:10:03.876687892Z [2024-04-03 02:10:03,876: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:10:03.913952630Z [2024-04-03 02:10:03,913: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:10:03.915032637Z [2024-04-03 02:10:03,914: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:10:03.915111000Z [2024-04-03 02:10:03,915: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:10:03.915230033Z [2024-04-03 02:10:03,915: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:10:03.915278547Z [2024-04-03 02:10:03,915: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:10:03.915573282Z [2024-04-03 02:10:03,915: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:10:03.915646379Z [2024-04-03 02:10:03,915: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:10:03.970455694Z [2024-04-03 02:10:03,970: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:10:04.023043213Z [2024-04-03 02:10:04,022: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:10:04.473590033Z [2024-04-03 02:10:04,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd17179d-66d9-4b29-a2fc-a5ebead159f7] succeeded in 3.732571653999912s: None 2024-04-03T02:10:04.696901368Z [2024-04-03 02:10:04,696: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[105acf28-2891-42f4-91a2-d13525a1ba65] succeeded in 3.9279108569999153s: None 2024-04-03T02:10:04.907448121Z [2024-04-03 02:10:04,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cbe47bb-39d0-4453-a938-f59ce6079456] received 2024-04-03T02:10:04.917615534Z [2024-04-03 02:10:04,917: INFO/ForkPoolWorker-15] [2cbe47bb-39d0-4453-a938-f59ce6079456] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:10:05.261790879Z [2024-04-03 02:10:05,257: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:10:06.361178850Z [2024-04-03 02:10:06,360: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee78e934-4a97-4376-944b-c1f85001e32b] succeeded in 5.621622110000317s: None 2024-04-03T02:10:06.364088402Z [2024-04-03 02:10:06,363: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:10:06.367691722Z [2024-04-03 02:10:06,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:10:06.393042919Z [2024-04-03 02:10:06,392: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:10:06.394198461Z [2024-04-03 02:10:06,393: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:10:06.394370614Z [2024-04-03 02:10:06,394: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:10:06.394667167Z [2024-04-03 02:10:06,394: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:10:06.394837212Z [2024-04-03 02:10:06,394: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:10:06.395162352Z [2024-04-03 02:10:06,395: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:10:06.395395125Z [2024-04-03 02:10:06,395: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:10:06.473828249Z [2024-04-03 02:10:06,473: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:10:07.099682252Z [2024-04-03 02:10:07,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cbe47bb-39d0-4453-a938-f59ce6079456] succeeded in 2.1906871749997663s: None 2024-04-03T02:10:07.416069445Z [2024-04-03 02:10:07,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9f69aa3-6721-4731-9f3f-2869c0546f43] received 2024-04-03T02:10:07.424822475Z [2024-04-03 02:10:07,424: INFO/ForkPoolWorker-15] [d9f69aa3-6721-4731-9f3f-2869c0546f43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:10:07.769579775Z [2024-04-03 02:10:07,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:10:08.888982934Z [2024-04-03 02:10:08,888: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:10:08.892422656Z [2024-04-03 02:10:08,892: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:10:08.931496287Z [2024-04-03 02:10:08,931: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:10:08.933203182Z [2024-04-03 02:10:08,932: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:10:08.933232027Z [2024-04-03 02:10:08,933: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:10:08.933371106Z [2024-04-03 02:10:08,933: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:10:08.933459165Z [2024-04-03 02:10:08,933: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:10:08.934784944Z [2024-04-03 02:10:08,934: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:10:08.934890074Z [2024-04-03 02:10:08,934: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:10:09.042448188Z [2024-04-03 02:10:09,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:10:09.590822343Z [2024-04-03 02:10:09,590: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9f69aa3-6721-4731-9f3f-2869c0546f43] succeeded in 2.1714174129997446s: None 2024-04-03T02:10:09.730443510Z [2024-04-03 02:10:09,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fd9a9a7-ef5d-4e23-9bba-15bd0218cb04] received 2024-04-03T02:10:09.753105476Z [2024-04-03 02:10:09,752: INFO/ForkPoolWorker-15] [6fd9a9a7-ef5d-4e23-9bba-15bd0218cb04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:10:10.174773127Z [2024-04-03 02:10:10,170: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:10:11.443130786Z [2024-04-03 02:10:11,442: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:10:11.447787239Z [2024-04-03 02:10:11,447: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:10:11.497883894Z [2024-04-03 02:10:11,497: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:10:11.498768148Z [2024-04-03 02:10:11,498: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:10:11.498783704Z [2024-04-03 02:10:11,498: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:10:11.498787651Z [2024-04-03 02:10:11,498: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:10:11.498791563Z [2024-04-03 02:10:11,498: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:10:11.500387589Z [2024-04-03 02:10:11,498: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:10:11.500405587Z [2024-04-03 02:10:11,498: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:10:11.593424613Z [2024-04-03 02:10:11,593: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:10:12.162788417Z [2024-04-03 02:10:12,162: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6fd9a9a7-ef5d-4e23-9bba-15bd0218cb04] succeeded in 2.4295872800003053s: None 2024-04-03T02:11:00.400512455Z [2024-04-03 02:11:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4f4c2a6-dcc2-4ca4-b5b1-7577d000f9f4] received 2024-04-03T02:11:00.410839527Z [2024-04-03 02:11:00,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df71f3a1-44c5-405c-a240-392ee55cdbe7] received 2024-04-03T02:11:00.428370234Z [2024-04-03 02:11:00,427: INFO/ForkPoolWorker-15] [f4f4c2a6-dcc2-4ca4-b5b1-7577d000f9f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:11:00.428598209Z [2024-04-03 02:11:00,428: INFO/ForkPoolWorker-16] [df71f3a1-44c5-405c-a240-392ee55cdbe7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:11:00.758755000Z [2024-04-03 02:11:00,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:11:00.896696119Z [2024-04-03 02:11:00,891: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:11:02.217250992Z [2024-04-03 02:11:02,216: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:11:02.221199099Z [2024-04-03 02:11:02,220: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:11:02.251627216Z [2024-04-03 02:11:02,251: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:11:02.254361798Z [2024-04-03 02:11:02,254: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:11:02.254427779Z [2024-04-03 02:11:02,254: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:11:02.254679948Z [2024-04-03 02:11:02,254: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:11:02.254697727Z [2024-04-03 02:11:02,254: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:11:02.254965786Z [2024-04-03 02:11:02,254: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:11:02.255075312Z [2024-04-03 02:11:02,254: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:11:02.260257775Z [2024-04-03 02:11:02,259: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:11:02.264024138Z [2024-04-03 02:11:02,263: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:11:02.300374385Z [2024-04-03 02:11:02,300: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:11:02.301737502Z [2024-04-03 02:11:02,301: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:11:02.301879596Z [2024-04-03 02:11:02,301: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:11:02.302122319Z [2024-04-03 02:11:02,301: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:11:02.302303042Z [2024-04-03 02:11:02,302: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:11:02.302683937Z [2024-04-03 02:11:02,302: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:11:02.302892905Z [2024-04-03 02:11:02,302: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:11:02.352052452Z [2024-04-03 02:11:02,351: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:11:02.423341038Z [2024-04-03 02:11:02,422: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:11:04.523164349Z [2024-04-03 02:11:04,522: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df71f3a1-44c5-405c-a240-392ee55cdbe7] succeeded in 4.108887956999752s: None 2024-04-03T02:11:05.428952636Z [2024-04-03 02:11:05,428: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4f4c2a6-dcc2-4ca4-b5b1-7577d000f9f4] succeeded in 5.024740992999796s: None 2024-04-03T02:12:00.231678609Z [2024-04-03 02:12:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d935d7f-faa9-4a2b-b3d9-2e2da4ff58ce] received 2024-04-03T02:12:00.247070037Z [2024-04-03 02:12:00,246: INFO/ForkPoolWorker-15] [5d935d7f-faa9-4a2b-b3d9-2e2da4ff58ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:12:00.255498591Z [2024-04-03 02:12:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b75fe4b1-f6f4-4370-ab2d-e725c6b4bdff] received 2024-04-03T02:12:00.260767495Z [2024-04-03 02:12:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[390c1b93-f6cb-4186-9db3-d9e43c455f35] received 2024-04-03T02:12:00.271292184Z [2024-04-03 02:12:00,270: INFO/ForkPoolWorker-16] [b75fe4b1-f6f4-4370-ab2d-e725c6b4bdff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:12:00.309053496Z [2024-04-03 02:12:00,301: INFO/ForkPoolWorker-1] [390c1b93-f6cb-4186-9db3-d9e43c455f35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:12:00.725197932Z [2024-04-03 02:12:00,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:12:00.744559497Z [2024-04-03 02:12:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:12:00.857002193Z [2024-04-03 02:12:00,848: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:12:01.090246374Z [2024-04-03 02:12:01,090: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:12:01.859292464Z [2024-04-03 02:12:01,858: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d935d7f-faa9-4a2b-b3d9-2e2da4ff58ce] succeeded in 1.6229766299998118s: None 2024-04-03T02:12:02.722996683Z [2024-04-03 02:12:02,722: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:12:02.726526664Z [2024-04-03 02:12:02,726: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:12:02.752319603Z [2024-04-03 02:12:02,752: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:12:02.754524869Z [2024-04-03 02:12:02,754: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:12:02.754718145Z [2024-04-03 02:12:02,754: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:12:02.754963000Z [2024-04-03 02:12:02,754: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:12:02.755069762Z [2024-04-03 02:12:02,754: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:12:02.755949448Z [2024-04-03 02:12:02,755: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:12:02.756181119Z [2024-04-03 02:12:02,756: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:12:02.781646722Z [2024-04-03 02:12:02,780: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:12:02.792660892Z [2024-04-03 02:12:02,785: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:12:02.886850844Z [2024-04-03 02:12:02,886: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:12:02.888261869Z [2024-04-03 02:12:02,888: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:12:02.888545688Z [2024-04-03 02:12:02,888: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:12:02.888676973Z [2024-04-03 02:12:02,888: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:12:02.888930397Z [2024-04-03 02:12:02,888: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:12:02.889008198Z [2024-04-03 02:12:02,888: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:12:02.889260069Z [2024-04-03 02:12:02,889: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:12:02.889333170Z [2024-04-03 02:12:02,889: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:12:03.024567757Z [2024-04-03 02:12:03,024: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:12:05.276538285Z [2024-04-03 02:12:05,276: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[390c1b93-f6cb-4186-9db3-d9e43c455f35] succeeded in 5.012408608999976s: None 2024-04-03T02:12:05.746119319Z [2024-04-03 02:12:05,745: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b75fe4b1-f6f4-4370-ab2d-e725c6b4bdff] succeeded in 5.4877669460001925s: None 2024-04-03T02:13:01.088550276Z [2024-04-03 02:13:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86305345-dc9e-4ec2-bb0e-e1b270b9e153] received 2024-04-03T02:13:01.091307963Z [2024-04-03 02:13:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ab3a52f-ee15-4b01-a01a-c9b8ebd0115e] received 2024-04-03T02:13:01.110449554Z [2024-04-03 02:13:01,108: INFO/ForkPoolWorker-15] [86305345-dc9e-4ec2-bb0e-e1b270b9e153] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:13:01.112320642Z [2024-04-03 02:13:01,111: INFO/ForkPoolWorker-16] [9ab3a52f-ee15-4b01-a01a-c9b8ebd0115e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:13:01.638249376Z [2024-04-03 02:13:01,633: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:13:01.675632133Z [2024-04-03 02:13:01,665: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:13:02.971744308Z [2024-04-03 02:13:02,971: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:13:02.988381957Z [2024-04-03 02:13:02,987: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:13:03.037455429Z [2024-04-03 02:13:03,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:13:03.038819253Z [2024-04-03 02:13:03,038: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:13:03.038850806Z [2024-04-03 02:13:03,038: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:13:03.039076488Z [2024-04-03 02:13:03,038: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:13:03.039142512Z [2024-04-03 02:13:03,039: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:13:03.039399240Z [2024-04-03 02:13:03,039: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:13:03.039486462Z [2024-04-03 02:13:03,039: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:13:03.059906236Z [2024-04-03 02:13:03,059: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:13:03.063612216Z [2024-04-03 02:13:03,063: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:13:03.115393886Z [2024-04-03 02:13:03,115: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:13:03.118179333Z [2024-04-03 02:13:03,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:13:03.119319139Z [2024-04-03 02:13:03,119: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:13:03.119473354Z [2024-04-03 02:13:03,119: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:13:03.119675767Z [2024-04-03 02:13:03,119: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:13:03.119755933Z [2024-04-03 02:13:03,119: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:13:03.120045355Z [2024-04-03 02:13:03,119: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:13:03.120211086Z [2024-04-03 02:13:03,120: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:13:03.217181103Z [2024-04-03 02:13:03,216: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:13:05.192361270Z [2024-04-03 02:13:05,191: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86305345-dc9e-4ec2-bb0e-e1b270b9e153] succeeded in 4.099587734000124s: None 2024-04-03T02:13:05.678114112Z [2024-04-03 02:13:05,677: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ab3a52f-ee15-4b01-a01a-c9b8ebd0115e] succeeded in 4.582610209999984s: None 2024-04-03T02:14:00.845327539Z [2024-04-03 02:14:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[211335bb-0ea8-41c1-9ffe-af9fa865db35] received 2024-04-03T02:14:00.849485203Z [2024-04-03 02:14:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4f6be94-1d1c-4ad7-af97-dce369dd10ba] received 2024-04-03T02:14:00.871081487Z [2024-04-03 02:14:00,870: INFO/ForkPoolWorker-15] [211335bb-0ea8-41c1-9ffe-af9fa865db35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:14:00.874975099Z [2024-04-03 02:14:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7323767b-0a02-4e3a-953d-4499d522bfd9] received 2024-04-03T02:14:00.881866178Z [2024-04-03 02:14:00,881: INFO/ForkPoolWorker-16] [f4f6be94-1d1c-4ad7-af97-dce369dd10ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:14:00.896836847Z [2024-04-03 02:14:00,896: INFO/ForkPoolWorker-1] [7323767b-0a02-4e3a-953d-4499d522bfd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:14:01.300897997Z [2024-04-03 02:14:01,297: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:14:01.313102921Z [2024-04-03 02:14:01,309: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:14:01.497355133Z [2024-04-03 02:14:01,483: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:14:01.931472735Z [2024-04-03 02:14:01,931: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:14:02.634752954Z [2024-04-03 02:14:02,634: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7323767b-0a02-4e3a-953d-4499d522bfd9] succeeded in 1.7568497270003718s: None 2024-04-03T02:14:02.991594502Z [2024-04-03 02:14:02,991: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:14:02.996483524Z [2024-04-03 02:14:02,995: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:14:03.046728269Z [2024-04-03 02:14:03,046: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:14:03.051126397Z [2024-04-03 02:14:03,050: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:14:03.051261476Z [2024-04-03 02:14:03,051: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:14:03.051429116Z [2024-04-03 02:14:03,051: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:14:03.051495705Z [2024-04-03 02:14:03,051: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:14:03.051793829Z [2024-04-03 02:14:03,051: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:14:03.051873968Z [2024-04-03 02:14:03,051: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:14:03.136412269Z [2024-04-03 02:14:03,136: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:14:03.139855474Z [2024-04-03 02:14:03,139: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:14:03.177166935Z [2024-04-03 02:14:03,176: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:14:03.215196153Z [2024-04-03 02:14:03,214: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:14:03.216365294Z [2024-04-03 02:14:03,216: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:14:03.216429725Z [2024-04-03 02:14:03,216: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:14:03.216592692Z [2024-04-03 02:14:03,216: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:14:03.216715084Z [2024-04-03 02:14:03,216: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:14:03.216963031Z [2024-04-03 02:14:03,216: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:14:03.217060008Z [2024-04-03 02:14:03,216: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:14:03.351577211Z [2024-04-03 02:14:03,351: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:14:06.833241230Z [2024-04-03 02:14:06,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[211335bb-0ea8-41c1-9ffe-af9fa865db35] succeeded in 5.97322113700011s: None 2024-04-03T02:14:06.946990723Z [2024-04-03 02:14:06,946: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4f6be94-1d1c-4ad7-af97-dce369dd10ba] succeeded in 6.09044684599985s: None 2024-04-03T02:15:00.541340008Z [2024-04-03 02:15:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46a03e81-4e48-48e6-ae87-fe57223745e3] received 2024-04-03T02:15:00.551100748Z [2024-04-03 02:15:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9e78a4d-8a01-43f9-a056-8dea77ae45ee] received 2024-04-03T02:15:00.569911618Z [2024-04-03 02:15:00,569: INFO/ForkPoolWorker-15] [46a03e81-4e48-48e6-ae87-fe57223745e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:15:00.581450801Z [2024-04-03 02:15:00,580: INFO/ForkPoolWorker-16] [e9e78a4d-8a01-43f9-a056-8dea77ae45ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:15:00.591833102Z [2024-04-03 02:15:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ef60bc9-4356-4a5e-9fef-435fe97ce57e] received 2024-04-03T02:15:00.635330823Z [2024-04-03 02:15:00,634: INFO/ForkPoolWorker-1] [0ef60bc9-4356-4a5e-9fef-435fe97ce57e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:15:01.042193610Z [2024-04-03 02:15:01,029: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:15:01.330495273Z [2024-04-03 02:15:01,326: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:15:01.439316555Z [2024-04-03 02:15:01,417: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:15:02.704113428Z [2024-04-03 02:15:02,703: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:15:02.707559028Z [2024-04-03 02:15:02,707: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:15:02.735462625Z [2024-04-03 02:15:02,735: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:15:02.736522133Z [2024-04-03 02:15:02,736: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:15:02.736548216Z [2024-04-03 02:15:02,736: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:15:02.736658816Z [2024-04-03 02:15:02,736: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:15:02.736692449Z [2024-04-03 02:15:02,736: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:15:02.736888395Z [2024-04-03 02:15:02,736: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:15:02.736916864Z [2024-04-03 02:15:02,736: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:15:02.770725653Z [2024-04-03 02:15:02,770: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:15:02.774978866Z [2024-04-03 02:15:02,774: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:15:02.869541105Z [2024-04-03 02:15:02,869: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:15:02.874255291Z [2024-04-03 02:15:02,874: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:15:02.883731647Z [2024-04-03 02:15:02,883: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:15:02.883890702Z [2024-04-03 02:15:02,883: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:15:02.884117718Z [2024-04-03 02:15:02,883: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:15:02.884418086Z [2024-04-03 02:15:02,884: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:15:02.885711053Z [2024-04-03 02:15:02,885: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:15:02.886022981Z [2024-04-03 02:15:02,885: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:15:03.039564178Z [2024-04-03 02:15:03,039: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:15:03.272373126Z [2024-04-03 02:15:03,272: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:15:03.282180867Z [2024-04-03 02:15:03,281: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:15:03.415570470Z [2024-04-03 02:15:03,415: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:15:03.422281650Z [2024-04-03 02:15:03,422: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:15:03.426453879Z [2024-04-03 02:15:03,426: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:15:03.426747689Z [2024-04-03 02:15:03,426: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:15:03.427104439Z [2024-04-03 02:15:03,426: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:15:03.428216869Z [2024-04-03 02:15:03,428: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:15:03.428393387Z [2024-04-03 02:15:03,428: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:15:03.632923676Z [2024-04-03 02:15:03,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:15:04.392253418Z [2024-04-03 02:15:04,391: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46a03e81-4e48-48e6-ae87-fe57223745e3] succeeded in 3.8376034520001667s: None 2024-04-03T02:15:04.602741355Z [2024-04-03 02:15:04,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9e78a4d-8a01-43f9-a056-8dea77ae45ee] succeeded in 4.04777504499998s: None 2024-04-03T02:15:04.989947788Z [2024-04-03 02:15:04,989: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0ef60bc9-4356-4a5e-9fef-435fe97ce57e] succeeded in 4.392444919000354s: None 2024-04-03T02:15:05.394629471Z [2024-04-03 02:15:05,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3d4f230-bb91-4fc2-8f6f-85e684f9ac3d] received 2024-04-03T02:15:05.405713139Z [2024-04-03 02:15:05,405: INFO/ForkPoolWorker-15] [e3d4f230-bb91-4fc2-8f6f-85e684f9ac3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:15:05.680128782Z [2024-04-03 02:15:05,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:15:06.798254924Z [2024-04-03 02:15:06,797: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:15:06.801722281Z [2024-04-03 02:15:06,801: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:15:06.826324431Z [2024-04-03 02:15:06,826: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:15:06.829226060Z [2024-04-03 02:15:06,828: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:15:06.829296816Z [2024-04-03 02:15:06,829: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:15:06.829619518Z [2024-04-03 02:15:06,829: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:15:06.830110361Z [2024-04-03 02:15:06,829: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:15:06.830455042Z [2024-04-03 02:15:06,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:15:06.830539162Z [2024-04-03 02:15:06,830: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:15:06.920715541Z [2024-04-03 02:15:06,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:15:07.452363492Z [2024-04-03 02:15:07,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3d4f230-bb91-4fc2-8f6f-85e684f9ac3d] succeeded in 2.055645518000347s: None 2024-04-03T02:15:08.362756336Z [2024-04-03 02:15:08,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64901928-4b24-4b3a-b715-59f2717105d8] received 2024-04-03T02:15:08.368677003Z [2024-04-03 02:15:08,368: INFO/ForkPoolWorker-15] [64901928-4b24-4b3a-b715-59f2717105d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:15:08.690126289Z [2024-04-03 02:15:08,686: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:15:09.874647771Z [2024-04-03 02:15:09,874: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:15:09.878239738Z [2024-04-03 02:15:09,877: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:15:09.903170462Z [2024-04-03 02:15:09,902: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:15:09.904362739Z [2024-04-03 02:15:09,904: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:15:09.904387486Z [2024-04-03 02:15:09,904: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:15:09.904514598Z [2024-04-03 02:15:09,904: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:15:09.904529379Z [2024-04-03 02:15:09,904: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:15:09.904794325Z [2024-04-03 02:15:09,904: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:15:09.904808543Z [2024-04-03 02:15:09,904: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:15:09.980194525Z [2024-04-03 02:15:09,979: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:15:10.614882422Z [2024-04-03 02:15:10,614: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64901928-4b24-4b3a-b715-59f2717105d8] succeeded in 2.2505517590002455s: None 2024-04-03T02:15:10.645770441Z [2024-04-03 02:15:10,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[708f0874-6a98-4ef0-b571-03c625c957f3] received 2024-04-03T02:15:10.663822247Z [2024-04-03 02:15:10,663: INFO/ForkPoolWorker-15] [708f0874-6a98-4ef0-b571-03c625c957f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:15:11.023033145Z [2024-04-03 02:15:11,019: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:15:12.150137068Z [2024-04-03 02:15:12,149: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:15:12.154018088Z [2024-04-03 02:15:12,153: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:15:12.203361618Z [2024-04-03 02:15:12,203: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:15:12.205678616Z [2024-04-03 02:15:12,205: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:15:12.205885020Z [2024-04-03 02:15:12,205: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:15:12.206148118Z [2024-04-03 02:15:12,205: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:15:12.206380621Z [2024-04-03 02:15:12,206: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:15:12.206889332Z [2024-04-03 02:15:12,206: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:15:12.207446023Z [2024-04-03 02:15:12,207: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:15:12.311736351Z [2024-04-03 02:15:12,311: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:15:12.933584301Z [2024-04-03 02:15:12,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[708f0874-6a98-4ef0-b571-03c625c957f3] succeeded in 2.2822876559998804s: None 2024-04-03T02:16:00.895865800Z [2024-04-03 02:16:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eadd0f2-a21a-45a3-86c5-690c18302cd1] received 2024-04-03T02:16:00.912911637Z [2024-04-03 02:16:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6ff8b15-ceaa-4d1f-ba62-dff81781c504] received 2024-04-03T02:16:00.914143244Z [2024-04-03 02:16:00,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e51f5be-ca0a-49f1-ace3-42417eb1409e] received 2024-04-03T02:16:00.930233496Z [2024-04-03 02:16:00,929: INFO/ForkPoolWorker-15] [8eadd0f2-a21a-45a3-86c5-690c18302cd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:16:00.932377080Z [2024-04-03 02:16:00,931: INFO/ForkPoolWorker-1] [7e51f5be-ca0a-49f1-ace3-42417eb1409e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:16:00.933039170Z [2024-04-03 02:16:00,932: INFO/ForkPoolWorker-16] [f6ff8b15-ceaa-4d1f-ba62-dff81781c504] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:16:01.344284028Z [2024-04-03 02:16:01,339: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:16:01.460141559Z [2024-04-03 02:16:01,444: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:16:01.647503852Z [2024-04-03 02:16:01,642: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:16:01.796079788Z [2024-04-03 02:16:01,795: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:16:02.433914372Z [2024-04-03 02:16:02,433: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8eadd0f2-a21a-45a3-86c5-690c18302cd1] succeeded in 1.5321730420000677s: None 2024-04-03T02:16:03.111759399Z [2024-04-03 02:16:03,110: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:16:03.113979567Z [2024-04-03 02:16:03,113: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:16:03.165672204Z [2024-04-03 02:16:03,165: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:16:03.176916453Z [2024-04-03 02:16:03,176: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:16:03.177172805Z [2024-04-03 02:16:03,176: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:16:03.177481421Z [2024-04-03 02:16:03,177: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:16:03.177620004Z [2024-04-03 02:16:03,177: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:16:03.177937682Z [2024-04-03 02:16:03,177: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:16:03.178158100Z [2024-04-03 02:16:03,178: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:16:03.260949229Z [2024-04-03 02:16:03,260: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:16:03.264814632Z [2024-04-03 02:16:03,264: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:16:03.294076944Z [2024-04-03 02:16:03,293: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:16:03.325770711Z [2024-04-03 02:16:03,325: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:16:03.329430872Z [2024-04-03 02:16:03,329: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:16:03.329634717Z [2024-04-03 02:16:03,329: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:16:03.329878088Z [2024-04-03 02:16:03,329: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:16:03.330049566Z [2024-04-03 02:16:03,329: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:16:03.330530629Z [2024-04-03 02:16:03,330: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:16:03.330811277Z [2024-04-03 02:16:03,330: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:16:03.419705691Z [2024-04-03 02:16:03,419: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:16:05.483380343Z [2024-04-03 02:16:05,482: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6ff8b15-ceaa-4d1f-ba62-dff81781c504] succeeded in 4.56460323500005s: None 2024-04-03T02:16:05.518575538Z [2024-04-03 02:16:05,517: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e51f5be-ca0a-49f1-ace3-42417eb1409e] succeeded in 4.600751983999999s: None 2024-04-03T02:17:00.192213187Z [2024-04-03 02:17:00,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfdd2187-bb30-4996-b962-7d53a3c903cd] received 2024-04-03T02:17:00.217693924Z [2024-04-03 02:17:00,214: INFO/ForkPoolWorker-15] [bfdd2187-bb30-4996-b962-7d53a3c903cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:17:00.221591604Z [2024-04-03 02:17:00,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2984d7fa-de63-4698-855c-18973dd397c1] received 2024-04-03T02:17:00.240653639Z [2024-04-03 02:17:00,240: INFO/ForkPoolWorker-16] [2984d7fa-de63-4698-855c-18973dd397c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:17:00.591496695Z [2024-04-03 02:17:00,587: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:17:00.675101637Z [2024-04-03 02:17:00,671: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:17:02.157214284Z [2024-04-03 02:17:02,156: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:17:02.161411791Z [2024-04-03 02:17:02,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:17:02.199726905Z [2024-04-03 02:17:02,199: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:17:02.201075284Z [2024-04-03 02:17:02,200: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:17:02.201200748Z [2024-04-03 02:17:02,201: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:17:02.201417549Z [2024-04-03 02:17:02,201: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:17:02.201512477Z [2024-04-03 02:17:02,201: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:17:02.201802458Z [2024-04-03 02:17:02,201: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:17:02.202012077Z [2024-04-03 02:17:02,201: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:17:02.239953063Z [2024-04-03 02:17:02,239: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:17:02.243970415Z [2024-04-03 02:17:02,243: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:17:02.285893201Z [2024-04-03 02:17:02,285: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:17:02.287504556Z [2024-04-03 02:17:02,287: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:17:02.287666292Z [2024-04-03 02:17:02,287: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:17:02.287994538Z [2024-04-03 02:17:02,287: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:17:02.288117862Z [2024-04-03 02:17:02,287: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:17:02.288703309Z [2024-04-03 02:17:02,288: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:17:02.288907159Z [2024-04-03 02:17:02,288: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:17:02.312289222Z [2024-04-03 02:17:02,311: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:17:02.409755752Z [2024-04-03 02:17:02,409: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:17:04.130389109Z [2024-04-03 02:17:04,129: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2984d7fa-de63-4698-855c-18973dd397c1] succeeded in 3.9059292739998455s: None 2024-04-03T02:17:04.271058805Z [2024-04-03 02:17:04,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfdd2187-bb30-4996-b962-7d53a3c903cd] succeeded in 4.073935108000114s: None 2024-04-03T02:18:00.577780239Z [2024-04-03 02:18:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d076b17-b505-4f2e-aa9c-4642993c4ecc] received 2024-04-03T02:18:00.584900356Z [2024-04-03 02:18:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a77716b-23e1-4fbe-a35e-689a12b1d0e9] received 2024-04-03T02:18:00.589478991Z [2024-04-03 02:18:00,589: INFO/ForkPoolWorker-15] [5d076b17-b505-4f2e-aa9c-4642993c4ecc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:18:00.590515381Z [2024-04-03 02:18:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10243e28-db9f-45f7-ad74-0a964599dc97] received 2024-04-03T02:18:00.623160144Z [2024-04-03 02:18:00,620: INFO/ForkPoolWorker-16] [2a77716b-23e1-4fbe-a35e-689a12b1d0e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:18:00.627178634Z [2024-04-03 02:18:00,626: INFO/ForkPoolWorker-1] [10243e28-db9f-45f7-ad74-0a964599dc97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:18:01.123026627Z [2024-04-03 02:18:01,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:18:01.201030604Z [2024-04-03 02:18:01,196: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:18:01.283588755Z [2024-04-03 02:18:01,278: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:18:01.473245465Z [2024-04-03 02:18:01,472: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:18:02.280087277Z [2024-04-03 02:18:02,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d076b17-b505-4f2e-aa9c-4642993c4ecc] succeeded in 1.6984952249999878s: None 2024-04-03T02:18:02.782825443Z [2024-04-03 02:18:02,781: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:18:02.799356967Z [2024-04-03 02:18:02,797: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:18:02.856787641Z [2024-04-03 02:18:02,856: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:18:02.858524621Z [2024-04-03 02:18:02,858: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:18:02.858897606Z [2024-04-03 02:18:02,858: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:18:02.859072535Z [2024-04-03 02:18:02,858: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:18:02.859250118Z [2024-04-03 02:18:02,859: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:18:02.859544987Z [2024-04-03 02:18:02,859: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:18:02.859674511Z [2024-04-03 02:18:02,859: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:18:02.993436423Z [2024-04-03 02:18:02,993: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:18:03.010762676Z [2024-04-03 02:18:03,010: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:18:03.014462883Z [2024-04-03 02:18:03,013: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:18:03.084699173Z [2024-04-03 02:18:03,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:18:03.088782723Z [2024-04-03 02:18:03,088: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:18:03.091526232Z [2024-04-03 02:18:03,091: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:18:03.091732986Z [2024-04-03 02:18:03,091: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:18:03.091838509Z [2024-04-03 02:18:03,091: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:18:03.092199651Z [2024-04-03 02:18:03,092: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:18:03.092304505Z [2024-04-03 02:18:03,092: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:18:03.241497549Z [2024-04-03 02:18:03,241: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:18:05.271139673Z [2024-04-03 02:18:05,270: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[10243e28-db9f-45f7-ad74-0a964599dc97] succeeded in 4.676956965000045s: None 2024-04-03T02:18:05.374354243Z [2024-04-03 02:18:05,373: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2a77716b-23e1-4fbe-a35e-689a12b1d0e9] succeeded in 4.783609949000038s: None 2024-04-03T02:18:06.294150393Z [2024-04-03 02:18:06,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe3727c9-6932-43f5-9c13-d036ed260959] received 2024-04-03T02:18:06.305718030Z [2024-04-03 02:18:06,305: INFO/ForkPoolWorker-15] [fe3727c9-6932-43f5-9c13-d036ed260959] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-03T02:18:06.648039918Z [2024-04-03 02:18:06,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-03T02:18:06.832292690Z [2024-04-03 02:18:06,831: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-03T02:18:06.836307943Z [2024-04-03 02:18:06,835: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:18:06.876042049Z [2024-04-03 02:18:06,875: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:18:06.877181599Z [2024-04-03 02:18:06,876: INFO/ForkPoolWorker-15] Read SDNC 901a6031-b863-47af-aeae-b4c136e09d6a (epa_03) 2024-04-03T02:18:06.877233139Z [2024-04-03 02:18:06,877: INFO/ForkPoolWorker-15] [{'_id': '901a6031-b863-47af-aeae-b4c136e09d6a', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-03T02:18:06.877312009Z [2024-04-03 02:18:06,877: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-03T02:18:06.877570123Z [2024-04-03 02:18:06,877: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a 2024-04-03T02:18:06.984000711Z [2024-04-03 02:18:06,983: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:18:07.634519470Z [2024-04-03 02:18:07,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe3727c9-6932-43f5-9c13-d036ed260959] succeeded in 1.3402047659997152s: None 2024-04-03T02:19:00.310369274Z [2024-04-03 02:19:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6706af8-eb96-4cd9-a653-a37f35b9f952] received 2024-04-03T02:19:00.314179994Z [2024-04-03 02:19:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b9c7995-a9f4-4d31-b5f1-71885d209944] received 2024-04-03T02:19:00.323230485Z [2024-04-03 02:19:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df62647f-9e5e-49cd-83f8-47e195171af9] received 2024-04-03T02:19:00.328216631Z [2024-04-03 02:19:00,327: INFO/ForkPoolWorker-16] [3b9c7995-a9f4-4d31-b5f1-71885d209944] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:19:00.339703506Z [2024-04-03 02:19:00,339: INFO/ForkPoolWorker-15] [a6706af8-eb96-4cd9-a653-a37f35b9f952] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-03T02:19:00.343774269Z [2024-04-03 02:19:00,343: INFO/ForkPoolWorker-1] [df62647f-9e5e-49cd-83f8-47e195171af9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:19:00.868339954Z [2024-04-03 02:19:00,860: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:19:00.876614173Z [2024-04-03 02:19:00,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-03T02:19:00.968055828Z [2024-04-03 02:19:00,964: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:19:01.084259693Z [2024-04-03 02:19:01,083: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-03T02:19:01.088811617Z [2024-04-03 02:19:01,088: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:19:01.146229127Z [2024-04-03 02:19:01,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:19:01.147283951Z [2024-04-03 02:19:01,147: INFO/ForkPoolWorker-15] [] 2024-04-03T02:19:01.147424459Z [2024-04-03 02:19:01,147: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-03T02:19:01.148808322Z [2024-04-03 02:19:01,148: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-03T02:19:01.152821823Z [2024-04-03 02:19:01,152: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-03T02:19:01.153635334Z [2024-04-03 02:19:01,153: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-03T02:19:01.156465740Z [2024-04-03 02:19:01,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:19:01.218774772Z [2024-04-03 02:19:01,218: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:19:01.221010815Z [2024-04-03 02:19:01,220: INFO/ForkPoolWorker-15] [] 2024-04-03T02:19:01.221923769Z [2024-04-03 02:19:01,220: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-03T02:19:01.223937013Z [2024-04-03 02:19:01,223: ERROR/ForkPoolWorker-15] [a6706af8-eb96-4cd9-a653-a37f35b9f952] Failed to execute task Dag 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a' could not be found; either it does not exist or it failed to parse.. 2024-04-03T02:19:01.223949264Z Traceback (most recent call last): 2024-04-03T02:19:01.223953254Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T02:19:01.223957036Z args.func(args) 2024-04-03T02:19:01.223960914Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T02:19:01.223964669Z return func(*args, **kwargs) 2024-04-03T02:19:01.223967687Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T02:19:01.223970652Z return f(*args, **kwargs) 2024-04-03T02:19:01.223973629Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T02:19:01.223976746Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T02:19:01.223979763Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T02:19:01.223983107Z raise AirflowException( 2024-04-03T02:19:01.223987435Z airflow.exceptions.AirflowException: Dag 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a' could not be found; either it does not exist or it failed to parse. 2024-04-03T02:19:01.253969283Z [2024-04-03 02:19:01,253: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6706af8-eb96-4cd9-a653-a37f35b9f952] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a6706af8-eb96-4cd9-a653-a37f35b9f952') 2024-04-03T02:19:01.253984491Z Traceback (most recent call last): 2024-04-03T02:19:01.253988425Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T02:19:01.253991647Z R = retval = fun(*args, **kwargs) 2024-04-03T02:19:01.254001917Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T02:19:01.254005452Z return self.run(*args, **kwargs) 2024-04-03T02:19:01.254018912Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T02:19:01.254022904Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T02:19:01.254026497Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T02:19:01.254029995Z raise AirflowException(msg) 2024-04-03T02:19:01.254033702Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a6706af8-eb96-4cd9-a653-a37f35b9f952 2024-04-03T02:19:02.182203059Z [2024-04-03 02:19:02,181: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:19:02.185515808Z [2024-04-03 02:19:02,185: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:19:02.208707644Z [2024-04-03 02:19:02,208: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:19:02.209801775Z [2024-04-03 02:19:02,209: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:19:02.209855277Z [2024-04-03 02:19:02,209: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:19:02.209986109Z [2024-04-03 02:19:02,209: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:19:02.210033880Z [2024-04-03 02:19:02,209: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:19:02.210263654Z [2024-04-03 02:19:02,210: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:19:02.210295553Z [2024-04-03 02:19:02,210: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:19:02.264673875Z [2024-04-03 02:19:02,264: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:19:02.267957004Z [2024-04-03 02:19:02,267: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:19:02.297182673Z [2024-04-03 02:19:02,296: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:19:02.307450619Z [2024-04-03 02:19:02,307: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:19:02.308682394Z [2024-04-03 02:19:02,308: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:19:02.308819894Z [2024-04-03 02:19:02,308: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:19:02.309013191Z [2024-04-03 02:19:02,308: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:19:02.309143429Z [2024-04-03 02:19:02,308: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:19:02.309440914Z [2024-04-03 02:19:02,309: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:19:02.309600906Z [2024-04-03 02:19:02,309: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:19:02.383312403Z [2024-04-03 02:19:02,383: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:19:03.988965681Z [2024-04-03 02:19:03,988: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df62647f-9e5e-49cd-83f8-47e195171af9] succeeded in 3.663461006000034s: None 2024-04-03T02:19:04.516543036Z [2024-04-03 02:19:04,515: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3b9c7995-a9f4-4d31-b5f1-71885d209944] succeeded in 4.1986226210001405s: None 2024-04-03T02:19:12.387545606Z [2024-04-03 02:19:12,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b6fb8b3-df1e-4dcd-bf3e-9eb00e287bb2] received 2024-04-03T02:19:12.415450779Z [2024-04-03 02:19:12,415: INFO/ForkPoolWorker-15] [1b6fb8b3-df1e-4dcd-bf3e-9eb00e287bb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-03T02:19:12.718969136Z [2024-04-03 02:19:12,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-03T02:19:12.888915744Z [2024-04-03 02:19:12,888: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-03T02:19:12.892714720Z [2024-04-03 02:19:12,892: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:19:12.931674638Z [2024-04-03 02:19:12,931: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:19:12.932898408Z [2024-04-03 02:19:12,932: INFO/ForkPoolWorker-15] [] 2024-04-03T02:19:12.932943837Z [2024-04-03 02:19:12,932: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-03T02:19:12.934487845Z [2024-04-03 02:19:12,934: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-03T02:19:12.935199259Z [2024-04-03 02:19:12,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-03T02:19:12.936109383Z [2024-04-03 02:19:12,935: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-03T02:19:12.939745410Z [2024-04-03 02:19:12,939: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:19:12.973511745Z [2024-04-03 02:19:12,973: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:19:12.974683388Z [2024-04-03 02:19:12,974: INFO/ForkPoolWorker-15] [] 2024-04-03T02:19:12.974700010Z [2024-04-03 02:19:12,974: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-03T02:19:12.975755907Z [2024-04-03 02:19:12,975: ERROR/ForkPoolWorker-15] [1b6fb8b3-df1e-4dcd-bf3e-9eb00e287bb2] Failed to execute task Dag 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a' could not be found; either it does not exist or it failed to parse.. 2024-04-03T02:19:12.975781247Z Traceback (most recent call last): 2024-04-03T02:19:12.975784977Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T02:19:12.975788503Z args.func(args) 2024-04-03T02:19:12.975791881Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T02:19:12.975795472Z return func(*args, **kwargs) 2024-04-03T02:19:12.975807769Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T02:19:12.975810581Z return f(*args, **kwargs) 2024-04-03T02:19:12.975813419Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T02:19:12.975816212Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T02:19:12.975819010Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T02:19:12.975821712Z raise AirflowException( 2024-04-03T02:19:12.975825527Z airflow.exceptions.AirflowException: Dag 'sdnc_status_901a6031-b863-47af-aeae-b4c136e09d6a' could not be found; either it does not exist or it failed to parse. 2024-04-03T02:19:12.999493897Z [2024-04-03 02:19:12,998: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b6fb8b3-df1e-4dcd-bf3e-9eb00e287bb2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1b6fb8b3-df1e-4dcd-bf3e-9eb00e287bb2') 2024-04-03T02:19:12.999507861Z Traceback (most recent call last): 2024-04-03T02:19:12.999511914Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T02:19:12.999514951Z R = retval = fun(*args, **kwargs) 2024-04-03T02:19:12.999553912Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T02:19:12.999557231Z return self.run(*args, **kwargs) 2024-04-03T02:19:12.999563816Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T02:19:12.999567509Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T02:19:12.999570382Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T02:19:12.999573922Z raise AirflowException(msg) 2024-04-03T02:19:12.999577787Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1b6fb8b3-df1e-4dcd-bf3e-9eb00e287bb2 2024-04-03T02:20:01.056345873Z [2024-04-03 02:20:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0faa0174-d43b-40ad-9251-6e58325ec142] received 2024-04-03T02:20:01.065031677Z [2024-04-03 02:20:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02b1034f-e832-4084-8f94-998076e84096] received 2024-04-03T02:20:01.080084466Z [2024-04-03 02:20:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5cba34e-0b0b-4f71-bd3a-f928677abde9] received 2024-04-03T02:20:01.085166317Z [2024-04-03 02:20:01,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e16d819-d165-4d2e-8cdf-58439f4f2bad] received 2024-04-03T02:20:01.097553603Z [2024-04-03 02:20:01,097: INFO/ForkPoolWorker-1] [b5cba34e-0b0b-4f71-bd3a-f928677abde9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:20:01.098539786Z [2024-04-03 02:20:01,097: INFO/ForkPoolWorker-16] [02b1034f-e832-4084-8f94-998076e84096] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:20:01.113125620Z [2024-04-03 02:20:01,112: INFO/ForkPoolWorker-15] [0faa0174-d43b-40ad-9251-6e58325ec142] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:20:01.115908593Z [2024-04-03 02:20:01,115: INFO/ForkPoolWorker-2] [0e16d819-d165-4d2e-8cdf-58439f4f2bad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:20:01.527972025Z [2024-04-03 02:20:01,521: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:20:01.745871843Z [2024-04-03 02:20:01,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:20:01.848006603Z [2024-04-03 02:20:01,839: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:20:01.919964399Z [2024-04-03 02:20:01,916: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:20:01.937173257Z [2024-04-03 02:20:01,936: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:20:02.559544817Z [2024-04-03 02:20:02,559: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02b1034f-e832-4084-8f94-998076e84096] succeeded in 1.4857493160002377s: None 2024-04-03T02:20:03.226921803Z [2024-04-03 02:20:03,226: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:20:03.230301961Z [2024-04-03 02:20:03,229: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:20:03.294407814Z [2024-04-03 02:20:03,293: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:20:03.300035268Z [2024-04-03 02:20:03,299: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:20:03.302079907Z [2024-04-03 02:20:03,299: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:20:03.302259079Z [2024-04-03 02:20:03,302: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:20:03.302315697Z [2024-04-03 02:20:03,302: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:20:03.302625463Z [2024-04-03 02:20:03,302: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:20:03.302685846Z [2024-04-03 02:20:03,302: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:20:03.383444460Z [2024-04-03 02:20:03,383: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T02:20:03.387330391Z [2024-04-03 02:20:03,386: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:20:03.437517151Z [2024-04-03 02:20:03,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:20:03.451803288Z [2024-04-03 02:20:03,451: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T02:20:03.455835610Z [2024-04-03 02:20:03,454: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:20:03.455913343Z [2024-04-03 02:20:03,455: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:20:03.456069970Z [2024-04-03 02:20:03,455: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:20:03.456128230Z [2024-04-03 02:20:03,456: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T02:20:03.456397962Z [2024-04-03 02:20:03,456: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:20:03.456557581Z [2024-04-03 02:20:03,456: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:20:03.605898096Z [2024-04-03 02:20:03,605: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:20:03.715997357Z [2024-04-03 02:20:03,715: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:20:03.720802894Z [2024-04-03 02:20:03,720: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:20:03.781377652Z [2024-04-03 02:20:03,781: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:20:03.783668764Z [2024-04-03 02:20:03,783: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:20:03.783681945Z [2024-04-03 02:20:03,783: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:20:03.785671766Z [2024-04-03 02:20:03,783: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:20:03.785711989Z [2024-04-03 02:20:03,785: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:20:03.791327529Z [2024-04-03 02:20:03,789: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:20:03.791432185Z [2024-04-03 02:20:03,791: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:20:03.894553281Z [2024-04-03 02:20:03,894: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:20:04.260393400Z [2024-04-03 02:20:04,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59b8742e-7abb-4de4-8de5-27eb977ef8ad] received 2024-04-03T02:20:04.285184478Z [2024-04-03 02:20:04,284: INFO/ForkPoolWorker-16] [59b8742e-7abb-4de4-8de5-27eb977ef8ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:20:04.344670832Z [2024-04-03 02:20:04,344: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0faa0174-d43b-40ad-9251-6e58325ec142] succeeded in 3.2842775409999376s: None 2024-04-03T02:20:04.652479310Z [2024-04-03 02:20:04,649: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:20:05.669604381Z [2024-04-03 02:20:05,669: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5cba34e-0b0b-4f71-bd3a-f928677abde9] succeeded in 4.587243868999849s: None 2024-04-03T02:20:05.794279521Z [2024-04-03 02:20:05,793: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e16d819-d165-4d2e-8cdf-58439f4f2bad] succeeded in 4.705322590999913s: None 2024-04-03T02:20:05.831364813Z [2024-04-03 02:20:05,830: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:20:05.835127255Z [2024-04-03 02:20:05,834: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:20:05.859452081Z [2024-04-03 02:20:05,859: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:20:05.860594795Z [2024-04-03 02:20:05,860: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:20:05.860725406Z [2024-04-03 02:20:05,860: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:20:05.860903033Z [2024-04-03 02:20:05,860: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:20:05.861022258Z [2024-04-03 02:20:05,860: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:20:05.861287682Z [2024-04-03 02:20:05,861: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:20:05.861403775Z [2024-04-03 02:20:05,861: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:20:05.935440730Z [2024-04-03 02:20:05,935: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:20:06.509879431Z [2024-04-03 02:20:06,509: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59b8742e-7abb-4de4-8de5-27eb977ef8ad] succeeded in 2.245732654999756s: None 2024-04-03T02:20:06.791206110Z [2024-04-03 02:20:06,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4bea4ba-168f-4d6e-b161-728e2b2e21bc] received 2024-04-03T02:20:06.806112320Z [2024-04-03 02:20:06,805: INFO/ForkPoolWorker-15] [a4bea4ba-168f-4d6e-b161-728e2b2e21bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:20:07.159205715Z [2024-04-03 02:20:07,156: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:20:08.450118980Z [2024-04-03 02:20:08,449: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:20:08.454284880Z [2024-04-03 02:20:08,453: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:20:08.487201537Z [2024-04-03 02:20:08,486: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:20:08.491163097Z [2024-04-03 02:20:08,490: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:20:08.491433787Z [2024-04-03 02:20:08,491: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:20:08.491634162Z [2024-04-03 02:20:08,491: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:20:08.491751318Z [2024-04-03 02:20:08,491: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:20:08.492054855Z [2024-04-03 02:20:08,491: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:20:08.492197321Z [2024-04-03 02:20:08,492: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:20:08.584185305Z [2024-04-03 02:20:08,583: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:20:09.164084393Z [2024-04-03 02:20:09,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4bea4ba-168f-4d6e-b161-728e2b2e21bc] succeeded in 2.3709507260000464s: None 2024-04-03T02:20:09.963348222Z [2024-04-03 02:20:09,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e762812a-938d-49d5-82c8-3d0d09daa8af] received 2024-04-03T02:20:09.970149507Z [2024-04-03 02:20:09,969: INFO/ForkPoolWorker-15] [e762812a-938d-49d5-82c8-3d0d09daa8af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:20:10.354176774Z [2024-04-03 02:20:10,351: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:20:11.551428550Z [2024-04-03 02:20:11,551: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:20:11.554851213Z [2024-04-03 02:20:11,554: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:20:11.582580273Z [2024-04-03 02:20:11,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:20:11.583809893Z [2024-04-03 02:20:11,583: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:20:11.583821689Z [2024-04-03 02:20:11,583: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:20:11.584127114Z [2024-04-03 02:20:11,583: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:20:11.584249195Z [2024-04-03 02:20:11,584: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:20:11.584580589Z [2024-04-03 02:20:11,584: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:20:11.584774410Z [2024-04-03 02:20:11,584: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:20:11.676220564Z [2024-04-03 02:20:11,675: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:20:12.272126023Z [2024-04-03 02:20:12,271: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e762812a-938d-49d5-82c8-3d0d09daa8af] succeeded in 2.306313643000067s: None 2024-04-03T02:21:00.499380102Z [2024-04-03 02:21:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d84485dd-271b-4a9e-ab25-43ea19ca428d] received 2024-04-03T02:21:00.503984830Z [2024-04-03 02:21:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2abe6c71-1687-4bd6-a776-96de8b2a463f] received 2024-04-03T02:21:00.516506165Z [2024-04-03 02:21:00,516: INFO/ForkPoolWorker-15] [d84485dd-271b-4a9e-ab25-43ea19ca428d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:21:00.522533269Z [2024-04-03 02:21:00,522: INFO/ForkPoolWorker-16] [2abe6c71-1687-4bd6-a776-96de8b2a463f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:21:00.985078738Z [2024-04-03 02:21:00,980: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:21:00.991958416Z [2024-04-03 02:21:00,987: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:21:02.330016950Z [2024-04-03 02:21:02,329: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:21:02.333410726Z [2024-04-03 02:21:02,333: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:21:02.359980091Z [2024-04-03 02:21:02,359: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:21:02.361227618Z [2024-04-03 02:21:02,360: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:21:02.361275422Z [2024-04-03 02:21:02,360: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:21:02.361318060Z [2024-04-03 02:21:02,360: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:21:02.361329136Z [2024-04-03 02:21:02,361: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:21:02.361702702Z [2024-04-03 02:21:02,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:21:02.361714269Z [2024-04-03 02:21:02,361: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:21:02.403390306Z [2024-04-03 02:21:02,402: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:21:02.407015005Z [2024-04-03 02:21:02,406: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:21:02.434789165Z [2024-04-03 02:21:02,433: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:21:02.436541074Z [2024-04-03 02:21:02,436: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:21:02.436620262Z [2024-04-03 02:21:02,436: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:21:02.437089306Z [2024-04-03 02:21:02,436: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:21:02.438787944Z [2024-04-03 02:21:02,437: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:21:02.439001194Z [2024-04-03 02:21:02,438: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:21:02.439041879Z [2024-04-03 02:21:02,438: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:21:02.440929825Z [2024-04-03 02:21:02,440: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:21:02.531550208Z [2024-04-03 02:21:02,530: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:21:04.029855819Z [2024-04-03 02:21:04,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d84485dd-271b-4a9e-ab25-43ea19ca428d] succeeded in 3.526404353000089s: None 2024-04-03T02:21:04.305155959Z [2024-04-03 02:21:04,304: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2abe6c71-1687-4bd6-a776-96de8b2a463f] succeeded in 3.7977069309999933s: None 2024-04-03T02:22:00.896039161Z [2024-04-03 02:22:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[805fbaac-4048-43fa-9536-c624bd4ee0fb] received 2024-04-03T02:22:00.914055184Z [2024-04-03 02:22:00,913: INFO/ForkPoolWorker-15] [805fbaac-4048-43fa-9536-c624bd4ee0fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:22:00.915489327Z [2024-04-03 02:22:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30757063-e1a6-484e-b98a-f555686569c8] received 2024-04-03T02:22:00.922829622Z [2024-04-03 02:22:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8f5ab66-78f6-4f1d-baea-e096f118a015] received 2024-04-03T02:22:00.945828622Z [2024-04-03 02:22:00,945: INFO/ForkPoolWorker-16] [30757063-e1a6-484e-b98a-f555686569c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:22:00.954931550Z [2024-04-03 02:22:00,952: INFO/ForkPoolWorker-1] [c8f5ab66-78f6-4f1d-baea-e096f118a015] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:22:01.417122871Z [2024-04-03 02:22:01,412: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:22:01.736243331Z [2024-04-03 02:22:01,731: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:22:01.970680653Z [2024-04-03 02:22:01,965: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:22:02.018519812Z [2024-04-03 02:22:02,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:22:02.906407610Z [2024-04-03 02:22:02,905: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30757063-e1a6-484e-b98a-f555686569c8] succeeded in 1.9852810950001185s: None 2024-04-03T02:22:03.417244982Z [2024-04-03 02:22:03,416: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:22:03.421918981Z [2024-04-03 02:22:03,421: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:22:03.498456919Z [2024-04-03 02:22:03,497: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:22:03.499596071Z [2024-04-03 02:22:03,499: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:22:03.499674927Z [2024-04-03 02:22:03,499: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:22:03.499842877Z [2024-04-03 02:22:03,499: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:22:03.499887214Z [2024-04-03 02:22:03,499: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:22:03.500139222Z [2024-04-03 02:22:03,500: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:22:03.500210303Z [2024-04-03 02:22:03,500: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:22:03.604005093Z [2024-04-03 02:22:03,603: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:22:03.677890183Z [2024-04-03 02:22:03,677: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:22:03.681318431Z [2024-04-03 02:22:03,680: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:22:03.751299855Z [2024-04-03 02:22:03,750: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:22:03.753272012Z [2024-04-03 02:22:03,752: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:22:03.753442421Z [2024-04-03 02:22:03,753: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:22:03.753869185Z [2024-04-03 02:22:03,753: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:22:03.754104641Z [2024-04-03 02:22:03,753: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:22:03.754861428Z [2024-04-03 02:22:03,754: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:22:03.755561555Z [2024-04-03 02:22:03,754: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:22:03.849368446Z [2024-04-03 02:22:03,849: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:22:05.641546631Z [2024-04-03 02:22:05,640: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[805fbaac-4048-43fa-9536-c624bd4ee0fb] succeeded in 4.74278513399986s: None 2024-04-03T02:22:07.060762732Z [2024-04-03 02:22:07,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c8f5ab66-78f6-4f1d-baea-e096f118a015] succeeded in 6.133681234000051s: None 2024-04-03T02:23:01.207400065Z [2024-04-03 02:23:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42fdbba3-9ba8-4509-93e7-30f79d28084c] received 2024-04-03T02:23:01.219141899Z [2024-04-03 02:23:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce491bb5-cc2d-45c5-880f-6173685d4c6d] received 2024-04-03T02:23:01.224401224Z [2024-04-03 02:23:01,219: INFO/ForkPoolWorker-15] [42fdbba3-9ba8-4509-93e7-30f79d28084c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:23:01.234245026Z [2024-04-03 02:23:01,233: INFO/ForkPoolWorker-16] [ce491bb5-cc2d-45c5-880f-6173685d4c6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:23:01.567043924Z [2024-04-03 02:23:01,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:23:01.570173705Z [2024-04-03 02:23:01,566: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:23:02.714340357Z [2024-04-03 02:23:02,713: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:23:02.717832498Z [2024-04-03 02:23:02,717: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:23:02.745137771Z [2024-04-03 02:23:02,744: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:23:02.746352828Z [2024-04-03 02:23:02,746: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:23:02.746467080Z [2024-04-03 02:23:02,746: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:23:02.746667870Z [2024-04-03 02:23:02,746: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:23:02.746681783Z [2024-04-03 02:23:02,746: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:23:02.746928038Z [2024-04-03 02:23:02,746: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:23:02.747054177Z [2024-04-03 02:23:02,746: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:23:02.748190468Z [2024-04-03 02:23:02,747: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:23:02.751506176Z [2024-04-03 02:23:02,751: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:23:02.836803699Z [2024-04-03 02:23:02,830: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:23:02.836823310Z [2024-04-03 02:23:02,832: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:23:02.836827738Z [2024-04-03 02:23:02,832: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:23:02.836833738Z [2024-04-03 02:23:02,832: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:23:02.836837880Z [2024-04-03 02:23:02,832: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:23:02.836841067Z [2024-04-03 02:23:02,832: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:23:02.836844280Z [2024-04-03 02:23:02,832: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:23:02.882419693Z [2024-04-03 02:23:02,882: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:23:02.946187794Z [2024-04-03 02:23:02,945: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:23:04.787683932Z [2024-04-03 02:23:04,787: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ce491bb5-cc2d-45c5-880f-6173685d4c6d] succeeded in 3.565066791999925s: None 2024-04-03T02:23:05.405294077Z [2024-04-03 02:23:05,404: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[42fdbba3-9ba8-4509-93e7-30f79d28084c] succeeded in 4.194921589999922s: None 2024-04-03T02:24:00.335767799Z [2024-04-03 02:24:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d90f33ba-48bb-484c-8ad9-51ee21b7ce04] received 2024-04-03T02:24:00.344601534Z [2024-04-03 02:24:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[471a9c3c-f898-44bb-b7b2-57ebf4672ec2] received 2024-04-03T02:24:00.351441605Z [2024-04-03 02:24:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f26e809d-d29e-4370-ae62-0223ebc4da0b] received 2024-04-03T02:24:00.362279801Z [2024-04-03 02:24:00,361: INFO/ForkPoolWorker-15] [d90f33ba-48bb-484c-8ad9-51ee21b7ce04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:24:00.371003750Z [2024-04-03 02:24:00,370: INFO/ForkPoolWorker-1] [f26e809d-d29e-4370-ae62-0223ebc4da0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:24:00.376914957Z [2024-04-03 02:24:00,376: INFO/ForkPoolWorker-16] [471a9c3c-f898-44bb-b7b2-57ebf4672ec2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:24:00.990341052Z [2024-04-03 02:24:00,981: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:24:01.044489684Z [2024-04-03 02:24:01,021: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:24:01.095537991Z [2024-04-03 02:24:01,090: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:24:01.420655279Z [2024-04-03 02:24:01,420: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:24:02.170970175Z [2024-04-03 02:24:02,170: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[471a9c3c-f898-44bb-b7b2-57ebf4672ec2] succeeded in 1.8222352309999224s: None 2024-04-03T02:24:02.481261971Z [2024-04-03 02:24:02,480: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:24:02.484667981Z [2024-04-03 02:24:02,484: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:24:02.515191167Z [2024-04-03 02:24:02,514: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:24:02.517072391Z [2024-04-03 02:24:02,516: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:24:02.517513250Z [2024-04-03 02:24:02,517: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:24:02.517733118Z [2024-04-03 02:24:02,517: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:24:02.517877712Z [2024-04-03 02:24:02,517: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:24:02.518477651Z [2024-04-03 02:24:02,518: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:24:02.519108804Z [2024-04-03 02:24:02,518: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:24:02.604286350Z [2024-04-03 02:24:02,604: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:24:02.649849726Z [2024-04-03 02:24:02,649: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:24:02.653339750Z [2024-04-03 02:24:02,652: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:24:02.701695824Z [2024-04-03 02:24:02,701: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:24:02.706797414Z [2024-04-03 02:24:02,702: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:24:02.707209102Z [2024-04-03 02:24:02,707: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:24:02.707399085Z [2024-04-03 02:24:02,707: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:24:02.707472560Z [2024-04-03 02:24:02,707: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:24:02.708084239Z [2024-04-03 02:24:02,707: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:24:02.708238668Z [2024-04-03 02:24:02,708: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:24:02.810994555Z [2024-04-03 02:24:02,804: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:24:04.138356390Z [2024-04-03 02:24:04,137: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d90f33ba-48bb-484c-8ad9-51ee21b7ce04] succeeded in 3.7996972119999555s: None 2024-04-03T02:24:04.685108330Z [2024-04-03 02:24:04,684: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f26e809d-d29e-4370-ae62-0223ebc4da0b] succeeded in 4.331411628000296s: None 2024-04-03T02:25:01.108597198Z [2024-04-03 02:25:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[873644a2-f915-48e8-9fd9-6616b1afd8cf] received 2024-04-03T02:25:01.123057828Z [2024-04-03 02:25:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4ba8865-bf16-4d39-b9c8-a8927fba70d7] received 2024-04-03T02:25:01.130403484Z [2024-04-03 02:25:01,129: INFO/ForkPoolWorker-15] [873644a2-f915-48e8-9fd9-6616b1afd8cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:25:01.144099069Z [2024-04-03 02:25:01,143: INFO/ForkPoolWorker-16] [a4ba8865-bf16-4d39-b9c8-a8927fba70d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:25:01.168778199Z [2024-04-03 02:25:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[935a031e-1cb8-448a-a7dc-a9fc5c6571b9] received 2024-04-03T02:25:01.228021954Z [2024-04-03 02:25:01,227: INFO/ForkPoolWorker-1] [935a031e-1cb8-448a-a7dc-a9fc5c6571b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:25:01.613772864Z [2024-04-03 02:25:01,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:25:01.618556654Z [2024-04-03 02:25:01,612: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:25:01.783382282Z [2024-04-03 02:25:01,779: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:25:03.061326983Z [2024-04-03 02:25:03,060: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:25:03.064944914Z [2024-04-03 02:25:03,064: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:25:03.082713040Z [2024-04-03 02:25:03,082: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:25:03.086672150Z [2024-04-03 02:25:03,086: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:25:03.128982663Z [2024-04-03 02:25:03,126: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:25:03.133225157Z [2024-04-03 02:25:03,131: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:25:03.135601000Z [2024-04-03 02:25:03,134: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:25:03.136105269Z [2024-04-03 02:25:03,135: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:25:03.136401562Z [2024-04-03 02:25:03,136: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:25:03.136742282Z [2024-04-03 02:25:03,136: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:25:03.136776400Z [2024-04-03 02:25:03,136: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:25:03.136953643Z [2024-04-03 02:25:03,136: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:25:03.137132076Z [2024-04-03 02:25:03,137: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:25:03.137545722Z [2024-04-03 02:25:03,137: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:25:03.139480818Z [2024-04-03 02:25:03,137: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:25:03.139689515Z [2024-04-03 02:25:03,139: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:25:03.141212358Z [2024-04-03 02:25:03,141: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:25:03.141558131Z [2024-04-03 02:25:03,141: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:25:03.241215179Z [2024-04-03 02:25:03,240: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:25:03.276991043Z [2024-04-03 02:25:03,276: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:25:03.280787490Z [2024-04-03 02:25:03,280: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:25:03.320353408Z [2024-04-03 02:25:03,320: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:25:03.357700438Z [2024-04-03 02:25:03,357: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:25:03.359017993Z [2024-04-03 02:25:03,358: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:25:03.359150958Z [2024-04-03 02:25:03,358: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:25:03.359443045Z [2024-04-03 02:25:03,359: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:25:03.359565199Z [2024-04-03 02:25:03,359: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:25:03.359854097Z [2024-04-03 02:25:03,359: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:25:03.360317332Z [2024-04-03 02:25:03,359: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:25:03.478667772Z [2024-04-03 02:25:03,478: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:25:04.093966407Z [2024-04-03 02:25:04,093: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[935a031e-1cb8-448a-a7dc-a9fc5c6571b9] succeeded in 2.9165670749998753s: None 2024-04-03T02:25:04.106488286Z [2024-04-03 02:25:04,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c18a436-f5e0-430c-8e23-66bc470e0030] received 2024-04-03T02:25:04.116759670Z [2024-04-03 02:25:04,116: INFO/ForkPoolWorker-1] [4c18a436-f5e0-430c-8e23-66bc470e0030] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:25:04.451146964Z [2024-04-03 02:25:04,447: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:25:05.100159331Z [2024-04-03 02:25:05,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[873644a2-f915-48e8-9fd9-6616b1afd8cf] succeeded in 3.98582434599939s: None 2024-04-03T02:25:05.637375215Z [2024-04-03 02:25:05,636: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:25:05.640713266Z [2024-04-03 02:25:05,640: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:25:05.665538144Z [2024-04-03 02:25:05,665: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:25:05.667095828Z [2024-04-03 02:25:05,666: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:25:05.667115838Z [2024-04-03 02:25:05,667: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:25:05.667260326Z [2024-04-03 02:25:05,667: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:25:05.667274398Z [2024-04-03 02:25:05,667: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:25:05.667947722Z [2024-04-03 02:25:05,667: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:25:05.667967346Z [2024-04-03 02:25:05,667: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:25:05.742556270Z [2024-04-03 02:25:05,742: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:25:05.987823891Z [2024-04-03 02:25:05,987: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4ba8865-bf16-4d39-b9c8-a8927fba70d7] succeeded in 4.862392616000761s: None 2024-04-03T02:25:06.366541458Z [2024-04-03 02:25:06,365: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c18a436-f5e0-430c-8e23-66bc470e0030] succeeded in 2.255981776000226s: None 2024-04-03T02:25:06.618869486Z [2024-04-03 02:25:06,617: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13d98286-9377-4cdd-8deb-1b63162e9674] received 2024-04-03T02:25:06.626747741Z [2024-04-03 02:25:06,625: INFO/ForkPoolWorker-15] [13d98286-9377-4cdd-8deb-1b63162e9674] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:25:06.930787814Z [2024-04-03 02:25:06,927: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:25:08.069049521Z [2024-04-03 02:25:08,068: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:25:08.072449156Z [2024-04-03 02:25:08,071: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:25:08.098686418Z [2024-04-03 02:25:08,098: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:25:08.100014650Z [2024-04-03 02:25:08,099: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:25:08.100154362Z [2024-04-03 02:25:08,099: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:25:08.100387820Z [2024-04-03 02:25:08,100: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:25:08.100483487Z [2024-04-03 02:25:08,100: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:25:08.100736371Z [2024-04-03 02:25:08,100: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:25:08.100768558Z [2024-04-03 02:25:08,100: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:25:08.194631954Z [2024-04-03 02:25:08,194: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:25:08.675237081Z [2024-04-03 02:25:08,674: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13d98286-9377-4cdd-8deb-1b63162e9674] succeeded in 2.0556513240007916s: None 2024-04-03T02:25:08.915034321Z [2024-04-03 02:25:08,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7ae2718-fcd5-4d7c-ae12-c35c72e4f447] received 2024-04-03T02:25:08.921380197Z [2024-04-03 02:25:08,921: INFO/ForkPoolWorker-15] [e7ae2718-fcd5-4d7c-ae12-c35c72e4f447] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:25:09.199789679Z [2024-04-03 02:25:09,196: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:25:10.408850355Z [2024-04-03 02:25:10,408: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:25:10.412749775Z [2024-04-03 02:25:10,412: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:25:10.442386196Z [2024-04-03 02:25:10,442: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:25:10.445476767Z [2024-04-03 02:25:10,445: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:25:10.445679259Z [2024-04-03 02:25:10,445: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:25:10.445918807Z [2024-04-03 02:25:10,445: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:25:10.446083155Z [2024-04-03 02:25:10,445: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:25:10.446424741Z [2024-04-03 02:25:10,446: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:25:10.446633125Z [2024-04-03 02:25:10,446: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:25:10.555973318Z [2024-04-03 02:25:10,555: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:25:11.171254781Z [2024-04-03 02:25:11,170: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7ae2718-fcd5-4d7c-ae12-c35c72e4f447] succeeded in 2.254696560999946s: None 2024-04-03T02:26:01.203088250Z [2024-04-03 02:26:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff7b988a-23c3-45cb-af50-40f45ca5763b] received 2024-04-03T02:26:01.204920086Z [2024-04-03 02:26:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f48b54b-53b9-4dd9-93d4-5cd76fc1c4c0] received 2024-04-03T02:26:01.218111348Z [2024-04-03 02:26:01,217: INFO/ForkPoolWorker-15] [ff7b988a-23c3-45cb-af50-40f45ca5763b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:26:01.218818053Z [2024-04-03 02:26:01,218: INFO/ForkPoolWorker-16] [2f48b54b-53b9-4dd9-93d4-5cd76fc1c4c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:26:01.268075367Z [2024-04-03 02:26:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15d35736-1f40-491a-a78c-2cba940c18fd] received 2024-04-03T02:26:01.311895966Z [2024-04-03 02:26:01,311: INFO/ForkPoolWorker-1] [15d35736-1f40-491a-a78c-2cba940c18fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:26:01.593788417Z [2024-04-03 02:26:01,589: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:26:01.651230121Z [2024-04-03 02:26:01,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:26:01.679607418Z [2024-04-03 02:26:01,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:26:01.867157808Z [2024-04-03 02:26:01,866: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:26:02.487907924Z [2024-04-03 02:26:02,487: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f48b54b-53b9-4dd9-93d4-5cd76fc1c4c0] succeeded in 1.2802886959998432s: None 2024-04-03T02:26:02.900681716Z [2024-04-03 02:26:02,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:26:02.906286060Z [2024-04-03 02:26:02,905: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:26:02.966222752Z [2024-04-03 02:26:02,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:26:02.967700178Z [2024-04-03 02:26:02,967: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:26:02.967724858Z [2024-04-03 02:26:02,967: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:26:02.967847182Z [2024-04-03 02:26:02,967: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:26:02.967857768Z [2024-04-03 02:26:02,967: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:26:02.968092271Z [2024-04-03 02:26:02,967: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:26:02.968121640Z [2024-04-03 02:26:02,968: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:26:03.107705152Z [2024-04-03 02:26:03,107: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:26:03.109050255Z [2024-04-03 02:26:03,108: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:26:03.112185346Z [2024-04-03 02:26:03,111: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:26:03.175741673Z [2024-04-03 02:26:03,175: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:26:03.185346953Z [2024-04-03 02:26:03,185: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:26:03.185997822Z [2024-04-03 02:26:03,185: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:26:03.186439931Z [2024-04-03 02:26:03,185: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:26:03.186694888Z [2024-04-03 02:26:03,186: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:26:03.187387274Z [2024-04-03 02:26:03,187: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:26:03.187720700Z [2024-04-03 02:26:03,187: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:26:03.283354628Z [2024-04-03 02:26:03,283: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:26:05.439039736Z [2024-04-03 02:26:05,438: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15d35736-1f40-491a-a78c-2cba940c18fd] succeeded in 4.1667460999997274s: None 2024-04-03T02:26:05.501378046Z [2024-04-03 02:26:05,500: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff7b988a-23c3-45cb-af50-40f45ca5763b] succeeded in 4.296123603000524s: None 2024-04-03T02:27:00.281261552Z [2024-04-03 02:27:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e95f44f-84fa-4a8d-ba0a-25606af609c3] received 2024-04-03T02:27:00.303972555Z [2024-04-03 02:27:00,299: INFO/ForkPoolWorker-15] [8e95f44f-84fa-4a8d-ba0a-25606af609c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:27:00.315395725Z [2024-04-03 02:27:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb42f440-1d18-4e55-b56e-055d204f1efa] received 2024-04-03T02:27:00.344278486Z [2024-04-03 02:27:00,343: INFO/ForkPoolWorker-16] [fb42f440-1d18-4e55-b56e-055d204f1efa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:27:00.664241479Z [2024-04-03 02:27:00,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:27:00.770819886Z [2024-04-03 02:27:00,763: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:27:02.086231591Z [2024-04-03 02:27:02,085: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:27:02.090159897Z [2024-04-03 02:27:02,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:27:02.135288775Z [2024-04-03 02:27:02,134: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:27:02.137113041Z [2024-04-03 02:27:02,136: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:27:02.137126758Z [2024-04-03 02:27:02,137: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:27:02.137228099Z [2024-04-03 02:27:02,137: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:27:02.137260726Z [2024-04-03 02:27:02,137: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:27:02.138172299Z [2024-04-03 02:27:02,137: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:27:02.138209812Z [2024-04-03 02:27:02,138: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:27:02.158487003Z [2024-04-03 02:27:02,154: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:27:02.162486764Z [2024-04-03 02:27:02,162: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:27:02.192499026Z [2024-04-03 02:27:02,192: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:27:02.196793135Z [2024-04-03 02:27:02,196: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:27:02.196970044Z [2024-04-03 02:27:02,196: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:27:02.197148524Z [2024-04-03 02:27:02,196: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:27:02.197226006Z [2024-04-03 02:27:02,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:27:02.197500754Z [2024-04-03 02:27:02,197: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:27:02.197966626Z [2024-04-03 02:27:02,197: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:27:02.258330002Z [2024-04-03 02:27:02,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:27:02.281201795Z [2024-04-03 02:27:02,280: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:27:03.907138228Z [2024-04-03 02:27:03,906: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb42f440-1d18-4e55-b56e-055d204f1efa] succeeded in 3.5889551189993654s: None 2024-04-03T02:27:04.915275544Z [2024-04-03 02:27:04,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e95f44f-84fa-4a8d-ba0a-25606af609c3] succeeded in 4.629541735000203s: None 2024-04-03T02:28:01.167323090Z [2024-04-03 02:28:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84c0338a-5fe7-4cea-a8c6-4ee051102062] received 2024-04-03T02:28:01.191824779Z [2024-04-03 02:28:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fd1aa9c-f9e8-46c6-a761-d533dff7127c] received 2024-04-03T02:28:01.191990722Z [2024-04-03 02:28:01,190: INFO/ForkPoolWorker-15] [84c0338a-5fe7-4cea-a8c6-4ee051102062] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:28:01.223013951Z [2024-04-03 02:28:01,222: INFO/ForkPoolWorker-16] [0fd1aa9c-f9e8-46c6-a761-d533dff7127c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:28:01.227503305Z [2024-04-03 02:28:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ddcb559-9ff0-43fa-a234-fa080ff7039d] received 2024-04-03T02:28:01.243284607Z [2024-04-03 02:28:01,242: INFO/ForkPoolWorker-1] [2ddcb559-9ff0-43fa-a234-fa080ff7039d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:28:01.742751260Z [2024-04-03 02:28:01,738: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:28:01.766059877Z [2024-04-03 02:28:01,760: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:28:01.836317130Z [2024-04-03 02:28:01,829: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:28:02.089496256Z [2024-04-03 02:28:02,089: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:28:02.722237900Z [2024-04-03 02:28:02,721: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ddcb559-9ff0-43fa-a234-fa080ff7039d] succeeded in 1.4914868920004665s: None 2024-04-03T02:28:03.517285918Z [2024-04-03 02:28:03,516: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:28:03.521261931Z [2024-04-03 02:28:03,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:28:03.549930511Z [2024-04-03 02:28:03,549: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:28:03.554406960Z [2024-04-03 02:28:03,553: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:28:03.606579921Z [2024-04-03 02:28:03,606: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:28:03.611173223Z [2024-04-03 02:28:03,610: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:28:03.611423008Z [2024-04-03 02:28:03,611: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:28:03.611672162Z [2024-04-03 02:28:03,611: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:28:03.611798212Z [2024-04-03 02:28:03,611: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:28:03.612165814Z [2024-04-03 02:28:03,612: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:28:03.612378664Z [2024-04-03 02:28:03,612: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:28:03.621846393Z [2024-04-03 02:28:03,621: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:28:03.623362804Z [2024-04-03 02:28:03,623: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:28:03.623415368Z [2024-04-03 02:28:03,623: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:28:03.623502792Z [2024-04-03 02:28:03,623: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:28:03.623557332Z [2024-04-03 02:28:03,623: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:28:03.623781289Z [2024-04-03 02:28:03,623: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:28:03.623812795Z [2024-04-03 02:28:03,623: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:28:03.738030359Z [2024-04-03 02:28:03,737: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:28:03.832902941Z [2024-04-03 02:28:03,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:28:06.522560808Z [2024-04-03 02:28:06,522: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84c0338a-5fe7-4cea-a8c6-4ee051102062] succeeded in 5.350712393999856s: None 2024-04-03T02:28:06.905503922Z [2024-04-03 02:28:06,904: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0fd1aa9c-f9e8-46c6-a761-d533dff7127c] succeeded in 5.709619324999949s: None 2024-04-03T02:29:01.194171496Z [2024-04-03 02:29:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ebf14e0-a037-40d6-aa3e-c2ea09d49eb7] received 2024-04-03T02:29:01.222871163Z [2024-04-03 02:29:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deb7c393-2ba5-45e5-a4bf-5c84d15b358e] received 2024-04-03T02:29:01.228798578Z [2024-04-03 02:29:01,225: INFO/ForkPoolWorker-15] [0ebf14e0-a037-40d6-aa3e-c2ea09d49eb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:29:01.247958646Z [2024-04-03 02:29:01,247: INFO/ForkPoolWorker-16] [deb7c393-2ba5-45e5-a4bf-5c84d15b358e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:29:01.659090167Z [2024-04-03 02:29:01,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:29:01.666940890Z [2024-04-03 02:29:01,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:29:03.002268067Z [2024-04-03 02:29:03,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:29:03.008428996Z [2024-04-03 02:29:03,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:29:03.086905707Z [2024-04-03 02:29:03,086: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:29:03.088749728Z [2024-04-03 02:29:03,088: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:29:03.088842521Z [2024-04-03 02:29:03,088: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:29:03.089005924Z [2024-04-03 02:29:03,088: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:29:03.090002234Z [2024-04-03 02:29:03,089: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:29:03.090340084Z [2024-04-03 02:29:03,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:29:03.090424927Z [2024-04-03 02:29:03,090: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:29:03.097720513Z [2024-04-03 02:29:03,097: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:29:03.104845941Z [2024-04-03 02:29:03,104: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:29:03.189069752Z [2024-04-03 02:29:03,188: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:29:03.191600376Z [2024-04-03 02:29:03,191: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:29:03.191711937Z [2024-04-03 02:29:03,191: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:29:03.191919955Z [2024-04-03 02:29:03,191: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:29:03.192029828Z [2024-04-03 02:29:03,191: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:29:03.192407962Z [2024-04-03 02:29:03,192: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:29:03.192527593Z [2024-04-03 02:29:03,192: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:29:03.251551558Z [2024-04-03 02:29:03,251: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:29:03.336786650Z [2024-04-03 02:29:03,336: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:29:05.594026427Z [2024-04-03 02:29:05,593: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[deb7c393-2ba5-45e5-a4bf-5c84d15b358e] succeeded in 4.365953761000128s: None 2024-04-03T02:29:05.935681900Z [2024-04-03 02:29:05,934: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ebf14e0-a037-40d6-aa3e-c2ea09d49eb7] succeeded in 4.734059141000216s: None 2024-04-03T02:30:01.072352080Z [2024-04-03 02:30:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28480d1a-25c3-4e4c-ac07-bd83446c9c4e] received 2024-04-03T02:30:01.085595210Z [2024-04-03 02:30:01,085: INFO/ForkPoolWorker-15] [28480d1a-25c3-4e4c-ac07-bd83446c9c4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:30:01.096388883Z [2024-04-03 02:30:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3342858-82ac-4c5a-91c9-1c2defef7ce0] received 2024-04-03T02:30:01.118906358Z [2024-04-03 02:30:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d3aa5c6-44b6-4f5f-ae70-8e255008eae3] received 2024-04-03T02:30:01.120002208Z [2024-04-03 02:30:01,119: INFO/ForkPoolWorker-16] [f3342858-82ac-4c5a-91c9-1c2defef7ce0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:30:01.129947773Z [2024-04-03 02:30:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d07dbf27-9c41-4905-a477-9899e2ded314] received 2024-04-03T02:30:01.165521024Z [2024-04-03 02:30:01,165: INFO/ForkPoolWorker-1] [2d3aa5c6-44b6-4f5f-ae70-8e255008eae3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:30:01.168834265Z [2024-04-03 02:30:01,168: INFO/ForkPoolWorker-2] [d07dbf27-9c41-4905-a477-9899e2ded314] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:30:01.664222525Z [2024-04-03 02:30:01,659: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:30:01.772236185Z [2024-04-03 02:30:01,767: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:30:01.970928550Z [2024-04-03 02:30:01,945: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:30:02.016619715Z [2024-04-03 02:30:02,004: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:30:02.073451411Z [2024-04-03 02:30:02,073: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:30:02.672103196Z [2024-04-03 02:30:02,671: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d07dbf27-9c41-4905-a477-9899e2ded314] succeeded in 1.5339207900005931s: None 2024-04-03T02:30:03.616239004Z [2024-04-03 02:30:03,615: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:30:03.624102644Z [2024-04-03 02:30:03,623: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:30:03.629723676Z [2024-04-03 02:30:03,629: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:30:03.633493572Z [2024-04-03 02:30:03,633: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:30:03.667888781Z [2024-04-03 02:30:03,667: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:30:03.672641996Z [2024-04-03 02:30:03,672: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:30:03.688947302Z [2024-04-03 02:30:03,688: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:30:03.689090064Z [2024-04-03 02:30:03,688: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:30:03.690903615Z [2024-04-03 02:30:03,690: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:30:03.691167001Z [2024-04-03 02:30:03,691: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:30:03.691428748Z [2024-04-03 02:30:03,691: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:30:03.691593458Z [2024-04-03 02:30:03,691: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:30:03.691934298Z [2024-04-03 02:30:03,691: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:30:03.692147742Z [2024-04-03 02:30:03,692: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:30:03.692236422Z [2024-04-03 02:30:03,690: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:30:03.692332735Z [2024-04-03 02:30:03,692: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:30:03.692458316Z [2024-04-03 02:30:03,692: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:30:03.692580301Z [2024-04-03 02:30:03,692: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:30:03.692824889Z [2024-04-03 02:30:03,692: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:30:03.692900384Z [2024-04-03 02:30:03,692: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:30:03.736711212Z [2024-04-03 02:30:03,736: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:30:03.745553033Z [2024-04-03 02:30:03,741: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:30:03.746148163Z [2024-04-03 02:30:03,745: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:30:03.746291565Z [2024-04-03 02:30:03,746: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:30:03.746399391Z [2024-04-03 02:30:03,746: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:30:03.747237765Z [2024-04-03 02:30:03,746: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:30:03.747368585Z [2024-04-03 02:30:03,747: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:30:03.831137190Z [2024-04-03 02:30:03,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:30:03.866534802Z [2024-04-03 02:30:03,866: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:30:03.894675485Z [2024-04-03 02:30:03,894: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:30:04.804136118Z [2024-04-03 02:30:04,803: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2d3aa5c6-44b6-4f5f-ae70-8e255008eae3] succeeded in 3.6739705719992344s: None 2024-04-03T02:30:05.036212977Z [2024-04-03 02:30:05,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf980474-f80a-489b-832e-1c1a2fabeb2b] received 2024-04-03T02:30:05.046239382Z [2024-04-03 02:30:05,045: INFO/ForkPoolWorker-1] [cf980474-f80a-489b-832e-1c1a2fabeb2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:30:05.350172482Z [2024-04-03 02:30:05,347: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:30:05.682900614Z [2024-04-03 02:30:05,680: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3342858-82ac-4c5a-91c9-1c2defef7ce0] succeeded in 4.582253442000365s: None 2024-04-03T02:30:05.962648659Z [2024-04-03 02:30:05,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28480d1a-25c3-4e4c-ac07-bd83446c9c4e] succeeded in 4.88443267599996s: None 2024-04-03T02:30:06.576860938Z [2024-04-03 02:30:06,576: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:30:06.579833267Z [2024-04-03 02:30:06,579: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:30:06.604727639Z [2024-04-03 02:30:06,604: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:30:06.606438176Z [2024-04-03 02:30:06,606: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:30:06.609921081Z [2024-04-03 02:30:06,606: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:30:06.612435770Z [2024-04-03 02:30:06,610: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:30:06.612472825Z [2024-04-03 02:30:06,610: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:30:06.612480898Z [2024-04-03 02:30:06,610: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:30:06.612487708Z [2024-04-03 02:30:06,610: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:30:06.731140026Z [2024-04-03 02:30:06,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:30:07.387133859Z [2024-04-03 02:30:07,386: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf980474-f80a-489b-832e-1c1a2fabeb2b] succeeded in 2.3486355979994187s: None 2024-04-03T02:30:07.431750216Z [2024-04-03 02:30:07,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16f63eea-a595-471b-96ab-9da985e0ff00] received 2024-04-03T02:30:07.446569168Z [2024-04-03 02:30:07,445: INFO/ForkPoolWorker-15] [16f63eea-a595-471b-96ab-9da985e0ff00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:30:07.789573229Z [2024-04-03 02:30:07,782: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:30:09.011586675Z [2024-04-03 02:30:09,011: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:30:09.016242955Z [2024-04-03 02:30:09,015: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:30:09.037255779Z [2024-04-03 02:30:09,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:30:09.038777940Z [2024-04-03 02:30:09,038: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:30:09.038867456Z [2024-04-03 02:30:09,038: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:30:09.039028625Z [2024-04-03 02:30:09,038: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:30:09.039211688Z [2024-04-03 02:30:09,039: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:30:09.039455638Z [2024-04-03 02:30:09,039: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:30:09.039510913Z [2024-04-03 02:30:09,039: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:30:09.133307878Z [2024-04-03 02:30:09,132: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:30:09.717893438Z [2024-04-03 02:30:09,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16f63eea-a595-471b-96ab-9da985e0ff00] succeeded in 2.278564381999786s: None 2024-04-03T02:30:10.180689187Z [2024-04-03 02:30:10,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89b9b89f-2d5e-40ea-b11e-62200a74854b] received 2024-04-03T02:30:10.197358531Z [2024-04-03 02:30:10,194: INFO/ForkPoolWorker-15] [89b9b89f-2d5e-40ea-b11e-62200a74854b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:30:10.550639205Z [2024-04-03 02:30:10,547: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:30:11.918183879Z [2024-04-03 02:30:11,916: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:30:11.921273647Z [2024-04-03 02:30:11,920: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:30:11.996132968Z [2024-04-03 02:30:11,995: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:30:11.999300418Z [2024-04-03 02:30:11,999: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:30:11.999420994Z [2024-04-03 02:30:11,999: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:30:11.999467338Z [2024-04-03 02:30:11,999: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:30:11.999527798Z [2024-04-03 02:30:11,999: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:30:11.999782615Z [2024-04-03 02:30:11,999: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:30:11.999836702Z [2024-04-03 02:30:11,999: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:30:12.148126428Z [2024-04-03 02:30:12,147: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:30:13.017859494Z [2024-04-03 02:30:13,017: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89b9b89f-2d5e-40ea-b11e-62200a74854b] succeeded in 2.8314944959993227s: None 2024-04-03T02:31:00.889120295Z [2024-04-03 02:31:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7259691-448c-4d6b-a604-19a5a4bffbc4] received 2024-04-03T02:31:00.893856662Z [2024-04-03 02:31:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7982616f-baf5-4d47-a797-57e18d2f7116] received 2024-04-03T02:31:00.900747967Z [2024-04-03 02:31:00,900: INFO/ForkPoolWorker-15] [b7259691-448c-4d6b-a604-19a5a4bffbc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:31:00.906691896Z [2024-04-03 02:31:00,906: INFO/ForkPoolWorker-16] [7982616f-baf5-4d47-a797-57e18d2f7116] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:31:01.213670190Z [2024-04-03 02:31:01,207: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:31:01.319001244Z [2024-04-03 02:31:01,314: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:31:02.404340295Z [2024-04-03 02:31:02,403: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:31:02.408114179Z [2024-04-03 02:31:02,407: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:31:02.441064365Z [2024-04-03 02:31:02,440: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:31:02.442405387Z [2024-04-03 02:31:02,442: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:31:02.442550711Z [2024-04-03 02:31:02,442: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:31:02.442853035Z [2024-04-03 02:31:02,442: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:31:02.443008418Z [2024-04-03 02:31:02,442: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:31:02.443350710Z [2024-04-03 02:31:02,443: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:31:02.443473560Z [2024-04-03 02:31:02,443: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:31:02.490831777Z [2024-04-03 02:31:02,490: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:31:02.494988635Z [2024-04-03 02:31:02,494: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:31:02.540013264Z [2024-04-03 02:31:02,539: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:31:02.541204285Z [2024-04-03 02:31:02,540: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:31:02.541516778Z [2024-04-03 02:31:02,541: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:31:02.541725293Z [2024-04-03 02:31:02,541: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:31:02.541912290Z [2024-04-03 02:31:02,541: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:31:02.542235807Z [2024-04-03 02:31:02,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:31:02.542339991Z [2024-04-03 02:31:02,542: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:31:02.565754968Z [2024-04-03 02:31:02,565: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:31:02.630020681Z [2024-04-03 02:31:02,629: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:31:04.146109693Z [2024-04-03 02:31:04,145: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7259691-448c-4d6b-a604-19a5a4bffbc4] succeeded in 3.253423935999308s: None 2024-04-03T02:31:04.557184652Z [2024-04-03 02:31:04,556: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7982616f-baf5-4d47-a797-57e18d2f7116] succeeded in 3.658599408000555s: None 2024-04-03T02:32:00.646356563Z [2024-04-03 02:32:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41d2132b-32f3-4968-98d2-b85784e55094] received 2024-04-03T02:32:00.651308476Z [2024-04-03 02:32:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db257064-a897-4f31-9050-64998dfd0144] received 2024-04-03T02:32:00.666058888Z [2024-04-03 02:32:00,665: INFO/ForkPoolWorker-15] [41d2132b-32f3-4968-98d2-b85784e55094] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:32:00.668627615Z [2024-04-03 02:32:00,668: INFO/ForkPoolWorker-16] [db257064-a897-4f31-9050-64998dfd0144] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:32:00.671913854Z [2024-04-03 02:32:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cc245ba-f7d4-4074-8782-9a152743a1f5] received 2024-04-03T02:32:00.695591689Z [2024-04-03 02:32:00,695: INFO/ForkPoolWorker-1] [4cc245ba-f7d4-4074-8782-9a152743a1f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:32:01.146016147Z [2024-04-03 02:32:01,141: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:32:01.214475319Z [2024-04-03 02:32:01,210: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:32:01.344658912Z [2024-04-03 02:32:01,330: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:32:01.562947664Z [2024-04-03 02:32:01,562: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:32:02.102866040Z [2024-04-03 02:32:02,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41d2132b-32f3-4968-98d2-b85784e55094] succeeded in 1.4505395719997978s: None 2024-04-03T02:32:02.463222072Z [2024-04-03 02:32:02,462: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:32:02.466619442Z [2024-04-03 02:32:02,466: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:32:02.509150506Z [2024-04-03 02:32:02,508: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:32:02.514992579Z [2024-04-03 02:32:02,514: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:32:02.515149250Z [2024-04-03 02:32:02,514: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:32:02.515434922Z [2024-04-03 02:32:02,515: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:32:02.515497886Z [2024-04-03 02:32:02,515: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:32:02.516040792Z [2024-04-03 02:32:02,515: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:32:02.516202516Z [2024-04-03 02:32:02,515: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:32:02.618159220Z [2024-04-03 02:32:02,617: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:32:02.680290245Z [2024-04-03 02:32:02,679: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:32:02.683796259Z [2024-04-03 02:32:02,683: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:32:02.721489174Z [2024-04-03 02:32:02,721: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:32:02.722807712Z [2024-04-03 02:32:02,722: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:32:02.723041780Z [2024-04-03 02:32:02,722: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:32:02.723173072Z [2024-04-03 02:32:02,723: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:32:02.723260595Z [2024-04-03 02:32:02,723: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:32:02.723509232Z [2024-04-03 02:32:02,723: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:32:02.723605409Z [2024-04-03 02:32:02,723: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:32:02.852368190Z [2024-04-03 02:32:02,851: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:32:04.865633005Z [2024-04-03 02:32:04,864: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db257064-a897-4f31-9050-64998dfd0144] succeeded in 4.2091873770004895s: None 2024-04-03T02:32:05.704930450Z [2024-04-03 02:32:05,704: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4cc245ba-f7d4-4074-8782-9a152743a1f5] succeeded in 5.025963615999899s: None 2024-04-03T02:33:01.134962716Z [2024-04-03 02:33:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1139cc2e-bfc5-4da3-9539-91c8b6923f3b] received 2024-04-03T02:33:01.144485769Z [2024-04-03 02:33:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7d5baf3-649e-4ed5-9171-eff774515669] received 2024-04-03T02:33:01.167359027Z [2024-04-03 02:33:01,166: INFO/ForkPoolWorker-15] [1139cc2e-bfc5-4da3-9539-91c8b6923f3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:33:01.169866545Z [2024-04-03 02:33:01,169: INFO/ForkPoolWorker-16] [d7d5baf3-649e-4ed5-9171-eff774515669] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:33:01.570938458Z [2024-04-03 02:33:01,567: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:33:01.590819316Z [2024-04-03 02:33:01,586: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:33:02.727357031Z [2024-04-03 02:33:02,726: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:33:02.730867497Z [2024-04-03 02:33:02,730: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:33:02.760077528Z [2024-04-03 02:33:02,759: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:33:02.761931116Z [2024-04-03 02:33:02,761: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:33:02.763730707Z [2024-04-03 02:33:02,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:33:02.772770084Z [2024-04-03 02:33:02,772: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:33:02.772788742Z [2024-04-03 02:33:02,772: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:33:02.772930854Z [2024-04-03 02:33:02,772: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:33:02.772970463Z [2024-04-03 02:33:02,772: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:33:02.777851995Z [2024-04-03 02:33:02,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:33:02.777868863Z [2024-04-03 02:33:02,777: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:33:02.834216250Z [2024-04-03 02:33:02,833: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:33:02.838208474Z [2024-04-03 02:33:02,837: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:33:02.843021617Z [2024-04-03 02:33:02,842: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:33:02.843270492Z [2024-04-03 02:33:02,843: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:33:02.843395042Z [2024-04-03 02:33:02,843: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:33:02.843746050Z [2024-04-03 02:33:02,843: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:33:02.843869948Z [2024-04-03 02:33:02,843: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:33:02.934618069Z [2024-04-03 02:33:02,934: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:33:02.979827590Z [2024-04-03 02:33:02,979: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:33:04.630220747Z [2024-04-03 02:33:04,629: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d7d5baf3-649e-4ed5-9171-eff774515669] succeeded in 3.4788571199997023s: None 2024-04-03T02:33:04.856729026Z [2024-04-03 02:33:04,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1139cc2e-bfc5-4da3-9539-91c8b6923f3b] succeeded in 3.7175820820002627s: None 2024-04-03T02:34:01.035782421Z [2024-04-03 02:34:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[908b737f-265a-4e25-adc8-b4ea87d98887] received 2024-04-03T02:34:01.043343925Z [2024-04-03 02:34:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6038d89a-94cf-4edc-a3f4-8b19c80fad92] received 2024-04-03T02:34:01.049525920Z [2024-04-03 02:34:01,049: INFO/ForkPoolWorker-15] [908b737f-265a-4e25-adc8-b4ea87d98887] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:34:01.054812410Z [2024-04-03 02:34:01,054: INFO/ForkPoolWorker-16] [6038d89a-94cf-4edc-a3f4-8b19c80fad92] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:34:01.069807313Z [2024-04-03 02:34:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[126db79b-4929-47a5-9820-ff178cabd8d4] received 2024-04-03T02:34:01.108318681Z [2024-04-03 02:34:01,107: INFO/ForkPoolWorker-1] [126db79b-4929-47a5-9820-ff178cabd8d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:34:01.502764109Z [2024-04-03 02:34:01,498: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:34:01.639304759Z [2024-04-03 02:34:01,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:34:01.707700290Z [2024-04-03 02:34:01,702: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:34:01.773632897Z [2024-04-03 02:34:01,773: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:34:02.295119917Z [2024-04-03 02:34:02,294: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6038d89a-94cf-4edc-a3f4-8b19c80fad92] succeeded in 1.2496468869994715s: None 2024-04-03T02:34:02.943378233Z [2024-04-03 02:34:02,942: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:34:02.948985308Z [2024-04-03 02:34:02,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:34:02.988163984Z [2024-04-03 02:34:02,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:34:02.989367927Z [2024-04-03 02:34:02,989: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:34:02.989421623Z [2024-04-03 02:34:02,989: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:34:02.989602465Z [2024-04-03 02:34:02,989: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:34:02.989657446Z [2024-04-03 02:34:02,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:34:02.989912643Z [2024-04-03 02:34:02,989: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:34:02.990155026Z [2024-04-03 02:34:02,990: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:34:03.103240630Z [2024-04-03 02:34:03,102: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:34:03.187587656Z [2024-04-03 02:34:03,187: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:34:03.191630506Z [2024-04-03 02:34:03,191: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:34:03.241625147Z [2024-04-03 02:34:03,241: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:34:03.243046972Z [2024-04-03 02:34:03,242: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:34:03.243106884Z [2024-04-03 02:34:03,242: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:34:03.243379228Z [2024-04-03 02:34:03,243: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:34:03.243538875Z [2024-04-03 02:34:03,243: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:34:03.244251827Z [2024-04-03 02:34:03,244: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:34:03.244370771Z [2024-04-03 02:34:03,244: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:34:03.369463470Z [2024-04-03 02:34:03,369: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:34:05.800148870Z [2024-04-03 02:34:05,799: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[126db79b-4929-47a5-9820-ff178cabd8d4] succeeded in 4.721151759999884s: None 2024-04-03T02:34:06.077911024Z [2024-04-03 02:34:06,077: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[908b737f-265a-4e25-adc8-b4ea87d98887] succeeded in 5.039463338000132s: None 2024-04-03T02:35:00.970933305Z [2024-04-03 02:35:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eda3499f-0748-44d6-840d-c4e719a8b5a9] received 2024-04-03T02:35:00.977524209Z [2024-04-03 02:35:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30454038-d9c5-454f-b5c5-db8d5ab9d4da] received 2024-04-03T02:35:00.990308752Z [2024-04-03 02:35:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4a95411-b38e-4b81-b7f2-be7d1ae8cece] received 2024-04-03T02:35:00.993241324Z [2024-04-03 02:35:00,992: INFO/ForkPoolWorker-15] [eda3499f-0748-44d6-840d-c4e719a8b5a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:35:00.998044315Z [2024-04-03 02:35:00,997: INFO/ForkPoolWorker-1] [e4a95411-b38e-4b81-b7f2-be7d1ae8cece] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:35:01.009712169Z [2024-04-03 02:35:01,009: INFO/ForkPoolWorker-16] [30454038-d9c5-454f-b5c5-db8d5ab9d4da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:35:01.385643398Z [2024-04-03 02:35:01,381: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:35:01.432991688Z [2024-04-03 02:35:01,425: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:35:01.692014303Z [2024-04-03 02:35:01,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:35:02.706243924Z [2024-04-03 02:35:02,705: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:35:02.709484393Z [2024-04-03 02:35:02,709: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:35:02.736994912Z [2024-04-03 02:35:02,736: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:35:02.742198356Z [2024-04-03 02:35:02,741: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:35:02.742218322Z [2024-04-03 02:35:02,742: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:35:02.742295084Z [2024-04-03 02:35:02,742: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:35:02.742346069Z [2024-04-03 02:35:02,742: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:35:02.742571819Z [2024-04-03 02:35:02,742: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:35:02.742617939Z [2024-04-03 02:35:02,742: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:35:02.861180249Z [2024-04-03 02:35:02,860: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:35:02.884715963Z [2024-04-03 02:35:02,884: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:35:02.890202426Z [2024-04-03 02:35:02,889: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:35:02.963135203Z [2024-04-03 02:35:02,962: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:35:02.971735406Z [2024-04-03 02:35:02,971: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:35:02.971756590Z [2024-04-03 02:35:02,971: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:35:02.971825481Z [2024-04-03 02:35:02,971: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:35:02.971868045Z [2024-04-03 02:35:02,971: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:35:02.972143651Z [2024-04-03 02:35:02,971: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:35:02.972190719Z [2024-04-03 02:35:02,972: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:35:03.021061112Z [2024-04-03 02:35:03,020: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:35:03.026719145Z [2024-04-03 02:35:03,026: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:35:03.092348375Z [2024-04-03 02:35:03,092: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:35:03.093781851Z [2024-04-03 02:35:03,093: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:35:03.094303990Z [2024-04-03 02:35:03,094: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:35:03.100394186Z [2024-04-03 02:35:03,100: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:35:03.100632790Z [2024-04-03 02:35:03,100: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:35:03.101120838Z [2024-04-03 02:35:03,100: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:35:03.101309526Z [2024-04-03 02:35:03,101: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:35:03.111869328Z [2024-04-03 02:35:03,111: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:35:03.269220003Z [2024-04-03 02:35:03,268: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:35:03.707546472Z [2024-04-03 02:35:03,707: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eda3499f-0748-44d6-840d-c4e719a8b5a9] succeeded in 2.7333880340001997s: None 2024-04-03T02:35:03.717624830Z [2024-04-03 02:35:03,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddfba728-a618-4e46-b691-30d405a5c34c] received 2024-04-03T02:35:03.728614817Z [2024-04-03 02:35:03,728: INFO/ForkPoolWorker-15] [ddfba728-a618-4e46-b691-30d405a5c34c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:35:04.181321801Z [2024-04-03 02:35:04,178: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:35:05.329418206Z [2024-04-03 02:35:05,329: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:35:05.332614501Z [2024-04-03 02:35:05,332: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:35:05.353997890Z [2024-04-03 02:35:05,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:35:05.355818118Z [2024-04-03 02:35:05,355: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:35:05.355834598Z [2024-04-03 02:35:05,355: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:35:05.362261521Z [2024-04-03 02:35:05,355: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:35:05.362716057Z [2024-04-03 02:35:05,362: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:35:05.362895113Z [2024-04-03 02:35:05,362: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:35:05.362929397Z [2024-04-03 02:35:05,362: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:35:05.433465468Z [2024-04-03 02:35:05,433: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:35:05.514254622Z [2024-04-03 02:35:05,513: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30454038-d9c5-454f-b5c5-db8d5ab9d4da] succeeded in 4.528387518000272s: None 2024-04-03T02:35:05.687817249Z [2024-04-03 02:35:05,687: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4a95411-b38e-4b81-b7f2-be7d1ae8cece] succeeded in 4.694685762000518s: None 2024-04-03T02:35:05.944781325Z [2024-04-03 02:35:05,944: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ddfba728-a618-4e46-b691-30d405a5c34c] succeeded in 2.2257238239999424s: None 2024-04-03T02:35:06.692617953Z [2024-04-03 02:35:06,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2421d86-0a5a-41a6-b3f7-d3a431774672] received 2024-04-03T02:35:06.698646426Z [2024-04-03 02:35:06,698: INFO/ForkPoolWorker-15] [a2421d86-0a5a-41a6-b3f7-d3a431774672] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:35:06.978911819Z [2024-04-03 02:35:06,975: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:35:08.131345579Z [2024-04-03 02:35:08,130: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:35:08.134688537Z [2024-04-03 02:35:08,134: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:35:08.161579188Z [2024-04-03 02:35:08,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:35:08.163138209Z [2024-04-03 02:35:08,162: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:35:08.163205985Z [2024-04-03 02:35:08,163: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:35:08.163409099Z [2024-04-03 02:35:08,163: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:35:08.163486576Z [2024-04-03 02:35:08,163: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:35:08.163778144Z [2024-04-03 02:35:08,163: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:35:08.163859524Z [2024-04-03 02:35:08,163: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:35:08.241436129Z [2024-04-03 02:35:08,241: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:35:08.840461345Z [2024-04-03 02:35:08,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2421d86-0a5a-41a6-b3f7-d3a431774672] succeeded in 2.146175566999773s: None 2024-04-03T02:35:08.964138155Z [2024-04-03 02:35:08,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a4d0a5e-f2b8-4072-a104-6235b34e76ac] received 2024-04-03T02:35:08.970727384Z [2024-04-03 02:35:08,970: INFO/ForkPoolWorker-15] [6a4d0a5e-f2b8-4072-a104-6235b34e76ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:35:09.257936444Z [2024-04-03 02:35:09,254: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:35:10.489756057Z [2024-04-03 02:35:10,489: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:35:10.493279196Z [2024-04-03 02:35:10,492: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:35:10.516813479Z [2024-04-03 02:35:10,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:35:10.517972694Z [2024-04-03 02:35:10,517: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:35:10.518080297Z [2024-04-03 02:35:10,517: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:35:10.518221308Z [2024-04-03 02:35:10,518: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:35:10.518304017Z [2024-04-03 02:35:10,518: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:35:10.518533083Z [2024-04-03 02:35:10,518: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:35:10.518722398Z [2024-04-03 02:35:10,518: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:35:10.597004618Z [2024-04-03 02:35:10,596: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:35:11.114640547Z [2024-04-03 02:35:11,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a4d0a5e-f2b8-4072-a104-6235b34e76ac] succeeded in 2.147895815999618s: None 2024-04-03T02:36:01.106890792Z [2024-04-03 02:36:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61571c3a-977b-40ad-b5eb-466853429228] received 2024-04-03T02:36:01.113506684Z [2024-04-03 02:36:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b412e2c-cc4f-4b7d-9140-1ddaa288b460] received 2024-04-03T02:36:01.123117148Z [2024-04-03 02:36:01,122: INFO/ForkPoolWorker-15] [61571c3a-977b-40ad-b5eb-466853429228] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:36:01.124099124Z [2024-04-03 02:36:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a41d2c94-9e45-4eda-b1a8-8728f5bba8e2] received 2024-04-03T02:36:01.142652113Z [2024-04-03 02:36:01,141: INFO/ForkPoolWorker-1] [a41d2c94-9e45-4eda-b1a8-8728f5bba8e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:36:01.143752830Z [2024-04-03 02:36:01,143: INFO/ForkPoolWorker-16] [9b412e2c-cc4f-4b7d-9140-1ddaa288b460] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:36:01.688561221Z [2024-04-03 02:36:01,673: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:36:01.878857897Z [2024-04-03 02:36:01,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:36:01.923420060Z [2024-04-03 02:36:01,900: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:36:02.261901189Z [2024-04-03 02:36:02,261: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:36:02.806847976Z [2024-04-03 02:36:02,801: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a41d2c94-9e45-4eda-b1a8-8728f5bba8e2] succeeded in 1.6751799479998226s: None 2024-04-03T02:36:03.268234339Z [2024-04-03 02:36:03,267: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:36:03.271754388Z [2024-04-03 02:36:03,271: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:36:03.273992759Z [2024-04-03 02:36:03,273: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:36:03.278008395Z [2024-04-03 02:36:03,277: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:36:03.320808999Z [2024-04-03 02:36:03,320: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:36:03.322458557Z [2024-04-03 02:36:03,322: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:36:03.323937462Z [2024-04-03 02:36:03,323: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:36:03.323971291Z [2024-04-03 02:36:03,323: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:36:03.324100523Z [2024-04-03 02:36:03,323: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:36:03.324227756Z [2024-04-03 02:36:03,323: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:36:03.324351612Z [2024-04-03 02:36:03,324: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:36:03.324407151Z [2024-04-03 02:36:03,324: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:36:03.324485276Z [2024-04-03 02:36:03,324: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:36:03.324570939Z [2024-04-03 02:36:03,324: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:36:03.324808842Z [2024-04-03 02:36:03,324: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:36:03.325084411Z [2024-04-03 02:36:03,324: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:36:03.325258677Z [2024-04-03 02:36:03,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:36:03.325459652Z [2024-04-03 02:36:03,325: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:36:03.408536998Z [2024-04-03 02:36:03,408: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:36:03.429574779Z [2024-04-03 02:36:03,429: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:36:05.507408366Z [2024-04-03 02:36:05,506: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61571c3a-977b-40ad-b5eb-466853429228] succeeded in 4.396081764999508s: None 2024-04-03T02:36:05.765202768Z [2024-04-03 02:36:05,764: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b412e2c-cc4f-4b7d-9140-1ddaa288b460] succeeded in 4.647267778999776s: None 2024-04-03T02:37:00.656034667Z [2024-04-03 02:37:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc79e9f0-5133-4b37-9c90-ff6130c2d54a] received 2024-04-03T02:37:00.674568488Z [2024-04-03 02:37:00,673: INFO/ForkPoolWorker-15] [fc79e9f0-5133-4b37-9c90-ff6130c2d54a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:37:00.701368314Z [2024-04-03 02:37:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59b90639-ccb5-452a-b3b4-8ef01614fc56] received 2024-04-03T02:37:00.716972054Z [2024-04-03 02:37:00,716: INFO/ForkPoolWorker-16] [59b90639-ccb5-452a-b3b4-8ef01614fc56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:37:01.098813163Z [2024-04-03 02:37:01,093: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:37:01.205358188Z [2024-04-03 02:37:01,201: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:37:02.480208085Z [2024-04-03 02:37:02,479: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:37:02.483586684Z [2024-04-03 02:37:02,483: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:37:02.512293414Z [2024-04-03 02:37:02,512: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:37:02.513712977Z [2024-04-03 02:37:02,513: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:37:02.513740548Z [2024-04-03 02:37:02,513: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:37:02.513880900Z [2024-04-03 02:37:02,513: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:37:02.513909543Z [2024-04-03 02:37:02,513: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:37:02.514453556Z [2024-04-03 02:37:02,514: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:37:02.514484251Z [2024-04-03 02:37:02,514: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:37:02.596765175Z [2024-04-03 02:37:02,596: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:37:02.681969930Z [2024-04-03 02:37:02,681: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:37:02.686550151Z [2024-04-03 02:37:02,686: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:37:02.707769180Z [2024-04-03 02:37:02,707: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:37:02.708815452Z [2024-04-03 02:37:02,708: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:37:02.708848171Z [2024-04-03 02:37:02,708: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:37:02.708999983Z [2024-04-03 02:37:02,708: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:37:02.709016354Z [2024-04-03 02:37:02,708: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:37:02.709246922Z [2024-04-03 02:37:02,709: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:37:02.709252759Z [2024-04-03 02:37:02,709: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:37:02.803967153Z [2024-04-03 02:37:02,803: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:37:04.273518035Z [2024-04-03 02:37:04,272: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59b90639-ccb5-452a-b3b4-8ef01614fc56] succeeded in 3.5696606439996685s: None 2024-04-03T02:37:04.533404299Z [2024-04-03 02:37:04,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc79e9f0-5133-4b37-9c90-ff6130c2d54a] succeeded in 3.87387771900012s: None 2024-04-03T02:38:01.100759569Z [2024-04-03 02:38:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d96765c9-9c7b-4f2b-a585-5d2b13fdc6e6] received 2024-04-03T02:38:01.122320560Z [2024-04-03 02:38:01,121: INFO/ForkPoolWorker-15] [d96765c9-9c7b-4f2b-a585-5d2b13fdc6e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:38:01.127372327Z [2024-04-03 02:38:01,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[411d3d91-5833-485a-9940-cc2f7afef6ca] received 2024-04-03T02:38:01.142329956Z [2024-04-03 02:38:01,141: INFO/ForkPoolWorker-16] [411d3d91-5833-485a-9940-cc2f7afef6ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:38:01.147775422Z [2024-04-03 02:38:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97c423e6-6433-468a-985e-0e4f9ca18df7] received 2024-04-03T02:38:01.181460911Z [2024-04-03 02:38:01,180: INFO/ForkPoolWorker-1] [97c423e6-6433-468a-985e-0e4f9ca18df7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:38:01.478828337Z [2024-04-03 02:38:01,474: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:38:01.633697815Z [2024-04-03 02:38:01,625: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:38:01.645730493Z [2024-04-03 02:38:01,641: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:38:01.939288006Z [2024-04-03 02:38:01,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:38:02.564410922Z [2024-04-03 02:38:02,563: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d96765c9-9c7b-4f2b-a585-5d2b13fdc6e6] succeeded in 1.4584807100000035s: None 2024-04-03T02:38:02.789564166Z [2024-04-03 02:38:02,788: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:38:02.795203729Z [2024-04-03 02:38:02,792: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:38:02.868397297Z [2024-04-03 02:38:02,868: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:38:02.875261711Z [2024-04-03 02:38:02,874: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:38:02.878431188Z [2024-04-03 02:38:02,878: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:38:02.878558146Z [2024-04-03 02:38:02,878: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:38:02.878727664Z [2024-04-03 02:38:02,878: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:38:02.879048606Z [2024-04-03 02:38:02,878: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:38:02.879137256Z [2024-04-03 02:38:02,879: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:38:02.945594616Z [2024-04-03 02:38:02,945: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:38:02.949132444Z [2024-04-03 02:38:02,948: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:38:02.989837698Z [2024-04-03 02:38:02,989: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:38:03.000403625Z [2024-04-03 02:38:03,000: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:38:03.000434411Z [2024-04-03 02:38:03,000: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:38:03.000522437Z [2024-04-03 02:38:03,000: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:38:03.000533178Z [2024-04-03 02:38:03,000: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:38:03.000802571Z [2024-04-03 02:38:03,000: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:38:03.000814947Z [2024-04-03 02:38:03,000: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:38:03.025411364Z [2024-04-03 02:38:03,025: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:38:03.115592225Z [2024-04-03 02:38:03,115: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:38:05.123179442Z [2024-04-03 02:38:05,122: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[411d3d91-5833-485a-9940-cc2f7afef6ca] succeeded in 3.9906323710001743s: None 2024-04-03T02:38:05.443687111Z [2024-04-03 02:38:05,443: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[97c423e6-6433-468a-985e-0e4f9ca18df7] succeeded in 4.290104252999299s: None 2024-04-03T02:39:01.029061227Z [2024-04-03 02:39:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc0a0e49-3b45-4126-b86b-25c11f8f4365] received 2024-04-03T02:39:01.031665481Z [2024-04-03 02:39:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5f0d4ea-a9aa-4cd2-9101-16b024edb494] received 2024-04-03T02:39:01.053517596Z [2024-04-03 02:39:01,053: INFO/ForkPoolWorker-15] [bc0a0e49-3b45-4126-b86b-25c11f8f4365] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:39:01.053734962Z [2024-04-03 02:39:01,053: INFO/ForkPoolWorker-16] [e5f0d4ea-a9aa-4cd2-9101-16b024edb494] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:39:01.475707469Z [2024-04-03 02:39:01,471: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:39:01.515122726Z [2024-04-03 02:39:01,510: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:39:02.918751083Z [2024-04-03 02:39:02,918: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:39:02.922508783Z [2024-04-03 02:39:02,922: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:39:02.972113797Z [2024-04-03 02:39:02,970: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:39:02.975223486Z [2024-04-03 02:39:02,974: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:39:02.975737279Z [2024-04-03 02:39:02,975: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:39:02.975930984Z [2024-04-03 02:39:02,975: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:39:02.976027054Z [2024-04-03 02:39:02,975: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:39:02.976401409Z [2024-04-03 02:39:02,976: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:39:02.976542199Z [2024-04-03 02:39:02,976: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:39:03.037540648Z [2024-04-03 02:39:03,037: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:39:03.041867919Z [2024-04-03 02:39:03,041: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:39:03.084995947Z [2024-04-03 02:39:03,084: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:39:03.089786635Z [2024-04-03 02:39:03,089: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:39:03.089974586Z [2024-04-03 02:39:03,089: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:39:03.090432919Z [2024-04-03 02:39:03,090: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:39:03.090564529Z [2024-04-03 02:39:03,090: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:39:03.090954703Z [2024-04-03 02:39:03,090: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:39:03.091107082Z [2024-04-03 02:39:03,090: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:39:03.114188880Z [2024-04-03 02:39:03,113: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:39:03.277984093Z [2024-04-03 02:39:03,277: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:39:05.126103969Z [2024-04-03 02:39:05,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc0a0e49-3b45-4126-b86b-25c11f8f4365] succeeded in 4.093876198000544s: None 2024-04-03T02:39:05.493800341Z [2024-04-03 02:39:05,492: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5f0d4ea-a9aa-4cd2-9101-16b024edb494] succeeded in 4.456891416999497s: None 2024-04-03T02:40:01.006114405Z [2024-04-03 02:40:01,004: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff4f93b5-2d2f-46c5-81f8-2a0b5a0565f8] received 2024-04-03T02:40:01.021064294Z [2024-04-03 02:40:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9048892b-6ce8-450d-ba93-6f1c9cd5a4ef] received 2024-04-03T02:40:01.042350150Z [2024-04-03 02:40:01,041: INFO/ForkPoolWorker-15] [ff4f93b5-2d2f-46c5-81f8-2a0b5a0565f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:40:01.047755469Z [2024-04-03 02:40:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e5513d7-46e7-4162-8133-0da5bec554c0] received 2024-04-03T02:40:01.048177347Z [2024-04-03 02:40:01,047: INFO/ForkPoolWorker-16] [9048892b-6ce8-450d-ba93-6f1c9cd5a4ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:40:01.053015035Z [2024-04-03 02:40:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74491bdf-4971-4944-b7c2-07e2c903d7b5] received 2024-04-03T02:40:01.076808794Z [2024-04-03 02:40:01,076: INFO/ForkPoolWorker-2] [74491bdf-4971-4944-b7c2-07e2c903d7b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:40:01.090868042Z [2024-04-03 02:40:01,084: INFO/ForkPoolWorker-1] [2e5513d7-46e7-4162-8133-0da5bec554c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:40:01.651700828Z [2024-04-03 02:40:01,638: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:40:01.821604787Z [2024-04-03 02:40:01,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:40:01.940991960Z [2024-04-03 02:40:01,936: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:40:02.009653133Z [2024-04-03 02:40:02,004: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:40:02.069778529Z [2024-04-03 02:40:02,069: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:40:02.686710412Z [2024-04-03 02:40:02,686: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9048892b-6ce8-450d-ba93-6f1c9cd5a4ef] succeeded in 1.6604599980000785s: None 2024-04-03T02:40:03.622624248Z [2024-04-03 02:40:03,622: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T02:40:03.627711774Z [2024-04-03 02:40:03,626: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:40:03.649566550Z [2024-04-03 02:40:03,649: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:40:03.653731730Z [2024-04-03 02:40:03,653: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:40:03.703954904Z [2024-04-03 02:40:03,703: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T02:40:03.706997240Z [2024-04-03 02:40:03,706: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:40:03.710390099Z [2024-04-03 02:40:03,710: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:40:03.710694231Z [2024-04-03 02:40:03,710: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:40:03.710963507Z [2024-04-03 02:40:03,710: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T02:40:03.712106900Z [2024-04-03 02:40:03,711: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:40:03.713399849Z [2024-04-03 02:40:03,713: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:40:03.760501758Z [2024-04-03 02:40:03,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:40:03.767315332Z [2024-04-03 02:40:03,767: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:40:03.767351699Z [2024-04-03 02:40:03,767: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:40:03.767548938Z [2024-04-03 02:40:03,767: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:40:03.767613577Z [2024-04-03 02:40:03,767: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:40:03.767983984Z [2024-04-03 02:40:03,767: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:40:03.768106005Z [2024-04-03 02:40:03,767: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:40:03.852923345Z [2024-04-03 02:40:03,852: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:40:03.873086204Z [2024-04-03 02:40:03,872: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:40:03.930250521Z [2024-04-03 02:40:03,929: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:40:03.934488226Z [2024-04-03 02:40:03,934: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:40:03.981047696Z [2024-04-03 02:40:03,980: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:40:03.983356180Z [2024-04-03 02:40:03,983: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:40:03.983370857Z [2024-04-03 02:40:03,983: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:40:03.983555146Z [2024-04-03 02:40:03,983: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:40:03.983599951Z [2024-04-03 02:40:03,983: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:40:03.983888859Z [2024-04-03 02:40:03,983: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:40:03.983951881Z [2024-04-03 02:40:03,983: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:40:04.134716153Z [2024-04-03 02:40:04,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:40:04.930768192Z [2024-04-03 02:40:04,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e779488e-0407-4439-8760-b711b472b52b] received 2024-04-03T02:40:04.937149376Z [2024-04-03 02:40:04,936: INFO/ForkPoolWorker-16] [e779488e-0407-4439-8760-b711b472b52b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:40:04.986132255Z [2024-04-03 02:40:04,985: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff4f93b5-2d2f-46c5-81f8-2a0b5a0565f8] succeeded in 3.955824226999539s: None 2024-04-03T02:40:05.270840018Z [2024-04-03 02:40:05,267: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:40:05.843121804Z [2024-04-03 02:40:05,842: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[74491bdf-4971-4944-b7c2-07e2c903d7b5] succeeded in 4.784968724999999s: None 2024-04-03T02:40:06.220060133Z [2024-04-03 02:40:06,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e5513d7-46e7-4162-8133-0da5bec554c0] succeeded in 5.160151332000169s: None 2024-04-03T02:40:06.727656552Z [2024-04-03 02:40:06,727: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:40:06.733861361Z [2024-04-03 02:40:06,733: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:40:06.788538676Z [2024-04-03 02:40:06,788: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:40:06.789750159Z [2024-04-03 02:40:06,789: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:40:06.789812862Z [2024-04-03 02:40:06,789: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:40:06.790002624Z [2024-04-03 02:40:06,789: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:40:06.790085368Z [2024-04-03 02:40:06,789: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:40:06.790378142Z [2024-04-03 02:40:06,790: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:40:06.790453304Z [2024-04-03 02:40:06,790: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:40:06.863130943Z [2024-04-03 02:40:06,862: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:40:07.525475890Z [2024-04-03 02:40:07,524: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e779488e-0407-4439-8760-b711b472b52b] succeeded in 2.592823947999932s: None 2024-04-03T02:40:08.549763562Z [2024-04-03 02:40:08,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74a3f691-12f5-4d13-b30b-da770d77a088] received 2024-04-03T02:40:08.559739694Z [2024-04-03 02:40:08,559: INFO/ForkPoolWorker-15] [74a3f691-12f5-4d13-b30b-da770d77a088] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:40:08.844120941Z [2024-04-03 02:40:08,840: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:40:10.222888491Z [2024-04-03 02:40:10,222: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:40:10.232914656Z [2024-04-03 02:40:10,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:40:10.252360198Z [2024-04-03 02:40:10,252: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:40:10.254132498Z [2024-04-03 02:40:10,253: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:40:10.254183603Z [2024-04-03 02:40:10,254: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:40:10.254286765Z [2024-04-03 02:40:10,254: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:40:10.254326033Z [2024-04-03 02:40:10,254: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:40:10.254818064Z [2024-04-03 02:40:10,254: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:40:10.254900930Z [2024-04-03 02:40:10,254: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:40:10.348977114Z [2024-04-03 02:40:10,348: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:40:11.016066281Z [2024-04-03 02:40:11,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74a3f691-12f5-4d13-b30b-da770d77a088] succeeded in 2.46414348899998s: None 2024-04-03T02:40:11.381214556Z [2024-04-03 02:40:11,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e50cdab-c358-4740-b555-4b0317816564] received 2024-04-03T02:40:11.390807250Z [2024-04-03 02:40:11,390: INFO/ForkPoolWorker-15] [4e50cdab-c358-4740-b555-4b0317816564] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:40:11.730645812Z [2024-04-03 02:40:11,727: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:40:12.966456768Z [2024-04-03 02:40:12,966: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:40:12.970039242Z [2024-04-03 02:40:12,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:40:13.054948035Z [2024-04-03 02:40:13,054: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:40:13.056410234Z [2024-04-03 02:40:13,056: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:40:13.056555929Z [2024-04-03 02:40:13,056: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:40:13.056771577Z [2024-04-03 02:40:13,056: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:40:13.056872306Z [2024-04-03 02:40:13,056: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:40:13.057197961Z [2024-04-03 02:40:13,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:40:13.057714066Z [2024-04-03 02:40:13,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:40:13.155129120Z [2024-04-03 02:40:13,154: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:40:13.763549097Z [2024-04-03 02:40:13,760: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e50cdab-c358-4740-b555-4b0317816564] succeeded in 2.377607974000057s: None 2024-04-03T02:41:00.968164071Z [2024-04-03 02:41:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e87dfd63-4e94-4cea-bf0c-14224c34eace] received 2024-04-03T02:41:00.971919917Z [2024-04-03 02:41:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[116a69cb-55ad-4f57-a5f3-7a44e5b71d6b] received 2024-04-03T02:41:00.986367754Z [2024-04-03 02:41:00,985: INFO/ForkPoolWorker-15] [e87dfd63-4e94-4cea-bf0c-14224c34eace] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:41:00.994717850Z [2024-04-03 02:41:00,994: INFO/ForkPoolWorker-16] [116a69cb-55ad-4f57-a5f3-7a44e5b71d6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:41:01.457851068Z [2024-04-03 02:41:01,452: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:41:01.541233392Z [2024-04-03 02:41:01,536: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:41:02.743369466Z [2024-04-03 02:41:02,742: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:41:02.746793549Z [2024-04-03 02:41:02,746: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:41:02.847805061Z [2024-04-03 02:41:02,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:41:02.847820330Z [2024-04-03 02:41:02,847: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:41:02.847824219Z [2024-04-03 02:41:02,847: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:41:02.847840529Z [2024-04-03 02:41:02,847: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:41:02.847863300Z [2024-04-03 02:41:02,847: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:41:02.851952269Z [2024-04-03 02:41:02,848: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:41:02.851968636Z [2024-04-03 02:41:02,848: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:41:02.883444535Z [2024-04-03 02:41:02,882: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:41:02.889798983Z [2024-04-03 02:41:02,889: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:41:02.931159988Z [2024-04-03 02:41:02,930: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:41:02.932421887Z [2024-04-03 02:41:02,932: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:41:02.932877606Z [2024-04-03 02:41:02,932: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:41:02.933243440Z [2024-04-03 02:41:02,932: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:41:02.933440690Z [2024-04-03 02:41:02,933: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:41:02.933944366Z [2024-04-03 02:41:02,933: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:41:02.933990293Z [2024-04-03 02:41:02,933: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:41:02.965258824Z [2024-04-03 02:41:02,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:41:03.029735711Z [2024-04-03 02:41:03,029: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:41:05.254292089Z [2024-04-03 02:41:05,253: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e87dfd63-4e94-4cea-bf0c-14224c34eace] succeeded in 4.277519859000677s: None 2024-04-03T02:41:06.110090205Z [2024-04-03 02:41:06,109: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[116a69cb-55ad-4f57-a5f3-7a44e5b71d6b] succeeded in 5.1349328839996815s: None 2024-04-03T02:42:00.398861902Z [2024-04-03 02:42:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d19eccb7-1f43-4c81-98c6-670463a6e905] received 2024-04-03T02:42:00.409604753Z [2024-04-03 02:42:00,408: INFO/ForkPoolWorker-15] [d19eccb7-1f43-4c81-98c6-670463a6e905] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:42:00.422758468Z [2024-04-03 02:42:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9264280-b8f5-41ad-be1c-b2cd845d07f8] received 2024-04-03T02:42:00.438188940Z [2024-04-03 02:42:00,437: INFO/ForkPoolWorker-16] [c9264280-b8f5-41ad-be1c-b2cd845d07f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:42:00.444954469Z [2024-04-03 02:42:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f15e40-42cd-4f9b-b725-0547f765d9c0] received 2024-04-03T02:42:00.499006358Z [2024-04-03 02:42:00,494: INFO/ForkPoolWorker-1] [e0f15e40-42cd-4f9b-b725-0547f765d9c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:42:00.782678855Z [2024-04-03 02:42:00,766: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:42:00.950542071Z [2024-04-03 02:42:00,943: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:42:01.174853875Z [2024-04-03 02:42:01,166: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:42:01.273524455Z [2024-04-03 02:42:01,273: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:42:01.929647902Z [2024-04-03 02:42:01,929: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9264280-b8f5-41ad-be1c-b2cd845d07f8] succeeded in 1.504642648999834s: None 2024-04-03T02:42:02.502963254Z [2024-04-03 02:42:02,502: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:42:02.506425642Z [2024-04-03 02:42:02,506: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:42:02.545771226Z [2024-04-03 02:42:02,545: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:42:02.547380786Z [2024-04-03 02:42:02,547: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:42:02.547518413Z [2024-04-03 02:42:02,547: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:42:02.547739737Z [2024-04-03 02:42:02,547: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:42:02.547886680Z [2024-04-03 02:42:02,547: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:42:02.548258365Z [2024-04-03 02:42:02,548: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:42:02.548412263Z [2024-04-03 02:42:02,548: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:42:02.606772150Z [2024-04-03 02:42:02,606: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:42:02.611001964Z [2024-04-03 02:42:02,609: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:42:02.627023883Z [2024-04-03 02:42:02,626: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:42:02.639388266Z [2024-04-03 02:42:02,639: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:42:02.641967686Z [2024-04-03 02:42:02,641: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:42:02.642000655Z [2024-04-03 02:42:02,641: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:42:02.642177903Z [2024-04-03 02:42:02,641: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:42:02.642194136Z [2024-04-03 02:42:02,642: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:42:02.643353457Z [2024-04-03 02:42:02,643: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:42:02.643374919Z [2024-04-03 02:42:02,643: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:42:02.722964363Z [2024-04-03 02:42:02,722: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:42:04.182053519Z [2024-04-03 02:42:04,181: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0f15e40-42cd-4f9b-b725-0547f765d9c0] succeeded in 3.733404619999419s: None 2024-04-03T02:42:05.639919490Z [2024-04-03 02:42:05,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d19eccb7-1f43-4c81-98c6-670463a6e905] succeeded in 5.237943715999791s: None 2024-04-03T02:43:00.916228616Z [2024-04-03 02:43:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07097249-e566-4e61-bd3f-8a6a292f0561] received 2024-04-03T02:43:00.928237300Z [2024-04-03 02:43:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2acda556-8cfd-47a2-a721-27a5b4fcc0ef] received 2024-04-03T02:43:00.943849947Z [2024-04-03 02:43:00,943: INFO/ForkPoolWorker-15] [07097249-e566-4e61-bd3f-8a6a292f0561] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:43:00.949943443Z [2024-04-03 02:43:00,949: INFO/ForkPoolWorker-16] [2acda556-8cfd-47a2-a721-27a5b4fcc0ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:43:01.379827328Z [2024-04-03 02:43:01,372: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:43:01.523119591Z [2024-04-03 02:43:01,519: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:43:02.701246985Z [2024-04-03 02:43:02,700: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:43:02.704606752Z [2024-04-03 02:43:02,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:43:02.730809353Z [2024-04-03 02:43:02,730: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:43:02.731711951Z [2024-04-03 02:43:02,731: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:43:02.731726039Z [2024-04-03 02:43:02,731: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:43:02.731841158Z [2024-04-03 02:43:02,731: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:43:02.731849585Z [2024-04-03 02:43:02,731: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:43:02.732085240Z [2024-04-03 02:43:02,731: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:43:02.732095880Z [2024-04-03 02:43:02,732: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:43:02.763627918Z [2024-04-03 02:43:02,763: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:43:02.771185897Z [2024-04-03 02:43:02,766: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:43:02.854721047Z [2024-04-03 02:43:02,854: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:43:02.858160307Z [2024-04-03 02:43:02,857: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:43:02.859364392Z [2024-04-03 02:43:02,859: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:43:02.862880794Z [2024-04-03 02:43:02,859: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:43:02.863189406Z [2024-04-03 02:43:02,862: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:43:02.863382256Z [2024-04-03 02:43:02,863: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:43:02.863764559Z [2024-04-03 02:43:02,863: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:43:02.864407428Z [2024-04-03 02:43:02,864: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:43:02.958021790Z [2024-04-03 02:43:02,957: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:43:05.300261585Z [2024-04-03 02:43:05,299: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07097249-e566-4e61-bd3f-8a6a292f0561] succeeded in 4.381221052000001s: None 2024-04-03T02:43:05.823639117Z [2024-04-03 02:43:05,823: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2acda556-8cfd-47a2-a721-27a5b4fcc0ef] succeeded in 4.892124060000242s: None 2024-04-03T02:44:01.174475678Z [2024-04-03 02:44:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2daa20cc-ec1d-4361-93f0-d82bed71faa5] received 2024-04-03T02:44:01.198350222Z [2024-04-03 02:44:01,195: INFO/ForkPoolWorker-15] [2daa20cc-ec1d-4361-93f0-d82bed71faa5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:44:01.206086772Z [2024-04-03 02:44:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21a911fa-4c5c-4c5a-a4cd-7229b9191f73] received 2024-04-03T02:44:01.235263162Z [2024-04-03 02:44:01,234: INFO/ForkPoolWorker-16] [21a911fa-4c5c-4c5a-a4cd-7229b9191f73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:44:01.239508319Z [2024-04-03 02:44:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fdf63c3-0724-41d3-8a76-3421de48ff57] received 2024-04-03T02:44:01.280482450Z [2024-04-03 02:44:01,279: INFO/ForkPoolWorker-1] [8fdf63c3-0724-41d3-8a76-3421de48ff57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:44:01.687039791Z [2024-04-03 02:44:01,682: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:44:01.708156076Z [2024-04-03 02:44:01,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:44:01.724710409Z [2024-04-03 02:44:01,720: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:44:01.991950729Z [2024-04-03 02:44:01,991: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:44:02.548237655Z [2024-04-03 02:44:02,547: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8fdf63c3-0724-41d3-8a76-3421de48ff57] succeeded in 1.3032507899997654s: None 2024-04-03T02:44:03.122624043Z [2024-04-03 02:44:03,118: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:44:03.126133297Z [2024-04-03 02:44:03,125: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:44:03.228034037Z [2024-04-03 02:44:03,227: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:44:03.235212454Z [2024-04-03 02:44:03,234: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:44:03.235241186Z [2024-04-03 02:44:03,235: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:44:03.235258472Z [2024-04-03 02:44:03,235: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:44:03.235302829Z [2024-04-03 02:44:03,235: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:44:03.235550790Z [2024-04-03 02:44:03,235: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:44:03.235562737Z [2024-04-03 02:44:03,235: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:44:03.285850113Z [2024-04-03 02:44:03,285: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:44:03.290682323Z [2024-04-03 02:44:03,290: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:44:03.349185707Z [2024-04-03 02:44:03,348: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:44:03.351325591Z [2024-04-03 02:44:03,351: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:44:03.351426778Z [2024-04-03 02:44:03,351: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:44:03.351588510Z [2024-04-03 02:44:03,351: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:44:03.351675427Z [2024-04-03 02:44:03,351: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:44:03.351954092Z [2024-04-03 02:44:03,351: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:44:03.352060645Z [2024-04-03 02:44:03,351: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:44:03.428064079Z [2024-04-03 02:44:03,427: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:44:03.492105681Z [2024-04-03 02:44:03,491: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:44:06.004772251Z [2024-04-03 02:44:06,004: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2daa20cc-ec1d-4361-93f0-d82bed71faa5] succeeded in 4.824068470000384s: None 2024-04-03T02:44:06.304409094Z [2024-04-03 02:44:06,303: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21a911fa-4c5c-4c5a-a4cd-7229b9191f73] succeeded in 5.0940690629995515s: None 2024-04-03T02:45:00.555124872Z [2024-04-03 02:45:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41620cf5-20a5-47e3-aa05-808945f52b29] received 2024-04-03T02:45:00.560269847Z [2024-04-03 02:45:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82475bf8-dc70-4a41-9fc7-3d2e54663225] received 2024-04-03T02:45:00.568052610Z [2024-04-03 02:45:00,567: INFO/ForkPoolWorker-15] [41620cf5-20a5-47e3-aa05-808945f52b29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:45:00.570796190Z [2024-04-03 02:45:00,570: INFO/ForkPoolWorker-16] [82475bf8-dc70-4a41-9fc7-3d2e54663225] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:45:00.574419976Z [2024-04-03 02:45:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5446ab7-e77b-44f4-bfab-565289d69239] received 2024-04-03T02:45:00.674361193Z [2024-04-03 02:45:00,673: INFO/ForkPoolWorker-1] [e5446ab7-e77b-44f4-bfab-565289d69239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:45:00.971546172Z [2024-04-03 02:45:00,966: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:45:01.038888583Z [2024-04-03 02:45:01,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:45:01.271615688Z [2024-04-03 02:45:01,258: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:45:02.924714480Z [2024-04-03 02:45:02,924: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:45:02.931374108Z [2024-04-03 02:45:02,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:45:03.046880950Z [2024-04-03 02:45:03,046: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:45:03.053452350Z [2024-04-03 02:45:03,052: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:45:03.059942141Z [2024-04-03 02:45:03,059: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:45:03.066441937Z [2024-04-03 02:45:03,066: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:45:03.066974893Z [2024-04-03 02:45:03,066: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:45:03.067200332Z [2024-04-03 02:45:03,067: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:45:03.067321675Z [2024-04-03 02:45:03,067: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:45:03.067650734Z [2024-04-03 02:45:03,067: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:45:03.068352634Z [2024-04-03 02:45:03,067: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:45:03.107616428Z [2024-04-03 02:45:03,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:45:03.111567743Z [2024-04-03 02:45:03,111: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:45:03.111723031Z [2024-04-03 02:45:03,111: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:45:03.111990962Z [2024-04-03 02:45:03,111: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:45:03.116072828Z [2024-04-03 02:45:03,115: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:45:03.116393377Z [2024-04-03 02:45:03,116: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:45:03.116493317Z [2024-04-03 02:45:03,116: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:45:03.175990937Z [2024-04-03 02:45:03,175: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:45:03.308468146Z [2024-04-03 02:45:03,308: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:45:03.695134731Z [2024-04-03 02:45:03,693: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:45:03.709162154Z [2024-04-03 02:45:03,708: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:45:03.806983271Z [2024-04-03 02:45:03,805: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:45:03.810480480Z [2024-04-03 02:45:03,810: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:45:03.810532344Z [2024-04-03 02:45:03,810: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:45:03.810611440Z [2024-04-03 02:45:03,810: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:45:03.814728286Z [2024-04-03 02:45:03,810: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:45:03.822672710Z [2024-04-03 02:45:03,822: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:45:03.822729981Z [2024-04-03 02:45:03,822: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:45:03.953667475Z [2024-04-03 02:45:03,953: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:45:04.208577952Z [2024-04-03 02:45:04,208: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41620cf5-20a5-47e3-aa05-808945f52b29] succeeded in 3.6483905860004597s: None 2024-04-03T02:45:04.715894725Z [2024-04-03 02:45:04,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[600ba66b-f47c-4fcd-8ed5-12dfd808f95d] received 2024-04-03T02:45:04.723453638Z [2024-04-03 02:45:04,723: INFO/ForkPoolWorker-15] [600ba66b-f47c-4fcd-8ed5-12dfd808f95d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:45:05.024865046Z [2024-04-03 02:45:05,024: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[82475bf8-dc70-4a41-9fc7-3d2e54663225] succeeded in 4.461680673000046s: None 2024-04-03T02:45:05.082559776Z [2024-04-03 02:45:05,078: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:45:05.877534857Z [2024-04-03 02:45:05,876: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5446ab7-e77b-44f4-bfab-565289d69239] succeeded in 5.290206675999798s: None 2024-04-03T02:45:06.255290811Z [2024-04-03 02:45:06,254: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:45:06.258790633Z [2024-04-03 02:45:06,258: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:45:06.284826196Z [2024-04-03 02:45:06,284: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:45:06.286471779Z [2024-04-03 02:45:06,286: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:45:06.286521130Z [2024-04-03 02:45:06,286: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:45:06.286570780Z [2024-04-03 02:45:06,286: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:45:06.286692640Z [2024-04-03 02:45:06,286: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:45:06.287237165Z [2024-04-03 02:45:06,287: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:45:06.287249807Z [2024-04-03 02:45:06,287: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:45:06.388383486Z [2024-04-03 02:45:06,388: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:45:07.085617990Z [2024-04-03 02:45:07,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[600ba66b-f47c-4fcd-8ed5-12dfd808f95d] succeeded in 2.367460145000223s: None 2024-04-03T02:45:07.126533201Z [2024-04-03 02:45:07,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[508cb96d-912a-4a31-b9b2-aaaf72d851af] received 2024-04-03T02:45:07.133536393Z [2024-04-03 02:45:07,133: INFO/ForkPoolWorker-15] [508cb96d-912a-4a31-b9b2-aaaf72d851af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:45:07.405937207Z [2024-04-03 02:45:07,402: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:45:08.546184567Z [2024-04-03 02:45:08,545: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:45:08.549896371Z [2024-04-03 02:45:08,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:45:08.582142932Z [2024-04-03 02:45:08,581: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:45:08.583643600Z [2024-04-03 02:45:08,583: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:45:08.583752681Z [2024-04-03 02:45:08,583: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:45:08.584055756Z [2024-04-03 02:45:08,583: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:45:08.584221453Z [2024-04-03 02:45:08,584: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:45:08.584567777Z [2024-04-03 02:45:08,584: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:45:08.585732759Z [2024-04-03 02:45:08,584: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:45:08.696789553Z [2024-04-03 02:45:08,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:45:09.260401930Z [2024-04-03 02:45:09,259: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[508cb96d-912a-4a31-b9b2-aaaf72d851af] succeeded in 2.131719322000208s: None 2024-04-03T02:45:09.301195609Z [2024-04-03 02:45:09,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a2e3ce8-1c4b-45d1-8689-f76e12ac57d9] received 2024-04-03T02:45:09.310952310Z [2024-04-03 02:45:09,310: INFO/ForkPoolWorker-15] [5a2e3ce8-1c4b-45d1-8689-f76e12ac57d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:45:09.609921399Z [2024-04-03 02:45:09,606: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:45:10.932603701Z [2024-04-03 02:45:10,932: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:45:10.939510895Z [2024-04-03 02:45:10,935: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:45:10.962484635Z [2024-04-03 02:45:10,962: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:45:10.963860069Z [2024-04-03 02:45:10,963: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:45:10.963999119Z [2024-04-03 02:45:10,963: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:45:10.964178793Z [2024-04-03 02:45:10,963: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:45:10.964310214Z [2024-04-03 02:45:10,964: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:45:10.964587681Z [2024-04-03 02:45:10,964: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:45:10.964746436Z [2024-04-03 02:45:10,964: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:45:11.047909096Z [2024-04-03 02:45:11,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:45:11.576836586Z [2024-04-03 02:45:11,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a2e3ce8-1c4b-45d1-8689-f76e12ac57d9] succeeded in 2.273701652999989s: None 2024-04-03T02:46:00.901040454Z [2024-04-03 02:46:00,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75bb5455-fa18-4242-b543-8fd034fc0d1f] received 2024-04-03T02:46:00.906670986Z [2024-04-03 02:46:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7751c598-372e-4462-afe6-92300426a975] received 2024-04-03T02:46:00.923784672Z [2024-04-03 02:46:00,923: INFO/ForkPoolWorker-15] [75bb5455-fa18-4242-b543-8fd034fc0d1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:46:00.928647377Z [2024-04-03 02:46:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bae816e7-2b52-4027-91ed-9f1ec40ae8c9] received 2024-04-03T02:46:00.935804506Z [2024-04-03 02:46:00,935: INFO/ForkPoolWorker-16] [7751c598-372e-4462-afe6-92300426a975] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:46:00.968902908Z [2024-04-03 02:46:00,963: INFO/ForkPoolWorker-1] [bae816e7-2b52-4027-91ed-9f1ec40ae8c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:46:01.310891682Z [2024-04-03 02:46:01,307: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:46:01.535161975Z [2024-04-03 02:46:01,529: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:46:01.553991638Z [2024-04-03 02:46:01,549: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:46:01.860298264Z [2024-04-03 02:46:01,860: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:46:02.523901137Z [2024-04-03 02:46:02,523: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7751c598-372e-4462-afe6-92300426a975] succeeded in 1.6142824219996328s: None 2024-04-03T02:46:02.775234096Z [2024-04-03 02:46:02,767: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:46:02.783290665Z [2024-04-03 02:46:02,778: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:46:02.863086103Z [2024-04-03 02:46:02,861: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:46:02.868231274Z [2024-04-03 02:46:02,864: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:46:02.868242060Z [2024-04-03 02:46:02,864: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:46:02.868246206Z [2024-04-03 02:46:02,864: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:46:02.868250159Z [2024-04-03 02:46:02,865: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:46:02.868253637Z [2024-04-03 02:46:02,865: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:46:02.868256943Z [2024-04-03 02:46:02,865: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:46:02.998176605Z [2024-04-03 02:46:02,997: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:46:03.122958575Z [2024-04-03 02:46:03,119: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:46:03.126548141Z [2024-04-03 02:46:03,126: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:46:03.206573702Z [2024-04-03 02:46:03,206: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:46:03.207694255Z [2024-04-03 02:46:03,207: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:46:03.207762565Z [2024-04-03 02:46:03,207: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:46:03.207780224Z [2024-04-03 02:46:03,207: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:46:03.207842330Z [2024-04-03 02:46:03,207: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:46:03.208069509Z [2024-04-03 02:46:03,207: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:46:03.208084465Z [2024-04-03 02:46:03,208: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:46:03.336186820Z [2024-04-03 02:46:03,335: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:46:05.406415918Z [2024-04-03 02:46:05,405: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75bb5455-fa18-4242-b543-8fd034fc0d1f] succeeded in 4.498738055999638s: None 2024-04-03T02:46:05.814172913Z [2024-04-03 02:46:05,813: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bae816e7-2b52-4027-91ed-9f1ec40ae8c9] succeeded in 4.876966910000192s: None 2024-04-03T02:47:00.367995245Z [2024-04-03 02:47:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9da85563-01ca-4d0a-8657-3f58eb43b572] received 2024-04-03T02:47:00.375020846Z [2024-04-03 02:47:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6cbfad3-a023-4994-9d05-832713107f45] received 2024-04-03T02:47:00.379150628Z [2024-04-03 02:47:00,378: INFO/ForkPoolWorker-15] [9da85563-01ca-4d0a-8657-3f58eb43b572] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:47:00.419722349Z [2024-04-03 02:47:00,419: INFO/ForkPoolWorker-16] [e6cbfad3-a023-4994-9d05-832713107f45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:47:00.721397381Z [2024-04-03 02:47:00,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:47:00.803770638Z [2024-04-03 02:47:00,793: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:47:02.338084557Z [2024-04-03 02:47:02,337: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:47:02.341850560Z [2024-04-03 02:47:02,341: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:47:02.372512123Z [2024-04-03 02:47:02,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:47:02.374668282Z [2024-04-03 02:47:02,374: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:47:02.374696728Z [2024-04-03 02:47:02,374: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:47:02.374885443Z [2024-04-03 02:47:02,374: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:47:02.374937667Z [2024-04-03 02:47:02,374: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:47:02.375815443Z [2024-04-03 02:47:02,375: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:47:02.375874289Z [2024-04-03 02:47:02,375: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:47:02.414993364Z [2024-04-03 02:47:02,414: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:47:02.418726884Z [2024-04-03 02:47:02,418: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:47:02.453684992Z [2024-04-03 02:47:02,453: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:47:02.455190889Z [2024-04-03 02:47:02,454: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:47:02.455224722Z [2024-04-03 02:47:02,455: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:47:02.455355915Z [2024-04-03 02:47:02,455: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:47:02.455376164Z [2024-04-03 02:47:02,455: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:47:02.456005318Z [2024-04-03 02:47:02,455: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:47:02.456121569Z [2024-04-03 02:47:02,455: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:47:02.462352647Z [2024-04-03 02:47:02,462: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:47:02.538349920Z [2024-04-03 02:47:02,538: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:47:04.028460634Z [2024-04-03 02:47:04,027: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6cbfad3-a023-4994-9d05-832713107f45] succeeded in 3.647913814000276s: None 2024-04-03T02:47:04.384891101Z [2024-04-03 02:47:04,384: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9da85563-01ca-4d0a-8657-3f58eb43b572] succeeded in 4.0137010290000035s: None 2024-04-03T02:48:00.422725820Z [2024-04-03 02:48:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ca6795c-5fc9-4e2f-bbcd-5f16ff201086] received 2024-04-03T02:48:00.425227164Z [2024-04-03 02:48:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b70c798a-2b54-46ef-8205-af3c0acd3d9d] received 2024-04-03T02:48:00.440175761Z [2024-04-03 02:48:00,439: INFO/ForkPoolWorker-15] [6ca6795c-5fc9-4e2f-bbcd-5f16ff201086] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:48:00.442732398Z [2024-04-03 02:48:00,442: INFO/ForkPoolWorker-16] [b70c798a-2b54-46ef-8205-af3c0acd3d9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:48:00.444635964Z [2024-04-03 02:48:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d1a7db6-0fca-4273-b0a1-0079b04c337c] received 2024-04-03T02:48:00.468040046Z [2024-04-03 02:48:00,467: INFO/ForkPoolWorker-1] [4d1a7db6-0fca-4273-b0a1-0079b04c337c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:48:00.988665390Z [2024-04-03 02:48:00,980: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:48:00.996222466Z [2024-04-03 02:48:00,992: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:48:01.022637270Z [2024-04-03 02:48:01,017: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:48:01.407483253Z [2024-04-03 02:48:01,407: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:48:01.986129773Z [2024-04-03 02:48:01,985: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b70c798a-2b54-46ef-8205-af3c0acd3d9d] succeeded in 1.5577916180000102s: None 2024-04-03T02:48:02.549370738Z [2024-04-03 02:48:02,548: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:48:02.552716192Z [2024-04-03 02:48:02,552: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:48:02.573506996Z [2024-04-03 02:48:02,573: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:48:02.577088250Z [2024-04-03 02:48:02,576: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:48:02.586194334Z [2024-04-03 02:48:02,585: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:48:02.588136631Z [2024-04-03 02:48:02,587: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:48:02.588256670Z [2024-04-03 02:48:02,588: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:48:02.588441580Z [2024-04-03 02:48:02,588: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:48:02.588540258Z [2024-04-03 02:48:02,588: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:48:02.588877198Z [2024-04-03 02:48:02,588: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:48:02.588985866Z [2024-04-03 02:48:02,588: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:48:02.607408733Z [2024-04-03 02:48:02,607: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:48:02.608903686Z [2024-04-03 02:48:02,608: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:48:02.609062358Z [2024-04-03 02:48:02,608: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:48:02.609274724Z [2024-04-03 02:48:02,609: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:48:02.609419046Z [2024-04-03 02:48:02,609: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:48:02.611073732Z [2024-04-03 02:48:02,610: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:48:02.611585584Z [2024-04-03 02:48:02,611: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:48:02.670164671Z [2024-04-03 02:48:02,669: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:48:02.693439876Z [2024-04-03 02:48:02,693: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:48:04.104360288Z [2024-04-03 02:48:04,103: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d1a7db6-0fca-4273-b0a1-0079b04c337c] succeeded in 3.65544615699946s: None 2024-04-03T02:48:04.558091021Z [2024-04-03 02:48:04,557: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ca6795c-5fc9-4e2f-bbcd-5f16ff201086] succeeded in 4.129926830000841s: None 2024-04-03T02:49:00.683270184Z [2024-04-03 02:49:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[565bdb84-35a5-4072-b8d1-5e3b499fd5f9] received 2024-04-03T02:49:00.695639888Z [2024-04-03 02:49:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd0f1d79-c303-4317-b9bc-01518f6f32e8] received 2024-04-03T02:49:00.707038439Z [2024-04-03 02:49:00,706: INFO/ForkPoolWorker-15] [565bdb84-35a5-4072-b8d1-5e3b499fd5f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:49:00.745827937Z [2024-04-03 02:49:00,742: INFO/ForkPoolWorker-16] [dd0f1d79-c303-4317-b9bc-01518f6f32e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:49:01.144293133Z [2024-04-03 02:49:01,139: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:49:01.284925299Z [2024-04-03 02:49:01,280: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:49:02.430616401Z [2024-04-03 02:49:02,430: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:49:02.434490175Z [2024-04-03 02:49:02,433: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:49:02.487292831Z [2024-04-03 02:49:02,486: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:49:02.489438046Z [2024-04-03 02:49:02,489: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:49:02.489459987Z [2024-04-03 02:49:02,489: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:49:02.489738172Z [2024-04-03 02:49:02,489: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:49:02.489803786Z [2024-04-03 02:49:02,489: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:49:02.490148004Z [2024-04-03 02:49:02,489: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:49:02.490211249Z [2024-04-03 02:49:02,490: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:49:02.589170748Z [2024-04-03 02:49:02,588: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:49:02.700582928Z [2024-04-03 02:49:02,700: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:49:02.704103789Z [2024-04-03 02:49:02,703: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:49:02.743450991Z [2024-04-03 02:49:02,743: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:49:02.744637086Z [2024-04-03 02:49:02,744: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:49:02.744656890Z [2024-04-03 02:49:02,744: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:49:02.744768254Z [2024-04-03 02:49:02,744: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:49:02.744780423Z [2024-04-03 02:49:02,744: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:49:02.745074481Z [2024-04-03 02:49:02,744: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:49:02.745165879Z [2024-04-03 02:49:02,744: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:49:02.861452861Z [2024-04-03 02:49:02,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:49:04.609367679Z [2024-04-03 02:49:04,607: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[565bdb84-35a5-4072-b8d1-5e3b499fd5f9] succeeded in 3.9165566300007413s: None 2024-04-03T02:49:04.621281905Z [2024-04-03 02:49:04,620: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd0f1d79-c303-4317-b9bc-01518f6f32e8] succeeded in 3.91585142599979s: None 2024-04-03T02:50:00.642923197Z [2024-04-03 02:50:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5809c899-32b3-46e9-b803-2796629e7cce] received 2024-04-03T02:50:00.648460824Z [2024-04-03 02:50:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cbf6f37-55af-461f-9a02-538d26bf37c3] received 2024-04-03T02:50:00.656064140Z [2024-04-03 02:50:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43379fba-7024-44c9-8df5-b955dd852f0b] received 2024-04-03T02:50:00.659449089Z [2024-04-03 02:50:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff2ae5d4-bcdf-469d-a480-b9a965c31513] received 2024-04-03T02:50:00.672905415Z [2024-04-03 02:50:00,672: INFO/ForkPoolWorker-15] [5809c899-32b3-46e9-b803-2796629e7cce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:50:00.680549298Z [2024-04-03 02:50:00,680: INFO/ForkPoolWorker-16] [3cbf6f37-55af-461f-9a02-538d26bf37c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:50:00.686278032Z [2024-04-03 02:50:00,685: INFO/ForkPoolWorker-2] [ff2ae5d4-bcdf-469d-a480-b9a965c31513] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:50:00.687200070Z [2024-04-03 02:50:00,686: INFO/ForkPoolWorker-1] [43379fba-7024-44c9-8df5-b955dd852f0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:50:01.092571522Z [2024-04-03 02:50:01,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:50:01.143364237Z [2024-04-03 02:50:01,135: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:50:01.453630513Z [2024-04-03 02:50:01,444: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:50:01.791577974Z [2024-04-03 02:50:01,785: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:50:02.161609400Z [2024-04-03 02:50:02,161: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:50:02.843110521Z [2024-04-03 02:50:02,841: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:50:02.846634108Z [2024-04-03 02:50:02,846: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:50:02.919315082Z [2024-04-03 02:50:02,919: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:50:02.927901678Z [2024-04-03 02:50:02,927: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3cbf6f37-55af-461f-9a02-538d26bf37c3] succeeded in 2.2728728280008s: None 2024-04-03T02:50:02.931646458Z [2024-04-03 02:50:02,931: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:50:02.931669624Z [2024-04-03 02:50:02,931: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:50:02.931755933Z [2024-04-03 02:50:02,931: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:50:02.931786708Z [2024-04-03 02:50:02,931: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:50:02.932097446Z [2024-04-03 02:50:02,931: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:50:02.932139882Z [2024-04-03 02:50:02,932: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:50:03.080751601Z [2024-04-03 02:50:03,080: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:50:03.233143861Z [2024-04-03 02:50:03,232: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T02:50:03.237901503Z [2024-04-03 02:50:03,237: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:50:03.283356186Z [2024-04-03 02:50:03,283: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T02:50:03.287189494Z [2024-04-03 02:50:03,286: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:50:03.287327586Z [2024-04-03 02:50:03,287: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:50:03.287531530Z [2024-04-03 02:50:03,287: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:50:03.287653469Z [2024-04-03 02:50:03,287: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T02:50:03.288041910Z [2024-04-03 02:50:03,287: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:50:03.288187270Z [2024-04-03 02:50:03,288: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:50:03.385233686Z [2024-04-03 02:50:03,384: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:50:03.889142250Z [2024-04-03 02:50:03,888: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:50:03.892400040Z [2024-04-03 02:50:03,891: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:50:03.946946383Z [2024-04-03 02:50:03,946: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:50:03.948093559Z [2024-04-03 02:50:03,947: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:50:03.948106225Z [2024-04-03 02:50:03,948: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:50:03.948250891Z [2024-04-03 02:50:03,948: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:50:03.948260502Z [2024-04-03 02:50:03,948: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:50:03.948500082Z [2024-04-03 02:50:03,948: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:50:03.948525282Z [2024-04-03 02:50:03,948: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:50:04.091903887Z [2024-04-03 02:50:04,091: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:50:04.105770862Z [2024-04-03 02:50:04,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5809c899-32b3-46e9-b803-2796629e7cce] succeeded in 3.456613749999633s: None 2024-04-03T02:50:04.725390962Z [2024-04-03 02:50:04,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ba2b3de-66c0-4df7-a1f1-d315d90f36db] received 2024-04-03T02:50:04.736069619Z [2024-04-03 02:50:04,735: INFO/ForkPoolWorker-15] [3ba2b3de-66c0-4df7-a1f1-d315d90f36db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:50:05.060607908Z [2024-04-03 02:50:05,057: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:50:05.087661239Z [2024-04-03 02:50:05,087: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ff2ae5d4-bcdf-469d-a480-b9a965c31513] succeeded in 4.4233644599999025s: None 2024-04-03T02:50:05.979552280Z [2024-04-03 02:50:05,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[43379fba-7024-44c9-8df5-b955dd852f0b] succeeded in 5.320639474000018s: None 2024-04-03T02:50:06.191477595Z [2024-04-03 02:50:06,191: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:50:06.195023156Z [2024-04-03 02:50:06,194: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:50:06.233879577Z [2024-04-03 02:50:06,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:50:06.236059866Z [2024-04-03 02:50:06,235: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:50:06.236089915Z [2024-04-03 02:50:06,235: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:50:06.236341697Z [2024-04-03 02:50:06,235: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:50:06.236425645Z [2024-04-03 02:50:06,236: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:50:06.236811727Z [2024-04-03 02:50:06,236: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:50:06.236966584Z [2024-04-03 02:50:06,236: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:50:06.346342652Z [2024-04-03 02:50:06,345: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:50:07.094255526Z [2024-04-03 02:50:07,093: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ba2b3de-66c0-4df7-a1f1-d315d90f36db] succeeded in 2.3647361980001733s: None 2024-04-03T02:50:07.135984083Z [2024-04-03 02:50:07,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee10f40c-d5d7-4684-8517-5463717eaee6] received 2024-04-03T02:50:07.152926080Z [2024-04-03 02:50:07,152: INFO/ForkPoolWorker-15] [ee10f40c-d5d7-4684-8517-5463717eaee6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:50:07.441633424Z [2024-04-03 02:50:07,438: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:50:08.553325448Z [2024-04-03 02:50:08,552: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:50:08.557037812Z [2024-04-03 02:50:08,556: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:50:08.597595538Z [2024-04-03 02:50:08,597: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:50:08.599045005Z [2024-04-03 02:50:08,598: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:50:08.599107783Z [2024-04-03 02:50:08,598: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:50:08.599320973Z [2024-04-03 02:50:08,599: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:50:08.599380944Z [2024-04-03 02:50:08,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:50:08.599681608Z [2024-04-03 02:50:08,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:50:08.599692806Z [2024-04-03 02:50:08,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:50:08.696841936Z [2024-04-03 02:50:08,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:50:09.240058589Z [2024-04-03 02:50:09,238: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee10f40c-d5d7-4684-8517-5463717eaee6] succeeded in 2.098817858000075s: None 2024-04-03T02:50:09.806178151Z [2024-04-03 02:50:09,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5914b6b-1400-4897-82ac-885e95023a91] received 2024-04-03T02:50:09.831090952Z [2024-04-03 02:50:09,830: INFO/ForkPoolWorker-15] [d5914b6b-1400-4897-82ac-885e95023a91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:50:10.210789052Z [2024-04-03 02:50:10,207: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:50:11.398122656Z [2024-04-03 02:50:11,397: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:50:11.402797472Z [2024-04-03 02:50:11,402: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:50:11.447740161Z [2024-04-03 02:50:11,447: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:50:11.449014989Z [2024-04-03 02:50:11,448: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:50:11.449152253Z [2024-04-03 02:50:11,448: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:50:11.449352871Z [2024-04-03 02:50:11,449: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:50:11.449442240Z [2024-04-03 02:50:11,449: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:50:11.449801484Z [2024-04-03 02:50:11,449: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:50:11.449881156Z [2024-04-03 02:50:11,449: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:50:11.584188450Z [2024-04-03 02:50:11,583: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:50:12.239350499Z [2024-04-03 02:50:12,238: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5914b6b-1400-4897-82ac-885e95023a91] succeeded in 2.4319657530004406s: None 2024-04-03T02:51:00.555382299Z [2024-04-03 02:51:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a96159c-1453-401e-9113-e7494cafa53c] received 2024-04-03T02:51:00.557089585Z [2024-04-03 02:51:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81433a5c-d468-4211-abdf-f95e416b8e30] received 2024-04-03T02:51:00.577594592Z [2024-04-03 02:51:00,577: INFO/ForkPoolWorker-15] [6a96159c-1453-401e-9113-e7494cafa53c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:51:00.580350466Z [2024-04-03 02:51:00,579: INFO/ForkPoolWorker-16] [81433a5c-d468-4211-abdf-f95e416b8e30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:51:00.896074070Z [2024-04-03 02:51:00,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:51:00.984142596Z [2024-04-03 02:51:00,980: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:51:02.222432815Z [2024-04-03 02:51:02,222: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:51:02.225990852Z [2024-04-03 02:51:02,225: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:51:02.227884592Z [2024-04-03 02:51:02,227: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:51:02.231410925Z [2024-04-03 02:51:02,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:51:02.253780311Z [2024-04-03 02:51:02,252: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:51:02.255401010Z [2024-04-03 02:51:02,255: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:51:02.255490683Z [2024-04-03 02:51:02,255: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:51:02.255615345Z [2024-04-03 02:51:02,255: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:51:02.255685710Z [2024-04-03 02:51:02,255: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:51:02.255972986Z [2024-04-03 02:51:02,255: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:51:02.256052814Z [2024-04-03 02:51:02,255: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:51:02.261266956Z [2024-04-03 02:51:02,255: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:51:02.262696863Z [2024-04-03 02:51:02,262: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:51:02.262776289Z [2024-04-03 02:51:02,262: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:51:02.262873061Z [2024-04-03 02:51:02,262: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:51:02.262911066Z [2024-04-03 02:51:02,262: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:51:02.263494671Z [2024-04-03 02:51:02,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:51:02.263577768Z [2024-04-03 02:51:02,263: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:51:02.336300011Z [2024-04-03 02:51:02,336: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:51:02.361214721Z [2024-04-03 02:51:02,360: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:51:03.867909001Z [2024-04-03 02:51:03,867: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[81433a5c-d468-4211-abdf-f95e416b8e30] succeeded in 3.306999612999789s: None 2024-04-03T02:51:04.247114358Z [2024-04-03 02:51:04,246: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a96159c-1453-401e-9113-e7494cafa53c] succeeded in 3.68605615999968s: None 2024-04-03T02:52:00.337310654Z [2024-04-03 02:52:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7ac9a03-9bb1-4a45-94a7-43f82bf35e21] received 2024-04-03T02:52:00.339643716Z [2024-04-03 02:52:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ea24bc1-8a5b-4c3f-81fa-07fb031dc73f] received 2024-04-03T02:52:00.348562307Z [2024-04-03 02:52:00,348: INFO/ForkPoolWorker-15] [c7ac9a03-9bb1-4a45-94a7-43f82bf35e21] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:52:00.355957149Z [2024-04-03 02:52:00,355: INFO/ForkPoolWorker-16] [2ea24bc1-8a5b-4c3f-81fa-07fb031dc73f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:52:00.390066220Z [2024-04-03 02:52:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abe0959c-beaf-4cfa-92d3-2f1882cfcc5f] received 2024-04-03T02:52:00.416627073Z [2024-04-03 02:52:00,416: INFO/ForkPoolWorker-1] [abe0959c-beaf-4cfa-92d3-2f1882cfcc5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:52:00.697688810Z [2024-04-03 02:52:00,693: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:52:00.762749672Z [2024-04-03 02:52:00,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:52:01.081007920Z [2024-04-03 02:52:01,077: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:52:01.082195785Z [2024-04-03 02:52:01,081: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:52:01.792042989Z [2024-04-03 02:52:01,791: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7ac9a03-9bb1-4a45-94a7-43f82bf35e21] succeeded in 1.450449664000189s: None 2024-04-03T02:52:02.473551262Z [2024-04-03 02:52:02,473: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:52:02.477028602Z [2024-04-03 02:52:02,476: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:52:02.504978340Z [2024-04-03 02:52:02,504: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:52:02.506311633Z [2024-04-03 02:52:02,506: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:52:02.506394020Z [2024-04-03 02:52:02,506: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:52:02.506551828Z [2024-04-03 02:52:02,506: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:52:02.506677940Z [2024-04-03 02:52:02,506: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:52:02.506980472Z [2024-04-03 02:52:02,506: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:52:02.507173053Z [2024-04-03 02:52:02,507: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:52:02.539155734Z [2024-04-03 02:52:02,538: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:52:02.542735883Z [2024-04-03 02:52:02,542: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:52:02.574942197Z [2024-04-03 02:52:02,574: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:52:02.576611228Z [2024-04-03 02:52:02,576: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:52:02.576667764Z [2024-04-03 02:52:02,576: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:52:02.576852160Z [2024-04-03 02:52:02,576: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:52:02.577022269Z [2024-04-03 02:52:02,576: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:52:02.577342910Z [2024-04-03 02:52:02,577: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:52:02.577490795Z [2024-04-03 02:52:02,577: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:52:02.590318518Z [2024-04-03 02:52:02,590: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:52:02.673501743Z [2024-04-03 02:52:02,673: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:52:04.199299575Z [2024-04-03 02:52:04,198: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abe0959c-beaf-4cfa-92d3-2f1882cfcc5f] succeeded in 3.798650058000021s: None 2024-04-03T02:52:04.662110240Z [2024-04-03 02:52:04,661: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ea24bc1-8a5b-4c3f-81fa-07fb031dc73f] succeeded in 4.32022243099982s: None 2024-04-03T02:52:24.538035924Z [2024-04-03 02:52:24,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98bfbda1-8ca3-4da7-9f10-9b3b21b5507b] received 2024-04-03T02:52:24.552105905Z [2024-04-03 02:52:24,551: INFO/ForkPoolWorker-15] [98bfbda1-8ca3-4da7-9f10-9b3b21b5507b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240403025223_537992', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-03T02:52:24.851185768Z [2024-04-03 02:52:24,847: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-03T02:52:25.172706052Z [2024-04-03 02:52:25,172: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:52:25.721823873Z [2024-04-03 02:52:25,721: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98bfbda1-8ca3-4da7-9f10-9b3b21b5507b] succeeded in 1.180668063999292s: None 2024-04-03T02:53:00.609763773Z [2024-04-03 02:53:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a408ab6-86b0-4e25-abe8-4fd0c6281ddf] received 2024-04-03T02:53:00.620925043Z [2024-04-03 02:53:00,620: INFO/ForkPoolWorker-15] [1a408ab6-86b0-4e25-abe8-4fd0c6281ddf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:53:00.624680438Z [2024-04-03 02:53:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[045f1f97-5d3c-4839-bf37-ec717464a41f] received 2024-04-03T02:53:00.653558119Z [2024-04-03 02:53:00,651: INFO/ForkPoolWorker-16] [045f1f97-5d3c-4839-bf37-ec717464a41f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:53:01.171569497Z [2024-04-03 02:53:01,165: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:53:01.174103056Z [2024-04-03 02:53:01,168: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:53:02.438405833Z [2024-04-03 02:53:02,438: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:53:02.442904212Z [2024-04-03 02:53:02,442: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:53:02.478931215Z [2024-04-03 02:53:02,478: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:53:02.480569449Z [2024-04-03 02:53:02,480: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:53:02.480744361Z [2024-04-03 02:53:02,480: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:53:02.480989612Z [2024-04-03 02:53:02,480: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:53:02.481120793Z [2024-04-03 02:53:02,481: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:53:02.481487356Z [2024-04-03 02:53:02,481: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:53:02.481697261Z [2024-04-03 02:53:02,481: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:53:02.557950250Z [2024-04-03 02:53:02,557: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:53:02.561412193Z [2024-04-03 02:53:02,560: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:53:02.568218010Z [2024-04-03 02:53:02,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:53:02.592377179Z [2024-04-03 02:53:02,592: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:53:02.593641451Z [2024-04-03 02:53:02,593: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:53:02.593680824Z [2024-04-03 02:53:02,593: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:53:02.593812052Z [2024-04-03 02:53:02,593: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:53:02.593836516Z [2024-04-03 02:53:02,593: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:53:02.594035951Z [2024-04-03 02:53:02,593: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:53:02.594075085Z [2024-04-03 02:53:02,594: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:53:02.688763044Z [2024-04-03 02:53:02,688: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:53:04.156435428Z [2024-04-03 02:53:04,154: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a408ab6-86b0-4e25-abe8-4fd0c6281ddf] succeeded in 3.543103360999339s: None 2024-04-03T02:53:04.535375541Z [2024-04-03 02:53:04,534: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[045f1f97-5d3c-4839-bf37-ec717464a41f] succeeded in 3.9064868989999013s: None 2024-04-03T02:53:56.238235381Z [2024-04-03 02:53:56,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6864513-e63b-4e80-807a-cec77a1e7fa8] received 2024-04-03T02:53:56.255754717Z [2024-04-03 02:53:56,255: INFO/ForkPoolWorker-15] [a6864513-e63b-4e80-807a-cec77a1e7fa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:53:56.559343769Z [2024-04-03 02:53:56,555: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:53:57.794728817Z [2024-04-03 02:53:57,794: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:53:57.799480808Z [2024-04-03 02:53:57,799: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:53:57.827229661Z [2024-04-03 02:53:57,827: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:53:57.828518876Z [2024-04-03 02:53:57,828: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:53:57.828670522Z [2024-04-03 02:53:57,828: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:53:57.828802151Z [2024-04-03 02:53:57,828: INFO/ForkPoolWorker-15] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:53:57.829028648Z [2024-04-03 02:53:57,828: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:53:57.829149491Z [2024-04-03 02:53:57,828: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:53:57.829421731Z [2024-04-03 02:53:57,829: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:53:57.829609129Z [2024-04-03 02:53:57,829: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:53:57.833889942Z [2024-04-03 02:53:57,833: INFO/ForkPoolWorker-15] Creating DAG vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:53:57.918513992Z [2024-04-03 02:53:57,918: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:53:59.402731885Z [2024-04-03 02:53:59,402: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6864513-e63b-4e80-807a-cec77a1e7fa8] succeeded in 3.159934530999635s: None 2024-04-03T02:54:01.029735623Z [2024-04-03 02:54:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a98d9304-e02c-4989-a273-db52559008a0] received 2024-04-03T02:54:01.035310652Z [2024-04-03 02:54:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d20080de-992c-445d-8cf4-426be26e0765] received 2024-04-03T02:54:01.044564731Z [2024-04-03 02:54:01,042: INFO/ForkPoolWorker-15] [a98d9304-e02c-4989-a273-db52559008a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:54:01.052366803Z [2024-04-03 02:54:01,051: INFO/ForkPoolWorker-16] [d20080de-992c-445d-8cf4-426be26e0765] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:54:01.070329199Z [2024-04-03 02:54:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12bab2bb-3de5-460b-b81a-502c385900a8] received 2024-04-03T02:54:01.078276810Z [2024-04-03 02:54:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddfc00f3-bbb2-4ad5-a4d0-9fc091c90b79] received 2024-04-03T02:54:01.093425960Z [2024-04-03 02:54:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83a657db-1b47-4bfc-b1ba-fd6fc3fd1311] received 2024-04-03T02:54:01.114218949Z [2024-04-03 02:54:01,113: INFO/ForkPoolWorker-1] [12bab2bb-3de5-460b-b81a-502c385900a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:54:01.119386562Z [2024-04-03 02:54:01,118: INFO/ForkPoolWorker-2] [ddfc00f3-bbb2-4ad5-a4d0-9fc091c90b79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:54:01.121133122Z [2024-04-03 02:54:01,120: INFO/ForkPoolWorker-3] [83a657db-1b47-4bfc-b1ba-fd6fc3fd1311] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:54:01.455705337Z [2024-04-03 02:54:01,451: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:54:01.468950712Z [2024-04-03 02:54:01,464: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:54:01.629716648Z [2024-04-03 02:54:01,624: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:54:02.287917239Z [2024-04-03 02:54:02,283: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:54:02.314747840Z [2024-04-03 02:54:02,310: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:54:02.803667850Z [2024-04-03 02:54:02,799: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:03.667448748Z [2024-04-03 02:54:03,667: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:54:03.672668825Z [2024-04-03 02:54:03,672: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:54:03.731211306Z [2024-04-03 02:54:03,730: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:54:03.734960191Z [2024-04-03 02:54:03,734: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:54:03.735381694Z [2024-04-03 02:54:03,734: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:54:03.735510799Z [2024-04-03 02:54:03,735: INFO/ForkPoolWorker-16] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:54:03.735713168Z [2024-04-03 02:54:03,735: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:54:03.735806048Z [2024-04-03 02:54:03,735: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:54:03.736195073Z [2024-04-03 02:54:03,736: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:54:03.736657518Z [2024-04-03 02:54:03,736: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:54:03.742909597Z [2024-04-03 02:54:03,742: INFO/ForkPoolWorker-16] Creating DAG vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:54:03.884384832Z [2024-04-03 02:54:03,884: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:04.483862450Z [2024-04-03 02:54:04,483: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-03T02:54:04.507944471Z [2024-04-03 02:54:04,507: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:54:04.603799408Z [2024-04-03 02:54:04,603: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:54:04.609489772Z [2024-04-03 02:54:04,609: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:54:04.654678202Z [2024-04-03 02:54:04,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:54:04.656001680Z [2024-04-03 02:54:04,655: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:54:04.656195383Z [2024-04-03 02:54:04,656: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:54:04.656621042Z [2024-04-03 02:54:04,656: INFO/ForkPoolWorker-15] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:54:04.656860759Z [2024-04-03 02:54:04,656: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:54:04.657013060Z [2024-04-03 02:54:04,656: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:54:04.657486718Z [2024-04-03 02:54:04,657: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:54:04.657933849Z [2024-04-03 02:54:04,657: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:54:04.662677750Z [2024-04-03 02:54:04,662: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:54:04.675130462Z [2024-04-03 02:54:04,674: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-03T02:54:04.691908071Z [2024-04-03 02:54:04,691: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T02:54:04.696951542Z [2024-04-03 02:54:04,696: INFO/ForkPoolWorker-3] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:54:04.699072981Z [2024-04-03 02:54:04,696: INFO/ForkPoolWorker-3] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:54:04.700268652Z [2024-04-03 02:54:04,700: INFO/ForkPoolWorker-3] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:54:04.700580084Z [2024-04-03 02:54:04,700: INFO/ForkPoolWorker-3] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:54:04.700747239Z [2024-04-03 02:54:04,700: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-03T02:54:04.701094334Z [2024-04-03 02:54:04,700: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:54:04.701256987Z [2024-04-03 02:54:04,701: INFO/ForkPoolWorker-3] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:54:04.713496632Z [2024-04-03 02:54:04,713: INFO/ForkPoolWorker-3] Creating DAG vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:54:04.736269599Z [2024-04-03 02:54:04,735: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:54:04.781425173Z [2024-04-03 02:54:04,781: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:04.856126570Z [2024-04-03 02:54:04,855: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[12bab2bb-3de5-460b-b81a-502c385900a8] succeeded in 3.7826582640000197s: None 2024-04-03T02:54:04.876971372Z [2024-04-03 02:54:04,876: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:04.919532112Z [2024-04-03 02:54:04,919: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T02:54:04.920653258Z [2024-04-03 02:54:04,920: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:54:04.920780449Z [2024-04-03 02:54:04,920: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:54:04.920912659Z [2024-04-03 02:54:04,920: INFO/ForkPoolWorker-2] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:54:04.921144443Z [2024-04-03 02:54:04,920: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:54:04.921301155Z [2024-04-03 02:54:04,921: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T02:54:04.921606265Z [2024-04-03 02:54:04,921: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:54:04.921676985Z [2024-04-03 02:54:04,921: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:54:04.926168385Z [2024-04-03 02:54:04,925: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:54:05.164128464Z [2024-04-03 02:54:05,163: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:06.899222881Z [2024-04-03 02:54:06,898: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d20080de-992c-445d-8cf4-426be26e0765] succeeded in 5.859379698999874s: None 2024-04-03T02:54:06.994808594Z [2024-04-03 02:54:06,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0ca182a-6e1b-4fa7-aed1-6ca23fc5881c] received 2024-04-03T02:54:07.008382280Z [2024-04-03 02:54:07,008: INFO/ForkPoolWorker-16] [d0ca182a-6e1b-4fa7-aed1-6ca23fc5881c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:54:07.131955310Z [2024-04-03 02:54:07,130: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[83a657db-1b47-4bfc-b1ba-fd6fc3fd1311] succeeded in 6.029823400999703s: None 2024-04-03T02:54:07.348511913Z [2024-04-03 02:54:07,344: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:54:07.577409066Z [2024-04-03 02:54:07,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a98d9304-e02c-4989-a273-db52559008a0] succeeded in 6.545080255000357s: None 2024-04-03T02:54:07.730761611Z [2024-04-03 02:54:07,729: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ddfc00f3-bbb2-4ad5-a4d0-9fc091c90b79] succeeded in 6.641714804999538s: None 2024-04-03T02:54:08.477433693Z [2024-04-03 02:54:08,476: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:54:08.481094818Z [2024-04-03 02:54:08,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:54:08.506906576Z [2024-04-03 02:54:08,506: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:54:08.508453553Z [2024-04-03 02:54:08,508: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:54:08.509001576Z [2024-04-03 02:54:08,508: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:54:08.509157922Z [2024-04-03 02:54:08,508: INFO/ForkPoolWorker-16] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:54:08.509377805Z [2024-04-03 02:54:08,509: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:54:08.509566651Z [2024-04-03 02:54:08,509: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:54:08.511366020Z [2024-04-03 02:54:08,511: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:54:08.511571992Z [2024-04-03 02:54:08,511: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:54:08.517898488Z [2024-04-03 02:54:08,517: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:54:08.596438969Z [2024-04-03 02:54:08,596: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:09.286232683Z [2024-04-03 02:54:09,285: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0ca182a-6e1b-4fa7-aed1-6ca23fc5881c] succeeded in 2.28877022100005s: None 2024-04-03T02:54:09.926287399Z [2024-04-03 02:54:09,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab200ec5-eb5e-4b1f-af66-ae8ac2ad6392] received 2024-04-03T02:54:09.936506675Z [2024-04-03 02:54:09,936: INFO/ForkPoolWorker-15] [ab200ec5-eb5e-4b1f-af66-ae8ac2ad6392] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'split_metrics', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:54:10.338574422Z [2024-04-03 02:54:10,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:54:11.587012019Z [2024-04-03 02:54:11,586: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:54:11.590571250Z [2024-04-03 02:54:11,590: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:54:11.625241695Z [2024-04-03 02:54:11,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:54:11.626544824Z [2024-04-03 02:54:11,626: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:54:11.626734295Z [2024-04-03 02:54:11,626: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:54:11.626908088Z [2024-04-03 02:54:11,626: INFO/ForkPoolWorker-15] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:54:11.627127017Z [2024-04-03 02:54:11,626: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:54:11.627262246Z [2024-04-03 02:54:11,627: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:54:11.627747192Z [2024-04-03 02:54:11,627: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:54:11.627975054Z [2024-04-03 02:54:11,627: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:54:11.635916723Z [2024-04-03 02:54:11,635: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:54:11.715426649Z [2024-04-03 02:54:11,715: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:12.321494219Z [2024-04-03 02:54:12,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3668467-9838-4638-b435-ec9c02b916dc] received 2024-04-03T02:54:12.324983975Z [2024-04-03 02:54:12,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab200ec5-eb5e-4b1f-af66-ae8ac2ad6392] succeeded in 2.3941939650003405s: None 2024-04-03T02:54:12.341332486Z [2024-04-03 02:54:12,338: INFO/ForkPoolWorker-16] [d3668467-9838-4638-b435-ec9c02b916dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'collect_metrics', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:54:12.643441068Z [2024-04-03 02:54:12,639: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:54:13.874143857Z [2024-04-03 02:54:13,873: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:54:13.877543620Z [2024-04-03 02:54:13,877: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:54:13.953933218Z [2024-04-03 02:54:13,953: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:54:13.957444013Z [2024-04-03 02:54:13,957: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:54:13.957720767Z [2024-04-03 02:54:13,957: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:54:13.957986569Z [2024-04-03 02:54:13,957: INFO/ForkPoolWorker-16] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:54:13.958755885Z [2024-04-03 02:54:13,958: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:54:13.959413290Z [2024-04-03 02:54:13,959: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:54:13.960230875Z [2024-04-03 02:54:13,959: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:54:13.961207583Z [2024-04-03 02:54:13,960: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:54:13.979804457Z [2024-04-03 02:54:13,979: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:54:14.109882113Z [2024-04-03 02:54:14,109: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:14.686287229Z [2024-04-03 02:54:14,685: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d3668467-9838-4638-b435-ec9c02b916dc] succeeded in 2.36276004299998s: None 2024-04-03T02:54:14.852815534Z [2024-04-03 02:54:14,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2344ae22-52d4-4843-ba5b-e3e7a1a8e066] received 2024-04-03T02:54:14.864964829Z [2024-04-03 02:54:14,864: INFO/ForkPoolWorker-15] [2344ae22-52d4-4843-ba5b-e3e7a1a8e066] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'send_prometheus', 'scheduled__2024-04-03T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:54:15.129649505Z [2024-04-03 02:54:15,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:54:16.184089769Z [2024-04-03 02:54:16,183: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:54:16.187550909Z [2024-04-03 02:54:16,187: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:54:16.211844976Z [2024-04-03 02:54:16,211: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:54:16.213209321Z [2024-04-03 02:54:16,212: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:54:16.213260602Z [2024-04-03 02:54:16,213: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:54:16.213278979Z [2024-04-03 02:54:16,213: INFO/ForkPoolWorker-15] Read VIM 30cf6e1b-da8a-4893-a347-7a1fd6be4c82 (basic01_315863) 2024-04-03T02:54:16.213418239Z [2024-04-03 02:54:16,213: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'name': 'basic01_315863', 'vim_type': 'openstack'}] 2024-04-03T02:54:16.213432182Z [2024-04-03 02:54:16,213: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:54:16.214001725Z [2024-04-03 02:54:16,213: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:54:16.214012823Z [2024-04-03 02:54:16,213: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:54:16.220664897Z [2024-04-03 02:54:16,220: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82 2024-04-03T02:54:16.301574520Z [2024-04-03 02:54:16,301: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:54:16.877012060Z [2024-04-03 02:54:16,876: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2344ae22-52d4-4843-ba5b-e3e7a1a8e066] succeeded in 2.0219595200005642s: None 2024-04-03T02:55:01.398774304Z [2024-04-03 02:55:01,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c9c8b52-9926-4fe4-878d-83565fb8baa7] received 2024-04-03T02:55:01.404543972Z [2024-04-03 02:55:01,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4acd24d-b7af-467f-9db6-5c9371c8e541] received 2024-04-03T02:55:01.418667160Z [2024-04-03 02:55:01,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[463b0265-583c-46bd-99be-f2d24254a05e] received 2024-04-03T02:55:01.425278521Z [2024-04-03 02:55:01,424: INFO/ForkPoolWorker-16] [f4acd24d-b7af-467f-9db6-5c9371c8e541] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:55:01.431092089Z [2024-04-03 02:55:01,430: INFO/ForkPoolWorker-15] [6c9c8b52-9926-4fe4-878d-83565fb8baa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:55:01.458713172Z [2024-04-03 02:55:01,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef10dd88-e1c8-4eea-988a-1410b23043a4] received 2024-04-03T02:55:01.464786211Z [2024-04-03 02:55:01,464: INFO/ForkPoolWorker-1] [463b0265-583c-46bd-99be-f2d24254a05e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:55:01.466668753Z [2024-04-03 02:55:01,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fcfeddf-e666-47bd-902d-500f7b389d7a] received 2024-04-03T02:55:01.478541184Z [2024-04-03 02:55:01,478: INFO/ForkPoolWorker-2] [ef10dd88-e1c8-4eea-988a-1410b23043a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:55:01.485798325Z [2024-04-03 02:55:01,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31d77355-c53b-44cd-af3c-a6172bb01528] received 2024-04-03T02:55:01.490762922Z [2024-04-03 02:55:01,490: INFO/ForkPoolWorker-3] [8fcfeddf-e666-47bd-902d-500f7b389d7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:01.516195026Z [2024-04-03 02:55:01,515: INFO/ForkPoolWorker-4] [31d77355-c53b-44cd-af3c-a6172bb01528] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:01.864742676Z [2024-04-03 02:55:01,859: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:55:01.899006611Z [2024-04-03 02:55:01,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:55:02.009591864Z [2024-04-03 02:55:02,005: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:55:02.063609444Z [2024-04-03 02:55:02,058: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:02.274328741Z [2024-04-03 02:55:02,265: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:02.421581660Z [2024-04-03 02:55:02,416: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:55:05.196179681Z [2024-04-03 02:55:05,195: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:55:05.200561397Z [2024-04-03 02:55:05,199: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.262014961Z [2024-04-03 02:55:05,261: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:55:05.266035923Z [2024-04-03 02:55:05,265: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.297429317Z [2024-04-03 02:55:05,296: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:55:05.306112866Z [2024-04-03 02:55:05,305: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:55:05.307495603Z [2024-04-03 02:55:05,303: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.308161251Z [2024-04-03 02:55:05,307: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.308579956Z [2024-04-03 02:55:05,308: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.308805403Z [2024-04-03 02:55:05,308: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.309700978Z [2024-04-03 02:55:05,308: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:55:05.310086185Z [2024-04-03 02:55:05,309: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:55:05.310093824Z [2024-04-03 02:55:05,309: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.327490137Z [2024-04-03 02:55:05,327: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:55:05.330000092Z [2024-04-03 02:55:05,329: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.330014533Z [2024-04-03 02:55:05,329: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.330072874Z [2024-04-03 02:55:05,329: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.330108241Z [2024-04-03 02:55:05,330: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:55:05.331293031Z [2024-04-03 02:55:05,331: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:55:05.331306232Z [2024-04-03 02:55:05,331: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.343120155Z [2024-04-03 02:55:05,342: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:55:05.344147802Z [2024-04-03 02:55:05,343: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:55:05.350101498Z [2024-04-03 02:55:05,349: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:55:05.353247863Z [2024-04-03 02:55:05,352: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.375462603Z [2024-04-03 02:55:05,375: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:55:05.376856175Z [2024-04-03 02:55:05,376: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.376975719Z [2024-04-03 02:55:05,376: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.377173983Z [2024-04-03 02:55:05,376: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.377348763Z [2024-04-03 02:55:05,377: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:55:05.380055557Z [2024-04-03 02:55:05,377: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:55:05.380323509Z [2024-04-03 02:55:05,380: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.387260669Z [2024-04-03 02:55:05,387: WARNING/ForkPoolWorker-16] Dag 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:55:05.388163776Z [2024-04-03 02:55:05,387: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:55:05.391682296Z [2024-04-03 02:55:05,391: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:55:05.398215660Z [2024-04-03 02:55:05,397: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.415557499Z [2024-04-03 02:55:05,415: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:55:05.420955541Z [2024-04-03 02:55:05,420: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.421574311Z [2024-04-03 02:55:05,421: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.421805377Z [2024-04-03 02:55:05,421: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.421921446Z [2024-04-03 02:55:05,421: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:55:05.422277786Z [2024-04-03 02:55:05,422: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:55:05.422401736Z [2024-04-03 02:55:05,422: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.428360569Z [2024-04-03 02:55:05,427: ERROR/ForkPoolWorker-1] [463b0265-583c-46bd-99be-f2d24254a05e] Failed to execute task Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse.. 2024-04-03T02:55:05.428380175Z Traceback (most recent call last): 2024-04-03T02:55:05.428384307Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T02:55:05.428388371Z args.func(args) 2024-04-03T02:55:05.428392330Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T02:55:05.428396180Z return func(*args, **kwargs) 2024-04-03T02:55:05.428399223Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T02:55:05.428402181Z return f(*args, **kwargs) 2024-04-03T02:55:05.428405198Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T02:55:05.428408267Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T02:55:05.428427772Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T02:55:05.428430867Z raise AirflowException( 2024-04-03T02:55:05.428434885Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse. 2024-04-03T02:55:05.443115788Z [2024-04-03 02:55:05,442: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:55:05.446864538Z [2024-04-03 02:55:05,446: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:55:05.450766512Z [2024-04-03 02:55:05,450: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.450787278Z [2024-04-03 02:55:05,450: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.450889437Z [2024-04-03 02:55:05,450: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.450924151Z [2024-04-03 02:55:05,450: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:55:05.451120098Z [2024-04-03 02:55:05,451: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:55:05.451157182Z [2024-04-03 02:55:05,451: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.454503780Z [2024-04-03 02:55:05,453: ERROR/ForkPoolWorker-16] [f4acd24d-b7af-467f-9db6-5c9371c8e541] Failed to execute task Dag 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse.. 2024-04-03T02:55:05.454517052Z Traceback (most recent call last): 2024-04-03T02:55:05.454521355Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T02:55:05.454525084Z args.func(args) 2024-04-03T02:55:05.454528703Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T02:55:05.454532399Z return func(*args, **kwargs) 2024-04-03T02:55:05.454535467Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T02:55:05.454538499Z return f(*args, **kwargs) 2024-04-03T02:55:05.454541500Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T02:55:05.454544536Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T02:55:05.454547512Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T02:55:05.454550476Z raise AirflowException( 2024-04-03T02:55:05.454553995Z airflow.exceptions.AirflowException: Dag 'vim_status_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse. 2024-04-03T02:55:05.505738417Z [2024-04-03 02:55:05,505: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[463b0265-583c-46bd-99be-f2d24254a05e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 463b0265-583c-46bd-99be-f2d24254a05e') 2024-04-03T02:55:05.505749770Z Traceback (most recent call last): 2024-04-03T02:55:05.505754399Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T02:55:05.505771908Z R = retval = fun(*args, **kwargs) 2024-04-03T02:55:05.505776002Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T02:55:05.505779734Z return self.run(*args, **kwargs) 2024-04-03T02:55:05.505784480Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T02:55:05.505789018Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T02:55:05.505793103Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T02:55:05.505797405Z raise AirflowException(msg) 2024-04-03T02:55:05.505801440Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 463b0265-583c-46bd-99be-f2d24254a05e 2024-04-03T02:55:05.516419596Z [2024-04-03 02:55:05,516: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T02:55:05.520601153Z [2024-04-03 02:55:05,520: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.527426951Z [2024-04-03 02:55:05,519: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f4acd24d-b7af-467f-9db6-5c9371c8e541] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f4acd24d-b7af-467f-9db6-5c9371c8e541') 2024-04-03T02:55:05.527464107Z Traceback (most recent call last): 2024-04-03T02:55:05.527476257Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T02:55:05.527486952Z R = retval = fun(*args, **kwargs) 2024-04-03T02:55:05.527497569Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T02:55:05.527507801Z return self.run(*args, **kwargs) 2024-04-03T02:55:05.527519127Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T02:55:05.527529733Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T02:55:05.527537157Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T02:55:05.527545190Z raise AirflowException(msg) 2024-04-03T02:55:05.527553691Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f4acd24d-b7af-467f-9db6-5c9371c8e541 2024-04-03T02:55:05.562209366Z [2024-04-03 02:55:05,561: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T02:55:05.566683247Z [2024-04-03 02:55:05,565: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.567091147Z [2024-04-03 02:55:05,566: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.567616957Z [2024-04-03 02:55:05,567: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.567871585Z [2024-04-03 02:55:05,567: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T02:55:05.568338938Z [2024-04-03 02:55:05,568: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:55:05.568493011Z [2024-04-03 02:55:05,568: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.645841346Z [2024-04-03 02:55:05,645: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:55:05.684581694Z [2024-04-03 02:55:05,684: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-03T02:55:05.688302051Z [2024-04-03 02:55:05,687: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.740100279Z [2024-04-03 02:55:05,739: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-03T02:55:05.744700704Z [2024-04-03 02:55:05,744: INFO/ForkPoolWorker-4] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.745015342Z [2024-04-03 02:55:05,744: INFO/ForkPoolWorker-4] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.745360681Z [2024-04-03 02:55:05,745: INFO/ForkPoolWorker-4] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.745511524Z [2024-04-03 02:55:05,745: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-03T02:55:05.745791695Z [2024-04-03 02:55:05,745: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:55:05.746312824Z [2024-04-03 02:55:05,745: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.757476266Z [2024-04-03 02:55:05,757: WARNING/ForkPoolWorker-4] Dag 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:05.758774840Z [2024-04-03 02:55:05,758: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:05.759865416Z [2024-04-03 02:55:05,759: INFO/ForkPoolWorker-4] Getting VIM list 2024-04-03T02:55:05.762965062Z [2024-04-03 02:55:05,762: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.788498975Z [2024-04-03 02:55:05,786: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-03T02:55:05.796794037Z [2024-04-03 02:55:05,795: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:05.804352757Z [2024-04-03 02:55:05,804: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-04-03T02:55:05.805746595Z [2024-04-03 02:55:05,805: INFO/ForkPoolWorker-4] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.805859123Z [2024-04-03 02:55:05,805: INFO/ForkPoolWorker-4] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.806036325Z [2024-04-03 02:55:05,805: INFO/ForkPoolWorker-4] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.806109931Z [2024-04-03 02:55:05,806: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-04-03T02:55:05.806359642Z [2024-04-03 02:55:05,806: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:55:05.806892115Z [2024-04-03 02:55:05,806: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.811044537Z [2024-04-03 02:55:05,810: ERROR/ForkPoolWorker-4] [31d77355-c53b-44cd-af3c-a6172bb01528] Failed to execute task Dag 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse.. 2024-04-03T02:55:05.811063867Z Traceback (most recent call last): 2024-04-03T02:55:05.811068235Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T02:55:05.811071997Z args.func(args) 2024-04-03T02:55:05.811075799Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T02:55:05.811079693Z return func(*args, **kwargs) 2024-04-03T02:55:05.811082822Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T02:55:05.811086379Z return f(*args, **kwargs) 2024-04-03T02:55:05.811095685Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T02:55:05.811100357Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T02:55:05.811103896Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T02:55:05.811107351Z raise AirflowException( 2024-04-03T02:55:05.811111121Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse. 2024-04-03T02:55:05.837636746Z [2024-04-03 02:55:05,836: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-03T02:55:05.838280409Z [2024-04-03 02:55:05,838: INFO/ForkPoolWorker-3] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:05.838379738Z [2024-04-03 02:55:05,838: INFO/ForkPoolWorker-3] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:05.838585354Z [2024-04-03 02:55:05,838: INFO/ForkPoolWorker-3] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:05.838721646Z [2024-04-03 02:55:05,838: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-03T02:55:05.838965150Z [2024-04-03 02:55:05,838: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:55:05.839034806Z [2024-04-03 02:55:05,838: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:05.875580764Z [2024-04-03 02:55:05,875: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[31d77355-c53b-44cd-af3c-a6172bb01528] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 31d77355-c53b-44cd-af3c-a6172bb01528') 2024-04-03T02:55:05.875602880Z Traceback (most recent call last): 2024-04-03T02:55:05.875607997Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T02:55:05.875611995Z R = retval = fun(*args, **kwargs) 2024-04-03T02:55:05.875616018Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T02:55:05.875633533Z return self.run(*args, **kwargs) 2024-04-03T02:55:05.875638322Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T02:55:05.875642679Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T02:55:05.875646383Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T02:55:05.875650772Z raise AirflowException(msg) 2024-04-03T02:55:05.875655070Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 31d77355-c53b-44cd-af3c-a6172bb01528 2024-04-03T02:55:05.927738037Z [2024-04-03 02:55:05,927: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:55:06.493748825Z [2024-04-03 02:55:06,491: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[8fcfeddf-e666-47bd-902d-500f7b389d7a] succeeded in 5.020201338999868s: None 2024-04-03T02:55:07.485125848Z [2024-04-03 02:55:07,484: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c9c8b52-9926-4fe4-878d-83565fb8baa7] succeeded in 6.082813553000051s: None 2024-04-03T02:55:07.643997655Z [2024-04-03 02:55:07,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff79413b-1954-41ea-9f6e-07cfe6f92f61] received 2024-04-03T02:55:07.650903826Z [2024-04-03 02:55:07,650: INFO/ForkPoolWorker-15] [ff79413b-1954-41ea-9f6e-07cfe6f92f61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:08.010506729Z [2024-04-03 02:55:08,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:09.039597529Z [2024-04-03 02:55:09,039: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ef10dd88-e1c8-4eea-988a-1410b23043a4] succeeded in 7.57787721800014s: None 2024-04-03T02:55:09.264863717Z [2024-04-03 02:55:09,264: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:55:09.268882149Z [2024-04-03 02:55:09,268: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:09.311049954Z [2024-04-03 02:55:09,310: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:55:09.313045347Z [2024-04-03 02:55:09,312: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:09.313176603Z [2024-04-03 02:55:09,312: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:09.313476047Z [2024-04-03 02:55:09,313: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:09.314124048Z [2024-04-03 02:55:09,313: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:55:09.314461334Z [2024-04-03 02:55:09,314: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:55:09.314581212Z [2024-04-03 02:55:09,314: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:09.429023899Z [2024-04-03 02:55:09,428: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:55:09.967654706Z [2024-04-03 02:55:09,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ab9fc7c-8795-4740-8766-aeac2b240b51] received 2024-04-03T02:55:09.978413759Z [2024-04-03 02:55:09,978: INFO/ForkPoolWorker-16] [9ab9fc7c-8795-4740-8766-aeac2b240b51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T02:55:10.013969621Z [2024-04-03 02:55:09,999: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff79413b-1954-41ea-9f6e-07cfe6f92f61] succeeded in 2.3546688079995874s: None 2024-04-03T02:55:10.377778321Z [2024-04-03 02:55:10,374: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:11.603450566Z [2024-04-03 02:55:11,603: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:55:11.607649268Z [2024-04-03 02:55:11,606: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:11.631551218Z [2024-04-03 02:55:11,631: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:55:11.632536578Z [2024-04-03 02:55:11,632: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:11.632672293Z [2024-04-03 02:55:11,632: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:11.632888146Z [2024-04-03 02:55:11,632: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:11.633033663Z [2024-04-03 02:55:11,632: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:55:11.633301084Z [2024-04-03 02:55:11,633: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:55:11.633492860Z [2024-04-03 02:55:11,633: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:11.727311485Z [2024-04-03 02:55:11,727: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:55:12.246004841Z [2024-04-03 02:55:12,245: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ab9fc7c-8795-4740-8766-aeac2b240b51] succeeded in 2.274261844000648s: None 2024-04-03T02:55:12.463577025Z [2024-04-03 02:55:12,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[654af9f6-f250-4c93-907d-7c947f4d1d29] received 2024-04-03T02:55:12.474048196Z [2024-04-03 02:55:12,473: INFO/ForkPoolWorker-15] [654af9f6-f250-4c93-907d-7c947f4d1d29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:12.779888746Z [2024-04-03 02:55:12,776: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:14.135236339Z [2024-04-03 02:55:14,134: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:55:14.142174088Z [2024-04-03 02:55:14,140: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:14.193351444Z [2024-04-03 02:55:14,193: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:55:14.194396534Z [2024-04-03 02:55:14,194: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:14.194492395Z [2024-04-03 02:55:14,194: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:14.194689578Z [2024-04-03 02:55:14,194: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:14.196686661Z [2024-04-03 02:55:14,196: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:55:14.196903638Z [2024-04-03 02:55:14,196: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:55:14.196915208Z [2024-04-03 02:55:14,196: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:14.300133455Z [2024-04-03 02:55:14,299: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:55:14.891991005Z [2024-04-03 02:55:14,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[654af9f6-f250-4c93-907d-7c947f4d1d29] succeeded in 2.4255027859999245s: None 2024-04-03T02:55:17.487434789Z [2024-04-03 02:55:17,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[322bfce2-05cc-4257-b2f4-cc112fa8f248] received 2024-04-03T02:55:17.495271179Z [2024-04-03 02:55:17,495: INFO/ForkPoolWorker-15] [322bfce2-05cc-4257-b2f4-cc112fa8f248] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T02:55:17.498478054Z [2024-04-03 02:55:17,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8185f534-5ce3-44b2-8c22-d4e7c2a6a0f3] received 2024-04-03T02:55:17.506496538Z [2024-04-03 02:55:17,506: INFO/ForkPoolWorker-16] [8185f534-5ce3-44b2-8c22-d4e7c2a6a0f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:55:17.876586279Z [2024-04-03 02:55:17,873: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:55:17.905116335Z [2024-04-03 02:55:17,902: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:19.059948869Z [2024-04-03 02:55:19,059: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:55:19.063486739Z [2024-04-03 02:55:19,063: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:19.095666071Z [2024-04-03 02:55:19,095: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:55:19.096943722Z [2024-04-03 02:55:19,096: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:19.097195312Z [2024-04-03 02:55:19,097: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:19.097323496Z [2024-04-03 02:55:19,097: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:19.097430484Z [2024-04-03 02:55:19,097: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:55:19.097855991Z [2024-04-03 02:55:19,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:55:19.097909613Z [2024-04-03 02:55:19,097: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:19.108346040Z [2024-04-03 02:55:19,108: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:19.109226784Z [2024-04-03 02:55:19,108: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T02:55:19.112223337Z [2024-04-03 02:55:19,112: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:55:19.115097414Z [2024-04-03 02:55:19,114: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:19.163420595Z [2024-04-03 02:55:19,163: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:55:19.165929746Z [2024-04-03 02:55:19,165: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:19.166023026Z [2024-04-03 02:55:19,165: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:19.166661112Z [2024-04-03 02:55:19,165: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:19.166673602Z [2024-04-03 02:55:19,166: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:55:19.166704413Z [2024-04-03 02:55:19,166: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T02:55:19.166708556Z [2024-04-03 02:55:19,166: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:19.176707953Z [2024-04-03 02:55:19,173: ERROR/ForkPoolWorker-15] [322bfce2-05cc-4257-b2f4-cc112fa8f248] Failed to execute task Dag 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse.. 2024-04-03T02:55:19.176715743Z Traceback (most recent call last): 2024-04-03T02:55:19.176719621Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T02:55:19.176723365Z args.func(args) 2024-04-03T02:55:19.176727142Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T02:55:19.176731035Z return func(*args, **kwargs) 2024-04-03T02:55:19.176746436Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T02:55:19.176749591Z return f(*args, **kwargs) 2024-04-03T02:55:19.176759098Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T02:55:19.176762400Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T02:55:19.176765501Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T02:55:19.176768705Z raise AirflowException( 2024-04-03T02:55:19.176772455Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse. 2024-04-03T02:55:19.226065184Z [2024-04-03 02:55:19,223: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[322bfce2-05cc-4257-b2f4-cc112fa8f248] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 322bfce2-05cc-4257-b2f4-cc112fa8f248') 2024-04-03T02:55:19.226084474Z Traceback (most recent call last): 2024-04-03T02:55:19.226090057Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T02:55:19.226093088Z R = retval = fun(*args, **kwargs) 2024-04-03T02:55:19.226096134Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T02:55:19.226099605Z return self.run(*args, **kwargs) 2024-04-03T02:55:19.226103168Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T02:55:19.226108051Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T02:55:19.226110983Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T02:55:19.226115540Z raise AirflowException(msg) 2024-04-03T02:55:19.226119182Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 322bfce2-05cc-4257-b2f4-cc112fa8f248 2024-04-03T02:55:19.286777288Z [2024-04-03 02:55:19,285: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:55:19.289972382Z [2024-04-03 02:55:19,289: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:19.314458081Z [2024-04-03 02:55:19,314: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:55:19.316335358Z [2024-04-03 02:55:19,316: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:19.316392992Z [2024-04-03 02:55:19,316: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:19.316472236Z [2024-04-03 02:55:19,316: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:19.316512985Z [2024-04-03 02:55:19,316: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:55:19.316837502Z [2024-04-03 02:55:19,316: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:55:19.316847740Z [2024-04-03 02:55:19,316: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:19.323702946Z [2024-04-03 02:55:19,323: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:55:19.324085730Z [2024-04-03 02:55:19,323: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:55:19.324848270Z [2024-04-03 02:55:19,324: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:55:19.327917762Z [2024-04-03 02:55:19,327: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:55:19.341202106Z [2024-04-03 02:55:19,341: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:55:19.342741064Z [2024-04-03 02:55:19,342: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:55:19.342753473Z [2024-04-03 02:55:19,342: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:55:19.342757475Z [2024-04-03 02:55:19,342: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:55:19.342760986Z [2024-04-03 02:55:19,342: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:55:19.342776508Z [2024-04-03 02:55:19,342: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:55:19.342779908Z [2024-04-03 02:55:19,342: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:55:19.346667792Z [2024-04-03 02:55:19,346: ERROR/ForkPoolWorker-16] [8185f534-5ce3-44b2-8c22-d4e7c2a6a0f3] Failed to execute task Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse.. 2024-04-03T02:55:19.346683768Z Traceback (most recent call last): 2024-04-03T02:55:19.346687702Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T02:55:19.346693101Z args.func(args) 2024-04-03T02:55:19.346696411Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T02:55:19.346699766Z return func(*args, **kwargs) 2024-04-03T02:55:19.346702899Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T02:55:19.346705735Z return f(*args, **kwargs) 2024-04-03T02:55:19.346708567Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T02:55:19.346711377Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T02:55:19.346714208Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T02:55:19.346716898Z raise AirflowException( 2024-04-03T02:55:19.346732039Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse. 2024-04-03T02:55:19.376776689Z [2024-04-03 02:55:19,376: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8185f534-5ce3-44b2-8c22-d4e7c2a6a0f3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8185f534-5ce3-44b2-8c22-d4e7c2a6a0f3') 2024-04-03T02:55:19.376806722Z Traceback (most recent call last): 2024-04-03T02:55:19.376813462Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T02:55:19.376817581Z R = retval = fun(*args, **kwargs) 2024-04-03T02:55:19.376821668Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T02:55:19.376825771Z return self.run(*args, **kwargs) 2024-04-03T02:55:19.376833671Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T02:55:19.376839266Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T02:55:19.376843529Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T02:55:19.376849121Z raise AirflowException(msg) 2024-04-03T02:55:19.376853913Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8185f534-5ce3-44b2-8c22-d4e7c2a6a0f3 2024-04-03T02:56:00.707421344Z [2024-04-03 02:56:00,706: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd414dfa-ce0f-4d14-9f41-0c6138649224] received 2024-04-03T02:56:00.714423006Z [2024-04-03 02:56:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[310da83a-a8a5-4dcb-8542-6b0ada859d32] received 2024-04-03T02:56:00.726334772Z [2024-04-03 02:56:00,725: INFO/ForkPoolWorker-15] [cd414dfa-ce0f-4d14-9f41-0c6138649224] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:56:00.726847711Z [2024-04-03 02:56:00,726: INFO/ForkPoolWorker-16] [310da83a-a8a5-4dcb-8542-6b0ada859d32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:56:00.786384207Z [2024-04-03 02:56:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[600acde8-7b62-4855-a8f8-f3db1ac2e07a] received 2024-04-03T02:56:00.795240835Z [2024-04-03 02:56:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f6d0dbb-23a6-41ef-be18-61731781808c] received 2024-04-03T02:56:00.816203570Z [2024-04-03 02:56:00,815: INFO/ForkPoolWorker-2] [9f6d0dbb-23a6-41ef-be18-61731781808c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:56:00.845728905Z [2024-04-03 02:56:00,844: INFO/ForkPoolWorker-1] [600acde8-7b62-4855-a8f8-f3db1ac2e07a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:56:01.128044404Z [2024-04-03 02:56:01,124: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:56:01.368295022Z [2024-04-03 02:56:01,363: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:56:01.384083366Z [2024-04-03 02:56:01,372: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:56:01.472818932Z [2024-04-03 02:56:01,455: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:56:01.497613614Z [2024-04-03 02:56:01,497: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:56:02.501542507Z [2024-04-03 02:56:02,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd414dfa-ce0f-4d14-9f41-0c6138649224] succeeded in 1.7903207019999172s: None 2024-04-03T02:56:03.896703916Z [2024-04-03 02:56:03,896: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:56:03.901098607Z [2024-04-03 02:56:03,900: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:56:03.970400876Z [2024-04-03 02:56:03,970: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:56:03.971765321Z [2024-04-03 02:56:03,971: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:56:03.971882326Z [2024-04-03 02:56:03,971: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:56:03.972024743Z [2024-04-03 02:56:03,971: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:56:03.972097544Z [2024-04-03 02:56:03,972: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:56:03.972367869Z [2024-04-03 02:56:03,972: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:56:03.972820396Z [2024-04-03 02:56:03,972: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:56:03.979371314Z [2024-04-03 02:56:03,979: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:56:03.980497443Z [2024-04-03 02:56:03,979: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:56:03.981454210Z [2024-04-03 02:56:03,981: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:56:03.984338646Z [2024-04-03 02:56:03,984: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:56:04.035454562Z [2024-04-03 02:56:04,035: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:56:04.043213270Z [2024-04-03 02:56:04,042: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:56:04.043340423Z [2024-04-03 02:56:04,043: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:56:04.043508387Z [2024-04-03 02:56:04,043: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:56:04.043597408Z [2024-04-03 02:56:04,043: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:56:04.043903458Z [2024-04-03 02:56:04,043: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:56:04.044023698Z [2024-04-03 02:56:04,043: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:56:04.051152475Z [2024-04-03 02:56:04,050: ERROR/ForkPoolWorker-1] [600acde8-7b62-4855-a8f8-f3db1ac2e07a] Failed to execute task Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse.. 2024-04-03T02:56:04.051162635Z Traceback (most recent call last): 2024-04-03T02:56:04.051166713Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-03T02:56:04.051170419Z args.func(args) 2024-04-03T02:56:04.051173840Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-03T02:56:04.051177586Z return func(*args, **kwargs) 2024-04-03T02:56:04.051180755Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-03T02:56:04.051183787Z return f(*args, **kwargs) 2024-04-03T02:56:04.051186911Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-03T02:56:04.051190404Z dag = get_dag(args.subdir, args.dag_id) 2024-04-03T02:56:04.051193544Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-03T02:56:04.051196584Z raise AirflowException( 2024-04-03T02:56:04.051200414Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_30cf6e1b-da8a-4893-a347-7a1fd6be4c82' could not be found; either it does not exist or it failed to parse. 2024-04-03T02:56:04.059402093Z [2024-04-03 02:56:04,059: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T02:56:04.065265010Z [2024-04-03 02:56:04,063: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:56:04.102567189Z [2024-04-03 02:56:04,101: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[600acde8-7b62-4855-a8f8-f3db1ac2e07a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 600acde8-7b62-4855-a8f8-f3db1ac2e07a') 2024-04-03T02:56:04.102583051Z Traceback (most recent call last): 2024-04-03T02:56:04.102587010Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-03T02:56:04.102669909Z R = retval = fun(*args, **kwargs) 2024-04-03T02:56:04.102673573Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-03T02:56:04.102677122Z return self.run(*args, **kwargs) 2024-04-03T02:56:04.102680932Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-03T02:56:04.102693663Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-03T02:56:04.102696774Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-03T02:56:04.102700321Z raise AirflowException(msg) 2024-04-03T02:56:04.102704225Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 600acde8-7b62-4855-a8f8-f3db1ac2e07a 2024-04-03T02:56:04.135331952Z [2024-04-03 02:56:04,135: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T02:56:04.139173134Z [2024-04-03 02:56:04,138: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:56:04.139699189Z [2024-04-03 02:56:04,139: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:56:04.139905502Z [2024-04-03 02:56:04,139: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:56:04.140003574Z [2024-04-03 02:56:04,139: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T02:56:04.140269374Z [2024-04-03 02:56:04,140: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:56:04.140781907Z [2024-04-03 02:56:04,140: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:56:04.257022828Z [2024-04-03 02:56:04,256: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:56:04.260804905Z [2024-04-03 02:56:04,260: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:56:04.285875881Z [2024-04-03 02:56:04,285: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:56:04.294767774Z [2024-04-03 02:56:04,294: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:56:04.296308760Z [2024-04-03 02:56:04,296: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:56:04.296437218Z [2024-04-03 02:56:04,296: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:56:04.296609728Z [2024-04-03 02:56:04,296: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:56:04.296672039Z [2024-04-03 02:56:04,296: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:56:04.296964988Z [2024-04-03 02:56:04,296: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:56:04.297042631Z [2024-04-03 02:56:04,296: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:56:04.390442049Z [2024-04-03 02:56:04,390: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:56:05.917298828Z [2024-04-03 02:56:05,916: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f6d0dbb-23a6-41ef-be18-61731781808c] succeeded in 5.1226306930002465s: None 2024-04-03T02:56:06.696605611Z [2024-04-03 02:56:06,696: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[310da83a-a8a5-4dcb-8542-6b0ada859d32] succeeded in 5.977002087999608s: None 2024-04-03T02:56:24.098735590Z [2024-04-03 02:56:24,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31bf3b19-3007-495d-a7a8-6ab3495b283a] received 2024-04-03T02:56:24.119160994Z [2024-04-03 02:56:24,118: INFO/ForkPoolWorker-15] [31bf3b19-3007-495d-a7a8-6ab3495b283a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240403025623_652359', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-03T02:56:24.410535600Z [2024-04-03 02:56:24,406: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-03T02:56:24.762773156Z [2024-04-03 02:56:24,762: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:56:25.478897307Z [2024-04-03 02:56:25,478: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31bf3b19-3007-495d-a7a8-6ab3495b283a] succeeded in 1.3752472769992892s: None 2024-04-03T02:57:00.548824922Z [2024-04-03 02:57:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64c9488f-2672-4c33-804f-78f71f37d096] received 2024-04-03T02:57:00.562938072Z [2024-04-03 02:57:00,562: INFO/ForkPoolWorker-15] [64c9488f-2672-4c33-804f-78f71f37d096] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:57:00.569501236Z [2024-04-03 02:57:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42d131de-870e-495e-a6af-eb9a82904427] received 2024-04-03T02:57:00.613234887Z [2024-04-03 02:57:00,612: INFO/ForkPoolWorker-16] [42d131de-870e-495e-a6af-eb9a82904427] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:57:00.957659642Z [2024-04-03 02:57:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:57:01.038556675Z [2024-04-03 02:57:01,033: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:57:02.171639368Z [2024-04-03 02:57:02,171: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:57:02.175850383Z [2024-04-03 02:57:02,175: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:57:02.211830451Z [2024-04-03 02:57:02,211: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:57:02.217237254Z [2024-04-03 02:57:02,216: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:57:02.217683259Z [2024-04-03 02:57:02,217: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:57:02.217883037Z [2024-04-03 02:57:02,217: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:57:02.217958163Z [2024-04-03 02:57:02,217: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:57:02.219060601Z [2024-04-03 02:57:02,218: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:57:02.219078108Z [2024-04-03 02:57:02,218: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:57:02.318521559Z [2024-04-03 02:57:02,318: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:57:02.407528948Z [2024-04-03 02:57:02,407: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:57:02.411379593Z [2024-04-03 02:57:02,410: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:57:02.444672086Z [2024-04-03 02:57:02,444: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:57:02.445698640Z [2024-04-03 02:57:02,445: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:57:02.445858952Z [2024-04-03 02:57:02,445: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:57:02.446055228Z [2024-04-03 02:57:02,445: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:57:02.446202811Z [2024-04-03 02:57:02,446: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:57:02.446552296Z [2024-04-03 02:57:02,446: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:57:02.446745654Z [2024-04-03 02:57:02,446: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:57:02.544053575Z [2024-04-03 02:57:02,543: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:57:04.130373711Z [2024-04-03 02:57:04,129: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42d131de-870e-495e-a6af-eb9a82904427] succeeded in 3.546286949000205s: None 2024-04-03T02:57:04.401383387Z [2024-04-03 02:57:04,400: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64c9488f-2672-4c33-804f-78f71f37d096] succeeded in 3.845425428999988s: None 2024-04-03T02:58:01.110718950Z [2024-04-03 02:58:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00d6c48c-f4b2-4bf9-b518-5cc99bd9dc40] received 2024-04-03T02:58:01.116678926Z [2024-04-03 02:58:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60b3bd47-ff85-4ce6-b3b6-18fd7d901f56] received 2024-04-03T02:58:01.124013089Z [2024-04-03 02:58:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24ccae67-8483-43f2-8c57-a4c3cea403e3] received 2024-04-03T02:58:01.136107152Z [2024-04-03 02:58:01,135: INFO/ForkPoolWorker-16] [60b3bd47-ff85-4ce6-b3b6-18fd7d901f56] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T02:58:01.149195368Z [2024-04-03 02:58:01,148: INFO/ForkPoolWorker-15] [00d6c48c-f4b2-4bf9-b518-5cc99bd9dc40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:58:01.153007459Z [2024-04-03 02:58:01,152: INFO/ForkPoolWorker-1] [24ccae67-8483-43f2-8c57-a4c3cea403e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:58:01.505382668Z [2024-04-03 02:58:01,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:58:01.771680329Z [2024-04-03 02:58:01,766: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T02:58:01.781012935Z [2024-04-03 02:58:01,776: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:58:02.048811111Z [2024-04-03 02:58:02,048: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:58:02.572299243Z [2024-04-03 02:58:02,571: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60b3bd47-ff85-4ce6-b3b6-18fd7d901f56] succeeded in 1.4522142589994473s: None 2024-04-03T02:58:02.772282399Z [2024-04-03 02:58:02,771: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:58:02.775291519Z [2024-04-03 02:58:02,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:58:02.859003048Z [2024-04-03 02:58:02,858: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:58:02.868740061Z [2024-04-03 02:58:02,867: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:58:02.869061155Z [2024-04-03 02:58:02,868: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:58:02.869272241Z [2024-04-03 02:58:02,869: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:58:02.869388521Z [2024-04-03 02:58:02,869: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:58:02.869756219Z [2024-04-03 02:58:02,869: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:58:02.869849696Z [2024-04-03 02:58:02,869: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:58:02.951519573Z [2024-04-03 02:58:02,951: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:58:03.205847665Z [2024-04-03 02:58:03,205: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T02:58:03.209458004Z [2024-04-03 02:58:03,209: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:58:03.254336277Z [2024-04-03 02:58:03,254: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T02:58:03.263171269Z [2024-04-03 02:58:03,262: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:58:03.263209478Z [2024-04-03 02:58:03,263: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:58:03.263471993Z [2024-04-03 02:58:03,263: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:58:03.263570932Z [2024-04-03 02:58:03,263: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T02:58:03.263906074Z [2024-04-03 02:58:03,263: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:58:03.263991237Z [2024-04-03 02:58:03,263: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:58:03.352400321Z [2024-04-03 02:58:03,352: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:58:05.101882606Z [2024-04-03 02:58:05,101: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00d6c48c-f4b2-4bf9-b518-5cc99bd9dc40] succeeded in 3.9872417110000242s: None 2024-04-03T02:58:05.200338804Z [2024-04-03 02:58:05,199: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[24ccae67-8483-43f2-8c57-a4c3cea403e3] succeeded in 4.07286308699986s: None 2024-04-03T02:59:00.226390388Z [2024-04-03 02:59:00,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[384a4c3b-22cf-4a05-9a13-143fb0eaf263] received 2024-04-03T02:59:00.231855656Z [2024-04-03 02:59:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7204d503-949b-444a-b9f2-64b492fc88a3] received 2024-04-03T02:59:00.242230626Z [2024-04-03 02:59:00,241: INFO/ForkPoolWorker-15] [384a4c3b-22cf-4a05-9a13-143fb0eaf263] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T02:59:00.245972444Z [2024-04-03 02:59:00,245: INFO/ForkPoolWorker-16] [7204d503-949b-444a-b9f2-64b492fc88a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T02:59:00.576604100Z [2024-04-03 02:59:00,572: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T02:59:00.607545629Z [2024-04-03 02:59:00,603: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T02:59:02.079084565Z [2024-04-03 02:59:02,078: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T02:59:02.082911652Z [2024-04-03 02:59:02,082: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:59:02.088161326Z [2024-04-03 02:59:02,087: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T02:59:02.092808399Z [2024-04-03 02:59:02,091: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T02:59:02.119581982Z [2024-04-03 02:59:02,119: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T02:59:02.124047208Z [2024-04-03 02:59:02,123: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:59:02.124136824Z [2024-04-03 02:59:02,123: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:59:02.124331283Z [2024-04-03 02:59:02,124: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:59:02.124357208Z [2024-04-03 02:59:02,124: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T02:59:02.124364901Z [2024-04-03 02:59:02,124: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T02:59:02.124697046Z [2024-04-03 02:59:02,124: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T02:59:02.124912720Z [2024-04-03 02:59:02,124: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:59:02.125666049Z [2024-04-03 02:59:02,125: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T02:59:02.125733004Z [2024-04-03 02:59:02,125: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T02:59:02.125907424Z [2024-04-03 02:59:02,125: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T02:59:02.126345665Z [2024-04-03 02:59:02,125: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T02:59:02.126701936Z [2024-04-03 02:59:02,126: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T02:59:02.127095257Z [2024-04-03 02:59:02,126: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T02:59:02.208969694Z [2024-04-03 02:59:02,208: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:59:02.243336757Z [2024-04-03 02:59:02,243: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T02:59:04.492469824Z [2024-04-03 02:59:04,491: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7204d503-949b-444a-b9f2-64b492fc88a3] succeeded in 4.257245855000292s: None 2024-04-03T02:59:04.514370901Z [2024-04-03 02:59:04,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[384a4c3b-22cf-4a05-9a13-143fb0eaf263] succeeded in 4.2839115449996825s: None 2024-04-03T03:00:00.616106335Z [2024-04-03 03:00:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e20ef0e9-2fc8-4f7d-8072-33ae8b1b7443] received 2024-04-03T03:00:00.630926429Z [2024-04-03 03:00:00,629: INFO/ForkPoolWorker-15] [e20ef0e9-2fc8-4f7d-8072-33ae8b1b7443] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:00:00.641644463Z [2024-04-03 03:00:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80d11709-c166-42b9-b6c8-e59cb647d831] received 2024-04-03T03:00:00.644945482Z [2024-04-03 03:00:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5839388c-3cee-4581-907b-e5fee03468bf] received 2024-04-03T03:00:00.658479832Z [2024-04-03 03:00:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a84688a9-af73-45d3-84b3-c642c27a7078] received 2024-04-03T03:00:00.673337003Z [2024-04-03 03:00:00,672: INFO/ForkPoolWorker-16] [80d11709-c166-42b9-b6c8-e59cb647d831] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:00:00.684708612Z [2024-04-03 03:00:00,684: INFO/ForkPoolWorker-2] [a84688a9-af73-45d3-84b3-c642c27a7078] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:00:00.691609280Z [2024-04-03 03:00:00,691: INFO/ForkPoolWorker-1] [5839388c-3cee-4581-907b-e5fee03468bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:00:01.248125772Z [2024-04-03 03:00:01,244: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:00:01.285038746Z [2024-04-03 03:00:01,279: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:00:01.359411274Z [2024-04-03 03:00:01,354: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:00:01.482853883Z [2024-04-03 03:00:01,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:00:02.281453359Z [2024-04-03 03:00:02,281: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:00:02.961639271Z [2024-04-03 03:00:02,961: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80d11709-c166-42b9-b6c8-e59cb647d831] succeeded in 2.311612920000698s: None 2024-04-03T03:00:02.991255383Z [2024-04-03 03:00:02,990: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T03:00:02.995241124Z [2024-04-03 03:00:02,994: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:00:03.051241568Z [2024-04-03 03:00:03,051: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T03:00:03.055171293Z [2024-04-03 03:00:03,054: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:00:03.055413080Z [2024-04-03 03:00:03,055: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:00:03.055626753Z [2024-04-03 03:00:03,055: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:00:03.055806129Z [2024-04-03 03:00:03,055: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T03:00:03.056226055Z [2024-04-03 03:00:03,056: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:00:03.056475561Z [2024-04-03 03:00:03,056: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:00:03.061527669Z [2024-04-03 03:00:03,061: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:00:03.065608022Z [2024-04-03 03:00:03,065: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:00:03.135452590Z [2024-04-03 03:00:03,135: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:00:03.136872543Z [2024-04-03 03:00:03,136: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:00:03.137026803Z [2024-04-03 03:00:03,136: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:00:03.137306315Z [2024-04-03 03:00:03,137: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:00:03.137494789Z [2024-04-03 03:00:03,137: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:00:03.137873388Z [2024-04-03 03:00:03,137: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:00:03.138079208Z [2024-04-03 03:00:03,137: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:00:03.165518884Z [2024-04-03 03:00:03,165: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:00:03.243420933Z [2024-04-03 03:00:03,242: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:00:03.248092051Z [2024-04-03 03:00:03,247: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:00:03.296241135Z [2024-04-03 03:00:03,295: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:00:03.363357571Z [2024-04-03 03:00:03,363: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:00:03.369621868Z [2024-04-03 03:00:03,369: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:00:03.369644259Z [2024-04-03 03:00:03,369: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:00:03.369740159Z [2024-04-03 03:00:03,369: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:00:03.369766333Z [2024-04-03 03:00:03,369: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:00:03.370225686Z [2024-04-03 03:00:03,370: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:00:03.370240814Z [2024-04-03 03:00:03,370: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:00:03.471429131Z [2024-04-03 03:00:03,471: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:00:04.246920025Z [2024-04-03 03:00:04,246: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e20ef0e9-2fc8-4f7d-8072-33ae8b1b7443] succeeded in 3.627680306000002s: None 2024-04-03T03:00:04.683013469Z [2024-04-03 03:00:04,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d381b77c-f7a2-4d65-aa61-240cd42691e3] received 2024-04-03T03:00:04.690426341Z [2024-04-03 03:00:04,690: INFO/ForkPoolWorker-15] [d381b77c-f7a2-4d65-aa61-240cd42691e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:00:04.979605936Z [2024-04-03 03:00:04,976: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:00:05.404299710Z [2024-04-03 03:00:05,403: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5839388c-3cee-4581-907b-e5fee03468bf] succeeded in 4.755905996000365s: None 2024-04-03T03:00:06.233137006Z [2024-04-03 03:00:06,232: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a84688a9-af73-45d3-84b3-c642c27a7078] succeeded in 5.569870789000561s: None 2024-04-03T03:00:06.415231124Z [2024-04-03 03:00:06,414: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:00:06.418874074Z [2024-04-03 03:00:06,418: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:00:06.443062148Z [2024-04-03 03:00:06,442: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:00:06.444521017Z [2024-04-03 03:00:06,444: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:00:06.444531559Z [2024-04-03 03:00:06,444: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:00:06.444535985Z [2024-04-03 03:00:06,444: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:00:06.444539734Z [2024-04-03 03:00:06,444: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:00:06.444813025Z [2024-04-03 03:00:06,444: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:00:06.444866512Z [2024-04-03 03:00:06,444: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:00:06.522283249Z [2024-04-03 03:00:06,522: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:00:07.145508705Z [2024-04-03 03:00:07,145: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d381b77c-f7a2-4d65-aa61-240cd42691e3] succeeded in 2.460779703999833s: None 2024-04-03T03:00:07.419218249Z [2024-04-03 03:00:07,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a3942d1-6a1d-46e0-be9e-d12ad543699d] received 2024-04-03T03:00:07.425482387Z [2024-04-03 03:00:07,425: INFO/ForkPoolWorker-15] [7a3942d1-6a1d-46e0-be9e-d12ad543699d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:00:07.769861754Z [2024-04-03 03:00:07,765: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:00:09.059280443Z [2024-04-03 03:00:09,058: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:00:09.062843731Z [2024-04-03 03:00:09,062: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:00:09.111298418Z [2024-04-03 03:00:09,110: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:00:09.122691616Z [2024-04-03 03:00:09,112: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:00:09.122717423Z [2024-04-03 03:00:09,112: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:00:09.122723032Z [2024-04-03 03:00:09,112: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:00:09.122728338Z [2024-04-03 03:00:09,112: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:00:09.122935418Z [2024-04-03 03:00:09,118: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:00:09.122942640Z [2024-04-03 03:00:09,118: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:00:09.217048419Z [2024-04-03 03:00:09,216: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:00:09.725034504Z [2024-04-03 03:00:09,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc374db9-d833-4479-bda5-8a3d12665e5e] received 2024-04-03T03:00:09.731975593Z [2024-04-03 03:00:09,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a3942d1-6a1d-46e0-be9e-d12ad543699d] succeeded in 2.310469815999568s: None 2024-04-03T03:00:09.741985977Z [2024-04-03 03:00:09,741: INFO/ForkPoolWorker-16] [dc374db9-d833-4479-bda5-8a3d12665e5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:00:10.120263135Z [2024-04-03 03:00:10,116: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:00:11.385925441Z [2024-04-03 03:00:11,385: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:00:11.389586560Z [2024-04-03 03:00:11,389: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:00:11.427735431Z [2024-04-03 03:00:11,427: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:00:11.429815289Z [2024-04-03 03:00:11,429: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:00:11.429867431Z [2024-04-03 03:00:11,429: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:00:11.430072828Z [2024-04-03 03:00:11,429: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:00:11.430172785Z [2024-04-03 03:00:11,430: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:00:11.430573285Z [2024-04-03 03:00:11,430: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:00:11.430809540Z [2024-04-03 03:00:11,430: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:00:11.557646279Z [2024-04-03 03:00:11,557: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:00:12.265627749Z [2024-04-03 03:00:12,265: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc374db9-d833-4479-bda5-8a3d12665e5e] succeeded in 2.537324859000364s: None 2024-04-03T03:01:00.489007142Z [2024-04-03 03:01:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07e92975-089d-4ec2-b7ab-68992e83aa72] received 2024-04-03T03:01:00.494367222Z [2024-04-03 03:01:00,494: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0773f5b-e0f3-4d61-8dd7-1e7b4767178e] received 2024-04-03T03:01:00.512100962Z [2024-04-03 03:01:00,511: INFO/ForkPoolWorker-15] [07e92975-089d-4ec2-b7ab-68992e83aa72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:01:00.515254337Z [2024-04-03 03:01:00,514: INFO/ForkPoolWorker-16] [c0773f5b-e0f3-4d61-8dd7-1e7b4767178e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:01:00.901196994Z [2024-04-03 03:01:00,896: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:01:00.924180596Z [2024-04-03 03:01:00,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:01:02.245601769Z [2024-04-03 03:01:02,245: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:01:02.249497756Z [2024-04-03 03:01:02,249: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:01:02.249709686Z [2024-04-03 03:01:02,249: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:01:02.253157499Z [2024-04-03 03:01:02,252: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:01:02.281096719Z [2024-04-03 03:01:02,280: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:01:02.282570838Z [2024-04-03 03:01:02,282: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:01:02.282583189Z [2024-04-03 03:01:02,282: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:01:02.282681521Z [2024-04-03 03:01:02,282: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:01:02.282688849Z [2024-04-03 03:01:02,282: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:01:02.282719875Z [2024-04-03 03:01:02,282: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:01:02.282957971Z [2024-04-03 03:01:02,282: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:01:02.282978858Z [2024-04-03 03:01:02,282: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:01:02.287111109Z [2024-04-03 03:01:02,286: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:01:02.287313177Z [2024-04-03 03:01:02,287: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:01:02.287498689Z [2024-04-03 03:01:02,287: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:01:02.287605472Z [2024-04-03 03:01:02,287: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:01:02.287861611Z [2024-04-03 03:01:02,287: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:01:02.287918674Z [2024-04-03 03:01:02,287: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:01:02.362788823Z [2024-04-03 03:01:02,362: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:01:02.377057306Z [2024-04-03 03:01:02,376: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:01:03.978019183Z [2024-04-03 03:01:03,977: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c0773f5b-e0f3-4d61-8dd7-1e7b4767178e] succeeded in 3.4762454740002795s: None 2024-04-03T03:01:04.901512788Z [2024-04-03 03:01:04,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07e92975-089d-4ec2-b7ab-68992e83aa72] succeeded in 4.406586283000252s: None 2024-04-03T03:02:00.318016202Z [2024-04-03 03:02:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[867e1a76-769c-4770-b0ff-e02f8fc559c9] received 2024-04-03T03:02:00.322919696Z [2024-04-03 03:02:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdd7404c-c621-4db2-a959-8bffa1da4729] received 2024-04-03T03:02:00.334580995Z [2024-04-03 03:02:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0685d721-582e-4523-8f68-023a6aef6ab5] received 2024-04-03T03:02:00.341227901Z [2024-04-03 03:02:00,340: INFO/ForkPoolWorker-16] [cdd7404c-c621-4db2-a959-8bffa1da4729] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:02:00.341402778Z [2024-04-03 03:02:00,340: INFO/ForkPoolWorker-15] [867e1a76-769c-4770-b0ff-e02f8fc559c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:02:00.377566022Z [2024-04-03 03:02:00,377: INFO/ForkPoolWorker-1] [0685d721-582e-4523-8f68-023a6aef6ab5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:02:00.784752857Z [2024-04-03 03:02:00,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:02:00.942709604Z [2024-04-03 03:02:00,927: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:02:01.197969760Z [2024-04-03 03:02:01,192: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:02:01.741848498Z [2024-04-03 03:02:01,741: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:02:02.495149178Z [2024-04-03 03:02:02,494: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cdd7404c-c621-4db2-a959-8bffa1da4729] succeeded in 2.1684285029996317s: None 2024-04-03T03:02:02.919997868Z [2024-04-03 03:02:02,919: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:02:02.923845381Z [2024-04-03 03:02:02,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:02:02.981261119Z [2024-04-03 03:02:02,981: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:02:02.985046793Z [2024-04-03 03:02:02,982: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:02:02.985068098Z [2024-04-03 03:02:02,982: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:02:02.985072697Z [2024-04-03 03:02:02,982: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:02:02.985084999Z [2024-04-03 03:02:02,983: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:02:02.985088383Z [2024-04-03 03:02:02,983: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:02:02.985091578Z [2024-04-03 03:02:02,983: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:02:03.107923392Z [2024-04-03 03:02:03,107: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:02:03.216173561Z [2024-04-03 03:02:03,215: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:02:03.221038593Z [2024-04-03 03:02:03,220: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:02:03.254164197Z [2024-04-03 03:02:03,253: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:02:03.255491860Z [2024-04-03 03:02:03,255: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:02:03.255784809Z [2024-04-03 03:02:03,255: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:02:03.256072022Z [2024-04-03 03:02:03,255: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:02:03.256268411Z [2024-04-03 03:02:03,256: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:02:03.257291560Z [2024-04-03 03:02:03,256: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:02:03.257480109Z [2024-04-03 03:02:03,257: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:02:03.381283730Z [2024-04-03 03:02:03,380: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:02:05.198299278Z [2024-04-03 03:02:05,197: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[867e1a76-769c-4770-b0ff-e02f8fc559c9] succeeded in 4.87302119099968s: None 2024-04-03T03:02:05.703498060Z [2024-04-03 03:02:05,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0685d721-582e-4523-8f68-023a6aef6ab5] succeeded in 5.362591643999622s: None 2024-04-03T03:03:00.578334848Z [2024-04-03 03:03:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67923667-84e5-496a-be53-68677cc3c671] received 2024-04-03T03:03:00.588882507Z [2024-04-03 03:03:00,588: INFO/ForkPoolWorker-15] [67923667-84e5-496a-be53-68677cc3c671] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:03:00.604741060Z [2024-04-03 03:03:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d69d07e8-6026-4f68-9d16-f558a9f8f1be] received 2024-04-03T03:03:00.638072004Z [2024-04-03 03:03:00,632: INFO/ForkPoolWorker-16] [d69d07e8-6026-4f68-9d16-f558a9f8f1be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:03:01.079252827Z [2024-04-03 03:03:01,074: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:03:01.278829635Z [2024-04-03 03:03:01,274: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:03:02.742326723Z [2024-04-03 03:03:02,741: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:03:02.745797767Z [2024-04-03 03:03:02,745: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:03:02.783247397Z [2024-04-03 03:03:02,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:03:02.785263139Z [2024-04-03 03:03:02,785: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:03:02.785294355Z [2024-04-03 03:03:02,785: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:03:02.785417881Z [2024-04-03 03:03:02,785: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:03:02.785439413Z [2024-04-03 03:03:02,785: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:03:02.785661925Z [2024-04-03 03:03:02,785: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:03:02.785702947Z [2024-04-03 03:03:02,785: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:03:02.900210325Z [2024-04-03 03:03:02,899: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:03:03.058469459Z [2024-04-03 03:03:03,058: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:03:03.073121938Z [2024-04-03 03:03:03,062: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:03:03.170816461Z [2024-04-03 03:03:03,169: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:03:03.174758516Z [2024-04-03 03:03:03,174: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:03:03.174784861Z [2024-04-03 03:03:03,174: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:03:03.174902668Z [2024-04-03 03:03:03,174: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:03:03.174941899Z [2024-04-03 03:03:03,174: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:03:03.175226835Z [2024-04-03 03:03:03,175: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:03:03.176455175Z [2024-04-03 03:03:03,175: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:03:03.273211086Z [2024-04-03 03:03:03,272: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:03:04.816292074Z [2024-04-03 03:03:04,815: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67923667-84e5-496a-be53-68677cc3c671] succeeded in 4.234554785999535s: None 2024-04-03T03:03:05.181424415Z [2024-04-03 03:03:05,181: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d69d07e8-6026-4f68-9d16-f558a9f8f1be] succeeded in 4.5712519300004715s: None 2024-04-03T03:04:01.009827363Z [2024-04-03 03:04:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb99f655-9de2-4869-bc6c-55a2f6e5210f] received 2024-04-03T03:04:01.018768014Z [2024-04-03 03:04:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25eba783-a522-4325-9282-5422a8a2ec74] received 2024-04-03T03:04:01.027183484Z [2024-04-03 03:04:01,026: INFO/ForkPoolWorker-15] [bb99f655-9de2-4869-bc6c-55a2f6e5210f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:04:01.035194158Z [2024-04-03 03:04:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3575cda6-165c-4c92-9e1d-f66af9fd7535] received 2024-04-03T03:04:01.045931102Z [2024-04-03 03:04:01,045: INFO/ForkPoolWorker-16] [25eba783-a522-4325-9282-5422a8a2ec74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:04:01.080571847Z [2024-04-03 03:04:01,080: INFO/ForkPoolWorker-1] [3575cda6-165c-4c92-9e1d-f66af9fd7535] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:04:01.429709934Z [2024-04-03 03:04:01,425: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:04:01.484687471Z [2024-04-03 03:04:01,479: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:04:01.545569979Z [2024-04-03 03:04:01,541: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:04:01.753350650Z [2024-04-03 03:04:01,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:04:02.301524662Z [2024-04-03 03:04:02,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb99f655-9de2-4869-bc6c-55a2f6e5210f] succeeded in 1.2840229260000342s: None 2024-04-03T03:04:02.860702870Z [2024-04-03 03:04:02,852: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:04:02.860729044Z [2024-04-03 03:04:02,857: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:04:02.919531156Z [2024-04-03 03:04:02,919: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:04:02.931680349Z [2024-04-03 03:04:02,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:04:02.947706254Z [2024-04-03 03:04:02,947: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:04:02.949822714Z [2024-04-03 03:04:02,949: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:04:02.949911787Z [2024-04-03 03:04:02,949: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:04:02.950057850Z [2024-04-03 03:04:02,949: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:04:02.950673040Z [2024-04-03 03:04:02,950: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:04:02.950980671Z [2024-04-03 03:04:02,950: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:04:02.951044814Z [2024-04-03 03:04:02,950: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:04:02.985116959Z [2024-04-03 03:04:02,984: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:04:02.986391365Z [2024-04-03 03:04:02,985: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:04:02.986512828Z [2024-04-03 03:04:02,986: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:04:02.987024976Z [2024-04-03 03:04:02,986: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:04:02.987034881Z [2024-04-03 03:04:02,986: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:04:02.987049410Z [2024-04-03 03:04:02,986: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:04:02.987334696Z [2024-04-03 03:04:02,986: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:04:03.080170461Z [2024-04-03 03:04:03,079: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:04:03.083868167Z [2024-04-03 03:04:03,083: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:04:05.169692004Z [2024-04-03 03:04:05,169: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3575cda6-165c-4c92-9e1d-f66af9fd7535] succeeded in 4.12531326699991s: None 2024-04-03T03:04:05.542539700Z [2024-04-03 03:04:05,541: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25eba783-a522-4325-9282-5422a8a2ec74] succeeded in 4.519746285999645s: None 2024-04-03T03:05:00.658862183Z [2024-04-03 03:05:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92dd5fad-1892-4f88-a4c0-4b87d70422ed] received 2024-04-03T03:05:00.667835288Z [2024-04-03 03:05:00,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7079b945-8ce3-482e-88ec-d3e9e45dc160] received 2024-04-03T03:05:00.671673236Z [2024-04-03 03:05:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f51220dc-404b-4aa9-b3ad-35b28a3f97ea] received 2024-04-03T03:05:00.684799324Z [2024-04-03 03:05:00,684: INFO/ForkPoolWorker-1] [f51220dc-404b-4aa9-b3ad-35b28a3f97ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:05:00.686571427Z [2024-04-03 03:05:00,686: INFO/ForkPoolWorker-15] [92dd5fad-1892-4f88-a4c0-4b87d70422ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:05:00.695759647Z [2024-04-03 03:05:00,695: INFO/ForkPoolWorker-16] [7079b945-8ce3-482e-88ec-d3e9e45dc160] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:05:01.157881087Z [2024-04-03 03:05:01,153: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:05:01.281638362Z [2024-04-03 03:05:01,276: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:05:01.395479664Z [2024-04-03 03:05:01,390: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:05:02.730072104Z [2024-04-03 03:05:02,729: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:05:02.734040278Z [2024-04-03 03:05:02,733: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:05:02.754378240Z [2024-04-03 03:05:02,754: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:05:02.757843239Z [2024-04-03 03:05:02,757: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:05:02.799109138Z [2024-04-03 03:05:02,797: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:05:02.802329592Z [2024-04-03 03:05:02,799: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:05:02.802355622Z [2024-04-03 03:05:02,799: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:05:02.802377167Z [2024-04-03 03:05:02,800: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:05:02.802381583Z [2024-04-03 03:05:02,800: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:05:02.802384649Z [2024-04-03 03:05:02,800: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:05:02.802387970Z [2024-04-03 03:05:02,800: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:05:02.885645641Z [2024-04-03 03:05:02,885: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:05:02.888971121Z [2024-04-03 03:05:02,888: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:05:02.888987685Z [2024-04-03 03:05:02,888: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:05:02.889082225Z [2024-04-03 03:05:02,888: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:05:02.889107980Z [2024-04-03 03:05:02,889: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:05:02.889343898Z [2024-04-03 03:05:02,889: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:05:02.889369027Z [2024-04-03 03:05:02,889: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:05:02.916908095Z [2024-04-03 03:05:02,916: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:05:02.920933295Z [2024-04-03 03:05:02,920: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:05:02.921086168Z [2024-04-03 03:05:02,920: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:05:03.008134904Z [2024-04-03 03:05:03,007: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:05:03.011322978Z [2024-04-03 03:05:03,011: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:05:03.011512234Z [2024-04-03 03:05:03,011: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:05:03.011793797Z [2024-04-03 03:05:03,011: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:05:03.011983356Z [2024-04-03 03:05:03,011: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:05:03.012370726Z [2024-04-03 03:05:03,012: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:05:03.012593247Z [2024-04-03 03:05:03,012: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:05:03.055787235Z [2024-04-03 03:05:03,055: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:05:03.164857338Z [2024-04-03 03:05:03,164: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:05:04.193574764Z [2024-04-03 03:05:04,190: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92dd5fad-1892-4f88-a4c0-4b87d70422ed] succeeded in 3.5268685539995204s: None 2024-04-03T03:05:04.631410823Z [2024-04-03 03:05:04,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb53411f-c366-42a5-9011-2557319fb048] received 2024-04-03T03:05:04.639754762Z [2024-04-03 03:05:04,639: INFO/ForkPoolWorker-15] [fb53411f-c366-42a5-9011-2557319fb048] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:05:04.929966372Z [2024-04-03 03:05:04,929: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f51220dc-404b-4aa9-b3ad-35b28a3f97ea] succeeded in 4.254962326000168s: None 2024-04-03T03:05:04.986355209Z [2024-04-03 03:05:04,983: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:05:05.260172220Z [2024-04-03 03:05:05,259: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7079b945-8ce3-482e-88ec-d3e9e45dc160] succeeded in 4.58873980000044s: None 2024-04-03T03:05:06.268490681Z [2024-04-03 03:05:06,268: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:05:06.272193114Z [2024-04-03 03:05:06,271: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:05:06.304794724Z [2024-04-03 03:05:06,304: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:05:06.307783382Z [2024-04-03 03:05:06,307: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:05:06.307954693Z [2024-04-03 03:05:06,307: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:05:06.308227971Z [2024-04-03 03:05:06,307: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:05:06.308374596Z [2024-04-03 03:05:06,308: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:05:06.308808522Z [2024-04-03 03:05:06,308: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:05:06.308972533Z [2024-04-03 03:05:06,308: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:05:06.402789778Z [2024-04-03 03:05:06,402: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:05:07.067196222Z [2024-04-03 03:05:07,066: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb53411f-c366-42a5-9011-2557319fb048] succeeded in 2.43352571899959s: None 2024-04-03T03:05:08.070679456Z [2024-04-03 03:05:08,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26c9fd85-fc10-4ba2-b3f7-66f63f6e3fe6] received 2024-04-03T03:05:08.077354181Z [2024-04-03 03:05:08,077: INFO/ForkPoolWorker-15] [26c9fd85-fc10-4ba2-b3f7-66f63f6e3fe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:05:08.355850755Z [2024-04-03 03:05:08,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:05:09.490443496Z [2024-04-03 03:05:09,490: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:05:09.493694346Z [2024-04-03 03:05:09,493: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:05:09.523984521Z [2024-04-03 03:05:09,523: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:05:09.526782531Z [2024-04-03 03:05:09,526: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:05:09.526811550Z [2024-04-03 03:05:09,526: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:05:09.527094989Z [2024-04-03 03:05:09,526: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:05:09.527125016Z [2024-04-03 03:05:09,526: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:05:09.528246168Z [2024-04-03 03:05:09,527: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:05:09.528260848Z [2024-04-03 03:05:09,528: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:05:09.631241333Z [2024-04-03 03:05:09,630: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:05:10.302451402Z [2024-04-03 03:05:10,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26c9fd85-fc10-4ba2-b3f7-66f63f6e3fe6] succeeded in 2.2294797559998187s: None 2024-04-03T03:05:10.843396805Z [2024-04-03 03:05:10,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ac2cc54-7644-4d06-899f-101f84522507] received 2024-04-03T03:05:10.850992217Z [2024-04-03 03:05:10,850: INFO/ForkPoolWorker-15] [0ac2cc54-7644-4d06-899f-101f84522507] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:05:11.183657982Z [2024-04-03 03:05:11,180: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:05:12.563288510Z [2024-04-03 03:05:12,562: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:05:12.566774225Z [2024-04-03 03:05:12,566: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:05:12.602615483Z [2024-04-03 03:05:12,602: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:05:12.609268656Z [2024-04-03 03:05:12,608: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:05:12.610769851Z [2024-04-03 03:05:12,609: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:05:12.611055270Z [2024-04-03 03:05:12,610: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:05:12.611203320Z [2024-04-03 03:05:12,611: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:05:12.611566115Z [2024-04-03 03:05:12,611: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:05:12.614852544Z [2024-04-03 03:05:12,611: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:05:12.783621583Z [2024-04-03 03:05:12,782: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:05:13.451432284Z [2024-04-03 03:05:13,450: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ac2cc54-7644-4d06-899f-101f84522507] succeeded in 2.604868960999738s: None 2024-04-03T03:06:00.578480530Z [2024-04-03 03:06:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d27b501d-23fb-4ddc-aa6e-6552e43a786a] received 2024-04-03T03:06:00.588550913Z [2024-04-03 03:06:00,588: INFO/ForkPoolWorker-15] [d27b501d-23fb-4ddc-aa6e-6552e43a786a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:06:00.595941312Z [2024-04-03 03:06:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f1f7a3a-e2ff-429c-82b0-02541d08e033] received 2024-04-03T03:06:00.597835145Z [2024-04-03 03:06:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d5f15d3-b922-4dcb-9c5c-ab6be9ebc6e3] received 2024-04-03T03:06:00.631981144Z [2024-04-03 03:06:00,631: INFO/ForkPoolWorker-1] [2d5f15d3-b922-4dcb-9c5c-ab6be9ebc6e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:06:00.649142905Z [2024-04-03 03:06:00,646: INFO/ForkPoolWorker-16] [1f1f7a3a-e2ff-429c-82b0-02541d08e033] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:06:01.070461641Z [2024-04-03 03:06:01,066: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:06:01.192478225Z [2024-04-03 03:06:01,187: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:06:01.200680293Z [2024-04-03 03:06:01,197: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:06:01.538219684Z [2024-04-03 03:06:01,537: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:06:02.251281893Z [2024-04-03 03:06:02,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d27b501d-23fb-4ddc-aa6e-6552e43a786a] succeeded in 1.6700865220000196s: None 2024-04-03T03:06:02.771645124Z [2024-04-03 03:06:02,771: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:06:02.778117902Z [2024-04-03 03:06:02,774: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:06:02.878254150Z [2024-04-03 03:06:02,878: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:06:02.879958376Z [2024-04-03 03:06:02,879: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:06:02.880195656Z [2024-04-03 03:06:02,879: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:06:02.880388003Z [2024-04-03 03:06:02,880: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:06:02.880510609Z [2024-04-03 03:06:02,880: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:06:02.880811250Z [2024-04-03 03:06:02,880: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:06:02.881045946Z [2024-04-03 03:06:02,880: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:06:02.974546154Z [2024-04-03 03:06:02,974: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:06:03.022700988Z [2024-04-03 03:06:03,022: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:06:03.026360823Z [2024-04-03 03:06:03,025: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:06:03.087428306Z [2024-04-03 03:06:03,087: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:06:03.088734928Z [2024-04-03 03:06:03,088: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:06:03.088894276Z [2024-04-03 03:06:03,088: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:06:03.089081291Z [2024-04-03 03:06:03,088: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-03T03:06:03.089129079Z [2024-04-03 03:06:03,089: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:06:03.089416833Z [2024-04-03 03:06:03,089: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:06:03.089487082Z [2024-04-03 03:06:03,089: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:06:03.225519928Z [2024-04-03 03:06:03,225: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:06:05.025905969Z [2024-04-03 03:06:05,025: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f1f7a3a-e2ff-429c-82b0-02541d08e033] succeeded in 4.4252499610001905s: None 2024-04-03T03:06:06.182304788Z [2024-04-03 03:06:06,181: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2d5f15d3-b922-4dcb-9c5c-ab6be9ebc6e3] succeeded in 5.573218638000071s: None 2024-04-03T03:07:00.234460719Z [2024-04-03 03:07:00,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2f526ff-c020-4bc6-bedf-176e4bd25027] received 2024-04-03T03:07:00.246056977Z [2024-04-03 03:07:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b49eec46-a6ae-49e6-95a0-31a75e28ff32] received 2024-04-03T03:07:00.259854905Z [2024-04-03 03:07:00,259: INFO/ForkPoolWorker-15] [f2f526ff-c020-4bc6-bedf-176e4bd25027] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:07:00.268639717Z [2024-04-03 03:07:00,268: INFO/ForkPoolWorker-16] [b49eec46-a6ae-49e6-95a0-31a75e28ff32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:07:00.615481013Z [2024-04-03 03:07:00,611: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:07:00.619853030Z [2024-04-03 03:07:00,615: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:07:01.982323191Z [2024-04-03 03:07:01,981: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:07:01.985926147Z [2024-04-03 03:07:01,985: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:07:02.016842445Z [2024-04-03 03:07:02,016: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:07:02.018059534Z [2024-04-03 03:07:02,017: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:07:02.018176663Z [2024-04-03 03:07:02,018: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:07:02.018295116Z [2024-04-03 03:07:02,018: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:07:02.018466649Z [2024-04-03 03:07:02,018: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:07:02.018564527Z [2024-04-03 03:07:02,018: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:07:02.018828116Z [2024-04-03 03:07:02,018: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:07:02.018909068Z [2024-04-03 03:07:02,018: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:07:02.024387814Z [2024-04-03 03:07:02,024: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:07:02.102740972Z [2024-04-03 03:07:02,102: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:07:02.106228392Z [2024-04-03 03:07:02,105: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:07:02.111881372Z [2024-04-03 03:07:02,111: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:07:02.152233256Z [2024-04-03 03:07:02,152: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:07:02.153142398Z [2024-04-03 03:07:02,152: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:07:02.153182161Z [2024-04-03 03:07:02,153: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:07:02.153238756Z [2024-04-03 03:07:02,153: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:07:02.153346527Z [2024-04-03 03:07:02,153: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:07:02.153378879Z [2024-04-03 03:07:02,153: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:07:02.153593305Z [2024-04-03 03:07:02,153: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:07:02.153644013Z [2024-04-03 03:07:02,153: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:07:02.157996810Z [2024-04-03 03:07:02,157: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:07:02.247801507Z [2024-04-03 03:07:02,247: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:07:03.795346054Z [2024-04-03 03:07:03,794: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2f526ff-c020-4bc6-bedf-176e4bd25027] succeeded in 3.5571207709999726s: None 2024-04-03T03:07:04.104207920Z [2024-04-03 03:07:04,103: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b49eec46-a6ae-49e6-95a0-31a75e28ff32] succeeded in 3.854944976999832s: None 2024-04-03T03:08:00.388546329Z [2024-04-03 03:08:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[608b3d89-88db-45ae-88a2-7f0bf6392e15] received 2024-04-03T03:08:00.391943148Z [2024-04-03 03:08:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adbb1f12-d9cc-4de4-a96f-d9ab9d5c9b3d] received 2024-04-03T03:08:00.394136856Z [2024-04-03 03:08:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[486363eb-2a28-4b84-b09c-1d5c7a63c234] received 2024-04-03T03:08:00.425432274Z [2024-04-03 03:08:00,424: INFO/ForkPoolWorker-16] [adbb1f12-d9cc-4de4-a96f-d9ab9d5c9b3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:08:00.426386971Z [2024-04-03 03:08:00,425: INFO/ForkPoolWorker-15] [608b3d89-88db-45ae-88a2-7f0bf6392e15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:08:00.451377587Z [2024-04-03 03:08:00,450: INFO/ForkPoolWorker-1] [486363eb-2a28-4b84-b09c-1d5c7a63c234] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:08:00.935223156Z [2024-04-03 03:08:00,930: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:08:00.999191638Z [2024-04-03 03:08:00,994: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:08:01.071086877Z [2024-04-03 03:08:01,067: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:08:01.374995476Z [2024-04-03 03:08:01,374: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:08:02.035740979Z [2024-04-03 03:08:02,035: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[adbb1f12-d9cc-4de4-a96f-d9ab9d5c9b3d] succeeded in 1.6396392229999037s: None 2024-04-03T03:08:02.457748733Z [2024-04-03 03:08:02,457: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:08:02.461160594Z [2024-04-03 03:08:02,460: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:08:02.485416990Z [2024-04-03 03:08:02,485: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:08:02.486452309Z [2024-04-03 03:08:02,486: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:08:02.486475574Z [2024-04-03 03:08:02,486: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:08:02.486572511Z [2024-04-03 03:08:02,486: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:08:02.486722448Z [2024-04-03 03:08:02,486: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:08:02.486881351Z [2024-04-03 03:08:02,486: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:08:02.487319864Z [2024-04-03 03:08:02,487: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:08:02.487332278Z [2024-04-03 03:08:02,487: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:08:02.491900943Z [2024-04-03 03:08:02,491: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:08:02.559864828Z [2024-04-03 03:08:02,559: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:08:02.678198883Z [2024-04-03 03:08:02,677: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:08:02.681678289Z [2024-04-03 03:08:02,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:08:02.721608634Z [2024-04-03 03:08:02,721: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:08:02.726911997Z [2024-04-03 03:08:02,726: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:08:02.727261175Z [2024-04-03 03:08:02,726: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:08:02.727428180Z [2024-04-03 03:08:02,727: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:08:02.727722452Z [2024-04-03 03:08:02,727: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:08:02.728354038Z [2024-04-03 03:08:02,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:08:02.729178787Z [2024-04-03 03:08:02,728: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:08:02.729414886Z [2024-04-03 03:08:02,729: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:08:02.735298148Z [2024-04-03 03:08:02,735: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:08:02.846290789Z [2024-04-03 03:08:02,846: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:08:04.408862965Z [2024-04-03 03:08:04,408: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[486363eb-2a28-4b84-b09c-1d5c7a63c234] succeeded in 4.0064077980005095s: None 2024-04-03T03:08:04.421124940Z [2024-04-03 03:08:04,420: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[608b3d89-88db-45ae-88a2-7f0bf6392e15] succeeded in 4.0163212879997445s: None 2024-04-03T03:09:00.794724766Z [2024-04-03 03:09:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a7b1b57-351f-4563-9729-309970629201] received 2024-04-03T03:09:00.808667777Z [2024-04-03 03:09:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f97128-1257-48d1-81aa-835a9ac0bd7d] received 2024-04-03T03:09:00.827209806Z [2024-04-03 03:09:00,823: INFO/ForkPoolWorker-16] [e0f97128-1257-48d1-81aa-835a9ac0bd7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:09:00.827973876Z [2024-04-03 03:09:00,827: INFO/ForkPoolWorker-15] [4a7b1b57-351f-4563-9729-309970629201] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:09:01.210859135Z [2024-04-03 03:09:01,206: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:09:01.320891413Z [2024-04-03 03:09:01,315: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:09:02.620365407Z [2024-04-03 03:09:02,619: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:09:02.623874742Z [2024-04-03 03:09:02,623: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:09:02.650707068Z [2024-04-03 03:09:02,650: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:09:02.651938281Z [2024-04-03 03:09:02,651: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:09:02.652100052Z [2024-04-03 03:09:02,651: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:09:02.652234402Z [2024-04-03 03:09:02,652: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:09:02.652439673Z [2024-04-03 03:09:02,652: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:09:02.652589084Z [2024-04-03 03:09:02,652: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:09:02.652861695Z [2024-04-03 03:09:02,652: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:09:02.653027097Z [2024-04-03 03:09:02,652: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:09:02.657668359Z [2024-04-03 03:09:02,657: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:09:02.731440574Z [2024-04-03 03:09:02,731: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:09:02.754396911Z [2024-04-03 03:09:02,754: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:09:02.757931167Z [2024-04-03 03:09:02,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:09:02.817186923Z [2024-04-03 03:09:02,816: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:09:02.818973041Z [2024-04-03 03:09:02,818: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:09:02.819169296Z [2024-04-03 03:09:02,818: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:09:02.821099094Z [2024-04-03 03:09:02,820: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:09:02.822502615Z [2024-04-03 03:09:02,820: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:09:02.822514033Z [2024-04-03 03:09:02,821: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:09:02.822534447Z [2024-04-03 03:09:02,821: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:09:02.822538406Z [2024-04-03 03:09:02,821: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:09:02.858652646Z [2024-04-03 03:09:02,844: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:09:02.946087505Z [2024-04-03 03:09:02,945: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:09:05.069361558Z [2024-04-03 03:09:05,068: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0f97128-1257-48d1-81aa-835a9ac0bd7d] succeeded in 4.257425015000081s: None 2024-04-03T03:09:05.778772431Z [2024-04-03 03:09:05,777: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a7b1b57-351f-4563-9729-309970629201] succeeded in 4.979316488999757s: None 2024-04-03T03:10:01.136081970Z [2024-04-03 03:10:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3895bcbe-cf3c-4e9e-bdc1-7b18cc2a92f7] received 2024-04-03T03:10:01.140025708Z [2024-04-03 03:10:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[553dcd93-6d67-4dcd-aff8-b7dc0b7c0150] received 2024-04-03T03:10:01.151955219Z [2024-04-03 03:10:01,151: INFO/ForkPoolWorker-16] [553dcd93-6d67-4dcd-aff8-b7dc0b7c0150] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:10:01.154927533Z [2024-04-03 03:10:01,154: INFO/ForkPoolWorker-15] [3895bcbe-cf3c-4e9e-bdc1-7b18cc2a92f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:10:01.154944758Z [2024-04-03 03:10:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8d7c5d8-670f-4d95-8f05-781c9f8dc0e0] received 2024-04-03T03:10:01.181840237Z [2024-04-03 03:10:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2d75d5f-e93d-40f7-8b89-d147376d5891] received 2024-04-03T03:10:01.181862086Z [2024-04-03 03:10:01,180: INFO/ForkPoolWorker-1] [b8d7c5d8-670f-4d95-8f05-781c9f8dc0e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:10:01.193910704Z [2024-04-03 03:10:01,192: INFO/ForkPoolWorker-2] [a2d75d5f-e93d-40f7-8b89-d147376d5891] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:10:01.518437259Z [2024-04-03 03:10:01,515: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:10:01.585417444Z [2024-04-03 03:10:01,582: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:10:01.668579395Z [2024-04-03 03:10:01,664: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:10:01.748548314Z [2024-04-03 03:10:01,743: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:10:01.797189451Z [2024-04-03 03:10:01,796: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:10:02.339436212Z [2024-04-03 03:10:02,339: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[553dcd93-6d67-4dcd-aff8-b7dc0b7c0150] succeeded in 1.1956280289996357s: None 2024-04-03T03:10:03.035168332Z [2024-04-03 03:10:03,033: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T03:10:03.040409446Z [2024-04-03 03:10:03,039: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:10:03.120973886Z [2024-04-03 03:10:03,120: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T03:10:03.123048778Z [2024-04-03 03:10:03,122: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:10:03.123187982Z [2024-04-03 03:10:03,123: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:10:03.123330396Z [2024-04-03 03:10:03,123: INFO/ForkPoolWorker-2] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:10:03.123524965Z [2024-04-03 03:10:03,123: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:10:03.123745575Z [2024-04-03 03:10:03,123: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T03:10:03.124065506Z [2024-04-03 03:10:03,123: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:10:03.124217688Z [2024-04-03 03:10:03,124: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:10:03.131118309Z [2024-04-03 03:10:03,130: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:10:03.193524029Z [2024-04-03 03:10:03,193: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:10:03.200236875Z [2024-04-03 03:10:03,199: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:10:03.245003680Z [2024-04-03 03:10:03,244: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:10:03.271910058Z [2024-04-03 03:10:03,271: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:10:03.273193726Z [2024-04-03 03:10:03,272: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:10:03.273214222Z [2024-04-03 03:10:03,273: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:10:03.273320075Z [2024-04-03 03:10:03,273: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:10:03.273470827Z [2024-04-03 03:10:03,273: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:10:03.273522781Z [2024-04-03 03:10:03,273: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:10:03.273777201Z [2024-04-03 03:10:03,273: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:10:03.273836032Z [2024-04-03 03:10:03,273: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:10:03.280025107Z [2024-04-03 03:10:03,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:10:03.379289770Z [2024-04-03 03:10:03,378: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:10:03.383384815Z [2024-04-03 03:10:03,382: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:10:03.432990294Z [2024-04-03 03:10:03,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:10:03.452518997Z [2024-04-03 03:10:03,452: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:10:03.454910019Z [2024-04-03 03:10:03,454: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:10:03.457087153Z [2024-04-03 03:10:03,454: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:10:03.459428566Z [2024-04-03 03:10:03,457: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:10:03.460078736Z [2024-04-03 03:10:03,459: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:10:03.461013181Z [2024-04-03 03:10:03,460: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:10:03.461875619Z [2024-04-03 03:10:03,461: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:10:03.462091817Z [2024-04-03 03:10:03,461: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:10:03.469137162Z [2024-04-03 03:10:03,468: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:10:03.655487007Z [2024-04-03 03:10:03,655: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:10:04.256374850Z [2024-04-03 03:10:04,255: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3895bcbe-cf3c-4e9e-bdc1-7b18cc2a92f7] succeeded in 3.1146367490000557s: None 2024-04-03T03:10:05.383971283Z [2024-04-03 03:10:05,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17fe5682-fdb9-4b47-bbfb-6946283115b5] received 2024-04-03T03:10:05.402552010Z [2024-04-03 03:10:05,402: INFO/ForkPoolWorker-15] [17fe5682-fdb9-4b47-bbfb-6946283115b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:10:05.405609975Z [2024-04-03 03:10:05,405: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b8d7c5d8-670f-4d95-8f05-781c9f8dc0e0] succeeded in 4.248131964999629s: None 2024-04-03T03:10:05.505243603Z [2024-04-03 03:10:05,504: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a2d75d5f-e93d-40f7-8b89-d147376d5891] succeeded in 4.324663317999693s: None 2024-04-03T03:10:05.711223536Z [2024-04-03 03:10:05,707: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:10:06.941755350Z [2024-04-03 03:10:06,941: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:10:06.945272977Z [2024-04-03 03:10:06,944: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:10:06.967704866Z [2024-04-03 03:10:06,967: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:10:06.968874518Z [2024-04-03 03:10:06,968: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:10:06.969006636Z [2024-04-03 03:10:06,968: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:10:06.969567017Z [2024-04-03 03:10:06,969: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:10:06.969740803Z [2024-04-03 03:10:06,969: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:10:06.969812294Z [2024-04-03 03:10:06,969: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:10:06.970406571Z [2024-04-03 03:10:06,970: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:10:06.970530150Z [2024-04-03 03:10:06,970: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:10:06.976218146Z [2024-04-03 03:10:06,976: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:10:07.042390164Z [2024-04-03 03:10:07,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:10:07.589699220Z [2024-04-03 03:10:07,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17fe5682-fdb9-4b47-bbfb-6946283115b5] succeeded in 2.2004596080005285s: None 2024-04-03T03:10:07.820312678Z [2024-04-03 03:10:07,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cb21362-264d-44b3-8225-f1d0b84fff5d] received 2024-04-03T03:10:07.830085495Z [2024-04-03 03:10:07,829: INFO/ForkPoolWorker-15] [2cb21362-264d-44b3-8225-f1d0b84fff5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:10:08.108244729Z [2024-04-03 03:10:08,105: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:10:09.256154061Z [2024-04-03 03:10:09,255: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:10:09.259649415Z [2024-04-03 03:10:09,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:10:09.282692950Z [2024-04-03 03:10:09,282: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:10:09.283941898Z [2024-04-03 03:10:09,283: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:10:09.283969139Z [2024-04-03 03:10:09,283: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:10:09.283974470Z [2024-04-03 03:10:09,283: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:10:09.284005631Z [2024-04-03 03:10:09,283: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:10:09.284040353Z [2024-04-03 03:10:09,283: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:10:09.284606982Z [2024-04-03 03:10:09,284: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:10:09.284620298Z [2024-04-03 03:10:09,284: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:10:09.291101623Z [2024-04-03 03:10:09,290: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:10:09.360247236Z [2024-04-03 03:10:09,360: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:10:09.888921092Z [2024-04-03 03:10:09,888: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cb21362-264d-44b3-8225-f1d0b84fff5d] succeeded in 2.065002598999854s: None 2024-04-03T03:10:09.977392967Z [2024-04-03 03:10:09,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38b73cc5-c2c6-4f66-98a5-41964cf75118] received 2024-04-03T03:10:09.995445457Z [2024-04-03 03:10:09,992: INFO/ForkPoolWorker-15] [38b73cc5-c2c6-4f66-98a5-41964cf75118] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:10:10.383519345Z [2024-04-03 03:10:10,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:10:11.611429424Z [2024-04-03 03:10:11,611: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:10:11.614896443Z [2024-04-03 03:10:11,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:10:11.651446651Z [2024-04-03 03:10:11,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:10:11.652650266Z [2024-04-03 03:10:11,652: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:10:11.652771777Z [2024-04-03 03:10:11,652: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:10:11.652887721Z [2024-04-03 03:10:11,652: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:10:11.653184146Z [2024-04-03 03:10:11,652: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:10:11.653264509Z [2024-04-03 03:10:11,653: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:10:11.653551629Z [2024-04-03 03:10:11,653: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:10:11.654040677Z [2024-04-03 03:10:11,653: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:10:11.660165042Z [2024-04-03 03:10:11,659: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:10:11.734678422Z [2024-04-03 03:10:11,734: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:10:12.330764298Z [2024-04-03 03:10:12,330: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38b73cc5-c2c6-4f66-98a5-41964cf75118] succeeded in 2.3514010939998116s: None 2024-04-03T03:11:00.591849380Z [2024-04-03 03:11:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c13c44b-d7d5-4afe-a997-b80988da83c2] received 2024-04-03T03:11:00.597404055Z [2024-04-03 03:11:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[327cc659-98f4-41bc-8121-27c65f978f7e] received 2024-04-03T03:11:00.618377106Z [2024-04-03 03:11:00,617: INFO/ForkPoolWorker-15] [3c13c44b-d7d5-4afe-a997-b80988da83c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:11:00.624239889Z [2024-04-03 03:11:00,623: INFO/ForkPoolWorker-16] [327cc659-98f4-41bc-8121-27c65f978f7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:11:01.002240745Z [2024-04-03 03:11:00,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:11:01.009697424Z [2024-04-03 03:11:01,006: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:11:02.323228762Z [2024-04-03 03:11:02,322: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:11:02.327039243Z [2024-04-03 03:11:02,325: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:11:02.352404966Z [2024-04-03 03:11:02,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:11:02.353413005Z [2024-04-03 03:11:02,353: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:11:02.353457524Z [2024-04-03 03:11:02,353: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:11:02.353599611Z [2024-04-03 03:11:02,353: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:11:02.353727740Z [2024-04-03 03:11:02,353: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:11:02.353896463Z [2024-04-03 03:11:02,353: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:11:02.354402721Z [2024-04-03 03:11:02,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:11:02.354733814Z [2024-04-03 03:11:02,354: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:11:02.358992562Z [2024-04-03 03:11:02,358: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:11:02.426333847Z [2024-04-03 03:11:02,425: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:11:02.429972556Z [2024-04-03 03:11:02,429: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:11:02.434221006Z [2024-04-03 03:11:02,434: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:11:02.470822669Z [2024-04-03 03:11:02,470: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:11:02.475706438Z [2024-04-03 03:11:02,475: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:11:02.475899005Z [2024-04-03 03:11:02,475: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:11:02.476089054Z [2024-04-03 03:11:02,475: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:11:02.476341355Z [2024-04-03 03:11:02,476: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:11:02.476511295Z [2024-04-03 03:11:02,476: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:11:02.476837939Z [2024-04-03 03:11:02,476: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:11:02.477093546Z [2024-04-03 03:11:02,476: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:11:02.481296414Z [2024-04-03 03:11:02,481: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:11:02.570475452Z [2024-04-03 03:11:02,570: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:11:04.023686590Z [2024-04-03 03:11:04,023: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[327cc659-98f4-41bc-8121-27c65f978f7e] succeeded in 3.4230191179995018s: None 2024-04-03T03:11:05.634671959Z [2024-04-03 03:11:05,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c13c44b-d7d5-4afe-a997-b80988da83c2] succeeded in 5.03963955799918s: None 2024-04-03T03:12:00.880322789Z [2024-04-03 03:12:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16ec1990-1292-452e-839a-ff59f9d326e5] received 2024-04-03T03:12:00.884667673Z [2024-04-03 03:12:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b966afd-1032-4775-bbc0-f582e0e36e1f] received 2024-04-03T03:12:00.888713825Z [2024-04-03 03:12:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6007533f-b3a2-4739-9e34-93dc59066191] received 2024-04-03T03:12:00.901557182Z [2024-04-03 03:12:00,901: INFO/ForkPoolWorker-16] [9b966afd-1032-4775-bbc0-f582e0e36e1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:12:00.914559385Z [2024-04-03 03:12:00,914: INFO/ForkPoolWorker-15] [16ec1990-1292-452e-839a-ff59f9d326e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:12:00.917777449Z [2024-04-03 03:12:00,917: INFO/ForkPoolWorker-1] [6007533f-b3a2-4739-9e34-93dc59066191] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:12:01.351681772Z [2024-04-03 03:12:01,347: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:12:01.385013732Z [2024-04-03 03:12:01,380: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:12:01.620685003Z [2024-04-03 03:12:01,620: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:12:01.788351191Z [2024-04-03 03:12:01,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:12:02.372080173Z [2024-04-03 03:12:02,371: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6007533f-b3a2-4739-9e34-93dc59066191] succeeded in 1.4755010110002331s: None 2024-04-03T03:12:02.966200017Z [2024-04-03 03:12:02,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:12:02.969549065Z [2024-04-03 03:12:02,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:12:03.019411776Z [2024-04-03 03:12:03,019: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:12:03.023348160Z [2024-04-03 03:12:03,023: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:12:03.023375713Z [2024-04-03 03:12:03,023: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:12:03.023382395Z [2024-04-03 03:12:03,023: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:12:03.023554441Z [2024-04-03 03:12:03,023: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:12:03.023605400Z [2024-04-03 03:12:03,023: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:12:03.023889801Z [2024-04-03 03:12:03,023: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:12:03.023910718Z [2024-04-03 03:12:03,023: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:12:03.031793752Z [2024-04-03 03:12:03,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:12:03.191206768Z [2024-04-03 03:12:03,190: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:12:03.316703381Z [2024-04-03 03:12:03,316: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:12:03.320380575Z [2024-04-03 03:12:03,319: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:12:03.358348546Z [2024-04-03 03:12:03,358: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:12:03.360461888Z [2024-04-03 03:12:03,360: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:12:03.360514134Z [2024-04-03 03:12:03,360: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:12:03.360616581Z [2024-04-03 03:12:03,360: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:12:03.360768942Z [2024-04-03 03:12:03,360: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:12:03.360831451Z [2024-04-03 03:12:03,360: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:12:03.361614639Z [2024-04-03 03:12:03,361: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:12:03.361680466Z [2024-04-03 03:12:03,361: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:12:03.366278066Z [2024-04-03 03:12:03,366: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:12:03.501048477Z [2024-04-03 03:12:03,500: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:12:05.116538098Z [2024-04-03 03:12:05,116: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16ec1990-1292-452e-839a-ff59f9d326e5] succeeded in 4.227000052999756s: None 2024-04-03T03:12:06.063099929Z [2024-04-03 03:12:06,062: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b966afd-1032-4775-bbc0-f582e0e36e1f] succeeded in 5.174885370000084s: None 2024-04-03T03:13:00.615951241Z [2024-04-03 03:13:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca0a447b-047c-4982-9e1e-1fff9f9efc83] received 2024-04-03T03:13:00.631766136Z [2024-04-03 03:13:00,631: INFO/ForkPoolWorker-15] [ca0a447b-047c-4982-9e1e-1fff9f9efc83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:13:00.666569074Z [2024-04-03 03:13:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8d4a3f6-c8ea-4541-8102-4f637145a556] received 2024-04-03T03:13:00.715542804Z [2024-04-03 03:13:00,715: INFO/ForkPoolWorker-16] [d8d4a3f6-c8ea-4541-8102-4f637145a556] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:13:00.982330181Z [2024-04-03 03:13:00,978: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:13:01.153299867Z [2024-04-03 03:13:01,149: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:13:02.477319364Z [2024-04-03 03:13:02,476: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:13:02.481062679Z [2024-04-03 03:13:02,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:13:02.492114628Z [2024-04-03 03:13:02,491: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:13:02.496452980Z [2024-04-03 03:13:02,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:13:02.509260438Z [2024-04-03 03:13:02,509: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:13:02.510542585Z [2024-04-03 03:13:02,510: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:13:02.510769721Z [2024-04-03 03:13:02,510: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:13:02.510851770Z [2024-04-03 03:13:02,510: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:13:02.511006135Z [2024-04-03 03:13:02,510: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:13:02.511091018Z [2024-04-03 03:13:02,510: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:13:02.511359932Z [2024-04-03 03:13:02,511: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:13:02.511371131Z [2024-04-03 03:13:02,511: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:13:02.520815179Z [2024-04-03 03:13:02,520: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:13:02.520910546Z [2024-04-03 03:13:02,520: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:13:02.521897657Z [2024-04-03 03:13:02,521: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:13:02.521908043Z [2024-04-03 03:13:02,521: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:13:02.521920095Z [2024-04-03 03:13:02,521: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:13:02.522055837Z [2024-04-03 03:13:02,521: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:13:02.522077250Z [2024-04-03 03:13:02,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:13:02.522373366Z [2024-04-03 03:13:02,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:13:02.522422901Z [2024-04-03 03:13:02,522: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:13:02.541737436Z [2024-04-03 03:13:02,541: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:13:02.603281562Z [2024-04-03 03:13:02,603: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:13:02.644589534Z [2024-04-03 03:13:02,644: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:13:04.958145692Z [2024-04-03 03:13:04,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8d4a3f6-c8ea-4541-8102-4f637145a556] succeeded in 4.284783985000104s: None 2024-04-03T03:13:05.627138484Z [2024-04-03 03:13:05,626: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca0a447b-047c-4982-9e1e-1fff9f9efc83] succeeded in 5.008184541999981s: None 2024-04-03T03:14:01.024251407Z [2024-04-03 03:14:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc082a3f-c5ad-406f-8a45-7a584eb15154] received 2024-04-03T03:14:01.042844495Z [2024-04-03 03:14:01,042: INFO/ForkPoolWorker-15] [cc082a3f-c5ad-406f-8a45-7a584eb15154] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:14:01.061757685Z [2024-04-03 03:14:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bf5c098-38c3-4f79-9967-5f024fd9e0ff] received 2024-04-03T03:14:01.086236900Z [2024-04-03 03:14:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[721de856-b783-43de-a5e6-89277e7a846f] received 2024-04-03T03:14:01.091452930Z [2024-04-03 03:14:01,087: INFO/ForkPoolWorker-16] [6bf5c098-38c3-4f79-9967-5f024fd9e0ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:14:01.149192815Z [2024-04-03 03:14:01,148: INFO/ForkPoolWorker-1] [721de856-b783-43de-a5e6-89277e7a846f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:14:01.404718362Z [2024-04-03 03:14:01,400: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:14:01.478359667Z [2024-04-03 03:14:01,474: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:14:01.602398583Z [2024-04-03 03:14:01,596: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:14:01.723458614Z [2024-04-03 03:14:01,723: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:14:02.263786628Z [2024-04-03 03:14:02,263: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc082a3f-c5ad-406f-8a45-7a584eb15154] succeeded in 1.2353225850001763s: None 2024-04-03T03:14:02.861654821Z [2024-04-03 03:14:02,861: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:14:02.865259870Z [2024-04-03 03:14:02,864: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:14:02.908380119Z [2024-04-03 03:14:02,907: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:14:02.917226524Z [2024-04-03 03:14:02,916: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:14:02.918080409Z [2024-04-03 03:14:02,917: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:14:02.919660545Z [2024-04-03 03:14:02,919: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:14:02.919884006Z [2024-04-03 03:14:02,919: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:14:02.920071228Z [2024-04-03 03:14:02,919: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:14:02.920409414Z [2024-04-03 03:14:02,920: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:14:02.920722623Z [2024-04-03 03:14:02,920: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:14:02.921157235Z [2024-04-03 03:14:02,921: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:14:02.921743727Z [2024-04-03 03:14:02,921: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:14:02.926684924Z [2024-04-03 03:14:02,926: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:14:02.949093546Z [2024-04-03 03:14:02,948: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:14:02.950158325Z [2024-04-03 03:14:02,949: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:14:02.950205216Z [2024-04-03 03:14:02,950: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:14:02.950258751Z [2024-04-03 03:14:02,950: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:14:02.950351538Z [2024-04-03 03:14:02,950: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:14:02.950386170Z [2024-04-03 03:14:02,950: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:14:02.950611809Z [2024-04-03 03:14:02,950: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:14:02.950663538Z [2024-04-03 03:14:02,950: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:14:02.955637514Z [2024-04-03 03:14:02,955: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:14:03.013351232Z [2024-04-03 03:14:03,013: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:14:03.064267203Z [2024-04-03 03:14:03,064: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:14:05.727113743Z [2024-04-03 03:14:05,726: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6bf5c098-38c3-4f79-9967-5f024fd9e0ff] succeeded in 4.662646039999345s: None 2024-04-03T03:14:07.822172825Z [2024-04-03 03:14:07,821: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[721de856-b783-43de-a5e6-89277e7a846f] succeeded in 6.718045476000043s: None 2024-04-03T03:15:00.963835940Z [2024-04-03 03:15:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61d4d5a3-95b1-4d4a-8e65-0c5be1da0c74] received 2024-04-03T03:15:00.975043250Z [2024-04-03 03:15:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb4251b2-24a2-462c-a13a-fa48b7efc4cb] received 2024-04-03T03:15:00.983677806Z [2024-04-03 03:15:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e254660f-ac0d-4b51-be07-4c4f51f67afc] received 2024-04-03T03:15:00.997428556Z [2024-04-03 03:15:00,996: INFO/ForkPoolWorker-15] [61d4d5a3-95b1-4d4a-8e65-0c5be1da0c74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:15:00.997965759Z [2024-04-03 03:15:00,997: INFO/ForkPoolWorker-1] [e254660f-ac0d-4b51-be07-4c4f51f67afc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:15:01.012272502Z [2024-04-03 03:15:01,011: INFO/ForkPoolWorker-16] [fb4251b2-24a2-462c-a13a-fa48b7efc4cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:15:01.424909597Z [2024-04-03 03:15:01,420: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:15:01.436495637Z [2024-04-03 03:15:01,433: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:15:01.572665653Z [2024-04-03 03:15:01,568: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:15:02.620472053Z [2024-04-03 03:15:02,620: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:15:02.638434712Z [2024-04-03 03:15:02,637: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:15:02.642859181Z [2024-04-03 03:15:02,642: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:15:02.646148883Z [2024-04-03 03:15:02,645: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:15:02.667859983Z [2024-04-03 03:15:02,667: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:15:02.669603929Z [2024-04-03 03:15:02,669: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:15:02.669619233Z [2024-04-03 03:15:02,669: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:15:02.669668334Z [2024-04-03 03:15:02,669: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:15:02.669787679Z [2024-04-03 03:15:02,669: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:15:02.669819703Z [2024-04-03 03:15:02,669: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:15:02.670020560Z [2024-04-03 03:15:02,669: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:15:02.670054940Z [2024-04-03 03:15:02,669: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:15:02.678031321Z [2024-04-03 03:15:02,677: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:15:02.710259825Z [2024-04-03 03:15:02,710: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:15:02.712404115Z [2024-04-03 03:15:02,712: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:15:02.713172970Z [2024-04-03 03:15:02,713: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:15:02.713951045Z [2024-04-03 03:15:02,713: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:15:02.714546316Z [2024-04-03 03:15:02,713: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:15:02.714716218Z [2024-04-03 03:15:02,714: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:15:02.715773361Z [2024-04-03 03:15:02,715: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:15:02.716291625Z [2024-04-03 03:15:02,716: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:15:02.725947665Z [2024-04-03 03:15:02,725: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:15:02.832437538Z [2024-04-03 03:15:02,832: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:15:02.852920653Z [2024-04-03 03:15:02,852: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:15:02.854207137Z [2024-04-03 03:15:02,853: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:15:02.856470854Z [2024-04-03 03:15:02,856: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:15:02.914341709Z [2024-04-03 03:15:02,914: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:15:02.919067275Z [2024-04-03 03:15:02,918: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:15:02.919187062Z [2024-04-03 03:15:02,918: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:15:02.919330147Z [2024-04-03 03:15:02,919: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:15:02.919552724Z [2024-04-03 03:15:02,919: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:15:02.919664726Z [2024-04-03 03:15:02,919: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:15:02.920025207Z [2024-04-03 03:15:02,919: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:15:02.920182745Z [2024-04-03 03:15:02,919: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:15:02.927338358Z [2024-04-03 03:15:02,927: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:15:03.104312791Z [2024-04-03 03:15:03,104: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:15:03.507383356Z [2024-04-03 03:15:03,506: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e254660f-ac0d-4b51-be07-4c4f51f67afc] succeeded in 2.5185912480001207s: None 2024-04-03T03:15:03.884707236Z [2024-04-03 03:15:03,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5cea178-2df6-4b1d-8518-65d035b000b1] received 2024-04-03T03:15:03.900424769Z [2024-04-03 03:15:03,900: INFO/ForkPoolWorker-1] [e5cea178-2df6-4b1d-8518-65d035b000b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:15:04.203101392Z [2024-04-03 03:15:04,200: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:15:04.695683541Z [2024-04-03 03:15:04,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61d4d5a3-95b1-4d4a-8e65-0c5be1da0c74] succeeded in 3.7279667050006537s: None 2024-04-03T03:15:04.976622309Z [2024-04-03 03:15:04,975: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb4251b2-24a2-462c-a13a-fa48b7efc4cb] succeeded in 3.99822359800055s: None 2024-04-03T03:15:05.310399909Z [2024-04-03 03:15:05,309: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:15:05.313776634Z [2024-04-03 03:15:05,313: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:15:05.349124588Z [2024-04-03 03:15:05,348: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:15:05.350392520Z [2024-04-03 03:15:05,350: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:15:05.350503344Z [2024-04-03 03:15:05,350: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:15:05.350674671Z [2024-04-03 03:15:05,350: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:15:05.350864920Z [2024-04-03 03:15:05,350: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:15:05.350942831Z [2024-04-03 03:15:05,350: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:15:05.351199427Z [2024-04-03 03:15:05,351: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:15:05.351287467Z [2024-04-03 03:15:05,351: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:15:05.358174051Z [2024-04-03 03:15:05,357: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:15:05.431764707Z [2024-04-03 03:15:05,431: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:15:05.964529240Z [2024-04-03 03:15:05,964: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5cea178-2df6-4b1d-8518-65d035b000b1] succeeded in 2.077644103000239s: None 2024-04-03T03:15:06.455804628Z [2024-04-03 03:15:06,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f554b0c0-6a9e-4b96-8504-16308a105544] received 2024-04-03T03:15:06.463756596Z [2024-04-03 03:15:06,463: INFO/ForkPoolWorker-15] [f554b0c0-6a9e-4b96-8504-16308a105544] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:15:06.784758811Z [2024-04-03 03:15:06,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:15:07.895861981Z [2024-04-03 03:15:07,895: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:15:07.899399346Z [2024-04-03 03:15:07,898: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:15:07.925563512Z [2024-04-03 03:15:07,925: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:15:07.927113511Z [2024-04-03 03:15:07,926: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:15:07.927126709Z [2024-04-03 03:15:07,927: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:15:07.927157328Z [2024-04-03 03:15:07,927: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:15:07.927284501Z [2024-04-03 03:15:07,927: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:15:07.927305910Z [2024-04-03 03:15:07,927: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:15:07.927602682Z [2024-04-03 03:15:07,927: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:15:07.927609661Z [2024-04-03 03:15:07,927: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:15:07.934040979Z [2024-04-03 03:15:07,933: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:15:08.031184864Z [2024-04-03 03:15:08,030: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:15:08.542075393Z [2024-04-03 03:15:08,541: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f554b0c0-6a9e-4b96-8504-16308a105544] succeeded in 2.083489785999518s: None 2024-04-03T03:15:08.946917204Z [2024-04-03 03:15:08,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28bcd8a6-4ea3-4f2e-b0dd-a0653561237a] received 2024-04-03T03:15:08.955108918Z [2024-04-03 03:15:08,954: INFO/ForkPoolWorker-15] [28bcd8a6-4ea3-4f2e-b0dd-a0653561237a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:15:09.333288757Z [2024-04-03 03:15:09,329: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:15:10.604036402Z [2024-04-03 03:15:10,603: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:15:10.607590929Z [2024-04-03 03:15:10,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:15:10.637114845Z [2024-04-03 03:15:10,636: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:15:10.638709681Z [2024-04-03 03:15:10,638: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:15:10.638833960Z [2024-04-03 03:15:10,638: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:15:10.638924458Z [2024-04-03 03:15:10,638: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:15:10.639142909Z [2024-04-03 03:15:10,638: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:15:10.639194064Z [2024-04-03 03:15:10,639: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:15:10.639532375Z [2024-04-03 03:15:10,639: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:15:10.639603385Z [2024-04-03 03:15:10,639: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:15:10.646023963Z [2024-04-03 03:15:10,645: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:15:10.753306985Z [2024-04-03 03:15:10,747: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:15:11.323125621Z [2024-04-03 03:15:11,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28bcd8a6-4ea3-4f2e-b0dd-a0653561237a] succeeded in 2.3743052330000864s: None 2024-04-03T03:16:00.876630370Z [2024-04-03 03:16:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[387ece8d-4593-4e9d-bf59-c810f713268d] received 2024-04-03T03:16:00.892627996Z [2024-04-03 03:16:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c019073-10d2-4832-b4fc-72d9e76a4315] received 2024-04-03T03:16:00.894366824Z [2024-04-03 03:16:00,894: INFO/ForkPoolWorker-15] [387ece8d-4593-4e9d-bf59-c810f713268d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:16:00.907802825Z [2024-04-03 03:16:00,907: INFO/ForkPoolWorker-16] [0c019073-10d2-4832-b4fc-72d9e76a4315] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:16:00.922746581Z [2024-04-03 03:16:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29027bc6-e27f-4c9e-ba2b-e39e057c2ca7] received 2024-04-03T03:16:00.939508500Z [2024-04-03 03:16:00,939: INFO/ForkPoolWorker-1] [29027bc6-e27f-4c9e-ba2b-e39e057c2ca7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:16:01.270448674Z [2024-04-03 03:16:01,267: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:16:01.444000868Z [2024-04-03 03:16:01,419: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:16:01.574937687Z [2024-04-03 03:16:01,574: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:16:01.737488003Z [2024-04-03 03:16:01,730: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:16:02.247633218Z [2024-04-03 03:16:02,247: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c019073-10d2-4832-b4fc-72d9e76a4315] succeeded in 1.3506556719994478s: None 2024-04-03T03:16:02.938547482Z [2024-04-03 03:16:02,938: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:16:02.942704894Z [2024-04-03 03:16:02,941: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:16:02.983409651Z [2024-04-03 03:16:02,983: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:16:02.985195360Z [2024-04-03 03:16:02,984: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:16:02.985508232Z [2024-04-03 03:16:02,985: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:16:02.985740007Z [2024-04-03 03:16:02,985: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:16:02.986044753Z [2024-04-03 03:16:02,985: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:16:02.986247007Z [2024-04-03 03:16:02,986: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:16:02.988160107Z [2024-04-03 03:16:02,987: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:16:02.988366364Z [2024-04-03 03:16:02,988: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:16:02.993291241Z [2024-04-03 03:16:02,993: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:16:03.093785727Z [2024-04-03 03:16:03,093: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:16:03.139932666Z [2024-04-03 03:16:03,139: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:16:03.143515237Z [2024-04-03 03:16:03,143: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:16:03.202298436Z [2024-04-03 03:16:03,201: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:16:03.208233438Z [2024-04-03 03:16:03,207: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:16:03.209879001Z [2024-04-03 03:16:03,209: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:16:03.210019849Z [2024-04-03 03:16:03,209: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:16:03.210207452Z [2024-04-03 03:16:03,210: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:16:03.210301511Z [2024-04-03 03:16:03,210: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:16:03.210584848Z [2024-04-03 03:16:03,210: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:16:03.210738064Z [2024-04-03 03:16:03,210: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:16:03.215493192Z [2024-04-03 03:16:03,215: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:16:03.290559714Z [2024-04-03 03:16:03,290: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:16:05.729737499Z [2024-04-03 03:16:05,728: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29027bc6-e27f-4c9e-ba2b-e39e057c2ca7] succeeded in 4.803926289999254s: None 2024-04-03T03:16:06.015636737Z [2024-04-03 03:16:06,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[387ece8d-4593-4e9d-bf59-c810f713268d] succeeded in 5.134845063999819s: None 2024-04-03T03:17:00.592667869Z [2024-04-03 03:17:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2826567-3882-4d1a-97dd-c7e077b38c7d] received 2024-04-03T03:17:00.606993640Z [2024-04-03 03:17:00,606: INFO/ForkPoolWorker-15] [d2826567-3882-4d1a-97dd-c7e077b38c7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:17:00.651352894Z [2024-04-03 03:17:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[882a0f10-1d2c-4aac-96d7-fb5fe958b9ed] received 2024-04-03T03:17:00.668648340Z [2024-04-03 03:17:00,668: INFO/ForkPoolWorker-16] [882a0f10-1d2c-4aac-96d7-fb5fe958b9ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:17:01.083596388Z [2024-04-03 03:17:01,079: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:17:01.091784665Z [2024-04-03 03:17:01,087: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:17:02.490761369Z [2024-04-03 03:17:02,489: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:17:02.493439747Z [2024-04-03 03:17:02,493: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:17:02.514944664Z [2024-04-03 03:17:02,513: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:17:02.521474592Z [2024-04-03 03:17:02,518: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:17:02.541154122Z [2024-04-03 03:17:02,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:17:02.542863747Z [2024-04-03 03:17:02,542: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:17:02.542875412Z [2024-04-03 03:17:02,542: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:17:02.542878691Z [2024-04-03 03:17:02,542: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:17:02.543071230Z [2024-04-03 03:17:02,542: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:17:02.543078379Z [2024-04-03 03:17:02,542: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:17:02.544227247Z [2024-04-03 03:17:02,543: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:17:02.544238701Z [2024-04-03 03:17:02,543: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:17:02.552982992Z [2024-04-03 03:17:02,552: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:17:02.584826997Z [2024-04-03 03:17:02,584: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:17:02.586489269Z [2024-04-03 03:17:02,586: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:17:02.586932803Z [2024-04-03 03:17:02,586: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:17:02.587201734Z [2024-04-03 03:17:02,587: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:17:02.587704795Z [2024-04-03 03:17:02,587: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:17:02.588777798Z [2024-04-03 03:17:02,588: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:17:02.589442153Z [2024-04-03 03:17:02,589: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:17:02.589636791Z [2024-04-03 03:17:02,589: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:17:02.596687140Z [2024-04-03 03:17:02,596: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:17:02.645173729Z [2024-04-03 03:17:02,644: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:17:02.680904528Z [2024-04-03 03:17:02,680: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:17:04.719682939Z [2024-04-03 03:17:04,718: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[882a0f10-1d2c-4aac-96d7-fb5fe958b9ed] succeeded in 4.063720215000103s: None 2024-04-03T03:17:04.792496908Z [2024-04-03 03:17:04,791: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2826567-3882-4d1a-97dd-c7e077b38c7d] succeeded in 4.196023237999725s: None 2024-04-03T03:18:00.399582460Z [2024-04-03 03:18:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2bbff53-c928-4c86-bb94-8de7f03c1620] received 2024-04-03T03:18:00.403283375Z [2024-04-03 03:18:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26b44d4c-24b1-490d-9e61-a29434a82369] received 2024-04-03T03:18:00.409447158Z [2024-04-03 03:18:00,408: INFO/ForkPoolWorker-15] [e2bbff53-c928-4c86-bb94-8de7f03c1620] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:18:00.417155085Z [2024-04-03 03:18:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff5dac13-142b-418e-aab4-aa7096cf39ec] received 2024-04-03T03:18:00.428501837Z [2024-04-03 03:18:00,428: INFO/ForkPoolWorker-16] [26b44d4c-24b1-490d-9e61-a29434a82369] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:18:00.451443588Z [2024-04-03 03:18:00,450: INFO/ForkPoolWorker-1] [ff5dac13-142b-418e-aab4-aa7096cf39ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:18:00.891246646Z [2024-04-03 03:18:00,885: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:18:00.915098445Z [2024-04-03 03:18:00,908: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:18:01.129734968Z [2024-04-03 03:18:01,126: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:18:01.705887420Z [2024-04-03 03:18:01,705: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:18:02.278394490Z [2024-04-03 03:18:02,277: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:18:02.281602559Z [2024-04-03 03:18:02,281: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:18:02.329212434Z [2024-04-03 03:18:02,328: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:18:02.331294954Z [2024-04-03 03:18:02,331: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:18:02.331317478Z [2024-04-03 03:18:02,331: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:18:02.331387042Z [2024-04-03 03:18:02,331: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:18:02.331499255Z [2024-04-03 03:18:02,331: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:18:02.331529236Z [2024-04-03 03:18:02,331: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:18:02.331798449Z [2024-04-03 03:18:02,331: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:18:02.331815422Z [2024-04-03 03:18:02,331: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:18:02.336205458Z [2024-04-03 03:18:02,335: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:18:02.371141448Z [2024-04-03 03:18:02,370: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26b44d4c-24b1-490d-9e61-a29434a82369] succeeded in 1.965087563000452s: None 2024-04-03T03:18:02.421646161Z [2024-04-03 03:18:02,421: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:18:02.489526545Z [2024-04-03 03:18:02,489: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:18:02.492923718Z [2024-04-03 03:18:02,492: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:18:02.521829411Z [2024-04-03 03:18:02,521: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:18:02.524057360Z [2024-04-03 03:18:02,523: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:18:02.524206419Z [2024-04-03 03:18:02,524: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:18:02.524514552Z [2024-04-03 03:18:02,524: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:18:02.524845959Z [2024-04-03 03:18:02,524: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:18:02.524958172Z [2024-04-03 03:18:02,524: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:18:02.525880966Z [2024-04-03 03:18:02,525: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:18:02.525992946Z [2024-04-03 03:18:02,525: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:18:02.530706583Z [2024-04-03 03:18:02,530: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:18:02.606113581Z [2024-04-03 03:18:02,605: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:18:04.162771242Z [2024-04-03 03:18:04,161: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff5dac13-142b-418e-aab4-aa7096cf39ec] succeeded in 3.736669599000379s: None 2024-04-03T03:18:04.219940787Z [2024-04-03 03:18:04,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e2bbff53-c928-4c86-bb94-8de7f03c1620] succeeded in 3.8177847469996777s: None 2024-04-03T03:19:00.727928853Z [2024-04-03 03:19:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f421772-7b93-4107-bb11-94634edd0d34] received 2024-04-03T03:19:00.733582126Z [2024-04-03 03:19:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85a33bed-612a-480d-ab5b-e0c57a48c16e] received 2024-04-03T03:19:00.746277539Z [2024-04-03 03:19:00,743: INFO/ForkPoolWorker-15] [9f421772-7b93-4107-bb11-94634edd0d34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:19:00.778321811Z [2024-04-03 03:19:00,774: INFO/ForkPoolWorker-16] [85a33bed-612a-480d-ab5b-e0c57a48c16e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:19:01.200700060Z [2024-04-03 03:19:01,196: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:19:01.214382802Z [2024-04-03 03:19:01,209: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:19:02.459159843Z [2024-04-03 03:19:02,458: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:19:02.462583451Z [2024-04-03 03:19:02,462: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:19:02.487687173Z [2024-04-03 03:19:02,487: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:19:02.489070811Z [2024-04-03 03:19:02,488: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:19:02.489082018Z [2024-04-03 03:19:02,489: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:19:02.489193228Z [2024-04-03 03:19:02,489: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:19:02.489360724Z [2024-04-03 03:19:02,489: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:19:02.489417316Z [2024-04-03 03:19:02,489: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:19:02.489644993Z [2024-04-03 03:19:02,489: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:19:02.490111472Z [2024-04-03 03:19:02,489: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:19:02.495128914Z [2024-04-03 03:19:02,494: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:19:02.519736294Z [2024-04-03 03:19:02,519: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:19:02.527888912Z [2024-04-03 03:19:02,526: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:19:02.569157591Z [2024-04-03 03:19:02,567: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:19:02.570866993Z [2024-04-03 03:19:02,570: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:19:02.570937738Z [2024-04-03 03:19:02,570: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:19:02.571023002Z [2024-04-03 03:19:02,570: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:19:02.571296983Z [2024-04-03 03:19:02,571: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:19:02.571368695Z [2024-04-03 03:19:02,571: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:19:02.571654575Z [2024-04-03 03:19:02,571: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:19:02.572054126Z [2024-04-03 03:19:02,571: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:19:02.578282513Z [2024-04-03 03:19:02,578: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:19:02.592679453Z [2024-04-03 03:19:02,592: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:19:02.663081940Z [2024-04-03 03:19:02,662: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:19:04.501704015Z [2024-04-03 03:19:04,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f421772-7b93-4107-bb11-94634edd0d34] succeeded in 3.76990975300032s: None 2024-04-03T03:19:05.551344732Z [2024-04-03 03:19:05,550: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85a33bed-612a-480d-ab5b-e0c57a48c16e] succeeded in 4.814674991999709s: None 2024-04-03T03:20:00.610430477Z [2024-04-03 03:20:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9da365a2-6ead-45ac-9253-3756d11a277b] received 2024-04-03T03:20:00.615305052Z [2024-04-03 03:20:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[926e35a8-3708-4bbd-b28a-8294a26eb2ab] received 2024-04-03T03:20:00.635129292Z [2024-04-03 03:20:00,631: INFO/ForkPoolWorker-16] [926e35a8-3708-4bbd-b28a-8294a26eb2ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:20:00.640467883Z [2024-04-03 03:20:00,639: INFO/ForkPoolWorker-15] [9da365a2-6ead-45ac-9253-3756d11a277b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:20:00.672646282Z [2024-04-03 03:20:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1e755eb-ec61-4179-baa8-6907bdc907f2] received 2024-04-03T03:20:00.679154065Z [2024-04-03 03:20:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bb0b8c6-6b68-4017-8b9d-45b4231b83a3] received 2024-04-03T03:20:00.697958367Z [2024-04-03 03:20:00,697: INFO/ForkPoolWorker-1] [c1e755eb-ec61-4179-baa8-6907bdc907f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:20:00.718476611Z [2024-04-03 03:20:00,717: INFO/ForkPoolWorker-2] [6bb0b8c6-6b68-4017-8b9d-45b4231b83a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:20:01.114370868Z [2024-04-03 03:20:01,108: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:20:01.378227965Z [2024-04-03 03:20:01,377: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:20:01.423484327Z [2024-04-03 03:20:01,418: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:20:01.452320412Z [2024-04-03 03:20:01,446: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:20:01.521216481Z [2024-04-03 03:20:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:20:02.432378168Z [2024-04-03 03:20:02,431: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[926e35a8-3708-4bbd-b28a-8294a26eb2ab] succeeded in 1.8117953979999584s: None 2024-04-03T03:20:02.970306520Z [2024-04-03 03:20:02,969: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T03:20:02.974229993Z [2024-04-03 03:20:02,973: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:20:03.043589046Z [2024-04-03 03:20:03,043: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T03:20:03.049679333Z [2024-04-03 03:20:03,049: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:20:03.054937746Z [2024-04-03 03:20:03,049: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:20:03.055062862Z [2024-04-03 03:20:03,054: INFO/ForkPoolWorker-2] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:20:03.055269352Z [2024-04-03 03:20:03,055: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:20:03.055344430Z [2024-04-03 03:20:03,055: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T03:20:03.055752686Z [2024-04-03 03:20:03,055: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:20:03.055757755Z [2024-04-03 03:20:03,055: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:20:03.061271536Z [2024-04-03 03:20:03,061: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:20:03.121923458Z [2024-04-03 03:20:03,121: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:20:03.126809359Z [2024-04-03 03:20:03,126: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:20:03.266030893Z [2024-04-03 03:20:03,265: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:20:03.271885946Z [2024-04-03 03:20:03,271: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:20:03.271919635Z [2024-04-03 03:20:03,271: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:20:03.271944908Z [2024-04-03 03:20:03,271: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:20:03.273911863Z [2024-04-03 03:20:03,271: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:20:03.273932003Z [2024-04-03 03:20:03,273: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:20:03.274258166Z [2024-04-03 03:20:03,274: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:20:03.274266122Z [2024-04-03 03:20:03,274: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:20:03.280228814Z [2024-04-03 03:20:03,280: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:20:03.282371685Z [2024-04-03 03:20:03,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:20:03.453163548Z [2024-04-03 03:20:03,452: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:20:03.624116529Z [2024-04-03 03:20:03,622: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:20:03.629668052Z [2024-04-03 03:20:03,629: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:20:03.695651348Z [2024-04-03 03:20:03,695: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:20:03.697713691Z [2024-04-03 03:20:03,697: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:20:03.697910436Z [2024-04-03 03:20:03,697: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:20:03.697986168Z [2024-04-03 03:20:03,697: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:20:03.700832582Z [2024-04-03 03:20:03,700: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:20:03.700993262Z [2024-04-03 03:20:03,700: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:20:03.701437585Z [2024-04-03 03:20:03,701: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:20:03.701719868Z [2024-04-03 03:20:03,701: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:20:03.711171643Z [2024-04-03 03:20:03,710: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:20:03.833407549Z [2024-04-03 03:20:03,833: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:20:04.518458729Z [2024-04-03 03:20:04,518: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9da365a2-6ead-45ac-9253-3756d11a277b] succeeded in 3.9034870730001785s: None 2024-04-03T03:20:04.536486699Z [2024-04-03 03:20:04,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd5b51c1-423e-434d-8a91-1af9e0d95890] received 2024-04-03T03:20:04.547654653Z [2024-04-03 03:20:04,547: INFO/ForkPoolWorker-15] [dd5b51c1-423e-434d-8a91-1af9e0d95890] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:20:04.962577877Z [2024-04-03 03:20:04,959: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:20:05.635526101Z [2024-04-03 03:20:05,634: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6bb0b8c6-6b68-4017-8b9d-45b4231b83a3] succeeded in 4.946266244999606s: None 2024-04-03T03:20:05.708683188Z [2024-04-03 03:20:05,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1e755eb-ec61-4179-baa8-6907bdc907f2] succeeded in 5.032742876999691s: None 2024-04-03T03:20:06.303022827Z [2024-04-03 03:20:06,302: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:20:06.306661358Z [2024-04-03 03:20:06,306: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:20:06.330284345Z [2024-04-03 03:20:06,330: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:20:06.332801434Z [2024-04-03 03:20:06,332: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:20:06.333200623Z [2024-04-03 03:20:06,333: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:20:06.333401939Z [2024-04-03 03:20:06,333: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:20:06.333640478Z [2024-04-03 03:20:06,333: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:20:06.333807554Z [2024-04-03 03:20:06,333: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:20:06.334098305Z [2024-04-03 03:20:06,333: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:20:06.334308079Z [2024-04-03 03:20:06,334: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:20:06.340234631Z [2024-04-03 03:20:06,340: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:20:06.451786602Z [2024-04-03 03:20:06,451: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:20:07.082858710Z [2024-04-03 03:20:07,082: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd5b51c1-423e-434d-8a91-1af9e0d95890] succeeded in 2.544633137999881s: None 2024-04-03T03:20:07.451114296Z [2024-04-03 03:20:07,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14d99e28-7be1-48a3-a049-3ea719457491] received 2024-04-03T03:20:07.461821531Z [2024-04-03 03:20:07,461: INFO/ForkPoolWorker-15] [14d99e28-7be1-48a3-a049-3ea719457491] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:20:07.765314096Z [2024-04-03 03:20:07,756: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:20:08.890897633Z [2024-04-03 03:20:08,890: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:20:08.893936638Z [2024-04-03 03:20:08,893: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:20:08.924026004Z [2024-04-03 03:20:08,923: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:20:08.925246807Z [2024-04-03 03:20:08,925: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:20:08.925454643Z [2024-04-03 03:20:08,925: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:20:08.925465109Z [2024-04-03 03:20:08,925: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:20:08.925691811Z [2024-04-03 03:20:08,925: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:20:08.925720719Z [2024-04-03 03:20:08,925: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:20:08.925939057Z [2024-04-03 03:20:08,925: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:20:08.926380517Z [2024-04-03 03:20:08,926: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:20:08.932589465Z [2024-04-03 03:20:08,932: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:20:09.020327674Z [2024-04-03 03:20:09,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:20:10.725273600Z [2024-04-03 03:20:10,724: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14d99e28-7be1-48a3-a049-3ea719457491] succeeded in 3.2705279869996957s: None 2024-04-03T03:20:10.873635122Z [2024-04-03 03:20:10,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb865705-595c-4a9e-a1ed-436418c8f48b] received 2024-04-03T03:20:10.882110277Z [2024-04-03 03:20:10,881: INFO/ForkPoolWorker-15] [fb865705-595c-4a9e-a1ed-436418c8f48b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:20:11.169567412Z [2024-04-03 03:20:11,166: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:20:12.485809143Z [2024-04-03 03:20:12,485: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:20:12.489585115Z [2024-04-03 03:20:12,488: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:20:12.520648300Z [2024-04-03 03:20:12,520: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:20:12.521898983Z [2024-04-03 03:20:12,521: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:20:12.522037972Z [2024-04-03 03:20:12,521: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:20:12.522201158Z [2024-04-03 03:20:12,522: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:20:12.522341422Z [2024-04-03 03:20:12,522: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:20:12.522421169Z [2024-04-03 03:20:12,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:20:12.522736889Z [2024-04-03 03:20:12,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:20:12.522864067Z [2024-04-03 03:20:12,522: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:20:12.529834992Z [2024-04-03 03:20:12,529: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:20:12.629308903Z [2024-04-03 03:20:12,629: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:20:13.352914303Z [2024-04-03 03:20:13,352: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb865705-595c-4a9e-a1ed-436418c8f48b] succeeded in 2.4763403290007773s: None 2024-04-03T03:21:00.537364363Z [2024-04-03 03:21:00,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92cdea51-e53b-4561-8d02-133707349e74] received 2024-04-03T03:21:00.551229950Z [2024-04-03 03:21:00,550: INFO/ForkPoolWorker-15] [92cdea51-e53b-4561-8d02-133707349e74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:21:00.572575066Z [2024-04-03 03:21:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f114ca7-c514-4644-acce-a41e3d312f2c] received 2024-04-03T03:21:00.606606287Z [2024-04-03 03:21:00,606: INFO/ForkPoolWorker-16] [4f114ca7-c514-4644-acce-a41e3d312f2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:21:01.043757520Z [2024-04-03 03:21:01,037: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:21:01.258494656Z [2024-04-03 03:21:01,252: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:21:02.369463436Z [2024-04-03 03:21:02,369: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:21:02.372816665Z [2024-04-03 03:21:02,372: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:21:02.400264956Z [2024-04-03 03:21:02,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:21:02.402165804Z [2024-04-03 03:21:02,401: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:21:02.402282986Z [2024-04-03 03:21:02,402: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:21:02.402382386Z [2024-04-03 03:21:02,402: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:21:02.402556638Z [2024-04-03 03:21:02,402: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:21:02.402674139Z [2024-04-03 03:21:02,402: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:21:02.402948810Z [2024-04-03 03:21:02,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:21:02.403044517Z [2024-04-03 03:21:02,402: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:21:02.408450757Z [2024-04-03 03:21:02,408: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:21:02.514323670Z [2024-04-03 03:21:02,513: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:21:02.878859264Z [2024-04-03 03:21:02,878: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:21:02.882472719Z [2024-04-03 03:21:02,882: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:21:02.943151486Z [2024-04-03 03:21:02,942: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:21:02.947667495Z [2024-04-03 03:21:02,947: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:21:02.947685030Z [2024-04-03 03:21:02,947: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:21:02.947750305Z [2024-04-03 03:21:02,947: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:21:02.947922671Z [2024-04-03 03:21:02,947: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:21:02.947950054Z [2024-04-03 03:21:02,947: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:21:02.948187788Z [2024-04-03 03:21:02,948: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:21:02.948227658Z [2024-04-03 03:21:02,948: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:21:02.953515744Z [2024-04-03 03:21:02,953: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:21:03.053381833Z [2024-04-03 03:21:03,053: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:21:05.252836395Z [2024-04-03 03:21:05,252: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92cdea51-e53b-4561-8d02-133707349e74] succeeded in 4.712356500999704s: None 2024-04-03T03:21:05.641269294Z [2024-04-03 03:21:05,640: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f114ca7-c514-4644-acce-a41e3d312f2c] succeeded in 5.065304288999869s: None 2024-04-03T03:22:00.294959636Z [2024-04-03 03:22:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b96624b3-3368-446a-a5fd-529fed5a07ac] received 2024-04-03T03:22:00.297592343Z [2024-04-03 03:22:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd887656-3696-4eea-813f-26e03f0fc207] received 2024-04-03T03:22:00.308763017Z [2024-04-03 03:22:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99bbe904-5b32-47f0-a8f3-bdcd6881cd39] received 2024-04-03T03:22:00.325779875Z [2024-04-03 03:22:00,325: INFO/ForkPoolWorker-16] [dd887656-3696-4eea-813f-26e03f0fc207] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:22:00.328268173Z [2024-04-03 03:22:00,327: INFO/ForkPoolWorker-1] [99bbe904-5b32-47f0-a8f3-bdcd6881cd39] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:22:00.343250966Z [2024-04-03 03:22:00,342: INFO/ForkPoolWorker-15] [b96624b3-3368-446a-a5fd-529fed5a07ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:22:00.789324541Z [2024-04-03 03:22:00,771: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:22:00.806711627Z [2024-04-03 03:22:00,797: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:22:01.024427193Z [2024-04-03 03:22:01,020: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:22:01.667278693Z [2024-04-03 03:22:01,666: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:22:02.374623808Z [2024-04-03 03:22:02,374: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99bbe904-5b32-47f0-a8f3-bdcd6881cd39] succeeded in 2.059269602999848s: None 2024-04-03T03:22:02.435332488Z [2024-04-03 03:22:02,434: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:22:02.438610576Z [2024-04-03 03:22:02,438: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:22:02.475336464Z [2024-04-03 03:22:02,475: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:22:02.477017667Z [2024-04-03 03:22:02,476: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:22:02.477032738Z [2024-04-03 03:22:02,476: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:22:02.477099764Z [2024-04-03 03:22:02,477: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:22:02.477222773Z [2024-04-03 03:22:02,477: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:22:02.477260360Z [2024-04-03 03:22:02,477: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:22:02.478134806Z [2024-04-03 03:22:02,477: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:22:02.478144394Z [2024-04-03 03:22:02,478: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:22:02.482688583Z [2024-04-03 03:22:02,482: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:22:02.554839851Z [2024-04-03 03:22:02,554: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:22:02.757912715Z [2024-04-03 03:22:02,757: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:22:02.761467291Z [2024-04-03 03:22:02,761: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:22:02.818806859Z [2024-04-03 03:22:02,809: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:22:02.828668724Z [2024-04-03 03:22:02,824: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:22:02.828857034Z [2024-04-03 03:22:02,827: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:22:02.828861699Z [2024-04-03 03:22:02,827: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:22:02.828867139Z [2024-04-03 03:22:02,827: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:22:02.828871149Z [2024-04-03 03:22:02,827: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:22:02.828874267Z [2024-04-03 03:22:02,827: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:22:02.828877567Z [2024-04-03 03:22:02,828: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:22:02.833181175Z [2024-04-03 03:22:02,832: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:22:02.976135695Z [2024-04-03 03:22:02,975: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:22:04.810494436Z [2024-04-03 03:22:04,809: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b96624b3-3368-446a-a5fd-529fed5a07ac] succeeded in 4.507546200000434s: None 2024-04-03T03:22:05.170182787Z [2024-04-03 03:22:05,169: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd887656-3696-4eea-813f-26e03f0fc207] succeeded in 4.868563525000354s: None 2024-04-03T03:23:01.018738471Z [2024-04-03 03:23:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4da4b32-110c-4580-ba4d-2a272c864396] received 2024-04-03T03:23:01.018936770Z [2024-04-03 03:23:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fabc4485-15e1-44f7-82fd-0bc8cd0a32a5] received 2024-04-03T03:23:01.036668714Z [2024-04-03 03:23:01,036: INFO/ForkPoolWorker-15] [b4da4b32-110c-4580-ba4d-2a272c864396] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:23:01.038204690Z [2024-04-03 03:23:01,037: INFO/ForkPoolWorker-16] [fabc4485-15e1-44f7-82fd-0bc8cd0a32a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:23:01.404515262Z [2024-04-03 03:23:01,401: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:23:01.509651529Z [2024-04-03 03:23:01,506: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:23:02.620406701Z [2024-04-03 03:23:02,619: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:23:02.623710854Z [2024-04-03 03:23:02,623: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:23:02.651358373Z [2024-04-03 03:23:02,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:23:02.653379851Z [2024-04-03 03:23:02,653: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:23:02.653940690Z [2024-04-03 03:23:02,653: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:23:02.654452641Z [2024-04-03 03:23:02,653: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:23:02.654736309Z [2024-04-03 03:23:02,654: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:23:02.654874467Z [2024-04-03 03:23:02,654: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:23:02.655125448Z [2024-04-03 03:23:02,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:23:02.655234222Z [2024-04-03 03:23:02,655: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:23:02.659824316Z [2024-04-03 03:23:02,659: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:23:02.724585998Z [2024-04-03 03:23:02,724: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:23:02.728252107Z [2024-04-03 03:23:02,727: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:23:02.743575781Z [2024-04-03 03:23:02,743: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:23:02.752872083Z [2024-04-03 03:23:02,752: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:23:02.754892167Z [2024-04-03 03:23:02,754: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:23:02.755066644Z [2024-04-03 03:23:02,754: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:23:02.755205521Z [2024-04-03 03:23:02,755: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:23:02.755410612Z [2024-04-03 03:23:02,755: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:23:02.755546052Z [2024-04-03 03:23:02,755: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:23:02.755836558Z [2024-04-03 03:23:02,755: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:23:02.756446335Z [2024-04-03 03:23:02,756: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:23:02.761318519Z [2024-04-03 03:23:02,760: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:23:02.881355729Z [2024-04-03 03:23:02,881: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:23:04.570274964Z [2024-04-03 03:23:04,569: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4da4b32-110c-4580-ba4d-2a272c864396] succeeded in 3.5492908440000974s: None 2024-04-03T03:23:06.180052088Z [2024-04-03 03:23:06,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fabc4485-15e1-44f7-82fd-0bc8cd0a32a5] succeeded in 5.155052699999942s: None 2024-04-03T03:24:00.548512099Z [2024-04-03 03:24:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c460caf5-6fc7-403d-8765-5e0e788bbf05] received 2024-04-03T03:24:00.551683948Z [2024-04-03 03:24:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ef83ae8-b90a-47dd-850f-63765f461d2f] received 2024-04-03T03:24:00.564242884Z [2024-04-03 03:24:00,563: INFO/ForkPoolWorker-16] [7ef83ae8-b90a-47dd-850f-63765f461d2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:24:00.574020033Z [2024-04-03 03:24:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[475833c4-4373-44f2-95b0-6d694304e982] received 2024-04-03T03:24:00.579596761Z [2024-04-03 03:24:00,579: INFO/ForkPoolWorker-15] [c460caf5-6fc7-403d-8765-5e0e788bbf05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:24:00.593652988Z [2024-04-03 03:24:00,592: INFO/ForkPoolWorker-1] [475833c4-4373-44f2-95b0-6d694304e982] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:24:00.985627896Z [2024-04-03 03:24:00,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:24:01.035570017Z [2024-04-03 03:24:01,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:24:01.163872406Z [2024-04-03 03:24:01,159: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:24:01.328621664Z [2024-04-03 03:24:01,328: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:24:01.957180359Z [2024-04-03 03:24:01,956: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[475833c4-4373-44f2-95b0-6d694304e982] succeeded in 1.3807423910002399s: None 2024-04-03T03:24:02.483687267Z [2024-04-03 03:24:02,483: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:24:02.487750442Z [2024-04-03 03:24:02,487: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:24:02.517277736Z [2024-04-03 03:24:02,517: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:24:02.523338642Z [2024-04-03 03:24:02,523: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:24:02.523567457Z [2024-04-03 03:24:02,523: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:24:02.523814083Z [2024-04-03 03:24:02,523: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:24:02.523970611Z [2024-04-03 03:24:02,523: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:24:02.524063659Z [2024-04-03 03:24:02,523: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:24:02.524694299Z [2024-04-03 03:24:02,524: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:24:02.524792923Z [2024-04-03 03:24:02,524: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:24:02.530002531Z [2024-04-03 03:24:02,529: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:24:02.587570428Z [2024-04-03 03:24:02,587: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:24:02.591054320Z [2024-04-03 03:24:02,590: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:24:02.610263187Z [2024-04-03 03:24:02,609: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:24:02.618425660Z [2024-04-03 03:24:02,618: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:24:02.619667473Z [2024-04-03 03:24:02,619: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:24:02.619759755Z [2024-04-03 03:24:02,619: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:24:02.619914575Z [2024-04-03 03:24:02,619: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:24:02.620083251Z [2024-04-03 03:24:02,619: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:24:02.620161776Z [2024-04-03 03:24:02,620: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:24:02.620425421Z [2024-04-03 03:24:02,620: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:24:02.620482747Z [2024-04-03 03:24:02,620: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:24:02.625118915Z [2024-04-03 03:24:02,624: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:24:02.694558701Z [2024-04-03 03:24:02,694: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:24:04.197736605Z [2024-04-03 03:24:04,197: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c460caf5-6fc7-403d-8765-5e0e788bbf05] succeeded in 3.643734509000751s: None 2024-04-03T03:24:04.628153586Z [2024-04-03 03:24:04,627: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ef83ae8-b90a-47dd-850f-63765f461d2f] succeeded in 4.073509113s: None 2024-04-03T03:25:01.059735009Z [2024-04-03 03:25:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaa2ce8f-b7db-4f94-acf9-339852e1fd63] received 2024-04-03T03:25:01.070923657Z [2024-04-03 03:25:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55342c91-207e-4d53-935c-050fcd1e8dfa] received 2024-04-03T03:25:01.079470572Z [2024-04-03 03:25:01,079: INFO/ForkPoolWorker-15] [aaa2ce8f-b7db-4f94-acf9-339852e1fd63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:25:01.088273049Z [2024-04-03 03:25:01,087: INFO/ForkPoolWorker-16] [55342c91-207e-4d53-935c-050fcd1e8dfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:25:01.091929415Z [2024-04-03 03:25:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48bd9635-d0b4-4bcd-93e1-a0be9842ef59] received 2024-04-03T03:25:01.124977096Z [2024-04-03 03:25:01,124: INFO/ForkPoolWorker-1] [48bd9635-d0b4-4bcd-93e1-a0be9842ef59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:25:01.535461966Z [2024-04-03 03:25:01,531: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:25:01.555900680Z [2024-04-03 03:25:01,551: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:25:01.569358456Z [2024-04-03 03:25:01,565: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:25:02.735529775Z [2024-04-03 03:25:02,735: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:25:02.738944000Z [2024-04-03 03:25:02,738: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:25:02.764182965Z [2024-04-03 03:25:02,763: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:25:02.770723997Z [2024-04-03 03:25:02,767: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:25:02.770742369Z [2024-04-03 03:25:02,767: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:25:02.770746387Z [2024-04-03 03:25:02,767: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:25:02.770753705Z [2024-04-03 03:25:02,767: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:25:02.770758178Z [2024-04-03 03:25:02,768: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:25:02.770761896Z [2024-04-03 03:25:02,768: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:25:02.770780141Z [2024-04-03 03:25:02,768: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:25:02.770870464Z [2024-04-03 03:25:02,770: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:25:02.774665170Z [2024-04-03 03:25:02,773: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:25:02.775121438Z [2024-04-03 03:25:02,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:25:02.848119200Z [2024-04-03 03:25:02,847: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:25:02.848722065Z [2024-04-03 03:25:02,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:25:02.854389850Z [2024-04-03 03:25:02,854: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:25:02.854584869Z [2024-04-03 03:25:02,854: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:25:02.854861025Z [2024-04-03 03:25:02,854: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:25:02.855831204Z [2024-04-03 03:25:02,855: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:25:02.856215069Z [2024-04-03 03:25:02,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:25:02.856682002Z [2024-04-03 03:25:02,856: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:25:02.857219558Z [2024-04-03 03:25:02,856: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:25:02.864350760Z [2024-04-03 03:25:02,863: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:25:02.938669902Z [2024-04-03 03:25:02,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:25:02.941784328Z [2024-04-03 03:25:02,941: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:25:02.948025854Z [2024-04-03 03:25:02,946: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:25:03.014428491Z [2024-04-03 03:25:03,014: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:25:03.017576875Z [2024-04-03 03:25:03,017: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:25:03.017685797Z [2024-04-03 03:25:03,017: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:25:03.017808157Z [2024-04-03 03:25:03,017: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:25:03.017990864Z [2024-04-03 03:25:03,017: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:25:03.018148172Z [2024-04-03 03:25:03,017: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:25:03.018513855Z [2024-04-03 03:25:03,018: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:25:03.020101398Z [2024-04-03 03:25:03,019: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:25:03.024644000Z [2024-04-03 03:25:03,024: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:25:03.164752321Z [2024-04-03 03:25:03,164: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:25:03.649886461Z [2024-04-03 03:25:03,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aaa2ce8f-b7db-4f94-acf9-339852e1fd63] succeeded in 2.5857954329994755s: None 2024-04-03T03:25:04.092781591Z [2024-04-03 03:25:04,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1acca692-116a-4f55-8272-acf3c57a4281] received 2024-04-03T03:25:04.102352863Z [2024-04-03 03:25:04,102: INFO/ForkPoolWorker-15] [1acca692-116a-4f55-8272-acf3c57a4281] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:25:04.383827405Z [2024-04-03 03:25:04,383: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[48bd9635-d0b4-4bcd-93e1-a0be9842ef59] succeeded in 3.287562139000329s: None 2024-04-03T03:25:04.462962466Z [2024-04-03 03:25:04,459: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:25:05.263446801Z [2024-04-03 03:25:05,262: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55342c91-207e-4d53-935c-050fcd1e8dfa] succeeded in 4.18725790299959s: None 2024-04-03T03:25:05.609986876Z [2024-04-03 03:25:05,609: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:25:05.613340231Z [2024-04-03 03:25:05,612: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:25:05.637765517Z [2024-04-03 03:25:05,637: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:25:05.639128170Z [2024-04-03 03:25:05,638: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:25:05.639161217Z [2024-04-03 03:25:05,639: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:25:05.639192410Z [2024-04-03 03:25:05,639: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:25:05.639347677Z [2024-04-03 03:25:05,639: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:25:05.639360948Z [2024-04-03 03:25:05,639: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:25:05.640173580Z [2024-04-03 03:25:05,639: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:25:05.640240340Z [2024-04-03 03:25:05,640: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:25:05.646499742Z [2024-04-03 03:25:05,646: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:25:05.719509901Z [2024-04-03 03:25:05,719: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:25:06.285873266Z [2024-04-03 03:25:06,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1acca692-116a-4f55-8272-acf3c57a4281] succeeded in 2.188283376999607s: None 2024-04-03T03:25:06.492448938Z [2024-04-03 03:25:06,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00820f60-9f40-4f68-b75d-22144ebf6c87] received 2024-04-03T03:25:06.511663933Z [2024-04-03 03:25:06,511: INFO/ForkPoolWorker-15] [00820f60-9f40-4f68-b75d-22144ebf6c87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:25:06.820551561Z [2024-04-03 03:25:06,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:25:07.953301736Z [2024-04-03 03:25:07,952: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:25:07.956642746Z [2024-04-03 03:25:07,956: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:25:07.982405016Z [2024-04-03 03:25:07,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:25:07.984642597Z [2024-04-03 03:25:07,984: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:25:07.984771022Z [2024-04-03 03:25:07,984: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:25:07.984871188Z [2024-04-03 03:25:07,984: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:25:07.985109795Z [2024-04-03 03:25:07,984: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:25:07.985220706Z [2024-04-03 03:25:07,985: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:25:07.985502162Z [2024-04-03 03:25:07,985: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:25:07.985680935Z [2024-04-03 03:25:07,985: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:25:07.991705428Z [2024-04-03 03:25:07,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:25:08.077044900Z [2024-04-03 03:25:08,076: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:25:09.531586230Z [2024-04-03 03:25:09,531: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00820f60-9f40-4f68-b75d-22144ebf6c87] succeeded in 3.0376353980000204s: None 2024-04-03T03:25:09.841253857Z [2024-04-03 03:25:09,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8586622d-ce05-4fda-9a41-b2c2e2c87e7f] received 2024-04-03T03:25:09.852324391Z [2024-04-03 03:25:09,852: INFO/ForkPoolWorker-15] [8586622d-ce05-4fda-9a41-b2c2e2c87e7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:25:10.258729820Z [2024-04-03 03:25:10,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:25:11.475641574Z [2024-04-03 03:25:11,475: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:25:11.479135759Z [2024-04-03 03:25:11,478: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:25:11.529940021Z [2024-04-03 03:25:11,529: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:25:11.532181866Z [2024-04-03 03:25:11,531: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:25:11.532198330Z [2024-04-03 03:25:11,532: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:25:11.532311251Z [2024-04-03 03:25:11,532: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:25:11.532769555Z [2024-04-03 03:25:11,532: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:25:11.532784391Z [2024-04-03 03:25:11,532: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:25:11.533119439Z [2024-04-03 03:25:11,533: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:25:11.533171714Z [2024-04-03 03:25:11,533: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:25:11.539008638Z [2024-04-03 03:25:11,538: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:25:11.622694684Z [2024-04-03 03:25:11,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:25:12.232815836Z [2024-04-03 03:25:12,232: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8586622d-ce05-4fda-9a41-b2c2e2c87e7f] succeeded in 2.3883475109996652s: None 2024-04-03T03:26:00.809823468Z [2024-04-03 03:26:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b149e1ab-db75-4c80-be28-7a7a088889a7] received 2024-04-03T03:26:00.818347266Z [2024-04-03 03:26:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02c5897c-5824-42e8-8025-bf07568dc8f1] received 2024-04-03T03:26:00.828808152Z [2024-04-03 03:26:00,828: INFO/ForkPoolWorker-15] [b149e1ab-db75-4c80-be28-7a7a088889a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:26:00.844086798Z [2024-04-03 03:26:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5b8641b-a184-44d9-a8a1-fe7faeaa7980] received 2024-04-03T03:26:00.853945829Z [2024-04-03 03:26:00,850: INFO/ForkPoolWorker-16] [02c5897c-5824-42e8-8025-bf07568dc8f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:26:00.892115446Z [2024-04-03 03:26:00,890: INFO/ForkPoolWorker-1] [e5b8641b-a184-44d9-a8a1-fe7faeaa7980] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:26:01.248058143Z [2024-04-03 03:26:01,244: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:26:01.354953087Z [2024-04-03 03:26:01,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:26:01.371316523Z [2024-04-03 03:26:01,367: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:26:01.704650844Z [2024-04-03 03:26:01,704: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:26:02.233155188Z [2024-04-03 03:26:02,232: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02c5897c-5824-42e8-8025-bf07568dc8f1] succeeded in 1.4048982219992467s: None 2024-04-03T03:26:02.557389399Z [2024-04-03 03:26:02,557: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:26:02.560754089Z [2024-04-03 03:26:02,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:26:02.584097033Z [2024-04-03 03:26:02,583: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:26:02.585304174Z [2024-04-03 03:26:02,585: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:26:02.585318024Z [2024-04-03 03:26:02,585: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:26:02.585353157Z [2024-04-03 03:26:02,585: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:26:02.585472132Z [2024-04-03 03:26:02,585: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:26:02.585506170Z [2024-04-03 03:26:02,585: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:26:02.585689446Z [2024-04-03 03:26:02,585: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:26:02.585724008Z [2024-04-03 03:26:02,585: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:26:02.590033567Z [2024-04-03 03:26:02,589: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:26:02.654792689Z [2024-04-03 03:26:02,654: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:26:02.722223697Z [2024-04-03 03:26:02,721: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:26:02.725732010Z [2024-04-03 03:26:02,725: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:26:02.760589143Z [2024-04-03 03:26:02,760: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:26:02.762079414Z [2024-04-03 03:26:02,761: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:26:02.762388479Z [2024-04-03 03:26:02,762: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:26:02.762579185Z [2024-04-03 03:26:02,762: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:26:02.762830630Z [2024-04-03 03:26:02,762: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:26:02.763039858Z [2024-04-03 03:26:02,762: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:26:02.766812619Z [2024-04-03 03:26:02,766: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:26:02.767004924Z [2024-04-03 03:26:02,766: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:26:02.773240972Z [2024-04-03 03:26:02,771: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:26:02.856792972Z [2024-04-03 03:26:02,856: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:26:04.361625247Z [2024-04-03 03:26:04,361: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5b8641b-a184-44d9-a8a1-fe7faeaa7980] succeeded in 3.514121492000413s: None 2024-04-03T03:26:04.606346863Z [2024-04-03 03:26:04,605: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b149e1ab-db75-4c80-be28-7a7a088889a7] succeeded in 3.7922183040000164s: None 2024-04-03T03:27:00.584482502Z [2024-04-03 03:27:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f371d0a-0d21-45e0-8ddb-c0e33a85b769] received 2024-04-03T03:27:00.594868792Z [2024-04-03 03:27:00,594: INFO/ForkPoolWorker-15] [7f371d0a-0d21-45e0-8ddb-c0e33a85b769] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:27:00.603225982Z [2024-04-03 03:27:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d379e0d-3685-47a5-96b9-dc02c2fa1bcc] received 2024-04-03T03:27:00.617443686Z [2024-04-03 03:27:00,617: INFO/ForkPoolWorker-16] [1d379e0d-3685-47a5-96b9-dc02c2fa1bcc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:27:01.002726265Z [2024-04-03 03:27:00,992: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:27:01.092893317Z [2024-04-03 03:27:01,089: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:27:02.345799122Z [2024-04-03 03:27:02,345: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:27:02.348912890Z [2024-04-03 03:27:02,348: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:27:02.374340354Z [2024-04-03 03:27:02,374: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:27:02.375411695Z [2024-04-03 03:27:02,375: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:27:02.375430525Z [2024-04-03 03:27:02,375: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:27:02.375486281Z [2024-04-03 03:27:02,375: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:27:02.375602906Z [2024-04-03 03:27:02,375: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:27:02.375634250Z [2024-04-03 03:27:02,375: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:27:02.375925234Z [2024-04-03 03:27:02,375: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:27:02.375946249Z [2024-04-03 03:27:02,375: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:27:02.380824156Z [2024-04-03 03:27:02,380: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:27:02.457128804Z [2024-04-03 03:27:02,456: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:27:02.514171547Z [2024-04-03 03:27:02,513: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:27:02.517654038Z [2024-04-03 03:27:02,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:27:02.545477616Z [2024-04-03 03:27:02,545: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:27:02.546794752Z [2024-04-03 03:27:02,546: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:27:02.546914696Z [2024-04-03 03:27:02,546: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:27:02.546992368Z [2024-04-03 03:27:02,546: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:27:02.547137891Z [2024-04-03 03:27:02,546: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:27:02.547232669Z [2024-04-03 03:27:02,547: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:27:02.547474568Z [2024-04-03 03:27:02,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:27:02.547618780Z [2024-04-03 03:27:02,547: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:27:02.552598981Z [2024-04-03 03:27:02,552: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:27:02.624332170Z [2024-04-03 03:27:02,624: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:27:04.555592936Z [2024-04-03 03:27:04,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f371d0a-0d21-45e0-8ddb-c0e33a85b769] succeeded in 3.966077540999322s: None 2024-04-03T03:27:04.715538940Z [2024-04-03 03:27:04,714: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d379e0d-3685-47a5-96b9-dc02c2fa1bcc] succeeded in 4.108325961999981s: None 2024-04-03T03:28:00.382702515Z [2024-04-03 03:28:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6811204b-c9c7-428b-b436-b2a0b01e195f] received 2024-04-03T03:28:00.388173839Z [2024-04-03 03:28:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6b529ca-9190-4e2f-9391-27c0cd08ebbb] received 2024-04-03T03:28:00.404189522Z [2024-04-03 03:28:00,403: INFO/ForkPoolWorker-15] [6811204b-c9c7-428b-b436-b2a0b01e195f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:28:00.404677903Z [2024-04-03 03:28:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0b5a8be-8a6b-4f6c-b058-f29c0d9678e6] received 2024-04-03T03:28:00.412165885Z [2024-04-03 03:28:00,411: INFO/ForkPoolWorker-16] [a6b529ca-9190-4e2f-9391-27c0cd08ebbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:28:00.427341108Z [2024-04-03 03:28:00,426: INFO/ForkPoolWorker-1] [c0b5a8be-8a6b-4f6c-b058-f29c0d9678e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:28:00.927857804Z [2024-04-03 03:28:00,921: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:28:01.009687212Z [2024-04-03 03:28:01,001: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:28:01.185876863Z [2024-04-03 03:28:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:28:01.433528663Z [2024-04-03 03:28:01,433: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:28:02.247403521Z [2024-04-03 03:28:02,247: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6811204b-c9c7-428b-b436-b2a0b01e195f] succeeded in 1.8616850120006347s: None 2024-04-03T03:28:02.578795705Z [2024-04-03 03:28:02,578: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:28:02.580463174Z [2024-04-03 03:28:02,580: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:28:02.582184945Z [2024-04-03 03:28:02,581: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:28:02.583824076Z [2024-04-03 03:28:02,583: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:28:02.613735873Z [2024-04-03 03:28:02,613: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:28:02.615386504Z [2024-04-03 03:28:02,615: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:28:02.615449803Z [2024-04-03 03:28:02,615: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:28:02.615531906Z [2024-04-03 03:28:02,615: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:28:02.615708062Z [2024-04-03 03:28:02,615: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:28:02.615780391Z [2024-04-03 03:28:02,615: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:28:02.616075963Z [2024-04-03 03:28:02,615: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:28:02.616083933Z [2024-04-03 03:28:02,616: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:28:02.621372728Z [2024-04-03 03:28:02,621: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:28:02.623919447Z [2024-04-03 03:28:02,623: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:28:02.625053055Z [2024-04-03 03:28:02,624: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:28:02.625104023Z [2024-04-03 03:28:02,625: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:28:02.625187163Z [2024-04-03 03:28:02,625: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:28:02.625328560Z [2024-04-03 03:28:02,625: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:28:02.625410357Z [2024-04-03 03:28:02,625: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:28:02.625633039Z [2024-04-03 03:28:02,625: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:28:02.625704611Z [2024-04-03 03:28:02,625: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:28:02.629968175Z [2024-04-03 03:28:02,629: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:28:02.694863735Z [2024-04-03 03:28:02,694: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:28:02.705829016Z [2024-04-03 03:28:02,705: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:28:04.319689576Z [2024-04-03 03:28:04,319: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6b529ca-9190-4e2f-9391-27c0cd08ebbb] succeeded in 3.926563334000093s: None 2024-04-03T03:28:04.974528603Z [2024-04-03 03:28:04,974: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c0b5a8be-8a6b-4f6c-b058-f29c0d9678e6] succeeded in 4.565253723999376s: None 2024-04-03T03:29:01.078902506Z [2024-04-03 03:29:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25b086e1-320e-448f-86a2-0a056f04a772] received 2024-04-03T03:29:01.087310614Z [2024-04-03 03:29:01,086: INFO/ForkPoolWorker-15] [25b086e1-320e-448f-86a2-0a056f04a772] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:29:01.091989476Z [2024-04-03 03:29:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a86e1eaf-0452-44e0-b855-a7d298cf00ea] received 2024-04-03T03:29:01.102540612Z [2024-04-03 03:29:01,102: INFO/ForkPoolWorker-16] [a86e1eaf-0452-44e0-b855-a7d298cf00ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:29:01.432388843Z [2024-04-03 03:29:01,428: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:29:01.503956352Z [2024-04-03 03:29:01,499: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:29:02.802970766Z [2024-04-03 03:29:02,799: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:29:02.802993093Z [2024-04-03 03:29:02,801: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:29:02.806810293Z [2024-04-03 03:29:02,803: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:29:02.806828889Z [2024-04-03 03:29:02,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:29:02.876305633Z [2024-04-03 03:29:02,876: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:29:02.878105010Z [2024-04-03 03:29:02,877: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:29:02.878702732Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:29:02.878714551Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:29:02.878759618Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:29:02.878840779Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:29:02.878881371Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:29:02.878903019Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:29:02.879036910Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:29:02.879070585Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:29:02.879227445Z [2024-04-03 03:29:02,879: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:29:02.879248729Z [2024-04-03 03:29:02,879: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:29:02.879752342Z [2024-04-03 03:29:02,878: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:29:02.879970684Z [2024-04-03 03:29:02,879: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:29:02.880557831Z [2024-04-03 03:29:02,880: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:29:02.880629304Z [2024-04-03 03:29:02,880: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:29:02.884382073Z [2024-04-03 03:29:02,884: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:29:02.888931608Z [2024-04-03 03:29:02,887: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:29:02.967001123Z [2024-04-03 03:29:02,966: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:29:02.996108633Z [2024-04-03 03:29:02,995: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:29:05.473035388Z [2024-04-03 03:29:05,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25b086e1-320e-448f-86a2-0a056f04a772] succeeded in 4.3903418259997125s: None 2024-04-03T03:29:06.843356041Z [2024-04-03 03:29:06,842: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a86e1eaf-0452-44e0-b855-a7d298cf00ea] succeeded in 5.748963544000617s: None 2024-04-03T03:30:00.794702939Z [2024-04-03 03:30:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c13e4f11-8255-4ea3-bd91-0af32b242e3f] received 2024-04-03T03:30:00.798683534Z [2024-04-03 03:30:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ea5c75e-6d1c-47ec-af5f-72766132cfa8] received 2024-04-03T03:30:00.812331260Z [2024-04-03 03:30:00,811: INFO/ForkPoolWorker-15] [c13e4f11-8255-4ea3-bd91-0af32b242e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:30:00.819672441Z [2024-04-03 03:30:00,819: INFO/ForkPoolWorker-16] [6ea5c75e-6d1c-47ec-af5f-72766132cfa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:30:00.826779193Z [2024-04-03 03:30:00,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6de64489-f00b-46df-96e1-7f7d9221b653] received 2024-04-03T03:30:00.836880957Z [2024-04-03 03:30:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04d0b7df-9fb4-4cbc-84d7-c7eda1479da9] received 2024-04-03T03:30:00.855675041Z [2024-04-03 03:30:00,855: INFO/ForkPoolWorker-1] [6de64489-f00b-46df-96e1-7f7d9221b653] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:30:00.856730726Z [2024-04-03 03:30:00,856: INFO/ForkPoolWorker-2] [04d0b7df-9fb4-4cbc-84d7-c7eda1479da9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:30:01.216487808Z [2024-04-03 03:30:01,210: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:30:01.380811421Z [2024-04-03 03:30:01,376: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:30:01.666796184Z [2024-04-03 03:30:01,662: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:30:01.687596082Z [2024-04-03 03:30:01,683: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:30:02.019581323Z [2024-04-03 03:30:02,019: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:30:02.670206055Z [2024-04-03 03:30:02,669: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ea5c75e-6d1c-47ec-af5f-72766132cfa8] succeeded in 1.8712752949995775s: None 2024-04-03T03:30:03.422299187Z [2024-04-03 03:30:03,421: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T03:30:03.435228765Z [2024-04-03 03:30:03,430: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:30:03.448829117Z [2024-04-03 03:30:03,448: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:30:03.452899120Z [2024-04-03 03:30:03,452: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:30:03.516570098Z [2024-04-03 03:30:03,516: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T03:30:03.524759365Z [2024-04-03 03:30:03,524: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:30:03.524913842Z [2024-04-03 03:30:03,524: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:30:03.525211998Z [2024-04-03 03:30:03,524: INFO/ForkPoolWorker-2] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:30:03.525906573Z [2024-04-03 03:30:03,525: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:30:03.526116134Z [2024-04-03 03:30:03,525: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T03:30:03.530943161Z [2024-04-03 03:30:03,530: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:30:03.531085272Z [2024-04-03 03:30:03,530: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:30:03.531284591Z [2024-04-03 03:30:03,531: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:30:03.533619994Z [2024-04-03 03:30:03,533: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:30:03.533766360Z [2024-04-03 03:30:03,533: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:30:03.533884367Z [2024-04-03 03:30:03,533: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:30:03.534090848Z [2024-04-03 03:30:03,533: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:30:03.534212168Z [2024-04-03 03:30:03,534: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:30:03.534505363Z [2024-04-03 03:30:03,534: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:30:03.534632227Z [2024-04-03 03:30:03,534: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:30:03.539692945Z [2024-04-03 03:30:03,539: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:30:03.552057054Z [2024-04-03 03:30:03,551: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:30:03.676762905Z [2024-04-03 03:30:03,676: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:30:03.680411586Z [2024-04-03 03:30:03,679: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:30:03.767757377Z [2024-04-03 03:30:03,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:30:03.770260892Z [2024-04-03 03:30:03,770: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:30:03.782958995Z [2024-04-03 03:30:03,782: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:30:03.782973228Z [2024-04-03 03:30:03,782: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:30:03.782981290Z [2024-04-03 03:30:03,782: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:30:03.783135483Z [2024-04-03 03:30:03,782: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:30:03.783166823Z [2024-04-03 03:30:03,783: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:30:03.783385659Z [2024-04-03 03:30:03,783: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:30:03.783437994Z [2024-04-03 03:30:03,783: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:30:03.794174571Z [2024-04-03 03:30:03,793: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:30:03.811687249Z [2024-04-03 03:30:03,811: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:30:03.933437093Z [2024-04-03 03:30:03,933: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:30:04.734081600Z [2024-04-03 03:30:04,733: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c13e4f11-8255-4ea3-bd91-0af32b242e3f] succeeded in 3.9372304280004755s: None 2024-04-03T03:30:05.173033065Z [2024-04-03 03:30:05,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f390b6f1-7c29-4cde-9f26-06e215588663] received 2024-04-03T03:30:05.184418967Z [2024-04-03 03:30:05,183: INFO/ForkPoolWorker-15] [f390b6f1-7c29-4cde-9f26-06e215588663] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:30:05.462921379Z [2024-04-03 03:30:05,459: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:30:05.794992830Z [2024-04-03 03:30:05,794: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[04d0b7df-9fb4-4cbc-84d7-c7eda1479da9] succeeded in 4.955114323000089s: None 2024-04-03T03:30:06.097770459Z [2024-04-03 03:30:06,097: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6de64489-f00b-46df-96e1-7f7d9221b653] succeeded in 5.266604448999715s: None 2024-04-03T03:30:06.658839782Z [2024-04-03 03:30:06,658: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:30:06.662500701Z [2024-04-03 03:30:06,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:30:06.705556874Z [2024-04-03 03:30:06,705: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:30:06.708127168Z [2024-04-03 03:30:06,707: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:30:06.708140191Z [2024-04-03 03:30:06,708: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:30:06.708252517Z [2024-04-03 03:30:06,708: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:30:06.708461492Z [2024-04-03 03:30:06,708: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:30:06.708556435Z [2024-04-03 03:30:06,708: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:30:06.709002145Z [2024-04-03 03:30:06,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:30:06.709521924Z [2024-04-03 03:30:06,708: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:30:06.715920153Z [2024-04-03 03:30:06,715: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:30:06.809046790Z [2024-04-03 03:30:06,808: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:30:07.476247472Z [2024-04-03 03:30:07,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f390b6f1-7c29-4cde-9f26-06e215588663] succeeded in 2.2992056129996854s: None 2024-04-03T03:30:07.519151235Z [2024-04-03 03:30:07,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdf8a4a2-55eb-4783-882e-f174f5358f07] received 2024-04-03T03:30:07.532576133Z [2024-04-03 03:30:07,532: INFO/ForkPoolWorker-15] [cdf8a4a2-55eb-4783-882e-f174f5358f07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:30:07.862601717Z [2024-04-03 03:30:07,858: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:30:09.049582808Z [2024-04-03 03:30:09,049: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:30:09.053182860Z [2024-04-03 03:30:09,052: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:30:09.086334720Z [2024-04-03 03:30:09,085: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:30:09.087477450Z [2024-04-03 03:30:09,087: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:30:09.087590224Z [2024-04-03 03:30:09,087: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:30:09.087607240Z [2024-04-03 03:30:09,087: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:30:09.087863671Z [2024-04-03 03:30:09,087: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:30:09.088024592Z [2024-04-03 03:30:09,087: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:30:09.094797575Z [2024-04-03 03:30:09,088: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:30:09.094817262Z [2024-04-03 03:30:09,088: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:30:09.095379130Z [2024-04-03 03:30:09,095: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:30:09.166319166Z [2024-04-03 03:30:09,166: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:30:10.668904115Z [2024-04-03 03:30:10,667: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cdf8a4a2-55eb-4783-882e-f174f5358f07] succeeded in 3.146324643999833s: None 2024-04-03T03:30:11.019446013Z [2024-04-03 03:30:11,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb0eae1f-7985-4dac-a4ea-760bc72fd654] received 2024-04-03T03:30:11.031793434Z [2024-04-03 03:30:11,031: INFO/ForkPoolWorker-15] [cb0eae1f-7985-4dac-a4ea-760bc72fd654] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:30:11.331703880Z [2024-04-03 03:30:11,328: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:30:12.516374317Z [2024-04-03 03:30:12,515: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:30:12.520008292Z [2024-04-03 03:30:12,519: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:30:12.595742403Z [2024-04-03 03:30:12,595: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:30:12.598515112Z [2024-04-03 03:30:12,598: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:30:12.598531630Z [2024-04-03 03:30:12,598: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:30:12.598990318Z [2024-04-03 03:30:12,598: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:30:12.599311933Z [2024-04-03 03:30:12,599: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:30:12.599460934Z [2024-04-03 03:30:12,599: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:30:12.599904831Z [2024-04-03 03:30:12,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:30:12.600096005Z [2024-04-03 03:30:12,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:30:12.608686050Z [2024-04-03 03:30:12,608: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:30:12.711270569Z [2024-04-03 03:30:12,710: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:30:13.465539061Z [2024-04-03 03:30:13,465: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb0eae1f-7985-4dac-a4ea-760bc72fd654] succeeded in 2.4440443080002296s: None 2024-04-03T03:31:01.050762267Z [2024-04-03 03:31:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ad5cbe4-660f-47c8-a6a6-0338aa4a4224] received 2024-04-03T03:31:01.056606165Z [2024-04-03 03:31:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e43c8192-05df-4a57-8fd6-bba77308375c] received 2024-04-03T03:31:01.071031053Z [2024-04-03 03:31:01,070: INFO/ForkPoolWorker-15] [8ad5cbe4-660f-47c8-a6a6-0338aa4a4224] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:31:01.077260496Z [2024-04-03 03:31:01,076: INFO/ForkPoolWorker-16] [e43c8192-05df-4a57-8fd6-bba77308375c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:31:01.434115528Z [2024-04-03 03:31:01,427: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:31:01.537173472Z [2024-04-03 03:31:01,532: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:31:02.723784954Z [2024-04-03 03:31:02,723: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:31:02.727174308Z [2024-04-03 03:31:02,726: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:31:02.750468968Z [2024-04-03 03:31:02,750: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:31:02.752889288Z [2024-04-03 03:31:02,752: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:31:02.753489906Z [2024-04-03 03:31:02,753: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:31:02.753546328Z [2024-04-03 03:31:02,753: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:31:02.753764479Z [2024-04-03 03:31:02,753: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:31:02.753776326Z [2024-04-03 03:31:02,753: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:31:02.754665226Z [2024-04-03 03:31:02,754: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:31:02.754671897Z [2024-04-03 03:31:02,754: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:31:02.759248217Z [2024-04-03 03:31:02,759: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:31:02.848438041Z [2024-04-03 03:31:02,848: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:31:02.855433655Z [2024-04-03 03:31:02,852: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:31:02.872574950Z [2024-04-03 03:31:02,872: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:31:02.921477372Z [2024-04-03 03:31:02,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:31:02.926522530Z [2024-04-03 03:31:02,926: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:31:02.926547279Z [2024-04-03 03:31:02,926: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:31:02.926712006Z [2024-04-03 03:31:02,926: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:31:02.927565473Z [2024-04-03 03:31:02,926: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:31:02.927602332Z [2024-04-03 03:31:02,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:31:02.927608361Z [2024-04-03 03:31:02,927: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:31:02.927612191Z [2024-04-03 03:31:02,927: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:31:02.933582838Z [2024-04-03 03:31:02,933: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:31:03.049933202Z [2024-04-03 03:31:03,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:31:06.307444040Z [2024-04-03 03:31:06,306: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8ad5cbe4-660f-47c8-a6a6-0338aa4a4224] succeeded in 5.252959937000014s: None 2024-04-03T03:31:06.335044185Z [2024-04-03 03:31:06,334: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e43c8192-05df-4a57-8fd6-bba77308375c] succeeded in 5.2737368649995915s: None 2024-04-03T03:32:00.323851257Z [2024-04-03 03:32:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5a75a73-5735-4113-ae5c-e7a806601556] received 2024-04-03T03:32:00.337722584Z [2024-04-03 03:32:00,337: INFO/ForkPoolWorker-15] [e5a75a73-5735-4113-ae5c-e7a806601556] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:32:00.346112424Z [2024-04-03 03:32:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13a2e724-2b73-40f9-8b0b-c65df898c237] received 2024-04-03T03:32:00.358906877Z [2024-04-03 03:32:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[086ab0c9-063f-48b1-bb37-e6f4ddd46754] received 2024-04-03T03:32:00.359756453Z [2024-04-03 03:32:00,359: INFO/ForkPoolWorker-16] [13a2e724-2b73-40f9-8b0b-c65df898c237] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:32:00.383974182Z [2024-04-03 03:32:00,383: INFO/ForkPoolWorker-1] [086ab0c9-063f-48b1-bb37-e6f4ddd46754] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:32:00.805551875Z [2024-04-03 03:32:00,781: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:32:00.860973329Z [2024-04-03 03:32:00,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:32:01.044927673Z [2024-04-03 03:32:01,040: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:32:01.402275293Z [2024-04-03 03:32:01,402: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:32:02.071079799Z [2024-04-03 03:32:02,070: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[086ab0c9-063f-48b1-bb37-e6f4ddd46754] succeeded in 1.7014313549998406s: None 2024-04-03T03:32:02.303655155Z [2024-04-03 03:32:02,303: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:32:02.306977885Z [2024-04-03 03:32:02,306: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:32:02.331230123Z [2024-04-03 03:32:02,331: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:32:02.333492313Z [2024-04-03 03:32:02,333: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:32:02.333526276Z [2024-04-03 03:32:02,333: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:32:02.333594896Z [2024-04-03 03:32:02,333: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:32:02.333735830Z [2024-04-03 03:32:02,333: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:32:02.333771275Z [2024-04-03 03:32:02,333: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:32:02.334001349Z [2024-04-03 03:32:02,333: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:32:02.334035222Z [2024-04-03 03:32:02,333: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:32:02.339109917Z [2024-04-03 03:32:02,338: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:32:02.424673036Z [2024-04-03 03:32:02,424: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:32:02.454399456Z [2024-04-03 03:32:02,454: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:32:02.457767258Z [2024-04-03 03:32:02,457: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:32:02.484604055Z [2024-04-03 03:32:02,484: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:32:02.485664350Z [2024-04-03 03:32:02,485: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:32:02.485677290Z [2024-04-03 03:32:02,485: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:32:02.485735584Z [2024-04-03 03:32:02,485: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:32:02.485853247Z [2024-04-03 03:32:02,485: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:32:02.485903163Z [2024-04-03 03:32:02,485: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:32:02.486134015Z [2024-04-03 03:32:02,486: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:32:02.486181201Z [2024-04-03 03:32:02,486: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:32:02.490960983Z [2024-04-03 03:32:02,490: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:32:02.590854419Z [2024-04-03 03:32:02,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:32:04.076318624Z [2024-04-03 03:32:04,075: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[13a2e724-2b73-40f9-8b0b-c65df898c237] succeeded in 3.727317953000238s: None 2024-04-03T03:32:05.137985865Z [2024-04-03 03:32:05,137: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5a75a73-5735-4113-ae5c-e7a806601556] succeeded in 4.810108626999863s: None 2024-04-03T03:33:00.671827237Z [2024-04-03 03:33:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fdb1a6b-da35-4cda-9350-6dfeb9f3a9eb] received 2024-04-03T03:33:00.678843757Z [2024-04-03 03:33:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36b5267d-1ab5-4242-8523-6d7fa2bce1d1] received 2024-04-03T03:33:00.704922561Z [2024-04-03 03:33:00,701: INFO/ForkPoolWorker-15] [1fdb1a6b-da35-4cda-9350-6dfeb9f3a9eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:33:00.707387369Z [2024-04-03 03:33:00,707: INFO/ForkPoolWorker-16] [36b5267d-1ab5-4242-8523-6d7fa2bce1d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:33:01.096865544Z [2024-04-03 03:33:01,092: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:33:01.105392379Z [2024-04-03 03:33:01,101: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:33:02.358784208Z [2024-04-03 03:33:02,358: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:33:02.362751517Z [2024-04-03 03:33:02,362: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:33:02.401782324Z [2024-04-03 03:33:02,401: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:33:02.404635988Z [2024-04-03 03:33:02,404: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:33:02.405109681Z [2024-04-03 03:33:02,404: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:33:02.405219931Z [2024-04-03 03:33:02,405: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:33:02.405606445Z [2024-04-03 03:33:02,405: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:33:02.405737425Z [2024-04-03 03:33:02,405: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:33:02.406139989Z [2024-04-03 03:33:02,406: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:33:02.406560940Z [2024-04-03 03:33:02,406: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:33:02.411896148Z [2024-04-03 03:33:02,411: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:33:02.468009219Z [2024-04-03 03:33:02,467: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:33:02.471506946Z [2024-04-03 03:33:02,471: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:33:02.506696695Z [2024-04-03 03:33:02,506: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:33:02.509944069Z [2024-04-03 03:33:02,509: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:33:02.510112381Z [2024-04-03 03:33:02,509: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:33:02.510207118Z [2024-04-03 03:33:02,510: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:33:02.510454248Z [2024-04-03 03:33:02,510: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:33:02.510514960Z [2024-04-03 03:33:02,510: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:33:02.510923340Z [2024-04-03 03:33:02,510: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:33:02.511039489Z [2024-04-03 03:33:02,510: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:33:02.514651033Z [2024-04-03 03:33:02,514: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:33:02.517200548Z [2024-04-03 03:33:02,516: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:33:02.634016537Z [2024-04-03 03:33:02,633: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:33:04.903705232Z [2024-04-03 03:33:04,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1fdb1a6b-da35-4cda-9350-6dfeb9f3a9eb] succeeded in 4.224877947001005s: None 2024-04-03T03:33:05.292154037Z [2024-04-03 03:33:05,291: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36b5267d-1ab5-4242-8523-6d7fa2bce1d1] succeeded in 4.610264916998858s: None 2024-04-03T03:34:01.031391595Z [2024-04-03 03:34:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bb72dc6-2290-4172-bc33-dea4d2acfc91] received 2024-04-03T03:34:01.043598316Z [2024-04-03 03:34:01,043: INFO/ForkPoolWorker-15] [7bb72dc6-2290-4172-bc33-dea4d2acfc91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:34:01.073870362Z [2024-04-03 03:34:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c188b72-4384-4c5c-ad9a-24c98fd12306] received 2024-04-03T03:34:01.085982170Z [2024-04-03 03:34:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00d79cd6-b98d-45a4-ba16-6f0314db789b] received 2024-04-03T03:34:01.090085262Z [2024-04-03 03:34:01,089: INFO/ForkPoolWorker-16] [5c188b72-4384-4c5c-ad9a-24c98fd12306] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:34:01.135712744Z [2024-04-03 03:34:01,135: INFO/ForkPoolWorker-1] [00d79cd6-b98d-45a4-ba16-6f0314db789b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:34:01.498220871Z [2024-04-03 03:34:01,494: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:34:01.575780361Z [2024-04-03 03:34:01,571: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:34:01.599743691Z [2024-04-03 03:34:01,596: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:34:01.855875559Z [2024-04-03 03:34:01,855: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:34:02.329206559Z [2024-04-03 03:34:02,328: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5c188b72-4384-4c5c-ad9a-24c98fd12306] succeeded in 1.2521638839989464s: None 2024-04-03T03:34:02.783121841Z [2024-04-03 03:34:02,779: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:34:02.790952352Z [2024-04-03 03:34:02,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:34:02.836407048Z [2024-04-03 03:34:02,836: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:34:02.839747081Z [2024-04-03 03:34:02,839: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:34:02.868564905Z [2024-04-03 03:34:02,868: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:34:02.869624096Z [2024-04-03 03:34:02,869: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:34:02.869662597Z [2024-04-03 03:34:02,869: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:34:02.869713764Z [2024-04-03 03:34:02,869: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:34:02.869827814Z [2024-04-03 03:34:02,869: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:34:02.869850701Z [2024-04-03 03:34:02,869: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:34:02.870041099Z [2024-04-03 03:34:02,869: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:34:02.870158367Z [2024-04-03 03:34:02,870: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:34:02.873532211Z [2024-04-03 03:34:02,873: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:34:02.874897685Z [2024-04-03 03:34:02,874: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:34:02.875144463Z [2024-04-03 03:34:02,875: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:34:02.875289017Z [2024-04-03 03:34:02,875: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:34:02.875414235Z [2024-04-03 03:34:02,875: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:34:02.875603628Z [2024-04-03 03:34:02,875: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:34:02.875789356Z [2024-04-03 03:34:02,875: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:34:02.876138835Z [2024-04-03 03:34:02,876: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:34:02.876314348Z [2024-04-03 03:34:02,876: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:34:02.884376625Z [2024-04-03 03:34:02,884: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:34:03.001177492Z [2024-04-03 03:34:03,000: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:34:03.004206931Z [2024-04-03 03:34:03,003: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:34:05.316682058Z [2024-04-03 03:34:05,316: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00d79cd6-b98d-45a4-ba16-6f0314db789b] succeeded in 4.227362143001301s: None 2024-04-03T03:34:05.627152408Z [2024-04-03 03:34:05,626: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7bb72dc6-2290-4172-bc33-dea4d2acfc91] succeeded in 4.592410695000581s: None 2024-04-03T03:35:00.377377741Z [2024-04-03 03:35:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f016130e-1d19-43fa-980a-1ebee8174b96] received 2024-04-03T03:35:00.393636228Z [2024-04-03 03:35:00,393: INFO/ForkPoolWorker-15] [f016130e-1d19-43fa-980a-1ebee8174b96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:35:00.408114732Z [2024-04-03 03:35:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7afe387-1914-4ac1-a6c7-3931f56ea574] received 2024-04-03T03:35:00.411346484Z [2024-04-03 03:35:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e4670e3-6560-4490-a534-b1ff51ba29f3] received 2024-04-03T03:35:00.436418871Z [2024-04-03 03:35:00,436: INFO/ForkPoolWorker-16] [f7afe387-1914-4ac1-a6c7-3931f56ea574] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:35:00.454541253Z [2024-04-03 03:35:00,454: INFO/ForkPoolWorker-1] [0e4670e3-6560-4490-a534-b1ff51ba29f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:35:01.001568335Z [2024-04-03 03:35:00,997: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:35:01.035726961Z [2024-04-03 03:35:01,031: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:35:01.147826969Z [2024-04-03 03:35:01,142: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:35:02.453855664Z [2024-04-03 03:35:02,453: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:35:02.457337031Z [2024-04-03 03:35:02,456: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:35:02.462321137Z [2024-04-03 03:35:02,461: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:35:02.466432068Z [2024-04-03 03:35:02,465: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:35:02.490871710Z [2024-04-03 03:35:02,490: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:35:02.492057594Z [2024-04-03 03:35:02,491: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:35:02.492164236Z [2024-04-03 03:35:02,491: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:35:02.492412249Z [2024-04-03 03:35:02,492: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:35:02.492606195Z [2024-04-03 03:35:02,492: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:35:02.492790729Z [2024-04-03 03:35:02,492: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:35:02.493215453Z [2024-04-03 03:35:02,493: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:35:02.493264825Z [2024-04-03 03:35:02,493: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:35:02.501209064Z [2024-04-03 03:35:02,500: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:35:02.521306009Z [2024-04-03 03:35:02,521: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:35:02.522673080Z [2024-04-03 03:35:02,522: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:35:02.522862905Z [2024-04-03 03:35:02,522: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:35:02.523079292Z [2024-04-03 03:35:02,522: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:35:02.523208312Z [2024-04-03 03:35:02,523: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:35:02.523327701Z [2024-04-03 03:35:02,523: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:35:02.523639420Z [2024-04-03 03:35:02,523: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:35:02.523777742Z [2024-04-03 03:35:02,523: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:35:02.531022572Z [2024-04-03 03:35:02,530: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:35:02.613859021Z [2024-04-03 03:35:02,613: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:35:02.622577382Z [2024-04-03 03:35:02,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:35:02.743360164Z [2024-04-03 03:35:02,742: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:35:02.746513508Z [2024-04-03 03:35:02,746: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:35:02.790227054Z [2024-04-03 03:35:02,786: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:35:02.790252420Z [2024-04-03 03:35:02,788: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:35:02.790257388Z [2024-04-03 03:35:02,788: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:35:02.790262852Z [2024-04-03 03:35:02,788: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:35:02.790268303Z [2024-04-03 03:35:02,788: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:35:02.790273723Z [2024-04-03 03:35:02,788: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:35:02.790278083Z [2024-04-03 03:35:02,788: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:35:02.790282656Z [2024-04-03 03:35:02,788: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:35:02.794730095Z [2024-04-03 03:35:02,792: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:35:02.965312058Z [2024-04-03 03:35:02,965: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:35:03.463150576Z [2024-04-03 03:35:03,462: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f016130e-1d19-43fa-980a-1ebee8174b96] succeeded in 3.0805490239999926s: None 2024-04-03T03:35:04.300426078Z [2024-04-03 03:35:04,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6e0d3df-5a2b-44ca-b25b-85929d77c229] received 2024-04-03T03:35:04.310489092Z [2024-04-03 03:35:04,310: INFO/ForkPoolWorker-15] [e6e0d3df-5a2b-44ca-b25b-85929d77c229] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:35:04.439316086Z [2024-04-03 03:35:04,438: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7afe387-1914-4ac1-a6c7-3931f56ea574] succeeded in 4.027708642001016s: None 2024-04-03T03:35:04.595269852Z [2024-04-03 03:35:04,592: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:35:05.056426034Z [2024-04-03 03:35:05,055: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0e4670e3-6560-4490-a534-b1ff51ba29f3] succeeded in 4.639700638999784s: None 2024-04-03T03:35:05.707991471Z [2024-04-03 03:35:05,707: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:35:05.711354810Z [2024-04-03 03:35:05,710: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:35:05.736427018Z [2024-04-03 03:35:05,736: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:35:05.737980780Z [2024-04-03 03:35:05,737: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:35:05.738103613Z [2024-04-03 03:35:05,737: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:35:05.738167878Z [2024-04-03 03:35:05,738: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:35:05.738341768Z [2024-04-03 03:35:05,738: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:35:05.738452819Z [2024-04-03 03:35:05,738: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:35:05.738947128Z [2024-04-03 03:35:05,738: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:35:05.739659915Z [2024-04-03 03:35:05,739: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:35:05.745655896Z [2024-04-03 03:35:05,745: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:35:05.830514077Z [2024-04-03 03:35:05,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:35:06.436002187Z [2024-04-03 03:35:06,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6e0d3df-5a2b-44ca-b25b-85929d77c229] succeeded in 2.1319187650005915s: None 2024-04-03T03:35:06.880284313Z [2024-04-03 03:35:06,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44e66af0-6692-49a8-9424-96d8590e526e] received 2024-04-03T03:35:06.887883932Z [2024-04-03 03:35:06,887: INFO/ForkPoolWorker-15] [44e66af0-6692-49a8-9424-96d8590e526e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:35:07.169212245Z [2024-04-03 03:35:07,165: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:35:08.312229707Z [2024-04-03 03:35:08,311: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:35:08.316209949Z [2024-04-03 03:35:08,315: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:35:08.344161676Z [2024-04-03 03:35:08,343: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:35:08.345395058Z [2024-04-03 03:35:08,345: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:35:08.345527057Z [2024-04-03 03:35:08,345: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:35:08.345649064Z [2024-04-03 03:35:08,345: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:35:08.345852392Z [2024-04-03 03:35:08,345: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:35:08.345956611Z [2024-04-03 03:35:08,345: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:35:08.346298286Z [2024-04-03 03:35:08,346: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:35:08.346375550Z [2024-04-03 03:35:08,346: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:35:08.354458219Z [2024-04-03 03:35:08,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:35:08.434301192Z [2024-04-03 03:35:08,434: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:35:09.914648092Z [2024-04-03 03:35:09,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44e66af0-6692-49a8-9424-96d8590e526e] succeeded in 3.0310344560002704s: None 2024-04-03T03:35:09.923999276Z [2024-04-03 03:35:09,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fda06467-fe5a-49e6-94fe-bcdd83046bbb] received 2024-04-03T03:35:09.933209497Z [2024-04-03 03:35:09,932: INFO/ForkPoolWorker-15] [fda06467-fe5a-49e6-94fe-bcdd83046bbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:35:10.313341571Z [2024-04-03 03:35:10,309: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:35:11.678178287Z [2024-04-03 03:35:11,677: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:35:11.681611316Z [2024-04-03 03:35:11,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:35:11.717440955Z [2024-04-03 03:35:11,717: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:35:11.719133267Z [2024-04-03 03:35:11,718: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:35:11.719154205Z [2024-04-03 03:35:11,719: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:35:11.719524077Z [2024-04-03 03:35:11,719: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:35:11.719752247Z [2024-04-03 03:35:11,719: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:35:11.719768955Z [2024-04-03 03:35:11,719: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:35:11.721101005Z [2024-04-03 03:35:11,720: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:35:11.721120564Z [2024-04-03 03:35:11,721: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:35:11.729609736Z [2024-04-03 03:35:11,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:35:11.823094873Z [2024-04-03 03:35:11,822: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:35:12.433504991Z [2024-04-03 03:35:12,433: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fda06467-fe5a-49e6-94fe-bcdd83046bbb] succeeded in 2.507313616999454s: None 2024-04-03T03:36:00.884152678Z [2024-04-03 03:36:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[595f9133-4c92-4d28-9a74-69b46a6f18d9] received 2024-04-03T03:36:00.897886027Z [2024-04-03 03:36:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b218a4c-1c5e-423e-871b-e0deaf441339] received 2024-04-03T03:36:00.899282795Z [2024-04-03 03:36:00,898: INFO/ForkPoolWorker-15] [595f9133-4c92-4d28-9a74-69b46a6f18d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:36:00.922732719Z [2024-04-03 03:36:00,922: INFO/ForkPoolWorker-16] [7b218a4c-1c5e-423e-871b-e0deaf441339] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:36:00.928724908Z [2024-04-03 03:36:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cccb57ba-cdcd-4db8-95e4-acaebb1f1b1e] received 2024-04-03T03:36:00.938206355Z [2024-04-03 03:36:00,937: INFO/ForkPoolWorker-1] [cccb57ba-cdcd-4db8-95e4-acaebb1f1b1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:36:01.267771955Z [2024-04-03 03:36:01,263: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:36:01.353484778Z [2024-04-03 03:36:01,349: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:36:01.688460599Z [2024-04-03 03:36:01,684: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:36:01.905775322Z [2024-04-03 03:36:01,905: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:36:02.429895429Z [2024-04-03 03:36:02,429: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[595f9133-4c92-4d28-9a74-69b46a6f18d9] succeeded in 1.5412690110006224s: None 2024-04-03T03:36:02.953127220Z [2024-04-03 03:36:02,952: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:36:02.957291979Z [2024-04-03 03:36:02,956: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:36:02.958322351Z [2024-04-03 03:36:02,957: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:36:02.962146279Z [2024-04-03 03:36:02,961: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:36:03.003101364Z [2024-04-03 03:36:03,002: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:36:03.004315293Z [2024-04-03 03:36:03,004: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:36:03.004366117Z [2024-04-03 03:36:03,004: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:36:03.004370033Z [2024-04-03 03:36:03,004: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:36:03.004521602Z [2024-04-03 03:36:03,004: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:36:03.004558562Z [2024-04-03 03:36:03,004: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:36:03.004878459Z [2024-04-03 03:36:03,004: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:36:03.004917740Z [2024-04-03 03:36:03,004: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:36:03.010624583Z [2024-04-03 03:36:03,010: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:36:03.031882580Z [2024-04-03 03:36:03,031: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:36:03.034101544Z [2024-04-03 03:36:03,033: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:36:03.034205488Z [2024-04-03 03:36:03,034: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:36:03.034312377Z [2024-04-03 03:36:03,034: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:36:03.035840090Z [2024-04-03 03:36:03,034: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:36:03.036064645Z [2024-04-03 03:36:03,035: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:36:03.036451614Z [2024-04-03 03:36:03,036: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:36:03.036624459Z [2024-04-03 03:36:03,036: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:36:03.042787391Z [2024-04-03 03:36:03,042: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:36:03.113223001Z [2024-04-03 03:36:03,112: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:36:03.160178993Z [2024-04-03 03:36:03,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:36:05.140986969Z [2024-04-03 03:36:05,140: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cccb57ba-cdcd-4db8-95e4-acaebb1f1b1e] succeeded in 4.210169415999189s: None 2024-04-03T03:36:05.620489512Z [2024-04-03 03:36:05,620: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b218a4c-1c5e-423e-871b-e0deaf441339] succeeded in 4.714018267000938s: None 2024-04-03T03:37:00.997286461Z [2024-04-03 03:37:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac23776e-ea25-4a0b-8ee2-2b57b4461ead] received 2024-04-03T03:37:01.022718303Z [2024-04-03 03:37:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2610b295-d579-4c5c-9360-7c152dc9c4b3] received 2024-04-03T03:37:01.022925306Z [2024-04-03 03:37:01,022: INFO/ForkPoolWorker-15] [ac23776e-ea25-4a0b-8ee2-2b57b4461ead] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:37:01.042090630Z [2024-04-03 03:37:01,041: INFO/ForkPoolWorker-16] [2610b295-d579-4c5c-9360-7c152dc9c4b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:37:01.477404910Z [2024-04-03 03:37:01,471: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:37:01.535493260Z [2024-04-03 03:37:01,530: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:37:03.086717895Z [2024-04-03 03:37:03,086: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:37:03.092321725Z [2024-04-03 03:37:03,091: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:37:03.159122755Z [2024-04-03 03:37:03,158: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:37:03.164356846Z [2024-04-03 03:37:03,163: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:37:03.183823629Z [2024-04-03 03:37:03,183: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:37:03.187785081Z [2024-04-03 03:37:03,187: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:37:03.187805578Z [2024-04-03 03:37:03,187: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:37:03.187853630Z [2024-04-03 03:37:03,187: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:37:03.188051994Z [2024-04-03 03:37:03,187: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:37:03.188167045Z [2024-04-03 03:37:03,188: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:37:03.188481192Z [2024-04-03 03:37:03,188: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:37:03.188522227Z [2024-04-03 03:37:03,188: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:37:03.209741940Z [2024-04-03 03:37:03,209: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:37:03.236958552Z [2024-04-03 03:37:03,236: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:37:03.238674010Z [2024-04-03 03:37:03,238: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:37:03.238708048Z [2024-04-03 03:37:03,238: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:37:03.244349791Z [2024-04-03 03:37:03,238: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:37:03.244948719Z [2024-04-03 03:37:03,244: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:37:03.245154072Z [2024-04-03 03:37:03,244: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:37:03.246423028Z [2024-04-03 03:37:03,245: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:37:03.246431897Z [2024-04-03 03:37:03,245: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:37:03.254040275Z [2024-04-03 03:37:03,253: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:37:03.330057312Z [2024-04-03 03:37:03,329: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:37:03.344685946Z [2024-04-03 03:37:03,344: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:37:06.629623746Z [2024-04-03 03:37:06,619: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2610b295-d579-4c5c-9360-7c152dc9c4b3] succeeded in 5.591515396001341s: None 2024-04-03T03:37:06.629657357Z [2024-04-03 03:37:06,621: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac23776e-ea25-4a0b-8ee2-2b57b4461ead] succeeded in 5.620031319000191s: None 2024-04-03T03:38:00.653718660Z [2024-04-03 03:38:00,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ee38488-5e20-4190-b30d-c7a695f538fb] received 2024-04-03T03:38:00.656817031Z [2024-04-03 03:38:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2be341ae-f2e8-44f5-83a2-1371f24a1c19] received 2024-04-03T03:38:00.669401171Z [2024-04-03 03:38:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c67a8fd4-3236-4406-b45b-515cf8ce773e] received 2024-04-03T03:38:00.690037443Z [2024-04-03 03:38:00,689: INFO/ForkPoolWorker-15] [0ee38488-5e20-4190-b30d-c7a695f538fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:38:00.700450736Z [2024-04-03 03:38:00,699: INFO/ForkPoolWorker-16] [2be341ae-f2e8-44f5-83a2-1371f24a1c19] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:38:00.704976307Z [2024-04-03 03:38:00,704: INFO/ForkPoolWorker-1] [c67a8fd4-3236-4406-b45b-515cf8ce773e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:38:01.239637855Z [2024-04-03 03:38:01,234: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:38:01.415391062Z [2024-04-03 03:38:01,404: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:38:01.420450145Z [2024-04-03 03:38:01,412: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:38:02.094964310Z [2024-04-03 03:38:02,094: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:38:02.979596455Z [2024-04-03 03:38:02,979: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2be341ae-f2e8-44f5-83a2-1371f24a1c19] succeeded in 2.312738086999161s: None 2024-04-03T03:38:03.199786004Z [2024-04-03 03:38:03,199: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:38:03.203673298Z [2024-04-03 03:38:03,203: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:38:03.281404080Z [2024-04-03 03:38:03,281: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:38:03.284042002Z [2024-04-03 03:38:03,283: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:38:03.284130549Z [2024-04-03 03:38:03,284: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:38:03.284214095Z [2024-04-03 03:38:03,284: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:38:03.284370313Z [2024-04-03 03:38:03,284: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:38:03.284452462Z [2024-04-03 03:38:03,284: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:38:03.284833288Z [2024-04-03 03:38:03,284: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:38:03.284919801Z [2024-04-03 03:38:03,284: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:38:03.300150869Z [2024-04-03 03:38:03,299: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:38:03.499756145Z [2024-04-03 03:38:03,499: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:38:03.770542522Z [2024-04-03 03:38:03,770: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:38:03.774237458Z [2024-04-03 03:38:03,773: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:38:03.837980520Z [2024-04-03 03:38:03,837: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:38:03.845974282Z [2024-04-03 03:38:03,845: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:38:03.845999200Z [2024-04-03 03:38:03,845: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:38:03.846163662Z [2024-04-03 03:38:03,846: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:38:03.846460508Z [2024-04-03 03:38:03,846: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:38:03.846474152Z [2024-04-03 03:38:03,846: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:38:03.846850237Z [2024-04-03 03:38:03,846: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:38:03.847091959Z [2024-04-03 03:38:03,846: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:38:03.853778096Z [2024-04-03 03:38:03,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:38:04.008644976Z [2024-04-03 03:38:04,008: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:38:06.155370170Z [2024-04-03 03:38:06,154: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ee38488-5e20-4190-b30d-c7a695f538fb] succeeded in 5.49314804200003s: None 2024-04-03T03:38:06.462064823Z [2024-04-03 03:38:06,461: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c67a8fd4-3236-4406-b45b-515cf8ce773e] succeeded in 5.7852774359998875s: None 2024-04-03T03:39:00.523003750Z [2024-04-03 03:39:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2545ce4c-0a6b-4d9e-bc5c-0566787ae3d6] received 2024-04-03T03:39:00.539712836Z [2024-04-03 03:39:00,539: INFO/ForkPoolWorker-15] [2545ce4c-0a6b-4d9e-bc5c-0566787ae3d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:39:00.551509925Z [2024-04-03 03:39:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b18cea5e-abb3-4dd1-bb0c-35f4025e2415] received 2024-04-03T03:39:00.570290474Z [2024-04-03 03:39:00,569: INFO/ForkPoolWorker-16] [b18cea5e-abb3-4dd1-bb0c-35f4025e2415] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:39:00.961748972Z [2024-04-03 03:39:00,957: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:39:01.074372528Z [2024-04-03 03:39:01,069: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:39:02.297899129Z [2024-04-03 03:39:02,297: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:39:02.301581352Z [2024-04-03 03:39:02,301: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:39:02.325765880Z [2024-04-03 03:39:02,325: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:39:02.327035327Z [2024-04-03 03:39:02,326: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:39:02.327075549Z [2024-04-03 03:39:02,326: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:39:02.327085876Z [2024-04-03 03:39:02,326: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:39:02.327181859Z [2024-04-03 03:39:02,326: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:39:02.327192227Z [2024-04-03 03:39:02,327: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:39:02.328235562Z [2024-04-03 03:39:02,328: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:39:02.328247616Z [2024-04-03 03:39:02,328: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:39:02.332700214Z [2024-04-03 03:39:02,332: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:39:02.402309989Z [2024-04-03 03:39:02,401: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:39:02.596435901Z [2024-04-03 03:39:02,595: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:39:02.600061121Z [2024-04-03 03:39:02,599: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:39:02.645042222Z [2024-04-03 03:39:02,644: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:39:02.646641939Z [2024-04-03 03:39:02,646: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:39:02.647518750Z [2024-04-03 03:39:02,647: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:39:02.647591893Z [2024-04-03 03:39:02,647: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:39:02.647758093Z [2024-04-03 03:39:02,647: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:39:02.647945966Z [2024-04-03 03:39:02,647: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:39:02.649282101Z [2024-04-03 03:39:02,649: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:39:02.649358137Z [2024-04-03 03:39:02,649: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:39:02.655463253Z [2024-04-03 03:39:02,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:39:02.748075154Z [2024-04-03 03:39:02,747: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:39:03.828984995Z [2024-04-03 03:39:03,828: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b18cea5e-abb3-4dd1-bb0c-35f4025e2415] succeeded in 3.2741698530007852s: None 2024-04-03T03:39:04.652072738Z [2024-04-03 03:39:04,651: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2545ce4c-0a6b-4d9e-bc5c-0566787ae3d6] succeeded in 4.123850906000371s: None 2024-04-03T03:40:00.330114171Z [2024-04-03 03:40:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01a35bd3-cd6d-4174-9780-e66bc7073cf2] received 2024-04-03T03:40:00.332391941Z [2024-04-03 03:40:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48c6c290-0905-4513-8b3b-2801dda1114e] received 2024-04-03T03:40:00.341164310Z [2024-04-03 03:40:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f808a57c-9b1e-4c3d-9309-cf4deb6faf8e] received 2024-04-03T03:40:00.344159686Z [2024-04-03 03:40:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a285aa18-415d-4f4a-9988-7ebb8c007486] received 2024-04-03T03:40:00.373872334Z [2024-04-03 03:40:00,373: INFO/ForkPoolWorker-16] [48c6c290-0905-4513-8b3b-2801dda1114e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:40:00.379812595Z [2024-04-03 03:40:00,379: INFO/ForkPoolWorker-15] [01a35bd3-cd6d-4174-9780-e66bc7073cf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:40:00.387196107Z [2024-04-03 03:40:00,384: INFO/ForkPoolWorker-2] [a285aa18-415d-4f4a-9988-7ebb8c007486] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:40:00.422840485Z [2024-04-03 03:40:00,422: INFO/ForkPoolWorker-1] [f808a57c-9b1e-4c3d-9309-cf4deb6faf8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:40:00.951093087Z [2024-04-03 03:40:00,945: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:40:00.974150327Z [2024-04-03 03:40:00,968: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:40:01.156915196Z [2024-04-03 03:40:01,149: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:40:01.157466887Z [2024-04-03 03:40:01,148: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:40:01.470907300Z [2024-04-03 03:40:01,470: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:40:02.142064351Z [2024-04-03 03:40:02,141: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a285aa18-415d-4f4a-9988-7ebb8c007486] succeeded in 1.7934359050013882s: None 2024-04-03T03:40:02.643930374Z [2024-04-03 03:40:02,643: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:40:02.647921012Z [2024-04-03 03:40:02,647: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:40:02.684058509Z [2024-04-03 03:40:02,683: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:40:02.685371965Z [2024-04-03 03:40:02,685: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:40:02.685447407Z [2024-04-03 03:40:02,685: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:40:02.685527119Z [2024-04-03 03:40:02,685: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:40:02.685696272Z [2024-04-03 03:40:02,685: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:40:02.685779991Z [2024-04-03 03:40:02,685: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:40:02.686026776Z [2024-04-03 03:40:02,685: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:40:02.686411329Z [2024-04-03 03:40:02,686: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:40:02.691110046Z [2024-04-03 03:40:02,690: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:40:02.810720674Z [2024-04-03 03:40:02,808: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:40:03.061160577Z [2024-04-03 03:40:03,060: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:40:03.064919508Z [2024-04-03 03:40:03,064: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:40:03.117733636Z [2024-04-03 03:40:03,117: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:40:03.118744085Z [2024-04-03 03:40:03,118: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:40:03.118791890Z [2024-04-03 03:40:03,118: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:40:03.118816991Z [2024-04-03 03:40:03,118: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:40:03.118952926Z [2024-04-03 03:40:03,118: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:40:03.118981390Z [2024-04-03 03:40:03,118: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:40:03.119167593Z [2024-04-03 03:40:03,119: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:40:03.119240718Z [2024-04-03 03:40:03,119: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:40:03.123548777Z [2024-04-03 03:40:03,123: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:40:03.296407208Z [2024-04-03 03:40:03,296: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:40:03.382560792Z [2024-04-03 03:40:03,382: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:40:03.386393105Z [2024-04-03 03:40:03,385: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:40:03.432043456Z [2024-04-03 03:40:03,431: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:40:03.441916184Z [2024-04-03 03:40:03,441: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:40:03.442142741Z [2024-04-03 03:40:03,442: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:40:03.442274559Z [2024-04-03 03:40:03,442: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:40:03.442470585Z [2024-04-03 03:40:03,442: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:40:03.442609832Z [2024-04-03 03:40:03,442: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:40:03.442986846Z [2024-04-03 03:40:03,442: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:40:03.443137641Z [2024-04-03 03:40:03,443: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:40:03.458450557Z [2024-04-03 03:40:03,458: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:40:03.577167927Z [2024-04-03 03:40:03,576: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:40:04.272028140Z [2024-04-03 03:40:04,271: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f808a57c-9b1e-4c3d-9309-cf4deb6faf8e] succeeded in 3.9278311890011537s: None 2024-04-03T03:40:04.358574659Z [2024-04-03 03:40:04,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[372b1de0-053c-4852-b9f6-27f03217d211] received 2024-04-03T03:40:04.365778175Z [2024-04-03 03:40:04,365: INFO/ForkPoolWorker-1] [372b1de0-053c-4852-b9f6-27f03217d211] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:40:04.665818451Z [2024-04-03 03:40:04,663: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:40:05.237437398Z [2024-04-03 03:40:05,237: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[48c6c290-0905-4513-8b3b-2801dda1114e] succeeded in 4.898638160999326s: None 2024-04-03T03:40:05.422971695Z [2024-04-03 03:40:05,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[01a35bd3-cd6d-4174-9780-e66bc7073cf2] succeeded in 5.087931963000301s: None 2024-04-03T03:40:05.902223058Z [2024-04-03 03:40:05,901: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:40:05.905704288Z [2024-04-03 03:40:05,905: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:40:05.935857682Z [2024-04-03 03:40:05,935: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:40:05.937832863Z [2024-04-03 03:40:05,937: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:40:05.937973054Z [2024-04-03 03:40:05,937: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:40:05.938123739Z [2024-04-03 03:40:05,937: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:40:05.938384212Z [2024-04-03 03:40:05,938: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:40:05.938529340Z [2024-04-03 03:40:05,938: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:40:05.939204641Z [2024-04-03 03:40:05,939: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:40:05.939420507Z [2024-04-03 03:40:05,939: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:40:05.946421449Z [2024-04-03 03:40:05,946: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:40:06.016858388Z [2024-04-03 03:40:06,016: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:40:06.575282971Z [2024-04-03 03:40:06,574: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[372b1de0-053c-4852-b9f6-27f03217d211] succeeded in 2.213747195999531s: None 2024-04-03T03:40:06.984862416Z [2024-04-03 03:40:06,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dec13626-a5d0-43d4-9700-59f5035c0d4a] received 2024-04-03T03:40:06.994265961Z [2024-04-03 03:40:06,994: INFO/ForkPoolWorker-15] [dec13626-a5d0-43d4-9700-59f5035c0d4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:40:07.269583250Z [2024-04-03 03:40:07,265: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:40:08.467239069Z [2024-04-03 03:40:08,466: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:40:08.476109240Z [2024-04-03 03:40:08,469: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:40:08.509739082Z [2024-04-03 03:40:08,509: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:40:08.511023903Z [2024-04-03 03:40:08,510: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:40:08.511094078Z [2024-04-03 03:40:08,510: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:40:08.511247998Z [2024-04-03 03:40:08,511: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:40:08.511475578Z [2024-04-03 03:40:08,511: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:40:08.511578866Z [2024-04-03 03:40:08,511: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:40:08.511930395Z [2024-04-03 03:40:08,511: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:40:08.512159893Z [2024-04-03 03:40:08,512: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:40:08.519666737Z [2024-04-03 03:40:08,519: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:40:08.626755491Z [2024-04-03 03:40:08,626: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:40:10.187646487Z [2024-04-03 03:40:10,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dec13626-a5d0-43d4-9700-59f5035c0d4a] succeeded in 3.200026708000223s: None 2024-04-03T03:40:10.396588923Z [2024-04-03 03:40:10,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[127048ac-9b3a-487e-ba44-0f01fcda604b] received 2024-04-03T03:40:10.407985230Z [2024-04-03 03:40:10,407: INFO/ForkPoolWorker-15] [127048ac-9b3a-487e-ba44-0f01fcda604b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:40:10.731324494Z [2024-04-03 03:40:10,728: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:40:12.062679601Z [2024-04-03 03:40:12,062: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:40:12.066237651Z [2024-04-03 03:40:12,065: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:40:12.118693881Z [2024-04-03 03:40:12,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:40:12.119955622Z [2024-04-03 03:40:12,119: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:40:12.119972369Z [2024-04-03 03:40:12,119: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:40:12.119980693Z [2024-04-03 03:40:12,119: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:40:12.120111325Z [2024-04-03 03:40:12,119: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:40:12.120125615Z [2024-04-03 03:40:12,120: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:40:12.120358387Z [2024-04-03 03:40:12,120: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:40:12.120394320Z [2024-04-03 03:40:12,120: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:40:12.127986999Z [2024-04-03 03:40:12,127: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:40:12.211507805Z [2024-04-03 03:40:12,211: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:40:12.897289332Z [2024-04-03 03:40:12,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[127048ac-9b3a-487e-ba44-0f01fcda604b] succeeded in 2.496113217999664s: None 2024-04-03T03:41:01.071457365Z [2024-04-03 03:41:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[304add10-6d70-42ed-8b58-1efb376d7d1a] received 2024-04-03T03:41:01.074007522Z [2024-04-03 03:41:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0ad65f8-dc26-4641-aaac-8a564993194b] received 2024-04-03T03:41:01.093063108Z [2024-04-03 03:41:01,092: INFO/ForkPoolWorker-15] [304add10-6d70-42ed-8b58-1efb376d7d1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:41:01.097961311Z [2024-04-03 03:41:01,097: INFO/ForkPoolWorker-16] [d0ad65f8-dc26-4641-aaac-8a564993194b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:41:01.434770554Z [2024-04-03 03:41:01,430: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:41:01.475513532Z [2024-04-03 03:41:01,471: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:41:02.583897211Z [2024-04-03 03:41:02,583: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:41:02.587155287Z [2024-04-03 03:41:02,586: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:41:02.625292256Z [2024-04-03 03:41:02,625: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:41:02.626713719Z [2024-04-03 03:41:02,626: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:41:02.626764502Z [2024-04-03 03:41:02,626: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:41:02.626843352Z [2024-04-03 03:41:02,626: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:41:02.627071426Z [2024-04-03 03:41:02,626: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:41:02.627123278Z [2024-04-03 03:41:02,627: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:41:02.627439222Z [2024-04-03 03:41:02,627: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:41:02.627573981Z [2024-04-03 03:41:02,627: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:41:02.634566585Z [2024-04-03 03:41:02,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:41:02.661931579Z [2024-04-03 03:41:02,661: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:41:02.665254367Z [2024-04-03 03:41:02,664: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:41:02.705241686Z [2024-04-03 03:41:02,704: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:41:02.706424905Z [2024-04-03 03:41:02,706: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:41:02.706445236Z [2024-04-03 03:41:02,706: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:41:02.706665381Z [2024-04-03 03:41:02,706: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:41:02.706948068Z [2024-04-03 03:41:02,706: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:41:02.706960142Z [2024-04-03 03:41:02,706: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:41:02.707299684Z [2024-04-03 03:41:02,707: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:41:02.707309075Z [2024-04-03 03:41:02,707: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:41:02.710093911Z [2024-04-03 03:41:02,709: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:41:02.711804439Z [2024-04-03 03:41:02,711: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:41:02.822429368Z [2024-04-03 03:41:02,821: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:41:04.947396852Z [2024-04-03 03:41:04,947: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0ad65f8-dc26-4641-aaac-8a564993194b] succeeded in 3.8683983230002923s: None 2024-04-03T03:41:06.582853997Z [2024-04-03 03:41:06,582: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[304add10-6d70-42ed-8b58-1efb376d7d1a] succeeded in 5.508566686999984s: None 2024-04-03T03:41:41.604188287Z [2024-04-03 03:41:41,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[410deacb-0751-4c1d-aa56-0a04f13ee5fc] received 2024-04-03T03:41:41.615058356Z [2024-04-03 03:41:41,614: INFO/ForkPoolWorker-15] [410deacb-0751-4c1d-aa56-0a04f13ee5fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240403034140_058481', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-03T03:41:41.936541683Z [2024-04-03 03:41:41,933: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-03T03:41:42.242781535Z [2024-04-03 03:41:42,242: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:41:42.838648787Z [2024-04-03 03:41:42,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[410deacb-0751-4c1d-aa56-0a04f13ee5fc] succeeded in 1.2293875319992367s: None 2024-04-03T03:42:00.996142637Z [2024-04-03 03:42:00,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1be6f219-55fc-4421-986b-a37d8ca76130] received 2024-04-03T03:42:00.999959578Z [2024-04-03 03:42:00,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98ffb545-e90c-4f39-912c-9afe4c943ba7] received 2024-04-03T03:42:01.011625510Z [2024-04-03 03:42:01,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b7b8b6c-3e8f-48f8-a4d9-d73da7372639] received 2024-04-03T03:42:01.014176254Z [2024-04-03 03:42:01,013: INFO/ForkPoolWorker-15] [1be6f219-55fc-4421-986b-a37d8ca76130] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:42:01.028871674Z [2024-04-03 03:42:01,028: INFO/ForkPoolWorker-16] [98ffb545-e90c-4f39-912c-9afe4c943ba7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:42:01.085478430Z [2024-04-03 03:42:01,077: INFO/ForkPoolWorker-1] [0b7b8b6c-3e8f-48f8-a4d9-d73da7372639] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:42:01.338858367Z [2024-04-03 03:42:01,335: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:42:01.433457951Z [2024-04-03 03:42:01,429: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:42:01.662858237Z [2024-04-03 03:42:01,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:42:01.759822710Z [2024-04-03 03:42:01,759: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:42:02.329360109Z [2024-04-03 03:42:02,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1be6f219-55fc-4421-986b-a37d8ca76130] succeeded in 1.329097940999418s: None 2024-04-03T03:42:02.903188338Z [2024-04-03 03:42:02,902: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:42:02.907407666Z [2024-04-03 03:42:02,906: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:42:02.950706079Z [2024-04-03 03:42:02,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:42:02.954683444Z [2024-04-03 03:42:02,954: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:42:02.954755520Z [2024-04-03 03:42:02,954: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:42:02.954971728Z [2024-04-03 03:42:02,954: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:42:02.955487566Z [2024-04-03 03:42:02,954: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:42:02.955498558Z [2024-04-03 03:42:02,955: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:42:02.955633287Z [2024-04-03 03:42:02,955: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:42:02.955643970Z [2024-04-03 03:42:02,955: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:42:02.961099700Z [2024-04-03 03:42:02,960: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:42:03.021739399Z [2024-04-03 03:42:03,021: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:42:03.025324954Z [2024-04-03 03:42:03,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:42:03.057013251Z [2024-04-03 03:42:03,056: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:42:03.086937524Z [2024-04-03 03:42:03,086: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:42:03.088888195Z [2024-04-03 03:42:03,088: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:42:03.088925006Z [2024-04-03 03:42:03,088: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:42:03.089023324Z [2024-04-03 03:42:03,088: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:42:03.089254272Z [2024-04-03 03:42:03,089: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:42:03.089298560Z [2024-04-03 03:42:03,089: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:42:03.089546443Z [2024-04-03 03:42:03,089: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:42:03.089627007Z [2024-04-03 03:42:03,089: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:42:03.095764258Z [2024-04-03 03:42:03,095: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:42:03.256025884Z [2024-04-03 03:42:03,255: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:42:05.436526442Z [2024-04-03 03:42:05,435: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[98ffb545-e90c-4f39-912c-9afe4c943ba7] succeeded in 4.416421337999054s: None 2024-04-03T03:42:05.508395479Z [2024-04-03 03:42:05,507: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b7b8b6c-3e8f-48f8-a4d9-d73da7372639] succeeded in 4.491183912001361s: None 2024-04-03T03:43:00.723016338Z [2024-04-03 03:43:00,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07f5e010-a464-46b4-869d-b713c10af2df] received 2024-04-03T03:43:00.737710787Z [2024-04-03 03:43:00,737: INFO/ForkPoolWorker-15] [07f5e010-a464-46b4-869d-b713c10af2df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:43:00.750729521Z [2024-04-03 03:43:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f322311d-1262-4036-bc87-243c1d49a46a] received 2024-04-03T03:43:00.770861162Z [2024-04-03 03:43:00,769: INFO/ForkPoolWorker-16] [f322311d-1262-4036-bc87-243c1d49a46a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:43:01.105226872Z [2024-04-03 03:43:01,099: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:43:01.136264729Z [2024-04-03 03:43:01,132: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:43:02.318829501Z [2024-04-03 03:43:02,318: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:43:02.322351726Z [2024-04-03 03:43:02,321: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:43:02.338406834Z [2024-04-03 03:43:02,338: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:43:02.342539836Z [2024-04-03 03:43:02,341: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:43:02.353853167Z [2024-04-03 03:43:02,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:43:02.355379348Z [2024-04-03 03:43:02,355: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:43:02.355415352Z [2024-04-03 03:43:02,355: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:43:02.355518681Z [2024-04-03 03:43:02,355: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:43:02.355734344Z [2024-04-03 03:43:02,355: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:43:02.355741701Z [2024-04-03 03:43:02,355: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:43:02.356306005Z [2024-04-03 03:43:02,356: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:43:02.356362413Z [2024-04-03 03:43:02,356: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:43:02.361340839Z [2024-04-03 03:43:02,361: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:43:02.369712714Z [2024-04-03 03:43:02,369: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:43:02.371014054Z [2024-04-03 03:43:02,370: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:43:02.371189704Z [2024-04-03 03:43:02,370: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:43:02.371342656Z [2024-04-03 03:43:02,371: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:43:02.371533075Z [2024-04-03 03:43:02,371: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:43:02.371637693Z [2024-04-03 03:43:02,371: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:43:02.371930622Z [2024-04-03 03:43:02,371: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:43:02.372397033Z [2024-04-03 03:43:02,371: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:43:02.376922226Z [2024-04-03 03:43:02,376: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:43:02.462540346Z [2024-04-03 03:43:02,462: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:43:02.474194172Z [2024-04-03 03:43:02,473: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:43:04.608892008Z [2024-04-03 03:43:04,608: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f322311d-1262-4036-bc87-243c1d49a46a] succeeded in 3.8538897829985217s: None 2024-04-03T03:43:05.435992036Z [2024-04-03 03:43:05,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07f5e010-a464-46b4-869d-b713c10af2df] succeeded in 4.708341816000029s: None 2024-04-03T03:44:00.478219928Z [2024-04-03 03:44:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34bc1a94-294e-45c3-97f7-74a1825e74b1] received 2024-04-03T03:44:00.488707456Z [2024-04-03 03:44:00,488: INFO/ForkPoolWorker-15] [34bc1a94-294e-45c3-97f7-74a1825e74b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:44:00.493325778Z [2024-04-03 03:44:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfbffc2b-da8a-4381-ac97-2cd7fe5ce1cc] received 2024-04-03T03:44:00.501487154Z [2024-04-03 03:44:00,501: INFO/ForkPoolWorker-16] [dfbffc2b-da8a-4381-ac97-2cd7fe5ce1cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:44:00.521074810Z [2024-04-03 03:44:00,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f860cb4f-9d46-4cdc-ac33-765625072a42] received 2024-04-03T03:44:00.555074920Z [2024-04-03 03:44:00,549: INFO/ForkPoolWorker-1] [f860cb4f-9d46-4cdc-ac33-765625072a42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:44:00.968790727Z [2024-04-03 03:44:00,964: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:44:00.995089665Z [2024-04-03 03:44:00,991: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:44:01.139921193Z [2024-04-03 03:44:01,131: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:44:01.347538742Z [2024-04-03 03:44:01,347: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:44:02.041149935Z [2024-04-03 03:44:02,040: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dfbffc2b-da8a-4381-ac97-2cd7fe5ce1cc] succeeded in 1.5458671540000068s: None 2024-04-03T03:44:02.466217807Z [2024-04-03 03:44:02,465: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:44:02.470408889Z [2024-04-03 03:44:02,469: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:44:02.495080257Z [2024-04-03 03:44:02,494: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:44:02.496588588Z [2024-04-03 03:44:02,496: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:44:02.496638376Z [2024-04-03 03:44:02,496: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:44:02.496781003Z [2024-04-03 03:44:02,496: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:44:02.497029538Z [2024-04-03 03:44:02,496: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:44:02.497179338Z [2024-04-03 03:44:02,496: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:44:02.497474461Z [2024-04-03 03:44:02,497: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:44:02.498055142Z [2024-04-03 03:44:02,497: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:44:02.502489067Z [2024-04-03 03:44:02,502: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:44:02.577568137Z [2024-04-03 03:44:02,577: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:44:02.631672918Z [2024-04-03 03:44:02,631: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:44:02.635205021Z [2024-04-03 03:44:02,634: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:44:02.658285682Z [2024-04-03 03:44:02,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:44:02.660547941Z [2024-04-03 03:44:02,660: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:44:02.660810612Z [2024-04-03 03:44:02,660: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:44:02.661005889Z [2024-04-03 03:44:02,660: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:44:02.661318678Z [2024-04-03 03:44:02,661: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:44:02.661553680Z [2024-04-03 03:44:02,661: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:44:02.662053690Z [2024-04-03 03:44:02,661: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:44:02.662893043Z [2024-04-03 03:44:02,662: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:44:02.669166687Z [2024-04-03 03:44:02,668: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:44:02.762112938Z [2024-04-03 03:44:02,761: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:44:04.521801347Z [2024-04-03 03:44:04,521: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f860cb4f-9d46-4cdc-ac33-765625072a42] succeeded in 3.996507453999584s: None 2024-04-03T03:44:04.971584098Z [2024-04-03 03:44:04,971: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34bc1a94-294e-45c3-97f7-74a1825e74b1] succeeded in 4.490549742000439s: None 2024-04-03T03:45:01.320191405Z [2024-04-03 03:45:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f82596ad-0d1c-461a-9f16-c27b309c12c1] received 2024-04-03T03:45:01.334620825Z [2024-04-03 03:45:01,334: INFO/ForkPoolWorker-15] [f82596ad-0d1c-461a-9f16-c27b309c12c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:45:01.346951196Z [2024-04-03 03:45:01,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e167bccf-10a5-43f3-8dc7-f3efb43af804] received 2024-04-03T03:45:01.356871608Z [2024-04-03 03:45:01,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab2b12c2-7786-4e9f-93ee-b59c5209cee4] received 2024-04-03T03:45:01.372140952Z [2024-04-03 03:45:01,371: INFO/ForkPoolWorker-1] [ab2b12c2-7786-4e9f-93ee-b59c5209cee4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:45:01.396573343Z [2024-04-03 03:45:01,396: INFO/ForkPoolWorker-16] [e167bccf-10a5-43f3-8dc7-f3efb43af804] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:45:01.742193744Z [2024-04-03 03:45:01,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:45:01.751656103Z [2024-04-03 03:45:01,747: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:45:01.784311817Z [2024-04-03 03:45:01,780: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:45:03.172469145Z [2024-04-03 03:45:03,172: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:45:03.176089605Z [2024-04-03 03:45:03,175: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:45:03.245692418Z [2024-04-03 03:45:03,245: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:45:03.251554029Z [2024-04-03 03:45:03,250: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:45:03.251965300Z [2024-04-03 03:45:03,251: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:45:03.253610671Z [2024-04-03 03:45:03,253: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:45:03.253626097Z [2024-04-03 03:45:03,253: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:45:03.253720142Z [2024-04-03 03:45:03,253: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:45:03.257314423Z [2024-04-03 03:45:03,256: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:45:03.257329505Z [2024-04-03 03:45:03,257: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:45:03.257682662Z [2024-04-03 03:45:03,257: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:45:03.260320655Z [2024-04-03 03:45:03,257: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:45:03.270024172Z [2024-04-03 03:45:03,269: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:45:03.274293654Z [2024-04-03 03:45:03,273: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:45:03.279746055Z [2024-04-03 03:45:03,279: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:45:03.316721673Z [2024-04-03 03:45:03,316: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:45:03.319308144Z [2024-04-03 03:45:03,319: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:45:03.319825335Z [2024-04-03 03:45:03,319: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:45:03.320030090Z [2024-04-03 03:45:03,319: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:45:03.320283664Z [2024-04-03 03:45:03,320: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:45:03.320565360Z [2024-04-03 03:45:03,320: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:45:03.321369114Z [2024-04-03 03:45:03,321: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:45:03.321639065Z [2024-04-03 03:45:03,321: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:45:03.331719433Z [2024-04-03 03:45:03,331: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:45:03.368646840Z [2024-04-03 03:45:03,368: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:45:03.370868298Z [2024-04-03 03:45:03,370: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:45:03.371097405Z [2024-04-03 03:45:03,370: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:45:03.371229652Z [2024-04-03 03:45:03,371: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:45:03.371427197Z [2024-04-03 03:45:03,371: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:45:03.371630717Z [2024-04-03 03:45:03,371: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:45:03.372004772Z [2024-04-03 03:45:03,371: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:45:03.372138513Z [2024-04-03 03:45:03,372: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:45:03.382146502Z [2024-04-03 03:45:03,381: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:45:03.473136546Z [2024-04-03 03:45:03,472: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:45:03.488571447Z [2024-04-03 03:45:03,483: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:45:03.507963606Z [2024-04-03 03:45:03,507: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:45:04.408897031Z [2024-04-03 03:45:04,408: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f82596ad-0d1c-461a-9f16-c27b309c12c1] succeeded in 3.084516094000719s: None 2024-04-03T03:45:05.156968420Z [2024-04-03 03:45:05,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[363b0327-94aa-4c54-9573-d804a0b71363] received 2024-04-03T03:45:05.168184890Z [2024-04-03 03:45:05,167: INFO/ForkPoolWorker-15] [363b0327-94aa-4c54-9573-d804a0b71363] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:45:05.484549769Z [2024-04-03 03:45:05,481: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:45:05.490987541Z [2024-04-03 03:45:05,490: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e167bccf-10a5-43f3-8dc7-f3efb43af804] succeeded in 4.138072265999654s: None 2024-04-03T03:45:05.848176702Z [2024-04-03 03:45:05,847: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab2b12c2-7786-4e9f-93ee-b59c5209cee4] succeeded in 4.484065701999498s: None 2024-04-03T03:45:06.671370880Z [2024-04-03 03:45:06,667: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:45:06.671451518Z [2024-04-03 03:45:06,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:45:06.705614660Z [2024-04-03 03:45:06,705: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:45:06.706975359Z [2024-04-03 03:45:06,706: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:45:06.707007882Z [2024-04-03 03:45:06,706: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:45:06.707070981Z [2024-04-03 03:45:06,706: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:45:06.707189311Z [2024-04-03 03:45:06,707: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:45:06.707223258Z [2024-04-03 03:45:06,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:45:06.707465431Z [2024-04-03 03:45:06,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:45:06.707552766Z [2024-04-03 03:45:06,707: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:45:06.714063031Z [2024-04-03 03:45:06,713: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:45:06.796933302Z [2024-04-03 03:45:06,796: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:45:07.431750666Z [2024-04-03 03:45:07,431: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[363b0327-94aa-4c54-9573-d804a0b71363] succeeded in 2.272376658000212s: None 2024-04-03T03:45:07.670219906Z [2024-04-03 03:45:07,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fa28580-f5a6-41a6-a995-e923fd947beb] received 2024-04-03T03:45:07.680921700Z [2024-04-03 03:45:07,680: INFO/ForkPoolWorker-15] [6fa28580-f5a6-41a6-a995-e923fd947beb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:45:08.062481715Z [2024-04-03 03:45:08,059: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:45:09.242691529Z [2024-04-03 03:45:09,239: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:45:09.243677601Z [2024-04-03 03:45:09,243: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:45:09.279459292Z [2024-04-03 03:45:09,279: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:45:09.281249206Z [2024-04-03 03:45:09,281: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:45:09.281419928Z [2024-04-03 03:45:09,281: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:45:09.281548601Z [2024-04-03 03:45:09,281: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:45:09.281761296Z [2024-04-03 03:45:09,281: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:45:09.281884654Z [2024-04-03 03:45:09,281: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:45:09.282199983Z [2024-04-03 03:45:09,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:45:09.282359781Z [2024-04-03 03:45:09,282: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:45:09.289033635Z [2024-04-03 03:45:09,288: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:45:09.381082397Z [2024-04-03 03:45:09,380: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:45:09.962798634Z [2024-04-03 03:45:09,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6fa28580-f5a6-41a6-a995-e923fd947beb] succeeded in 2.2887643310004933s: None 2024-04-03T03:45:10.078205085Z [2024-04-03 03:45:10,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d26b399-7ecb-49d5-a53c-698958cfbc74] received 2024-04-03T03:45:10.099562155Z [2024-04-03 03:45:10,099: INFO/ForkPoolWorker-15] [7d26b399-7ecb-49d5-a53c-698958cfbc74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:45:10.430972843Z [2024-04-03 03:45:10,427: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:45:11.669848070Z [2024-04-03 03:45:11,669: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:45:11.673772986Z [2024-04-03 03:45:11,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:45:11.700950327Z [2024-04-03 03:45:11,700: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:45:11.701991168Z [2024-04-03 03:45:11,701: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:45:11.702021102Z [2024-04-03 03:45:11,701: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:45:11.702115468Z [2024-04-03 03:45:11,702: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:45:11.702227587Z [2024-04-03 03:45:11,702: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:45:11.702251136Z [2024-04-03 03:45:11,702: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:45:11.702490402Z [2024-04-03 03:45:11,702: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:45:11.702524492Z [2024-04-03 03:45:11,702: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:45:11.709100683Z [2024-04-03 03:45:11,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:45:11.784113590Z [2024-04-03 03:45:11,783: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:45:12.467133691Z [2024-04-03 03:45:12,466: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d26b399-7ecb-49d5-a53c-698958cfbc74] succeeded in 2.376939186000527s: None 2024-04-03T03:46:00.955822848Z [2024-04-03 03:46:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae4c5bfb-be74-4257-8f1d-5eea78d3f66f] received 2024-04-03T03:46:00.969222908Z [2024-04-03 03:46:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e7872d8-bf68-49a4-8994-fa7c8e574396] received 2024-04-03T03:46:00.971402038Z [2024-04-03 03:46:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83f1204c-41a9-4b97-8bc8-318850a124ce] received 2024-04-03T03:46:00.991924628Z [2024-04-03 03:46:00,991: INFO/ForkPoolWorker-15] [ae4c5bfb-be74-4257-8f1d-5eea78d3f66f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:46:00.995705954Z [2024-04-03 03:46:00,995: INFO/ForkPoolWorker-16] [7e7872d8-bf68-49a4-8994-fa7c8e574396] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:46:00.995761103Z [2024-04-03 03:46:00,995: INFO/ForkPoolWorker-1] [83f1204c-41a9-4b97-8bc8-318850a124ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:46:01.365722980Z [2024-04-03 03:46:01,361: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:46:01.651529928Z [2024-04-03 03:46:01,646: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:46:01.749562316Z [2024-04-03 03:46:01,745: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:46:02.000327759Z [2024-04-03 03:46:02,000: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:46:02.715434207Z [2024-04-03 03:46:02,714: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e7872d8-bf68-49a4-8994-fa7c8e574396] succeeded in 1.7421254990003945s: None 2024-04-03T03:46:03.080332829Z [2024-04-03 03:46:03,080: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:46:03.086676223Z [2024-04-03 03:46:03,083: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:46:03.144474057Z [2024-04-03 03:46:03,144: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:46:03.145763592Z [2024-04-03 03:46:03,145: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:46:03.145917973Z [2024-04-03 03:46:03,145: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:46:03.146016129Z [2024-04-03 03:46:03,145: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:46:03.146194544Z [2024-04-03 03:46:03,146: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:46:03.146279691Z [2024-04-03 03:46:03,146: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:46:03.146520439Z [2024-04-03 03:46:03,146: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:46:03.146672290Z [2024-04-03 03:46:03,146: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:46:03.151763183Z [2024-04-03 03:46:03,151: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:46:03.267402996Z [2024-04-03 03:46:03,267: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:46:03.323761302Z [2024-04-03 03:46:03,323: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:46:03.327070014Z [2024-04-03 03:46:03,326: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:46:03.386199541Z [2024-04-03 03:46:03,385: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:46:03.389395665Z [2024-04-03 03:46:03,389: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:46:03.389417436Z [2024-04-03 03:46:03,389: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:46:03.389450536Z [2024-04-03 03:46:03,389: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:46:03.389582377Z [2024-04-03 03:46:03,389: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:46:03.389613769Z [2024-04-03 03:46:03,389: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:46:03.390985688Z [2024-04-03 03:46:03,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:46:03.391006492Z [2024-04-03 03:46:03,390: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:46:03.412484901Z [2024-04-03 03:46:03,412: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:46:03.537190235Z [2024-04-03 03:46:03,536: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:46:05.661348903Z [2024-04-03 03:46:05,660: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[83f1204c-41a9-4b97-8bc8-318850a124ce] succeeded in 4.686555932999909s: None 2024-04-03T03:46:05.709679062Z [2024-04-03 03:46:05,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae4c5bfb-be74-4257-8f1d-5eea78d3f66f] succeeded in 4.7493167750017165s: None 2024-04-03T03:47:01.148043512Z [2024-04-03 03:47:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90db368e-aab9-4381-b77f-3c403ec307c1] received 2024-04-03T03:47:01.155150072Z [2024-04-03 03:47:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c1a5dde-215e-4b19-ad34-05030b7b3e9a] received 2024-04-03T03:47:01.163139642Z [2024-04-03 03:47:01,162: INFO/ForkPoolWorker-15] [90db368e-aab9-4381-b77f-3c403ec307c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:47:01.182169629Z [2024-04-03 03:47:01,181: INFO/ForkPoolWorker-16] [8c1a5dde-215e-4b19-ad34-05030b7b3e9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:47:01.626328283Z [2024-04-03 03:47:01,622: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:47:01.678893341Z [2024-04-03 03:47:01,674: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:47:02.982694620Z [2024-04-03 03:47:02,982: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:47:02.986286161Z [2024-04-03 03:47:02,985: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:47:03.027891663Z [2024-04-03 03:47:03,027: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:47:03.031701985Z [2024-04-03 03:47:03,031: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:47:03.053884491Z [2024-04-03 03:47:03,053: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:47:03.056310014Z [2024-04-03 03:47:03,056: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:47:03.056329648Z [2024-04-03 03:47:03,056: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:47:03.056389136Z [2024-04-03 03:47:03,056: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:47:03.056515051Z [2024-04-03 03:47:03,056: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:47:03.056524057Z [2024-04-03 03:47:03,056: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:47:03.056829518Z [2024-04-03 03:47:03,056: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:47:03.056863321Z [2024-04-03 03:47:03,056: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:47:03.061278782Z [2024-04-03 03:47:03,061: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:47:03.111054126Z [2024-04-03 03:47:03,110: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:47:03.112745800Z [2024-04-03 03:47:03,112: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:47:03.112762289Z [2024-04-03 03:47:03,112: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:47:03.112813005Z [2024-04-03 03:47:03,112: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:47:03.112912241Z [2024-04-03 03:47:03,112: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:47:03.112958142Z [2024-04-03 03:47:03,112: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:47:03.113156074Z [2024-04-03 03:47:03,113: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:47:03.113178727Z [2024-04-03 03:47:03,113: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:47:03.117806782Z [2024-04-03 03:47:03,117: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:47:03.235648182Z [2024-04-03 03:47:03,235: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:47:03.248456327Z [2024-04-03 03:47:03,248: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:47:05.414161156Z [2024-04-03 03:47:05,413: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c1a5dde-215e-4b19-ad34-05030b7b3e9a] succeeded in 4.255509632999747s: None 2024-04-03T03:47:05.535005832Z [2024-04-03 03:47:05,534: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90db368e-aab9-4381-b77f-3c403ec307c1] succeeded in 4.381388945999788s: None 2024-04-03T03:47:41.890735667Z [2024-04-03 03:47:41,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5051c60-ef55-45fc-b039-ece35fb85790] received 2024-04-03T03:47:41.909552930Z [2024-04-03 03:47:41,909: INFO/ForkPoolWorker-15] [c5051c60-ef55-45fc-b039-ece35fb85790] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240403034740_769917', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-03T03:47:42.230410954Z [2024-04-03 03:47:42,226: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-03T03:47:42.542682157Z [2024-04-03 03:47:42,542: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:47:43.184787627Z [2024-04-03 03:47:43,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5051c60-ef55-45fc-b039-ece35fb85790] succeeded in 1.288228772000366s: None 2024-04-03T03:48:00.315525674Z [2024-04-03 03:48:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[721bae18-f44a-4678-b71d-7ba6b9911b3a] received 2024-04-03T03:48:00.321092782Z [2024-04-03 03:48:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64bf1af4-86cb-4901-bc14-270876829e70] received 2024-04-03T03:48:00.333272587Z [2024-04-03 03:48:00,333: INFO/ForkPoolWorker-15] [721bae18-f44a-4678-b71d-7ba6b9911b3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:48:00.335440846Z [2024-04-03 03:48:00,335: INFO/ForkPoolWorker-16] [64bf1af4-86cb-4901-bc14-270876829e70] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:48:00.339182920Z [2024-04-03 03:48:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b022a18-ec74-4a79-b7d3-6fc301daaf93] received 2024-04-03T03:48:00.354894489Z [2024-04-03 03:48:00,354: INFO/ForkPoolWorker-1] [9b022a18-ec74-4a79-b7d3-6fc301daaf93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:48:00.730070256Z [2024-04-03 03:48:00,726: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:48:00.758367598Z [2024-04-03 03:48:00,753: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:48:00.910672740Z [2024-04-03 03:48:00,906: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:48:01.213138256Z [2024-04-03 03:48:01,212: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:48:01.965652271Z [2024-04-03 03:48:01,965: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[64bf1af4-86cb-4901-bc14-270876829e70] succeeded in 1.641515655001058s: None 2024-04-03T03:48:02.273206960Z [2024-04-03 03:48:02,272: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:48:02.279960365Z [2024-04-03 03:48:02,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:48:02.336914983Z [2024-04-03 03:48:02,336: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:48:02.342912104Z [2024-04-03 03:48:02,338: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:48:02.342930280Z [2024-04-03 03:48:02,338: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:48:02.342933591Z [2024-04-03 03:48:02,338: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:48:02.342942061Z [2024-04-03 03:48:02,338: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:48:02.342946019Z [2024-04-03 03:48:02,338: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:48:02.342949046Z [2024-04-03 03:48:02,339: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:48:02.342952350Z [2024-04-03 03:48:02,339: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:48:02.344207319Z [2024-04-03 03:48:02,343: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:48:02.447138032Z [2024-04-03 03:48:02,446: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:48:02.448889352Z [2024-04-03 03:48:02,448: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:48:02.452751830Z [2024-04-03 03:48:02,452: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:48:02.480744065Z [2024-04-03 03:48:02,480: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:48:02.481980085Z [2024-04-03 03:48:02,481: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:48:02.482035189Z [2024-04-03 03:48:02,481: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:48:02.482271676Z [2024-04-03 03:48:02,482: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:48:02.482394442Z [2024-04-03 03:48:02,482: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:48:02.482452389Z [2024-04-03 03:48:02,482: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:48:02.483309724Z [2024-04-03 03:48:02,483: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:48:02.483329648Z [2024-04-03 03:48:02,483: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:48:02.488754126Z [2024-04-03 03:48:02,488: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:48:02.566493828Z [2024-04-03 03:48:02,566: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:48:04.753499393Z [2024-04-03 03:48:04,753: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[721bae18-f44a-4678-b71d-7ba6b9911b3a] succeeded in 4.435613052999543s: None 2024-04-03T03:48:05.326382699Z [2024-04-03 03:48:05,325: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b022a18-ec74-4a79-b7d3-6fc301daaf93] succeeded in 4.983409687998574s: None 2024-04-03T03:49:00.873526039Z [2024-04-03 03:49:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44648bc1-b931-45af-8188-baf8169f92ee] received 2024-04-03T03:49:00.889535296Z [2024-04-03 03:49:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[487b000c-ffb7-4d73-89ac-ddedefbfdd2e] received 2024-04-03T03:49:00.892834334Z [2024-04-03 03:49:00,891: INFO/ForkPoolWorker-15] [44648bc1-b931-45af-8188-baf8169f92ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:49:00.913135313Z [2024-04-03 03:49:00,912: INFO/ForkPoolWorker-16] [487b000c-ffb7-4d73-89ac-ddedefbfdd2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:49:01.240472206Z [2024-04-03 03:49:01,236: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:49:01.265876950Z [2024-04-03 03:49:01,261: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:49:02.460117656Z [2024-04-03 03:49:02,459: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:49:02.463648321Z [2024-04-03 03:49:02,463: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:49:02.466278745Z [2024-04-03 03:49:02,465: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:49:02.470200588Z [2024-04-03 03:49:02,469: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:49:02.497770249Z [2024-04-03 03:49:02,497: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:49:02.501005868Z [2024-04-03 03:49:02,500: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:49:02.501266253Z [2024-04-03 03:49:02,500: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:49:02.501436031Z [2024-04-03 03:49:02,501: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:49:02.501727162Z [2024-04-03 03:49:02,501: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:49:02.501930417Z [2024-04-03 03:49:02,501: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:49:02.502553124Z [2024-04-03 03:49:02,502: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:49:02.502872101Z [2024-04-03 03:49:02,502: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:49:02.504221881Z [2024-04-03 03:49:02,504: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:49:02.505589741Z [2024-04-03 03:49:02,505: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:49:02.505668939Z [2024-04-03 03:49:02,505: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:49:02.505751607Z [2024-04-03 03:49:02,505: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:49:02.505910909Z [2024-04-03 03:49:02,505: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:49:02.505975531Z [2024-04-03 03:49:02,505: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:49:02.506191332Z [2024-04-03 03:49:02,506: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:49:02.506343672Z [2024-04-03 03:49:02,506: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:49:02.508864048Z [2024-04-03 03:49:02,508: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:49:02.510871447Z [2024-04-03 03:49:02,510: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:49:02.572904284Z [2024-04-03 03:49:02,572: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:49:02.582970369Z [2024-04-03 03:49:02,582: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:49:04.184699149Z [2024-04-03 03:49:04,184: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[487b000c-ffb7-4d73-89ac-ddedefbfdd2e] succeeded in 3.2851679289997264s: None 2024-04-03T03:49:04.478259562Z [2024-04-03 03:49:04,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44648bc1-b931-45af-8188-baf8169f92ee] succeeded in 3.6010452520004037s: None 2024-04-03T03:49:41.355807598Z [2024-04-03 03:49:41,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[883cef27-7186-4660-9436-ce37e196c755] received 2024-04-03T03:49:41.371298950Z [2024-04-03 03:49:41,370: INFO/ForkPoolWorker-15] [883cef27-7186-4660-9436-ce37e196c755] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240403034940_527211', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-03T03:49:41.784984511Z [2024-04-03 03:49:41,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-03T03:49:42.107767233Z [2024-04-03 03:49:42,107: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:49:42.670170634Z [2024-04-03 03:49:42,669: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[883cef27-7186-4660-9436-ce37e196c755] succeeded in 1.311610271999598s: None 2024-04-03T03:50:00.678927771Z [2024-04-03 03:50:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2d174d7-d438-4a54-afd0-03f3d6daf6de] received 2024-04-03T03:50:00.680567972Z [2024-04-03 03:50:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91762c1e-477d-42e0-bf2f-081f77ca22a5] received 2024-04-03T03:50:00.690940057Z [2024-04-03 03:50:00,690: INFO/ForkPoolWorker-15] [f2d174d7-d438-4a54-afd0-03f3d6daf6de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:50:00.700631647Z [2024-04-03 03:50:00,700: INFO/ForkPoolWorker-16] [91762c1e-477d-42e0-bf2f-081f77ca22a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:50:00.734564758Z [2024-04-03 03:50:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d70e2e5c-5bec-49bb-ba37-ec34008b12d8] received 2024-04-03T03:50:00.737726400Z [2024-04-03 03:50:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11e327fe-a963-4849-989d-96c61036c73c] received 2024-04-03T03:50:00.783812924Z [2024-04-03 03:50:00,778: INFO/ForkPoolWorker-2] [11e327fe-a963-4849-989d-96c61036c73c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:50:00.790511554Z [2024-04-03 03:50:00,786: INFO/ForkPoolWorker-1] [d70e2e5c-5bec-49bb-ba37-ec34008b12d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:50:01.134189941Z [2024-04-03 03:50:01,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:50:01.141016725Z [2024-04-03 03:50:01,135: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:50:01.407460782Z [2024-04-03 03:50:01,384: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:50:01.623496060Z [2024-04-03 03:50:01,613: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:50:01.732231561Z [2024-04-03 03:50:01,731: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:50:02.316062529Z [2024-04-03 03:50:02,315: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[91762c1e-477d-42e0-bf2f-081f77ca22a5] succeeded in 1.6337342390015692s: None 2024-04-03T03:50:02.610504827Z [2024-04-03 03:50:02,610: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:50:02.614189144Z [2024-04-03 03:50:02,613: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:50:02.640067541Z [2024-04-03 03:50:02,639: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:50:02.641952114Z [2024-04-03 03:50:02,641: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:50:02.643582862Z [2024-04-03 03:50:02,643: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:50:02.643738428Z [2024-04-03 03:50:02,643: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:50:02.644020770Z [2024-04-03 03:50:02,643: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:50:02.644192389Z [2024-04-03 03:50:02,644: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:50:02.644574064Z [2024-04-03 03:50:02,644: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:50:02.644774518Z [2024-04-03 03:50:02,644: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:50:02.650808039Z [2024-04-03 03:50:02,650: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:50:02.728619624Z [2024-04-03 03:50:02,728: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:50:02.979024122Z [2024-04-03 03:50:02,978: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:50:02.982326921Z [2024-04-03 03:50:02,981: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:50:03.035675307Z [2024-04-03 03:50:03,035: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T03:50:03.039361124Z [2024-04-03 03:50:03,038: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:50:03.096413404Z [2024-04-03 03:50:03,096: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:50:03.097668115Z [2024-04-03 03:50:03,097: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:50:03.097739731Z [2024-04-03 03:50:03,097: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:50:03.097860918Z [2024-04-03 03:50:03,097: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:50:03.098109550Z [2024-04-03 03:50:03,097: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:50:03.098252475Z [2024-04-03 03:50:03,098: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:50:03.098538160Z [2024-04-03 03:50:03,098: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:50:03.098619278Z [2024-04-03 03:50:03,098: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:50:03.103834261Z [2024-04-03 03:50:03,103: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:50:03.110189235Z [2024-04-03 03:50:03,109: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T03:50:03.119265966Z [2024-04-03 03:50:03,118: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:50:03.119600528Z [2024-04-03 03:50:03,119: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:50:03.119717896Z [2024-04-03 03:50:03,119: INFO/ForkPoolWorker-2] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:50:03.119901428Z [2024-04-03 03:50:03,119: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:50:03.119985872Z [2024-04-03 03:50:03,119: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T03:50:03.120908864Z [2024-04-03 03:50:03,120: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:50:03.121075976Z [2024-04-03 03:50:03,120: INFO/ForkPoolWorker-2] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:50:03.135052948Z [2024-04-03 03:50:03,134: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:50:03.249230274Z [2024-04-03 03:50:03,248: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:50:03.273439457Z [2024-04-03 03:50:03,267: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:50:03.400478560Z [2024-04-03 03:50:03,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22bedd48-9ae5-4e00-a4fe-816743eeb2f1] received 2024-04-03T03:50:03.408245989Z [2024-04-03 03:50:03,407: INFO/ForkPoolWorker-16] [22bedd48-9ae5-4e00-a4fe-816743eeb2f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:50:03.556403099Z [2024-04-03 03:50:03,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2d174d7-d438-4a54-afd0-03f3d6daf6de] succeeded in 2.873049497999091s: None 2024-04-03T03:50:03.944677098Z [2024-04-03 03:50:03,939: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:50:05.105560541Z [2024-04-03 03:50:05,105: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[11e327fe-a963-4849-989d-96c61036c73c] succeeded in 4.352483415999814s: None 2024-04-03T03:50:05.241206591Z [2024-04-03 03:50:05,240: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:50:05.246334249Z [2024-04-03 03:50:05,245: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:50:05.277677943Z [2024-04-03 03:50:05,277: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:50:05.279276466Z [2024-04-03 03:50:05,279: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:50:05.279348919Z [2024-04-03 03:50:05,279: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:50:05.279358061Z [2024-04-03 03:50:05,279: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:50:05.279504428Z [2024-04-03 03:50:05,279: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:50:05.279520686Z [2024-04-03 03:50:05,279: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:50:05.279763940Z [2024-04-03 03:50:05,279: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:50:05.279770727Z [2024-04-03 03:50:05,279: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:50:05.285454671Z [2024-04-03 03:50:05,285: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:50:05.359741675Z [2024-04-03 03:50:05,359: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:50:05.414399250Z [2024-04-03 03:50:05,413: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d70e2e5c-5bec-49bb-ba37-ec34008b12d8] succeeded in 4.675548384999274s: None 2024-04-03T03:50:05.930568299Z [2024-04-03 03:50:05,930: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22bedd48-9ae5-4e00-a4fe-816743eeb2f1] succeeded in 2.5279368410010647s: None 2024-04-03T03:50:06.747232379Z [2024-04-03 03:50:06,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8b079ec-476a-49c3-866a-4ed693854637] received 2024-04-03T03:50:06.754472856Z [2024-04-03 03:50:06,754: INFO/ForkPoolWorker-15] [f8b079ec-476a-49c3-866a-4ed693854637] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:50:07.060866541Z [2024-04-03 03:50:07,057: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:50:08.238451084Z [2024-04-03 03:50:08,238: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:50:08.244179973Z [2024-04-03 03:50:08,243: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:50:08.270843143Z [2024-04-03 03:50:08,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:50:08.271307230Z [2024-04-03 03:50:08,271: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:50:08.271405942Z [2024-04-03 03:50:08,271: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:50:08.271488905Z [2024-04-03 03:50:08,271: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:50:08.271654991Z [2024-04-03 03:50:08,271: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:50:08.271745586Z [2024-04-03 03:50:08,271: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:50:08.272023448Z [2024-04-03 03:50:08,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:50:08.272104503Z [2024-04-03 03:50:08,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:50:08.279258501Z [2024-04-03 03:50:08,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:50:08.352990432Z [2024-04-03 03:50:08,352: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:50:09.650868224Z [2024-04-03 03:50:09,650: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8b079ec-476a-49c3-866a-4ed693854637] succeeded in 2.901166755000304s: None 2024-04-03T03:50:09.662587447Z [2024-04-03 03:50:09,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08caabdd-86ce-4937-bef9-d19e17e10954] received 2024-04-03T03:50:09.671099315Z [2024-04-03 03:50:09,670: INFO/ForkPoolWorker-15] [08caabdd-86ce-4937-bef9-d19e17e10954] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:50:09.986232983Z [2024-04-03 03:50:09,981: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:50:11.265033959Z [2024-04-03 03:50:11,264: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:50:11.268361844Z [2024-04-03 03:50:11,267: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:50:11.296644355Z [2024-04-03 03:50:11,296: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:50:11.301834711Z [2024-04-03 03:50:11,301: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:50:11.301940554Z [2024-04-03 03:50:11,301: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:50:11.301950476Z [2024-04-03 03:50:11,301: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:50:11.302132668Z [2024-04-03 03:50:11,301: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:50:11.302159503Z [2024-04-03 03:50:11,302: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:50:11.302763897Z [2024-04-03 03:50:11,302: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:50:11.302919659Z [2024-04-03 03:50:11,302: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:50:11.308966364Z [2024-04-03 03:50:11,308: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:50:11.385233565Z [2024-04-03 03:50:11,384: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:50:11.923843925Z [2024-04-03 03:50:11,923: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08caabdd-86ce-4937-bef9-d19e17e10954] succeeded in 2.259585206000338s: None 2024-04-03T03:51:00.466429392Z [2024-04-03 03:51:00,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bd73480-83d9-47cf-867f-4b4cf50f5c8f] received 2024-04-03T03:51:00.470381910Z [2024-04-03 03:51:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5166f0ec-561c-4e6b-96a9-ce0dc8271dea] received 2024-04-03T03:51:00.489644443Z [2024-04-03 03:51:00,489: INFO/ForkPoolWorker-16] [5166f0ec-561c-4e6b-96a9-ce0dc8271dea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:51:00.495167310Z [2024-04-03 03:51:00,494: INFO/ForkPoolWorker-15] [1bd73480-83d9-47cf-867f-4b4cf50f5c8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:51:00.963450941Z [2024-04-03 03:51:00,959: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:51:00.976727508Z [2024-04-03 03:51:00,972: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:51:02.183809338Z [2024-04-03 03:51:02,183: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:51:02.187220996Z [2024-04-03 03:51:02,186: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:51:02.192181365Z [2024-04-03 03:51:02,191: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:51:02.195481666Z [2024-04-03 03:51:02,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:51:02.211415634Z [2024-04-03 03:51:02,211: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:51:02.213208512Z [2024-04-03 03:51:02,212: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:51:02.213230559Z [2024-04-03 03:51:02,213: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:51:02.213324999Z [2024-04-03 03:51:02,213: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:51:02.213508576Z [2024-04-03 03:51:02,213: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:51:02.213566736Z [2024-04-03 03:51:02,213: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:51:02.213841253Z [2024-04-03 03:51:02,213: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:51:02.213855646Z [2024-04-03 03:51:02,213: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:51:02.222665371Z [2024-04-03 03:51:02,222: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:51:02.239697862Z [2024-04-03 03:51:02,239: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:51:02.240965772Z [2024-04-03 03:51:02,240: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:51:02.241154779Z [2024-04-03 03:51:02,241: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:51:02.242050821Z [2024-04-03 03:51:02,241: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:51:02.242121779Z [2024-04-03 03:51:02,241: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:51:02.242244646Z [2024-04-03 03:51:02,242: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:51:02.242487726Z [2024-04-03 03:51:02,242: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:51:02.242670834Z [2024-04-03 03:51:02,242: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:51:02.246932268Z [2024-04-03 03:51:02,246: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:51:02.300446823Z [2024-04-03 03:51:02,300: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:51:02.319048779Z [2024-04-03 03:51:02,318: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:51:03.870849859Z [2024-04-03 03:51:03,870: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5166f0ec-561c-4e6b-96a9-ce0dc8271dea] succeeded in 3.3976891610000166s: None 2024-04-03T03:51:04.188922272Z [2024-04-03 03:51:04,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bd73480-83d9-47cf-867f-4b4cf50f5c8f] succeeded in 3.714588893999462s: None 2024-04-03T03:52:01.206765787Z [2024-04-03 03:52:01,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d425351-7a1b-4137-bc4c-e525aa03506e] received 2024-04-03T03:52:01.212610605Z [2024-04-03 03:52:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fa7b093-3b29-4bdd-be8c-eba4de027a57] received 2024-04-03T03:52:01.225441717Z [2024-04-03 03:52:01,225: INFO/ForkPoolWorker-15] [1d425351-7a1b-4137-bc4c-e525aa03506e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:52:01.230120564Z [2024-04-03 03:52:01,229: INFO/ForkPoolWorker-16] [0fa7b093-3b29-4bdd-be8c-eba4de027a57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:52:01.240652885Z [2024-04-03 03:52:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aadd02af-1be8-4d31-892e-290a3e0df6c9] received 2024-04-03T03:52:01.267363293Z [2024-04-03 03:52:01,266: INFO/ForkPoolWorker-1] [aadd02af-1be8-4d31-892e-290a3e0df6c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:52:01.616126460Z [2024-04-03 03:52:01,612: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:52:01.704987034Z [2024-04-03 03:52:01,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:52:01.708785751Z [2024-04-03 03:52:01,704: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:52:02.024981535Z [2024-04-03 03:52:02,024: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:52:02.563201150Z [2024-04-03 03:52:02,562: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d425351-7a1b-4137-bc4c-e525aa03506e] succeeded in 1.353412948001278s: None 2024-04-03T03:52:02.949673585Z [2024-04-03 03:52:02,949: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:52:02.957795299Z [2024-04-03 03:52:02,957: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:52:02.975994970Z [2024-04-03 03:52:02,975: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:52:02.982305455Z [2024-04-03 03:52:02,981: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:52:03.019181023Z [2024-04-03 03:52:03,018: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:52:03.020544734Z [2024-04-03 03:52:03,020: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:52:03.020718477Z [2024-04-03 03:52:03,020: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:52:03.020877994Z [2024-04-03 03:52:03,020: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:52:03.021125096Z [2024-04-03 03:52:03,020: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:52:03.021282387Z [2024-04-03 03:52:03,021: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:52:03.021645277Z [2024-04-03 03:52:03,021: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:52:03.021842930Z [2024-04-03 03:52:03,021: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:52:03.026490137Z [2024-04-03 03:52:03,026: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:52:03.027276016Z [2024-04-03 03:52:03,027: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:52:03.028712376Z [2024-04-03 03:52:03,028: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:52:03.028925587Z [2024-04-03 03:52:03,028: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:52:03.029102810Z [2024-04-03 03:52:03,028: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:52:03.029313024Z [2024-04-03 03:52:03,029: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:52:03.029457053Z [2024-04-03 03:52:03,029: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:52:03.029789563Z [2024-04-03 03:52:03,029: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:52:03.030004198Z [2024-04-03 03:52:03,029: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:52:03.034425780Z [2024-04-03 03:52:03,034: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:52:03.132531343Z [2024-04-03 03:52:03,132: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:52:03.136803787Z [2024-04-03 03:52:03,136: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:52:05.037175353Z [2024-04-03 03:52:05,036: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0fa7b093-3b29-4bdd-be8c-eba4de027a57] succeeded in 3.820698736999475s: None 2024-04-03T03:52:05.393546127Z [2024-04-03 03:52:05,392: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aadd02af-1be8-4d31-892e-290a3e0df6c9] succeeded in 4.14961797900105s: None 2024-04-03T03:53:00.269605489Z [2024-04-03 03:53:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[993c0497-4304-47ca-94b7-53269cba8ea8] received 2024-04-03T03:53:00.274066272Z [2024-04-03 03:53:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c74f1858-8b3c-47f1-b329-973e0b3bf2b1] received 2024-04-03T03:53:00.289081243Z [2024-04-03 03:53:00,288: INFO/ForkPoolWorker-15] [993c0497-4304-47ca-94b7-53269cba8ea8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:53:00.294303333Z [2024-04-03 03:53:00,293: INFO/ForkPoolWorker-16] [c74f1858-8b3c-47f1-b329-973e0b3bf2b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:53:00.589701615Z [2024-04-03 03:53:00,585: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:53:00.594230084Z [2024-04-03 03:53:00,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:53:02.017480345Z [2024-04-03 03:53:02,017: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:53:02.021149544Z [2024-04-03 03:53:02,020: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:53:02.054381756Z [2024-04-03 03:53:02,054: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:53:02.055564787Z [2024-04-03 03:53:02,055: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:53:02.055605506Z [2024-04-03 03:53:02,055: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:53:02.055758621Z [2024-04-03 03:53:02,055: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:53:02.055917661Z [2024-04-03 03:53:02,055: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:53:02.055984510Z [2024-04-03 03:53:02,055: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:53:02.056321116Z [2024-04-03 03:53:02,056: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:53:02.056499382Z [2024-04-03 03:53:02,056: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:53:02.062471212Z [2024-04-03 03:53:02,061: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:53:02.112439463Z [2024-04-03 03:53:02,112: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:53:02.116160391Z [2024-04-03 03:53:02,115: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:53:02.149658836Z [2024-04-03 03:53:02,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:53:02.151436251Z [2024-04-03 03:53:02,151: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:53:02.152665778Z [2024-04-03 03:53:02,152: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:53:02.152707193Z [2024-04-03 03:53:02,152: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:53:02.152775464Z [2024-04-03 03:53:02,152: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:53:02.152973811Z [2024-04-03 03:53:02,152: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:53:02.153031679Z [2024-04-03 03:53:02,152: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:53:02.153312123Z [2024-04-03 03:53:02,153: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:53:02.153392101Z [2024-04-03 03:53:02,153: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:53:02.159248975Z [2024-04-03 03:53:02,159: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:53:02.236868518Z [2024-04-03 03:53:02,236: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:53:03.989573284Z [2024-04-03 03:53:03,989: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[993c0497-4304-47ca-94b7-53269cba8ea8] succeeded in 3.716293744999348s: None 2024-04-03T03:53:04.282925094Z [2024-04-03 03:53:04,282: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c74f1858-8b3c-47f1-b329-973e0b3bf2b1] succeeded in 4.003287509000074s: None 2024-04-03T03:54:00.544043048Z [2024-04-03 03:54:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a73244f6-8851-46ad-8b40-170439f7bf45] received 2024-04-03T03:54:00.553590797Z [2024-04-03 03:54:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17511d0f-2162-4404-9b12-fa9528cb668d] received 2024-04-03T03:54:00.557358251Z [2024-04-03 03:54:00,556: INFO/ForkPoolWorker-15] [a73244f6-8851-46ad-8b40-170439f7bf45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:54:00.570351749Z [2024-04-03 03:54:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9207395a-5175-4b19-8a1e-d2d65a989120] received 2024-04-03T03:54:00.586644608Z [2024-04-03 03:54:00,586: INFO/ForkPoolWorker-16] [17511d0f-2162-4404-9b12-fa9528cb668d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:54:00.660060834Z [2024-04-03 03:54:00,653: INFO/ForkPoolWorker-1] [9207395a-5175-4b19-8a1e-d2d65a989120] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:54:01.058364972Z [2024-04-03 03:54:01,052: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:54:01.202465636Z [2024-04-03 03:54:01,190: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:54:01.577425412Z [2024-04-03 03:54:01,577: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:54:01.610154849Z [2024-04-03 03:54:01,603: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:54:02.587968635Z [2024-04-03 03:54:02,587: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9207395a-5175-4b19-8a1e-d2d65a989120] succeeded in 2.007313909000004s: None 2024-04-03T03:54:02.879905991Z [2024-04-03 03:54:02,878: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:54:02.886776278Z [2024-04-03 03:54:02,884: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:54:02.944479630Z [2024-04-03 03:54:02,944: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:54:02.946972718Z [2024-04-03 03:54:02,946: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:54:02.947025287Z [2024-04-03 03:54:02,946: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:54:02.947074823Z [2024-04-03 03:54:02,946: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:54:02.947249703Z [2024-04-03 03:54:02,947: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:54:02.947314088Z [2024-04-03 03:54:02,947: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:54:02.947637445Z [2024-04-03 03:54:02,947: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:54:02.947674989Z [2024-04-03 03:54:02,947: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:54:02.954117267Z [2024-04-03 03:54:02,953: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:54:03.084916498Z [2024-04-03 03:54:03,074: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:54:03.443506806Z [2024-04-03 03:54:03,443: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:54:03.447275803Z [2024-04-03 03:54:03,446: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:54:03.512021254Z [2024-04-03 03:54:03,511: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:54:03.513882776Z [2024-04-03 03:54:03,513: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:54:03.514015506Z [2024-04-03 03:54:03,513: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:54:03.514248382Z [2024-04-03 03:54:03,514: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:54:03.514580720Z [2024-04-03 03:54:03,514: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:54:03.514725330Z [2024-04-03 03:54:03,514: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:54:03.515122261Z [2024-04-03 03:54:03,514: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:54:03.516087539Z [2024-04-03 03:54:03,515: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:54:03.524754094Z [2024-04-03 03:54:03,524: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:54:03.618270078Z [2024-04-03 03:54:03,617: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:54:04.807714082Z [2024-04-03 03:54:04,806: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17511d0f-2162-4404-9b12-fa9528cb668d] succeeded in 4.2471185400008835s: None 2024-04-03T03:54:06.098769836Z [2024-04-03 03:54:06,098: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a73244f6-8851-46ad-8b40-170439f7bf45] succeeded in 5.551055359001111s: None 2024-04-03T03:55:00.899092771Z [2024-04-03 03:55:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c567872-3efe-4d4c-8d96-c044c239f729] received 2024-04-03T03:55:00.907107656Z [2024-04-03 03:55:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e3751fd-57ef-4723-9653-1ef4c93838ce] received 2024-04-03T03:55:00.911935365Z [2024-04-03 03:55:00,911: INFO/ForkPoolWorker-15] [9c567872-3efe-4d4c-8d96-c044c239f729] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:55:00.912227520Z [2024-04-03 03:55:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5bf9f1d-ccb8-4a90-b97c-d437acf6f906] received 2024-04-03T03:55:00.916585939Z [2024-04-03 03:55:00,916: INFO/ForkPoolWorker-16] [8e3751fd-57ef-4723-9653-1ef4c93838ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:55:00.933158262Z [2024-04-03 03:55:00,932: INFO/ForkPoolWorker-1] [d5bf9f1d-ccb8-4a90-b97c-d437acf6f906] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:55:01.312266662Z [2024-04-03 03:55:01,307: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:55:01.660928240Z [2024-04-03 03:55:01,651: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:55:01.713611144Z [2024-04-03 03:55:01,707: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:55:03.112450321Z [2024-04-03 03:55:03,112: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:55:03.116055611Z [2024-04-03 03:55:03,115: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:55:03.164248066Z [2024-04-03 03:55:03,164: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:55:03.167917428Z [2024-04-03 03:55:03,167: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:55:03.168095349Z [2024-04-03 03:55:03,167: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:55:03.168185576Z [2024-04-03 03:55:03,168: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:55:03.168356276Z [2024-04-03 03:55:03,168: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:55:03.171077854Z [2024-04-03 03:55:03,170: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:55:03.171350293Z [2024-04-03 03:55:03,171: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:55:03.171445154Z [2024-04-03 03:55:03,171: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:55:03.183248594Z [2024-04-03 03:55:03,182: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:55:03.235016322Z [2024-04-03 03:55:03,234: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:55:03.238431690Z [2024-04-03 03:55:03,238: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:55:03.273958002Z [2024-04-03 03:55:03,272: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:55:03.279324591Z [2024-04-03 03:55:03,279: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:55:03.280798824Z [2024-04-03 03:55:03,279: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:55:03.280994713Z [2024-04-03 03:55:03,280: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:55:03.281401745Z [2024-04-03 03:55:03,281: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:55:03.281613022Z [2024-04-03 03:55:03,281: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:55:03.281998796Z [2024-04-03 03:55:03,281: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:55:03.282525637Z [2024-04-03 03:55:03,281: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:55:03.300005355Z [2024-04-03 03:55:03,299: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:55:03.339663647Z [2024-04-03 03:55:03,339: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:55:03.407689492Z [2024-04-03 03:55:03,407: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:55:03.689172452Z [2024-04-03 03:55:03,688: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:55:03.697842378Z [2024-04-03 03:55:03,697: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:55:03.761037022Z [2024-04-03 03:55:03,760: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:55:03.765283090Z [2024-04-03 03:55:03,765: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:55:03.765435683Z [2024-04-03 03:55:03,765: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:55:03.765551374Z [2024-04-03 03:55:03,765: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:55:03.765803573Z [2024-04-03 03:55:03,765: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:55:03.766005679Z [2024-04-03 03:55:03,765: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:55:03.766512224Z [2024-04-03 03:55:03,766: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:55:03.767211107Z [2024-04-03 03:55:03,767: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:55:03.775815412Z [2024-04-03 03:55:03,775: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:55:03.858703810Z [2024-04-03 03:55:03,858: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:55:04.479464251Z [2024-04-03 03:55:04,478: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c567872-3efe-4d4c-8d96-c044c239f729] succeeded in 3.577264223000384s: None 2024-04-03T03:55:05.110059397Z [2024-04-03 03:55:05,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3487414-d48d-43d5-ab3a-9049e37add8f] received 2024-04-03T03:55:05.118806479Z [2024-04-03 03:55:05,118: INFO/ForkPoolWorker-15] [a3487414-d48d-43d5-ab3a-9049e37add8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:55:05.183966936Z [2024-04-03 03:55:05,183: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e3751fd-57ef-4723-9653-1ef4c93838ce] succeeded in 4.274892036000892s: None 2024-04-03T03:55:05.444720829Z [2024-04-03 03:55:05,441: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:55:06.530423743Z [2024-04-03 03:55:06,529: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d5bf9f1d-ccb8-4a90-b97c-d437acf6f906] succeeded in 5.6156921069996315s: None 2024-04-03T03:55:06.677825762Z [2024-04-03 03:55:06,675: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:55:06.682766227Z [2024-04-03 03:55:06,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:55:06.705537837Z [2024-04-03 03:55:06,705: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:55:06.706700851Z [2024-04-03 03:55:06,706: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:55:06.706716187Z [2024-04-03 03:55:06,706: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:55:06.706805778Z [2024-04-03 03:55:06,706: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:55:06.707052612Z [2024-04-03 03:55:06,706: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:55:06.707192435Z [2024-04-03 03:55:06,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:55:06.707646114Z [2024-04-03 03:55:06,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:55:06.707737807Z [2024-04-03 03:55:06,707: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:55:06.714068057Z [2024-04-03 03:55:06,713: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:55:06.787469436Z [2024-04-03 03:55:06,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:55:07.318820957Z [2024-04-03 03:55:07,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3487414-d48d-43d5-ab3a-9049e37add8f] succeeded in 2.206005729998651s: None 2024-04-03T03:55:07.470584864Z [2024-04-03 03:55:07,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ebccefe-73dd-4395-9317-7d25c63735dc] received 2024-04-03T03:55:07.478870263Z [2024-04-03 03:55:07,478: INFO/ForkPoolWorker-15] [2ebccefe-73dd-4395-9317-7d25c63735dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T03:55:07.770854583Z [2024-04-03 03:55:07,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:55:08.886374880Z [2024-04-03 03:55:08,886: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:55:08.889837448Z [2024-04-03 03:55:08,889: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:55:08.914813832Z [2024-04-03 03:55:08,914: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:55:08.916183714Z [2024-04-03 03:55:08,915: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:55:08.916328305Z [2024-04-03 03:55:08,916: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:55:08.916504531Z [2024-04-03 03:55:08,916: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:55:08.916738626Z [2024-04-03 03:55:08,916: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:55:08.916891245Z [2024-04-03 03:55:08,916: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:55:08.917217557Z [2024-04-03 03:55:08,917: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:55:08.917410465Z [2024-04-03 03:55:08,917: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:55:08.923594909Z [2024-04-03 03:55:08,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:55:09.041559360Z [2024-04-03 03:55:09,027: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:55:10.333675222Z [2024-04-03 03:55:10,333: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ebccefe-73dd-4395-9317-7d25c63735dc] succeeded in 2.8613201990010566s: None 2024-04-03T03:55:11.247590157Z [2024-04-03 03:55:11,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6eb6d353-f386-4e9f-976f-291dadb27bf1] received 2024-04-03T03:55:11.256972216Z [2024-04-03 03:55:11,256: INFO/ForkPoolWorker-15] [6eb6d353-f386-4e9f-976f-291dadb27bf1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T03:55:11.548703796Z [2024-04-03 03:55:11,545: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T03:55:12.643051596Z [2024-04-03 03:55:12,642: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:55:12.646436411Z [2024-04-03 03:55:12,645: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:55:12.681221032Z [2024-04-03 03:55:12,681: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:55:12.682284758Z [2024-04-03 03:55:12,682: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:55:12.682325889Z [2024-04-03 03:55:12,682: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:55:12.682360099Z [2024-04-03 03:55:12,682: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:55:12.682495434Z [2024-04-03 03:55:12,682: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:55:12.682528743Z [2024-04-03 03:55:12,682: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:55:12.682741305Z [2024-04-03 03:55:12,682: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:55:12.682779537Z [2024-04-03 03:55:12,682: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:55:12.688913170Z [2024-04-03 03:55:12,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T03:55:12.782717136Z [2024-04-03 03:55:12,781: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:55:13.451483187Z [2024-04-03 03:55:13,450: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6eb6d353-f386-4e9f-976f-291dadb27bf1] succeeded in 2.1992340709985s: None 2024-04-03T03:56:01.174435002Z [2024-04-03 03:56:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61c9d13f-3ec4-44d0-9e90-fca789daeece] received 2024-04-03T03:56:01.198034604Z [2024-04-03 03:56:01,197: INFO/ForkPoolWorker-15] [61c9d13f-3ec4-44d0-9e90-fca789daeece] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:56:01.216797249Z [2024-04-03 03:56:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59ba0fb7-bf0f-4d4d-9852-f91a95cecbe2] received 2024-04-03T03:56:01.238282220Z [2024-04-03 03:56:01,237: INFO/ForkPoolWorker-16] [59ba0fb7-bf0f-4d4d-9852-f91a95cecbe2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:56:01.242415415Z [2024-04-03 03:56:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecb694b7-aa5b-4b89-acbe-97acde8ba9e0] received 2024-04-03T03:56:01.272860366Z [2024-04-03 03:56:01,272: INFO/ForkPoolWorker-1] [ecb694b7-aa5b-4b89-acbe-97acde8ba9e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:56:01.655931528Z [2024-04-03 03:56:01,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:56:01.739587106Z [2024-04-03 03:56:01,734: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:56:01.760353278Z [2024-04-03 03:56:01,755: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:56:02.086257325Z [2024-04-03 03:56:02,085: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:56:02.914281137Z [2024-04-03 03:56:02,913: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59ba0fb7-bf0f-4d4d-9852-f91a95cecbe2] succeeded in 1.6910565569996834s: None 2024-04-03T03:56:03.294382743Z [2024-04-03 03:56:03,293: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:56:03.300023629Z [2024-04-03 03:56:03,299: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:56:03.383737480Z [2024-04-03 03:56:03,383: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:56:03.384823217Z [2024-04-03 03:56:03,384: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T03:56:03.386062346Z [2024-04-03 03:56:03,385: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:56:03.387646253Z [2024-04-03 03:56:03,387: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:56:03.387765997Z [2024-04-03 03:56:03,387: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:56:03.388014127Z [2024-04-03 03:56:03,387: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:56:03.388146636Z [2024-04-03 03:56:03,387: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:56:03.388508432Z [2024-04-03 03:56:03,388: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:56:03.389103010Z [2024-04-03 03:56:03,388: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:56:03.389834756Z [2024-04-03 03:56:03,388: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:56:03.407739982Z [2024-04-03 03:56:03,407: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:56:03.439869102Z [2024-04-03 03:56:03,439: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T03:56:03.441038328Z [2024-04-03 03:56:03,440: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:56:03.441061322Z [2024-04-03 03:56:03,440: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:56:03.441152297Z [2024-04-03 03:56:03,441: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:56:03.441341690Z [2024-04-03 03:56:03,441: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:56:03.441410374Z [2024-04-03 03:56:03,441: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T03:56:03.442057066Z [2024-04-03 03:56:03,441: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:56:03.442220228Z [2024-04-03 03:56:03,442: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:56:03.455614029Z [2024-04-03 03:56:03,455: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:56:03.549319104Z [2024-04-03 03:56:03,548: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:56:03.589514092Z [2024-04-03 03:56:03,589: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:56:06.149985191Z [2024-04-03 03:56:06,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61c9d13f-3ec4-44d0-9e90-fca789daeece] succeeded in 4.969768565999402s: None 2024-04-03T03:56:06.832895375Z [2024-04-03 03:56:06,832: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ecb694b7-aa5b-4b89-acbe-97acde8ba9e0] succeeded in 5.584976458998426s: None 2024-04-03T03:56:46.836610065Z [2024-04-03 03:56:46,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[885ec638-0556-4be5-9952-bb978ddc26c9] received 2024-04-03T03:56:46.854653477Z [2024-04-03 03:56:46,854: INFO/ForkPoolWorker-15] [885ec638-0556-4be5-9952-bb978ddc26c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240403035645_088555', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-03T03:56:47.145520347Z [2024-04-03 03:56:47,141: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-03T03:56:47.403659184Z [2024-04-03 03:56:47,403: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:56:48.011810682Z [2024-04-03 03:56:48,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[885ec638-0556-4be5-9952-bb978ddc26c9] succeeded in 1.1695182639996347s: None 2024-04-03T03:57:01.101056814Z [2024-04-03 03:57:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[178d02a8-b94a-4ef7-8532-34aa65a56346] received 2024-04-03T03:57:01.102686364Z [2024-04-03 03:57:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3859d36-8e33-4b33-bd9b-1b6475e39ab6] received 2024-04-03T03:57:01.113516648Z [2024-04-03 03:57:01,113: INFO/ForkPoolWorker-16] [a3859d36-8e33-4b33-bd9b-1b6475e39ab6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:57:01.123179655Z [2024-04-03 03:57:01,122: INFO/ForkPoolWorker-15] [178d02a8-b94a-4ef7-8532-34aa65a56346] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:57:01.515367969Z [2024-04-03 03:57:01,511: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:57:01.548783257Z [2024-04-03 03:57:01,545: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:57:02.769549208Z [2024-04-03 03:57:02,769: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:57:02.778245733Z [2024-04-03 03:57:02,777: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:57:02.827832715Z [2024-04-03 03:57:02,827: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:57:02.831147171Z [2024-04-03 03:57:02,830: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:57:02.831605646Z [2024-04-03 03:57:02,831: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:57:02.831765207Z [2024-04-03 03:57:02,831: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:57:02.831971815Z [2024-04-03 03:57:02,831: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:57:02.832134244Z [2024-04-03 03:57:02,831: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:57:02.832504962Z [2024-04-03 03:57:02,832: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:57:02.832642689Z [2024-04-03 03:57:02,832: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:57:02.837196381Z [2024-04-03 03:57:02,836: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:57:02.861882899Z [2024-04-03 03:57:02,861: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:57:02.865695575Z [2024-04-03 03:57:02,865: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:57:02.895317678Z [2024-04-03 03:57:02,895: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:57:02.899198122Z [2024-04-03 03:57:02,898: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:57:02.899357850Z [2024-04-03 03:57:02,899: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:57:02.899504791Z [2024-04-03 03:57:02,899: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:57:02.899710221Z [2024-04-03 03:57:02,899: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:57:02.899804343Z [2024-04-03 03:57:02,899: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:57:02.900104450Z [2024-04-03 03:57:02,899: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:57:02.903560673Z [2024-04-03 03:57:02,903: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:57:02.908111810Z [2024-04-03 03:57:02,907: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:57:02.923296519Z [2024-04-03 03:57:02,923: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:57:02.996989396Z [2024-04-03 03:57:02,993: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:57:05.580848352Z [2024-04-03 03:57:05,580: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3859d36-8e33-4b33-bd9b-1b6475e39ab6] succeeded in 4.4753972879989306s: None 2024-04-03T03:57:06.099205137Z [2024-04-03 03:57:06,098: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[178d02a8-b94a-4ef7-8532-34aa65a56346] succeeded in 4.9922557919999235s: None 2024-04-03T03:58:00.442090567Z [2024-04-03 03:58:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29327d7c-931a-425d-a39b-cc9819375088] received 2024-04-03T03:58:00.457028341Z [2024-04-03 03:58:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bee70475-bfd3-4f2e-a065-edd4d5a47a6f] received 2024-04-03T03:58:00.459377490Z [2024-04-03 03:58:00,459: INFO/ForkPoolWorker-15] [29327d7c-931a-425d-a39b-cc9819375088] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:58:00.469174144Z [2024-04-03 03:58:00,468: INFO/ForkPoolWorker-16] [bee70475-bfd3-4f2e-a065-edd4d5a47a6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:58:00.491611589Z [2024-04-03 03:58:00,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5bd9f81-1298-4b75-b0d9-62fbb9d8e568] received 2024-04-03T03:58:00.568206685Z [2024-04-03 03:58:00,567: INFO/ForkPoolWorker-1] [e5bd9f81-1298-4b75-b0d9-62fbb9d8e568] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T03:58:00.901380347Z [2024-04-03 03:58:00,897: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:58:01.329608138Z [2024-04-03 03:58:01,326: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:58:01.428917024Z [2024-04-03 03:58:01,424: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T03:58:02.312024983Z [2024-04-03 03:58:02,311: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:58:03.789471647Z [2024-04-03 03:58:03,786: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5bd9f81-1298-4b75-b0d9-62fbb9d8e568] succeeded in 3.2874318569993193s: None 2024-04-03T03:58:03.949309503Z [2024-04-03 03:58:03,948: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:58:03.954464756Z [2024-04-03 03:58:03,954: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:58:03.985314618Z [2024-04-03 03:58:03,985: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:58:03.987721380Z [2024-04-03 03:58:03,987: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:58:03.987764451Z [2024-04-03 03:58:03,987: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:58:03.987812068Z [2024-04-03 03:58:03,987: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:58:03.987908725Z [2024-04-03 03:58:03,987: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:58:03.987928428Z [2024-04-03 03:58:03,987: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:58:03.990315351Z [2024-04-03 03:58:03,990: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:58:03.990664398Z [2024-04-03 03:58:03,990: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:58:04.013437842Z [2024-04-03 03:58:04,010: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:58:04.046262372Z [2024-04-03 03:58:04,045: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:58:04.049499523Z [2024-04-03 03:58:04,049: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:58:04.078545762Z [2024-04-03 03:58:04,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:58:04.082779431Z [2024-04-03 03:58:04,082: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:58:04.082800780Z [2024-04-03 03:58:04,082: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:58:04.082941965Z [2024-04-03 03:58:04,082: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:58:04.083088592Z [2024-04-03 03:58:04,082: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:58:04.083226509Z [2024-04-03 03:58:04,083: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:58:04.083533407Z [2024-04-03 03:58:04,083: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:58:04.083632494Z [2024-04-03 03:58:04,083: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:58:04.095225850Z [2024-04-03 03:58:04,094: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:58:04.096047869Z [2024-04-03 03:58:04,095: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:58:04.248417610Z [2024-04-03 03:58:04,248: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:58:06.956061241Z [2024-04-03 03:58:06,955: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[29327d7c-931a-425d-a39b-cc9819375088] succeeded in 6.511702454001352s: None 2024-04-03T03:58:07.097606904Z [2024-04-03 03:58:07,096: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bee70475-bfd3-4f2e-a065-edd4d5a47a6f] succeeded in 6.638381242000833s: None 2024-04-03T03:59:00.327948332Z [2024-04-03 03:59:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[090c3776-f4b6-4dc3-8180-510f9f76e0ef] received 2024-04-03T03:59:00.332851368Z [2024-04-03 03:59:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7c3da90-a8e5-4737-bea5-4850b72c96d6] received 2024-04-03T03:59:00.349399064Z [2024-04-03 03:59:00,348: INFO/ForkPoolWorker-15] [090c3776-f4b6-4dc3-8180-510f9f76e0ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T03:59:00.355934245Z [2024-04-03 03:59:00,355: INFO/ForkPoolWorker-16] [a7c3da90-a8e5-4737-bea5-4850b72c96d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T03:59:00.676736220Z [2024-04-03 03:59:00,672: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T03:59:00.830586745Z [2024-04-03 03:59:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T03:59:02.460142839Z [2024-04-03 03:59:02,459: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T03:59:02.463552433Z [2024-04-03 03:59:02,463: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:59:02.495675401Z [2024-04-03 03:59:02,495: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T03:59:02.497140603Z [2024-04-03 03:59:02,496: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:59:02.497282322Z [2024-04-03 03:59:02,497: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:59:02.497448924Z [2024-04-03 03:59:02,497: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:59:02.497607150Z [2024-04-03 03:59:02,497: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:59:02.497711291Z [2024-04-03 03:59:02,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T03:59:02.497995271Z [2024-04-03 03:59:02,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:59:02.498111945Z [2024-04-03 03:59:02,498: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:59:02.503260895Z [2024-04-03 03:59:02,502: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T03:59:02.541181680Z [2024-04-03 03:59:02,540: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T03:59:02.545620379Z [2024-04-03 03:59:02,545: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T03:59:02.579243605Z [2024-04-03 03:59:02,578: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T03:59:02.580444098Z [2024-04-03 03:59:02,580: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T03:59:02.580457947Z [2024-04-03 03:59:02,580: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T03:59:02.580521767Z [2024-04-03 03:59:02,580: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T03:59:02.580673105Z [2024-04-03 03:59:02,580: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T03:59:02.580685347Z [2024-04-03 03:59:02,580: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T03:59:02.580890315Z [2024-04-03 03:59:02,580: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:59:02.580997299Z [2024-04-03 03:59:02,580: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T03:59:02.586803001Z [2024-04-03 03:59:02,586: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T03:59:02.665343661Z [2024-04-03 03:59:02,665: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:59:02.681778654Z [2024-04-03 03:59:02,681: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T03:59:05.104245168Z [2024-04-03 03:59:05,103: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[090c3776-f4b6-4dc3-8180-510f9f76e0ef] succeeded in 4.773156234999988s: None 2024-04-03T03:59:05.909797806Z [2024-04-03 03:59:05,909: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7c3da90-a8e5-4737-bea5-4850b72c96d6] succeeded in 5.574086572998567s: None 2024-04-03T04:00:00.463907877Z [2024-04-03 04:00:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd37e228-a787-48ae-a15b-110c844ba8cf] received 2024-04-03T04:00:00.470870225Z [2024-04-03 04:00:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7db9f98-d51b-4094-a0ad-42a607f44154] received 2024-04-03T04:00:00.475164470Z [2024-04-03 04:00:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d9089d7-61eb-494e-9bdc-03ba36809057] received 2024-04-03T04:00:00.482112180Z [2024-04-03 04:00:00,481: INFO/ForkPoolWorker-15] [fd37e228-a787-48ae-a15b-110c844ba8cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:00:00.491157623Z [2024-04-03 04:00:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91ee8f67-13cd-4a63-81d4-4b24c4e4ddd8] received 2024-04-03T04:00:00.493077406Z [2024-04-03 04:00:00,492: INFO/ForkPoolWorker-1] [2d9089d7-61eb-494e-9bdc-03ba36809057] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:00:00.502983215Z [2024-04-03 04:00:00,502: INFO/ForkPoolWorker-16] [f7db9f98-d51b-4094-a0ad-42a607f44154] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:00:00.578446415Z [2024-04-03 04:00:00,577: INFO/ForkPoolWorker-2] [91ee8f67-13cd-4a63-81d4-4b24c4e4ddd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:00:00.922471081Z [2024-04-03 04:00:00,917: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:00:01.205853976Z [2024-04-03 04:00:01,201: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:00:01.341304289Z [2024-04-03 04:00:01,334: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:00:01.645296007Z [2024-04-03 04:00:01,640: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:00:02.154058787Z [2024-04-03 04:00:02,153: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:00:03.073366199Z [2024-04-03 04:00:03,072: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7db9f98-d51b-4094-a0ad-42a607f44154] succeeded in 2.593080762999307s: None 2024-04-03T04:00:03.280232784Z [2024-04-03 04:00:03,279: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:00:03.283939230Z [2024-04-03 04:00:03,283: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:00:03.289563597Z [2024-04-03 04:00:03,289: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:00:03.301165742Z [2024-04-03 04:00:03,292: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:00:03.359320584Z [2024-04-03 04:00:03,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:00:03.360813150Z [2024-04-03 04:00:03,360: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:00:03.360825711Z [2024-04-03 04:00:03,360: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:00:03.360864632Z [2024-04-03 04:00:03,360: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:00:03.361018797Z [2024-04-03 04:00:03,360: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:00:03.361073576Z [2024-04-03 04:00:03,360: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:00:03.361409012Z [2024-04-03 04:00:03,361: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:00:03.361422555Z [2024-04-03 04:00:03,361: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:00:03.368801987Z [2024-04-03 04:00:03,368: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:00:03.373840507Z [2024-04-03 04:00:03,373: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:00:03.377438794Z [2024-04-03 04:00:03,377: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:00:03.377495620Z [2024-04-03 04:00:03,377: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:00:03.377762668Z [2024-04-03 04:00:03,377: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:00:03.378150962Z [2024-04-03 04:00:03,377: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:00:03.378307155Z [2024-04-03 04:00:03,378: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:00:03.378928638Z [2024-04-03 04:00:03,378: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:00:03.379037729Z [2024-04-03 04:00:03,378: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:00:03.386343539Z [2024-04-03 04:00:03,386: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:00:03.457320868Z [2024-04-03 04:00:03,457: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:00:03.479008841Z [2024-04-03 04:00:03,478: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:00:03.591525840Z [2024-04-03 04:00:03,590: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T04:00:03.611366651Z [2024-04-03 04:00:03,600: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:00:03.723034352Z [2024-04-03 04:00:03,722: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T04:00:03.726699789Z [2024-04-03 04:00:03,726: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:00:03.728353189Z [2024-04-03 04:00:03,728: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:00:03.730428281Z [2024-04-03 04:00:03,730: INFO/ForkPoolWorker-2] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:00:03.730703902Z [2024-04-03 04:00:03,730: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:00:03.730858018Z [2024-04-03 04:00:03,730: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T04:00:03.731842392Z [2024-04-03 04:00:03,731: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:00:03.732008109Z [2024-04-03 04:00:03,731: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:00:03.746241309Z [2024-04-03 04:00:03,745: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:00:03.920723347Z [2024-04-03 04:00:03,920: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:00:04.572545076Z [2024-04-03 04:00:04,571: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd37e228-a787-48ae-a15b-110c844ba8cf] succeeded in 4.10211410500051s: None 2024-04-03T04:00:05.397544012Z [2024-04-03 04:00:05,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7d74f40-d984-4ba9-a1cd-bd3d09ea9b17] received 2024-04-03T04:00:05.414379233Z [2024-04-03 04:00:05,414: INFO/ForkPoolWorker-15] [b7d74f40-d984-4ba9-a1cd-bd3d09ea9b17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:00:05.728617622Z [2024-04-03 04:00:05,725: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:00:05.772592432Z [2024-04-03 04:00:05,771: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2d9089d7-61eb-494e-9bdc-03ba36809057] succeeded in 5.292837167000471s: None 2024-04-03T04:00:06.475883710Z [2024-04-03 04:00:06,474: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[91ee8f67-13cd-4a63-81d4-4b24c4e4ddd8] succeeded in 5.971538548999888s: None 2024-04-03T04:00:06.908531074Z [2024-04-03 04:00:06,908: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:00:06.911788391Z [2024-04-03 04:00:06,911: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:00:06.943934268Z [2024-04-03 04:00:06,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:00:06.945470181Z [2024-04-03 04:00:06,945: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:00:06.945775243Z [2024-04-03 04:00:06,945: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:00:06.945863905Z [2024-04-03 04:00:06,945: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:00:06.946054347Z [2024-04-03 04:00:06,945: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:00:06.946133149Z [2024-04-03 04:00:06,945: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:00:06.946426620Z [2024-04-03 04:00:06,946: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:00:06.946439700Z [2024-04-03 04:00:06,946: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:00:06.954767247Z [2024-04-03 04:00:06,954: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:00:07.059303014Z [2024-04-03 04:00:07,058: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:00:07.716052781Z [2024-04-03 04:00:07,715: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7d74f40-d984-4ba9-a1cd-bd3d09ea9b17] succeeded in 2.3164647199992032s: None 2024-04-03T04:00:07.813865343Z [2024-04-03 04:00:07,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3b97c65-247d-4a58-8087-6571c75b797f] received 2024-04-03T04:00:07.827207957Z [2024-04-03 04:00:07,826: INFO/ForkPoolWorker-15] [c3b97c65-247d-4a58-8087-6571c75b797f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:00:08.131583060Z [2024-04-03 04:00:08,128: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:00:09.349203824Z [2024-04-03 04:00:09,348: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:00:09.353846377Z [2024-04-03 04:00:09,353: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:00:09.394536333Z [2024-04-03 04:00:09,394: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:00:09.397010530Z [2024-04-03 04:00:09,396: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:00:09.397108035Z [2024-04-03 04:00:09,396: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:00:09.397114017Z [2024-04-03 04:00:09,396: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:00:09.397119105Z [2024-04-03 04:00:09,396: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:00:09.397135996Z [2024-04-03 04:00:09,396: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:00:09.397487994Z [2024-04-03 04:00:09,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:00:09.397689400Z [2024-04-03 04:00:09,397: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:00:09.406675996Z [2024-04-03 04:00:09,406: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:00:09.491127401Z [2024-04-03 04:00:09,490: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:00:10.279806237Z [2024-04-03 04:00:10,272: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3b97c65-247d-4a58-8087-6571c75b797f] succeeded in 2.4550468689994887s: None 2024-04-03T04:00:10.507250124Z [2024-04-03 04:00:10,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e337720-c154-45b4-97de-f52efd313102] received 2024-04-03T04:00:10.517282962Z [2024-04-03 04:00:10,517: INFO/ForkPoolWorker-15] [9e337720-c154-45b4-97de-f52efd313102] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:00:10.938918636Z [2024-04-03 04:00:10,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:00:12.271452914Z [2024-04-03 04:00:12,271: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:00:12.275078215Z [2024-04-03 04:00:12,274: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:00:12.319752485Z [2024-04-03 04:00:12,317: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:00:12.319777105Z [2024-04-03 04:00:12,319: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:00:12.319788645Z [2024-04-03 04:00:12,319: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:00:12.320541870Z [2024-04-03 04:00:12,319: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:00:12.320555430Z [2024-04-03 04:00:12,319: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:00:12.320559724Z [2024-04-03 04:00:12,320: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:00:12.322113342Z [2024-04-03 04:00:12,321: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:00:12.322127415Z [2024-04-03 04:00:12,321: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:00:12.328862278Z [2024-04-03 04:00:12,328: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:00:12.456325681Z [2024-04-03 04:00:12,455: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:00:13.185836594Z [2024-04-03 04:00:13,185: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e337720-c154-45b4-97de-f52efd313102] succeeded in 2.6765021980008896s: None 2024-04-03T04:00:46.582629489Z [2024-04-03 04:00:46,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79b1e73b-00fd-4c6e-8c19-686a5f213238] received 2024-04-03T04:00:46.592615060Z [2024-04-03 04:00:46,592: INFO/ForkPoolWorker-15] [79b1e73b-00fd-4c6e-8c19-686a5f213238] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240403040045_061091', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-03T04:00:46.909778278Z [2024-04-03 04:00:46,906: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-03T04:00:47.235659452Z [2024-04-03 04:00:47,235: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:00:47.843767587Z [2024-04-03 04:00:47,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79b1e73b-00fd-4c6e-8c19-686a5f213238] succeeded in 1.257445020999512s: None 2024-04-03T04:01:01.371423170Z [2024-04-03 04:01:01,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e7ea96d-43a2-4744-9892-a7a278c5646a] received 2024-04-03T04:01:01.376552448Z [2024-04-03 04:01:01,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da2d92d0-ba88-4b4c-a424-d3319ccc6992] received 2024-04-03T04:01:01.382047538Z [2024-04-03 04:01:01,381: INFO/ForkPoolWorker-15] [1e7ea96d-43a2-4744-9892-a7a278c5646a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:01:01.392293416Z [2024-04-03 04:01:01,391: INFO/ForkPoolWorker-16] [da2d92d0-ba88-4b4c-a424-d3319ccc6992] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:01:01.681558739Z [2024-04-03 04:01:01,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:01:01.703709637Z [2024-04-03 04:01:01,700: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:01:02.868631387Z [2024-04-03 04:01:02,866: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:01:02.873565034Z [2024-04-03 04:01:02,870: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:01:02.919635660Z [2024-04-03 04:01:02,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:01:02.923188811Z [2024-04-03 04:01:02,922: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:01:02.923217455Z [2024-04-03 04:01:02,923: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:01:02.923259162Z [2024-04-03 04:01:02,923: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:01:02.923461146Z [2024-04-03 04:01:02,923: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:01:02.923546186Z [2024-04-03 04:01:02,923: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:01:02.923904639Z [2024-04-03 04:01:02,923: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:01:02.924139882Z [2024-04-03 04:01:02,923: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:01:02.933033112Z [2024-04-03 04:01:02,932: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:01:02.961659014Z [2024-04-03 04:01:02,960: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:01:02.965732831Z [2024-04-03 04:01:02,965: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:01:03.046837931Z [2024-04-03 04:01:03,046: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:01:03.059428515Z [2024-04-03 04:01:03,058: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:01:03.061385759Z [2024-04-03 04:01:03,061: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:01:03.063572655Z [2024-04-03 04:01:03,063: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:01:03.063702969Z [2024-04-03 04:01:03,063: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:01:03.063909297Z [2024-04-03 04:01:03,063: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:01:03.063971423Z [2024-04-03 04:01:03,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:01:03.064351193Z [2024-04-03 04:01:03,064: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:01:03.064528641Z [2024-04-03 04:01:03,064: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:01:03.071962693Z [2024-04-03 04:01:03,071: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:01:03.217674035Z [2024-04-03 04:01:03,217: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:01:05.493886934Z [2024-04-03 04:01:05,493: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e7ea96d-43a2-4744-9892-a7a278c5646a] succeeded in 4.117617154000982s: None 2024-04-03T04:01:06.358116410Z [2024-04-03 04:01:06,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[da2d92d0-ba88-4b4c-a424-d3319ccc6992] succeeded in 4.975715608999963s: None 2024-04-03T04:02:00.247931481Z [2024-04-03 04:02:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[434e83f9-a32d-43eb-92ef-e9dd34517aa2] received 2024-04-03T04:02:00.266736201Z [2024-04-03 04:02:00,260: INFO/ForkPoolWorker-15] [434e83f9-a32d-43eb-92ef-e9dd34517aa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:02:00.268475171Z [2024-04-03 04:02:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bfa4759-df9c-4814-a4a1-a31a2193a627] received 2024-04-03T04:02:00.279120008Z [2024-04-03 04:02:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57269130-310e-4926-91e5-310085027e33] received 2024-04-03T04:02:00.294169263Z [2024-04-03 04:02:00,293: INFO/ForkPoolWorker-16] [8bfa4759-df9c-4814-a4a1-a31a2193a627] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:02:00.313372032Z [2024-04-03 04:02:00,312: INFO/ForkPoolWorker-1] [57269130-310e-4926-91e5-310085027e33] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:02:00.779373647Z [2024-04-03 04:02:00,772: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:02:00.800678610Z [2024-04-03 04:02:00,793: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:02:01.033216998Z [2024-04-03 04:02:01,029: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:02:01.192784407Z [2024-04-03 04:02:01,192: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:02:01.955907121Z [2024-04-03 04:02:01,955: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[57269130-310e-4926-91e5-310085027e33] succeeded in 1.6744031560010626s: None 2024-04-03T04:02:02.336105439Z [2024-04-03 04:02:02,335: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:02:02.339568780Z [2024-04-03 04:02:02,339: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:02:02.376935825Z [2024-04-03 04:02:02,376: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:02:02.378855574Z [2024-04-03 04:02:02,378: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:02:02.379100815Z [2024-04-03 04:02:02,378: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:02:02.379337954Z [2024-04-03 04:02:02,379: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:02:02.379664593Z [2024-04-03 04:02:02,379: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:02:02.379945690Z [2024-04-03 04:02:02,379: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:02:02.380915563Z [2024-04-03 04:02:02,380: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:02:02.381101533Z [2024-04-03 04:02:02,380: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:02:02.390585983Z [2024-04-03 04:02:02,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:02:02.475413107Z [2024-04-03 04:02:02,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:02:02.525790262Z [2024-04-03 04:02:02,525: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:02:02.529514056Z [2024-04-03 04:02:02,529: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:02:02.568856387Z [2024-04-03 04:02:02,568: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:02:02.570105173Z [2024-04-03 04:02:02,569: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:02:02.570303123Z [2024-04-03 04:02:02,570: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:02:02.570436428Z [2024-04-03 04:02:02,570: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:02:02.570727941Z [2024-04-03 04:02:02,570: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:02:02.570950157Z [2024-04-03 04:02:02,570: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:02:02.571282236Z [2024-04-03 04:02:02,571: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:02:02.571482193Z [2024-04-03 04:02:02,571: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:02:02.577879936Z [2024-04-03 04:02:02,577: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:02:02.689079595Z [2024-04-03 04:02:02,688: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:02:04.600534945Z [2024-04-03 04:02:04,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[434e83f9-a32d-43eb-92ef-e9dd34517aa2] succeeded in 4.349989086000278s: None 2024-04-03T04:02:04.724962184Z [2024-04-03 04:02:04,724: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8bfa4759-df9c-4814-a4a1-a31a2193a627] succeeded in 4.450458811001226s: None 2024-04-03T04:03:00.976359916Z [2024-04-03 04:03:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1752aec8-5416-48a3-b9b1-59d674efa9c5] received 2024-04-03T04:03:00.984674533Z [2024-04-03 04:03:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[baf4b547-f1a9-4180-8fa2-96f45f4dfa9b] received 2024-04-03T04:03:01.017916190Z [2024-04-03 04:03:01,017: INFO/ForkPoolWorker-16] [baf4b547-f1a9-4180-8fa2-96f45f4dfa9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:03:01.028541786Z [2024-04-03 04:03:01,027: INFO/ForkPoolWorker-15] [1752aec8-5416-48a3-b9b1-59d674efa9c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:03:01.444616400Z [2024-04-03 04:03:01,437: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:03:01.532931625Z [2024-04-03 04:03:01,527: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:03:02.820896884Z [2024-04-03 04:03:02,820: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:03:02.825553254Z [2024-04-03 04:03:02,824: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:03:02.934574830Z [2024-04-03 04:03:02,934: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:03:02.947787225Z [2024-04-03 04:03:02,947: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:03:02.947816883Z [2024-04-03 04:03:02,947: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:03:02.947827576Z [2024-04-03 04:03:02,947: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:03:02.947915373Z [2024-04-03 04:03:02,947: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:03:02.948381035Z [2024-04-03 04:03:02,947: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:03:02.948704167Z [2024-04-03 04:03:02,948: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:03:02.948737767Z [2024-04-03 04:03:02,948: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:03:02.958876259Z [2024-04-03 04:03:02,958: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:03:02.962908143Z [2024-04-03 04:03:02,962: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:03:02.966430032Z [2024-04-03 04:03:02,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:03:03.001457121Z [2024-04-03 04:03:03,001: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:03:03.002933287Z [2024-04-03 04:03:03,002: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:03:03.003087886Z [2024-04-03 04:03:03,002: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:03:03.003236882Z [2024-04-03 04:03:03,003: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:03:03.003460251Z [2024-04-03 04:03:03,003: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:03:03.003616800Z [2024-04-03 04:03:03,003: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:03:03.003981171Z [2024-04-03 04:03:03,003: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:03:03.004696732Z [2024-04-03 04:03:03,003: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:03:03.010509759Z [2024-04-03 04:03:03,010: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:03:03.103439878Z [2024-04-03 04:03:03,103: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:03:03.110798801Z [2024-04-03 04:03:03,110: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:03:05.843533116Z [2024-04-03 04:03:05,842: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1752aec8-5416-48a3-b9b1-59d674efa9c5] succeeded in 4.8626101429999835s: None 2024-04-03T04:03:06.556246984Z [2024-04-03 04:03:06,555: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[baf4b547-f1a9-4180-8fa2-96f45f4dfa9b] succeeded in 5.568125669999063s: None 2024-04-03T04:04:01.032181776Z [2024-04-03 04:04:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d92027c-56b8-42d3-9a45-1c06fece7ccb] received 2024-04-03T04:04:01.046887036Z [2024-04-03 04:04:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a2b2827-a899-4687-a858-69860db0f0ef] received 2024-04-03T04:04:01.048541399Z [2024-04-03 04:04:01,048: INFO/ForkPoolWorker-15] [9d92027c-56b8-42d3-9a45-1c06fece7ccb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:04:01.061644279Z [2024-04-03 04:04:01,061: INFO/ForkPoolWorker-16] [3a2b2827-a899-4687-a858-69860db0f0ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:04:01.068473305Z [2024-04-03 04:04:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88845337-457b-4ca0-8d1d-b7163c2a5f77] received 2024-04-03T04:04:01.094732968Z [2024-04-03 04:04:01,094: INFO/ForkPoolWorker-1] [88845337-457b-4ca0-8d1d-b7163c2a5f77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:04:01.431293123Z [2024-04-03 04:04:01,427: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:04:01.783080316Z [2024-04-03 04:04:01,779: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:04:01.857695161Z [2024-04-03 04:04:01,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:04:01.960653962Z [2024-04-03 04:04:01,957: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:04:02.558142436Z [2024-04-03 04:04:02,552: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d92027c-56b8-42d3-9a45-1c06fece7ccb] succeeded in 1.5159765849984979s: None 2024-04-03T04:04:03.318960011Z [2024-04-03 04:04:03,318: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:04:03.323334972Z [2024-04-03 04:04:03,322: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:04:03.379225683Z [2024-04-03 04:04:03,379: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:04:03.380497190Z [2024-04-03 04:04:03,380: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:04:03.380624373Z [2024-04-03 04:04:03,380: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:04:03.380701110Z [2024-04-03 04:04:03,380: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:04:03.380878994Z [2024-04-03 04:04:03,380: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:04:03.380940950Z [2024-04-03 04:04:03,380: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:04:03.381171582Z [2024-04-03 04:04:03,381: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:04:03.381237317Z [2024-04-03 04:04:03,381: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:04:03.385645962Z [2024-04-03 04:04:03,385: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:04:03.461654249Z [2024-04-03 04:04:03,461: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:04:03.521818198Z [2024-04-03 04:04:03,521: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:04:03.526518489Z [2024-04-03 04:04:03,526: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:04:03.570466688Z [2024-04-03 04:04:03,570: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:04:03.572455536Z [2024-04-03 04:04:03,572: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:04:03.572599876Z [2024-04-03 04:04:03,572: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:04:03.572719645Z [2024-04-03 04:04:03,572: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:04:03.572908804Z [2024-04-03 04:04:03,572: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:04:03.572941827Z [2024-04-03 04:04:03,572: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:04:03.573194456Z [2024-04-03 04:04:03,573: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:04:03.573292976Z [2024-04-03 04:04:03,573: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:04:03.577988883Z [2024-04-03 04:04:03,577: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:04:03.697982360Z [2024-04-03 04:04:03,697: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:04:05.021131225Z [2024-04-03 04:04:05,020: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88845337-457b-4ca0-8d1d-b7163c2a5f77] succeeded in 3.948505901000317s: None 2024-04-03T04:04:05.678955266Z [2024-04-03 04:04:05,678: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a2b2827-a899-4687-a858-69860db0f0ef] succeeded in 4.625090956000349s: None 2024-04-03T04:05:00.802666242Z [2024-04-03 04:05:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01876efe-5fea-4a77-aa1a-133b1cb7336b] received 2024-04-03T04:05:00.805958615Z [2024-04-03 04:05:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d1c7717-6c0b-49a3-ac3c-e181fcc75d91] received 2024-04-03T04:05:00.833475992Z [2024-04-03 04:05:00,832: INFO/ForkPoolWorker-16] [2d1c7717-6c0b-49a3-ac3c-e181fcc75d91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:05:00.839641628Z [2024-04-03 04:05:00,839: INFO/ForkPoolWorker-15] [01876efe-5fea-4a77-aa1a-133b1cb7336b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:05:00.854325228Z [2024-04-03 04:05:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5bc75e6-fc6c-48cf-9830-c698e4613582] received 2024-04-03T04:05:00.878102268Z [2024-04-03 04:05:00,877: INFO/ForkPoolWorker-1] [f5bc75e6-fc6c-48cf-9830-c698e4613582] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:05:01.244983923Z [2024-04-03 04:05:01,240: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:05:01.311543882Z [2024-04-03 04:05:01,307: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:05:01.345746941Z [2024-04-03 04:05:01,341: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:05:02.732785744Z [2024-04-03 04:05:02,732: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:05:02.736336987Z [2024-04-03 04:05:02,735: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:05:02.752893741Z [2024-04-03 04:05:02,752: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:05:02.758424383Z [2024-04-03 04:05:02,757: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:05:02.760007957Z [2024-04-03 04:05:02,759: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:05:02.761194383Z [2024-04-03 04:05:02,760: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:05:02.761211214Z [2024-04-03 04:05:02,761: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:05:02.761274744Z [2024-04-03 04:05:02,761: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:05:02.761389377Z [2024-04-03 04:05:02,761: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:05:02.761428050Z [2024-04-03 04:05:02,761: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:05:02.761647264Z [2024-04-03 04:05:02,761: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:05:02.761673884Z [2024-04-03 04:05:02,761: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:05:02.766094697Z [2024-04-03 04:05:02,765: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:05:02.832498049Z [2024-04-03 04:05:02,832: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:05:02.836089669Z [2024-04-03 04:05:02,835: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:05:02.836365508Z [2024-04-03 04:05:02,836: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:05:02.836528288Z [2024-04-03 04:05:02,836: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:05:02.838765362Z [2024-04-03 04:05:02,836: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:05:02.838965292Z [2024-04-03 04:05:02,838: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:05:02.839426810Z [2024-04-03 04:05:02,839: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:05:02.839898316Z [2024-04-03 04:05:02,839: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:05:02.854684912Z [2024-04-03 04:05:02,854: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:05:02.864092340Z [2024-04-03 04:05:02,863: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:05:02.931587021Z [2024-04-03 04:05:02,931: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:05:02.935126125Z [2024-04-03 04:05:02,934: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:05:02.989622928Z [2024-04-03 04:05:02,989: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:05:02.990935052Z [2024-04-03 04:05:02,990: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:05:02.991075748Z [2024-04-03 04:05:02,990: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:05:02.991169607Z [2024-04-03 04:05:02,991: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:05:02.991336415Z [2024-04-03 04:05:02,991: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:05:02.991423315Z [2024-04-03 04:05:02,991: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:05:02.991712037Z [2024-04-03 04:05:02,991: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:05:02.991882700Z [2024-04-03 04:05:02,991: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:05:03.003469584Z [2024-04-03 04:05:03,003: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:05:03.028505715Z [2024-04-03 04:05:03,028: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:05:03.179135091Z [2024-04-03 04:05:03,178: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:05:03.877871274Z [2024-04-03 04:05:03,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[01876efe-5fea-4a77-aa1a-133b1cb7336b] succeeded in 3.0645255259987607s: None 2024-04-03T04:05:04.638631183Z [2024-04-03 04:05:04,637: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d1c7717-6c0b-49a3-ac3c-e181fcc75d91] succeeded in 3.8276479769992875s: None 2024-04-03T04:05:04.706689833Z [2024-04-03 04:05:04,706: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6a25b8d-d307-4926-bdcb-9c88e29614c2] received 2024-04-03T04:05:04.719620257Z [2024-04-03 04:05:04,719: INFO/ForkPoolWorker-15] [a6a25b8d-d307-4926-bdcb-9c88e29614c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:05:05.028452267Z [2024-04-03 04:05:05,025: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:05:05.233516543Z [2024-04-03 04:05:05,232: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5bc75e6-fc6c-48cf-9830-c698e4613582] succeeded in 4.374507676999201s: None 2024-04-03T04:05:06.243846474Z [2024-04-03 04:05:06,243: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:05:06.249328929Z [2024-04-03 04:05:06,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:05:06.276263751Z [2024-04-03 04:05:06,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:05:06.277923315Z [2024-04-03 04:05:06,277: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:05:06.278024188Z [2024-04-03 04:05:06,277: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:05:06.278118901Z [2024-04-03 04:05:06,277: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:05:06.278360446Z [2024-04-03 04:05:06,278: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:05:06.278776399Z [2024-04-03 04:05:06,278: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:05:06.279145048Z [2024-04-03 04:05:06,278: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:05:06.279340964Z [2024-04-03 04:05:06,279: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:05:06.286070132Z [2024-04-03 04:05:06,285: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:05:06.365725238Z [2024-04-03 04:05:06,365: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:05:07.024682866Z [2024-04-03 04:05:07,024: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6a25b8d-d307-4926-bdcb-9c88e29614c2] succeeded in 2.315715495000404s: None 2024-04-03T04:05:07.045500923Z [2024-04-03 04:05:07,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fad6cc80-6fe5-48b5-95f3-8c8937c23593] received 2024-04-03T04:05:07.051654818Z [2024-04-03 04:05:07,051: INFO/ForkPoolWorker-15] [fad6cc80-6fe5-48b5-95f3-8c8937c23593] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:05:07.326351813Z [2024-04-03 04:05:07,323: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:05:08.440494370Z [2024-04-03 04:05:08,440: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:05:08.443809904Z [2024-04-03 04:05:08,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:05:08.476569929Z [2024-04-03 04:05:08,476: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:05:08.478935801Z [2024-04-03 04:05:08,478: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:05:08.479423660Z [2024-04-03 04:05:08,479: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:05:08.479720642Z [2024-04-03 04:05:08,479: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:05:08.479923492Z [2024-04-03 04:05:08,479: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:05:08.480102399Z [2024-04-03 04:05:08,479: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:05:08.480493472Z [2024-04-03 04:05:08,480: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:05:08.480687001Z [2024-04-03 04:05:08,480: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:05:08.488478921Z [2024-04-03 04:05:08,488: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:05:08.557132503Z [2024-04-03 04:05:08,556: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:05:09.162927281Z [2024-04-03 04:05:09,162: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fad6cc80-6fe5-48b5-95f3-8c8937c23593] succeeded in 2.1153023280003254s: None 2024-04-03T04:05:09.885761979Z [2024-04-03 04:05:09,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0277d3c-ed9a-4d67-b469-a1dd4b8642ed] received 2024-04-03T04:05:09.900071235Z [2024-04-03 04:05:09,899: INFO/ForkPoolWorker-15] [f0277d3c-ed9a-4d67-b469-a1dd4b8642ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:05:10.309183255Z [2024-04-03 04:05:10,306: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:05:11.559128747Z [2024-04-03 04:05:11,558: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:05:11.562504139Z [2024-04-03 04:05:11,562: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:05:11.590745330Z [2024-04-03 04:05:11,590: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:05:11.592205180Z [2024-04-03 04:05:11,591: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:05:11.592385446Z [2024-04-03 04:05:11,592: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:05:11.592570502Z [2024-04-03 04:05:11,592: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:05:11.592755334Z [2024-04-03 04:05:11,592: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:05:11.592947299Z [2024-04-03 04:05:11,592: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:05:11.593290569Z [2024-04-03 04:05:11,593: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:05:11.593301197Z [2024-04-03 04:05:11,593: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:05:11.599751954Z [2024-04-03 04:05:11,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:05:11.691692012Z [2024-04-03 04:05:11,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:05:12.314173951Z [2024-04-03 04:05:12,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0277d3c-ed9a-4d67-b469-a1dd4b8642ed] succeeded in 2.4225126359997375s: None 2024-04-03T04:06:00.653142418Z [2024-04-03 04:06:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f493c441-00c6-4af6-a972-3ce10082cab4] received 2024-04-03T04:06:00.660292809Z [2024-04-03 04:06:00,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14b6dda1-732e-4dff-a9e2-e1eec52e668a] received 2024-04-03T04:06:00.671337911Z [2024-04-03 04:06:00,671: INFO/ForkPoolWorker-16] [14b6dda1-732e-4dff-a9e2-e1eec52e668a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:06:00.671847004Z [2024-04-03 04:06:00,671: INFO/ForkPoolWorker-15] [f493c441-00c6-4af6-a972-3ce10082cab4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:06:00.719351855Z [2024-04-03 04:06:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a13cf676-7147-4df9-970b-c20650a396f8] received 2024-04-03T04:06:00.772768207Z [2024-04-03 04:06:00,772: INFO/ForkPoolWorker-1] [a13cf676-7147-4df9-970b-c20650a396f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:06:01.139662471Z [2024-04-03 04:06:01,136: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:06:01.141160652Z [2024-04-03 04:06:01,138: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:06:01.289167727Z [2024-04-03 04:06:01,277: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:06:01.433003828Z [2024-04-03 04:06:01,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:06:01.979329538Z [2024-04-03 04:06:01,978: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f493c441-00c6-4af6-a972-3ce10082cab4] succeeded in 1.3236827560012898s: None 2024-04-03T04:06:02.428380841Z [2024-04-03 04:06:02,427: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:06:02.432182292Z [2024-04-03 04:06:02,431: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:06:02.467715286Z [2024-04-03 04:06:02,467: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:06:02.469254709Z [2024-04-03 04:06:02,469: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:06:02.469268249Z [2024-04-03 04:06:02,469: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:06:02.469398691Z [2024-04-03 04:06:02,469: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:06:02.469568092Z [2024-04-03 04:06:02,469: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:06:02.469627363Z [2024-04-03 04:06:02,469: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:06:02.469876712Z [2024-04-03 04:06:02,469: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:06:02.469937451Z [2024-04-03 04:06:02,469: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:06:02.475182140Z [2024-04-03 04:06:02,474: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:06:02.562066304Z [2024-04-03 04:06:02,561: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:06:02.718194938Z [2024-04-03 04:06:02,717: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:06:02.721828369Z [2024-04-03 04:06:02,721: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:06:02.762787431Z [2024-04-03 04:06:02,762: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:06:02.770298115Z [2024-04-03 04:06:02,768: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:06:02.770324841Z [2024-04-03 04:06:02,768: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:06:02.770336285Z [2024-04-03 04:06:02,768: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:06:02.770345551Z [2024-04-03 04:06:02,768: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:06:02.770351398Z [2024-04-03 04:06:02,769: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:06:02.776630015Z [2024-04-03 04:06:02,769: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:06:02.777667738Z [2024-04-03 04:06:02,776: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:06:02.789350932Z [2024-04-03 04:06:02,789: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:06:02.901324581Z [2024-04-03 04:06:02,901: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:06:05.026144917Z [2024-04-03 04:06:05,025: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a13cf676-7147-4df9-970b-c20650a396f8] succeeded in 4.298166237998885s: None 2024-04-03T04:06:05.412769803Z [2024-04-03 04:06:05,412: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[14b6dda1-732e-4dff-a9e2-e1eec52e668a] succeeded in 4.750658802000544s: None 2024-04-03T04:07:00.346927461Z [2024-04-03 04:07:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bb7f9e7-6cde-4c54-8ade-aa41a6a6724c] received 2024-04-03T04:07:00.351541404Z [2024-04-03 04:07:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e74e1de4-963d-494d-8bb5-ddb1b4079790] received 2024-04-03T04:07:00.371393954Z [2024-04-03 04:07:00,368: INFO/ForkPoolWorker-15] [6bb7f9e7-6cde-4c54-8ade-aa41a6a6724c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:07:00.374431978Z [2024-04-03 04:07:00,374: INFO/ForkPoolWorker-16] [e74e1de4-963d-494d-8bb5-ddb1b4079790] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:07:00.742168526Z [2024-04-03 04:07:00,737: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:07:00.961000265Z [2024-04-03 04:07:00,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:07:02.364721129Z [2024-04-03 04:07:02,364: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:07:02.368938711Z [2024-04-03 04:07:02,368: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:07:02.402214542Z [2024-04-03 04:07:02,402: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:07:02.403328151Z [2024-04-03 04:07:02,403: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:07:02.403509793Z [2024-04-03 04:07:02,403: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:07:02.403716898Z [2024-04-03 04:07:02,403: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:07:02.403972315Z [2024-04-03 04:07:02,403: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:07:02.404132161Z [2024-04-03 04:07:02,404: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:07:02.404655177Z [2024-04-03 04:07:02,404: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:07:02.404843542Z [2024-04-03 04:07:02,404: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:07:02.411484209Z [2024-04-03 04:07:02,411: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:07:02.492680526Z [2024-04-03 04:07:02,492: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:07:02.650353009Z [2024-04-03 04:07:02,649: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:07:02.653880321Z [2024-04-03 04:07:02,653: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:07:02.692331822Z [2024-04-03 04:07:02,691: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:07:02.696413919Z [2024-04-03 04:07:02,695: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:07:02.696488903Z [2024-04-03 04:07:02,696: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:07:02.696579479Z [2024-04-03 04:07:02,696: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:07:02.696794722Z [2024-04-03 04:07:02,696: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:07:02.696902445Z [2024-04-03 04:07:02,696: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:07:02.697235673Z [2024-04-03 04:07:02,697: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:07:02.697602831Z [2024-04-03 04:07:02,697: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:07:02.709290594Z [2024-04-03 04:07:02,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:07:02.869187821Z [2024-04-03 04:07:02,868: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:07:04.566934211Z [2024-04-03 04:07:04,566: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e74e1de4-963d-494d-8bb5-ddb1b4079790] succeeded in 4.21284697900046s: None 2024-04-03T04:07:05.326386983Z [2024-04-03 04:07:05,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6bb7f9e7-6cde-4c54-8ade-aa41a6a6724c] succeeded in 4.969460132000677s: None 2024-04-03T04:08:00.555519736Z [2024-04-03 04:08:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a05d866e-5032-4c30-8370-95f50218d493] received 2024-04-03T04:08:00.570972675Z [2024-04-03 04:08:00,570: INFO/ForkPoolWorker-15] [a05d866e-5032-4c30-8370-95f50218d493] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:08:00.578620826Z [2024-04-03 04:08:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[748622ba-0685-4fa1-a482-ee118efea5c9] received 2024-04-03T04:08:00.588493524Z [2024-04-03 04:08:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f64b8c24-07ec-43ce-a73d-acaaa5897bfe] received 2024-04-03T04:08:00.590263074Z [2024-04-03 04:08:00,589: INFO/ForkPoolWorker-16] [748622ba-0685-4fa1-a482-ee118efea5c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:08:00.623265511Z [2024-04-03 04:08:00,622: INFO/ForkPoolWorker-1] [f64b8c24-07ec-43ce-a73d-acaaa5897bfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:08:01.052893066Z [2024-04-03 04:08:01,048: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:08:01.076322476Z [2024-04-03 04:08:01,071: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:08:01.215819787Z [2024-04-03 04:08:01,211: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:08:01.342375513Z [2024-04-03 04:08:01,342: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:08:01.997878194Z [2024-04-03 04:08:01,997: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a05d866e-5032-4c30-8370-95f50218d493] succeeded in 1.4381540519989358s: None 2024-04-03T04:08:02.596187037Z [2024-04-03 04:08:02,595: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:08:02.599571164Z [2024-04-03 04:08:02,599: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:08:02.635311061Z [2024-04-03 04:08:02,635: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:08:02.636385784Z [2024-04-03 04:08:02,636: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:08:02.636422551Z [2024-04-03 04:08:02,636: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:08:02.636599573Z [2024-04-03 04:08:02,636: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:08:02.636770966Z [2024-04-03 04:08:02,636: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:08:02.636833519Z [2024-04-03 04:08:02,636: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:08:02.637090630Z [2024-04-03 04:08:02,636: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:08:02.637148842Z [2024-04-03 04:08:02,637: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:08:02.642370841Z [2024-04-03 04:08:02,642: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:08:02.717239693Z [2024-04-03 04:08:02,716: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:08:02.799216079Z [2024-04-03 04:08:02,792: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:08:02.799511540Z [2024-04-03 04:08:02,795: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:08:02.864679879Z [2024-04-03 04:08:02,864: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:08:02.866062666Z [2024-04-03 04:08:02,865: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:08:02.866858220Z [2024-04-03 04:08:02,866: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:08:02.867217383Z [2024-04-03 04:08:02,867: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:08:02.867391871Z [2024-04-03 04:08:02,867: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:08:02.867480660Z [2024-04-03 04:08:02,867: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:08:02.867939058Z [2024-04-03 04:08:02,867: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:08:02.868050133Z [2024-04-03 04:08:02,867: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:08:02.872905441Z [2024-04-03 04:08:02,872: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:08:02.944749258Z [2024-04-03 04:08:02,944: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:08:04.617001746Z [2024-04-03 04:08:04,616: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f64b8c24-07ec-43ce-a73d-acaaa5897bfe] succeeded in 4.020027226999446s: None 2024-04-03T04:08:06.086773207Z [2024-04-03 04:08:06,086: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[748622ba-0685-4fa1-a482-ee118efea5c9] succeeded in 5.505587280000327s: None 2024-04-03T04:09:00.527099242Z [2024-04-03 04:09:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e80bf076-8ba0-40de-990b-1953ed90e2d9] received 2024-04-03T04:09:00.530370233Z [2024-04-03 04:09:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24b5d55b-74e5-4d29-8f0d-03f6d5354049] received 2024-04-03T04:09:00.545505357Z [2024-04-03 04:09:00,545: INFO/ForkPoolWorker-15] [e80bf076-8ba0-40de-990b-1953ed90e2d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:09:00.550995879Z [2024-04-03 04:09:00,550: INFO/ForkPoolWorker-16] [24b5d55b-74e5-4d29-8f0d-03f6d5354049] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:09:00.959599113Z [2024-04-03 04:09:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:09:01.088119644Z [2024-04-03 04:09:01,084: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:09:02.292283465Z [2024-04-03 04:09:02,291: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:09:02.298113518Z [2024-04-03 04:09:02,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:09:02.341745341Z [2024-04-03 04:09:02,341: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:09:02.347381835Z [2024-04-03 04:09:02,346: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:09:02.355739089Z [2024-04-03 04:09:02,355: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:09:02.358004191Z [2024-04-03 04:09:02,357: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:09:02.358296102Z [2024-04-03 04:09:02,358: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:09:02.358649062Z [2024-04-03 04:09:02,358: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:09:02.359083707Z [2024-04-03 04:09:02,358: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:09:02.359366274Z [2024-04-03 04:09:02,359: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:09:02.359774064Z [2024-04-03 04:09:02,359: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:09:02.359956651Z [2024-04-03 04:09:02,359: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:09:02.365956542Z [2024-04-03 04:09:02,365: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:09:02.386363855Z [2024-04-03 04:09:02,386: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:09:02.389598525Z [2024-04-03 04:09:02,389: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:09:02.389835772Z [2024-04-03 04:09:02,389: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:09:02.390006716Z [2024-04-03 04:09:02,389: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:09:02.390297868Z [2024-04-03 04:09:02,390: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:09:02.390454589Z [2024-04-03 04:09:02,390: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:09:02.390866016Z [2024-04-03 04:09:02,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:09:02.391126077Z [2024-04-03 04:09:02,390: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:09:02.396689393Z [2024-04-03 04:09:02,396: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:09:02.453222284Z [2024-04-03 04:09:02,452: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:09:02.484283418Z [2024-04-03 04:09:02,483: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:09:04.038030519Z [2024-04-03 04:09:04,037: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e80bf076-8ba0-40de-990b-1953ed90e2d9] succeeded in 3.505771965999884s: None 2024-04-03T04:09:04.458252101Z [2024-04-03 04:09:04,457: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24b5d55b-74e5-4d29-8f0d-03f6d5354049] succeeded in 3.9214761499988526s: None 2024-04-03T04:10:00.434654743Z [2024-04-03 04:10:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdf7951f-4017-4a2e-8048-8edef9cc7726] received 2024-04-03T04:10:00.438445643Z [2024-04-03 04:10:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cac31d5-2961-4425-9430-dc51060206b5] received 2024-04-03T04:10:00.440587217Z [2024-04-03 04:10:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cca39fe-0e84-47db-8273-5e0a469a41a9] received 2024-04-03T04:10:00.441832939Z [2024-04-03 04:10:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31032bb3-2485-4536-a969-968a2f6a51f9] received 2024-04-03T04:10:00.472378623Z [2024-04-03 04:10:00,471: INFO/ForkPoolWorker-15] [fdf7951f-4017-4a2e-8048-8edef9cc7726] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:10:00.475291991Z [2024-04-03 04:10:00,474: INFO/ForkPoolWorker-2] [31032bb3-2485-4536-a969-968a2f6a51f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:10:00.479514873Z [2024-04-03 04:10:00,479: INFO/ForkPoolWorker-16] [8cac31d5-2961-4425-9430-dc51060206b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:10:00.481421964Z [2024-04-03 04:10:00,480: INFO/ForkPoolWorker-1] [1cca39fe-0e84-47db-8273-5e0a469a41a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:10:01.023673798Z [2024-04-03 04:10:01,019: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:10:01.066823305Z [2024-04-03 04:10:01,062: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:10:01.097378865Z [2024-04-03 04:10:01,080: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:10:01.102139963Z [2024-04-03 04:10:01,098: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:10:01.587951038Z [2024-04-03 04:10:01,587: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:10:02.223983653Z [2024-04-03 04:10:02,223: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1cca39fe-0e84-47db-8273-5e0a469a41a9] succeeded in 1.778681924999546s: None 2024-04-03T04:10:02.677197022Z [2024-04-03 04:10:02,676: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:10:02.681023828Z [2024-04-03 04:10:02,680: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:10:02.712819590Z [2024-04-03 04:10:02,712: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:10:02.714038614Z [2024-04-03 04:10:02,713: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:10:02.714163438Z [2024-04-03 04:10:02,713: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:10:02.714280953Z [2024-04-03 04:10:02,714: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:10:02.714480713Z [2024-04-03 04:10:02,714: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:10:02.714619185Z [2024-04-03 04:10:02,714: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:10:02.714926354Z [2024-04-03 04:10:02,714: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:10:02.715352098Z [2024-04-03 04:10:02,714: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:10:02.721965199Z [2024-04-03 04:10:02,721: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:10:02.832474405Z [2024-04-03 04:10:02,831: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:10:02.895106284Z [2024-04-03 04:10:02,894: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T04:10:02.898626231Z [2024-04-03 04:10:02,898: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:10:02.970533394Z [2024-04-03 04:10:02,970: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T04:10:02.972053937Z [2024-04-03 04:10:02,971: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:10:02.972075533Z [2024-04-03 04:10:02,971: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:10:02.972352988Z [2024-04-03 04:10:02,972: INFO/ForkPoolWorker-2] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:10:02.972630191Z [2024-04-03 04:10:02,972: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:10:02.972690932Z [2024-04-03 04:10:02,972: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T04:10:02.972948686Z [2024-04-03 04:10:02,972: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:10:02.972992999Z [2024-04-03 04:10:02,972: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:10:02.978049746Z [2024-04-03 04:10:02,977: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:10:02.996770329Z [2024-04-03 04:10:02,993: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:10:03.006407672Z [2024-04-03 04:10:03,005: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:10:03.083139123Z [2024-04-03 04:10:03,082: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:10:03.084591095Z [2024-04-03 04:10:03,084: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:10:03.084608302Z [2024-04-03 04:10:03,084: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:10:03.088293047Z [2024-04-03 04:10:03,084: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:10:03.089027969Z [2024-04-03 04:10:03,088: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:10:03.089151893Z [2024-04-03 04:10:03,088: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:10:03.089525763Z [2024-04-03 04:10:03,089: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:10:03.089572561Z [2024-04-03 04:10:03,089: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:10:03.096888702Z [2024-04-03 04:10:03,096: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:10:03.099090057Z [2024-04-03 04:10:03,098: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:10:03.201806943Z [2024-04-03 04:10:03,201: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:10:03.791313575Z [2024-04-03 04:10:03,789: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8cac31d5-2961-4425-9430-dc51060206b5] succeeded in 3.341169268998783s: None 2024-04-03T04:10:04.420818255Z [2024-04-03 04:10:04,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca62e0b5-f196-4d3c-a0f1-5b31e8faa956] received 2024-04-03T04:10:04.428518172Z [2024-04-03 04:10:04,428: INFO/ForkPoolWorker-16] [ca62e0b5-f196-4d3c-a0f1-5b31e8faa956] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:10:04.713626290Z [2024-04-03 04:10:04,710: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:10:04.942405283Z [2024-04-03 04:10:04,941: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdf7951f-4017-4a2e-8048-8edef9cc7726] succeeded in 4.499287104999894s: None 2024-04-03T04:10:05.416476848Z [2024-04-03 04:10:05,416: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[31032bb3-2485-4536-a969-968a2f6a51f9] succeeded in 4.971510519999356s: None 2024-04-03T04:10:05.878575710Z [2024-04-03 04:10:05,878: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:10:05.882232747Z [2024-04-03 04:10:05,881: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:10:05.906369933Z [2024-04-03 04:10:05,906: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:10:05.907547215Z [2024-04-03 04:10:05,907: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:10:05.907667672Z [2024-04-03 04:10:05,907: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:10:05.907749614Z [2024-04-03 04:10:05,907: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:10:05.907910454Z [2024-04-03 04:10:05,907: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:10:05.907960144Z [2024-04-03 04:10:05,907: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:10:05.908206301Z [2024-04-03 04:10:05,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:10:05.908328513Z [2024-04-03 04:10:05,908: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:10:05.914010065Z [2024-04-03 04:10:05,913: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:10:05.974420957Z [2024-04-03 04:10:05,974: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:10:06.554093131Z [2024-04-03 04:10:06,553: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca62e0b5-f196-4d3c-a0f1-5b31e8faa956] succeeded in 2.131347092999931s: None 2024-04-03T04:10:07.557607824Z [2024-04-03 04:10:07,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f61d4528-8fc8-4ec8-afd6-1772cecefe8a] received 2024-04-03T04:10:07.569183077Z [2024-04-03 04:10:07,568: INFO/ForkPoolWorker-15] [f61d4528-8fc8-4ec8-afd6-1772cecefe8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:10:07.874972774Z [2024-04-03 04:10:07,872: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:10:08.963763286Z [2024-04-03 04:10:08,963: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:10:08.966996751Z [2024-04-03 04:10:08,966: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:10:09.016092389Z [2024-04-03 04:10:09,015: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:10:09.020126468Z [2024-04-03 04:10:09,019: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:10:09.020190293Z [2024-04-03 04:10:09,020: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:10:09.020308329Z [2024-04-03 04:10:09,020: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:10:09.020562051Z [2024-04-03 04:10:09,020: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:10:09.020888105Z [2024-04-03 04:10:09,020: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:10:09.021335968Z [2024-04-03 04:10:09,021: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:10:09.021486199Z [2024-04-03 04:10:09,021: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:10:09.032231106Z [2024-04-03 04:10:09,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:10:09.111549962Z [2024-04-03 04:10:09,111: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:10:09.651224292Z [2024-04-03 04:10:09,650: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f61d4528-8fc8-4ec8-afd6-1772cecefe8a] succeeded in 2.0909793170012563s: None 2024-04-03T04:10:10.633205916Z [2024-04-03 04:10:10,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e04bf935-e943-40b4-a85e-ecc7f884d454] received 2024-04-03T04:10:10.651808857Z [2024-04-03 04:10:10,651: INFO/ForkPoolWorker-15] [e04bf935-e943-40b4-a85e-ecc7f884d454] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:10:11.006823486Z [2024-04-03 04:10:11,002: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:10:12.208043404Z [2024-04-03 04:10:12,207: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:10:12.211591049Z [2024-04-03 04:10:12,211: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:10:12.263357084Z [2024-04-03 04:10:12,263: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:10:12.267721962Z [2024-04-03 04:10:12,267: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:10:12.267778712Z [2024-04-03 04:10:12,267: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:10:12.267890264Z [2024-04-03 04:10:12,267: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:10:12.268099550Z [2024-04-03 04:10:12,267: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:10:12.268164003Z [2024-04-03 04:10:12,268: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:10:12.268460496Z [2024-04-03 04:10:12,268: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:10:12.268472807Z [2024-04-03 04:10:12,268: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:10:12.277919731Z [2024-04-03 04:10:12,277: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:10:12.357695959Z [2024-04-03 04:10:12,357: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:10:12.936941624Z [2024-04-03 04:10:12,936: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e04bf935-e943-40b4-a85e-ecc7f884d454] succeeded in 2.3024176150011044s: None 2024-04-03T04:11:00.304610295Z [2024-04-03 04:11:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4162d65d-b6ba-417f-97f1-134aee321b5e] received 2024-04-03T04:11:00.313399729Z [2024-04-03 04:11:00,312: INFO/ForkPoolWorker-15] [4162d65d-b6ba-417f-97f1-134aee321b5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:11:00.313621121Z [2024-04-03 04:11:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2100dabe-be9a-4774-8654-83cf93efb7e9] received 2024-04-03T04:11:00.326335845Z [2024-04-03 04:11:00,326: INFO/ForkPoolWorker-16] [2100dabe-be9a-4774-8654-83cf93efb7e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:11:00.682559359Z [2024-04-03 04:11:00,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:11:00.719357824Z [2024-04-03 04:11:00,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:11:01.971836856Z [2024-04-03 04:11:01,971: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:11:01.975817979Z [2024-04-03 04:11:01,975: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:11:02.012616753Z [2024-04-03 04:11:02,012: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:11:02.015897300Z [2024-04-03 04:11:02,014: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:11:02.016125687Z [2024-04-03 04:11:02,015: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:11:02.016332820Z [2024-04-03 04:11:02,016: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:11:02.016582746Z [2024-04-03 04:11:02,016: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:11:02.016739975Z [2024-04-03 04:11:02,016: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:11:02.017556579Z [2024-04-03 04:11:02,017: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:11:02.017739954Z [2024-04-03 04:11:02,017: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:11:02.023361912Z [2024-04-03 04:11:02,023: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:11:02.076995145Z [2024-04-03 04:11:02,076: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:11:02.080498597Z [2024-04-03 04:11:02,079: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:11:02.114058069Z [2024-04-03 04:11:02,113: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:11:02.120860005Z [2024-04-03 04:11:02,120: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:11:02.122155265Z [2024-04-03 04:11:02,121: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:11:02.122174600Z [2024-04-03 04:11:02,122: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:11:02.122288415Z [2024-04-03 04:11:02,122: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:11:02.122451310Z [2024-04-03 04:11:02,122: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:11:02.122834453Z [2024-04-03 04:11:02,122: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:11:02.123081367Z [2024-04-03 04:11:02,122: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:11:02.123246596Z [2024-04-03 04:11:02,123: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:11:02.134336668Z [2024-04-03 04:11:02,133: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:11:02.222455311Z [2024-04-03 04:11:02,222: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:11:04.091335350Z [2024-04-03 04:11:04,090: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2100dabe-be9a-4774-8654-83cf93efb7e9] succeeded in 3.7708064140006172s: None 2024-04-03T04:11:04.253150756Z [2024-04-03 04:11:04,252: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4162d65d-b6ba-417f-97f1-134aee321b5e] succeeded in 3.946080849000282s: None 2024-04-03T04:12:01.221844935Z [2024-04-03 04:12:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b3e5ef5-8ae9-4912-87a6-2c79a97104a1] received 2024-04-03T04:12:01.227406445Z [2024-04-03 04:12:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6650f0f7-725c-4b37-af89-db421c693906] received 2024-04-03T04:12:01.237127762Z [2024-04-03 04:12:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59734422-a134-4aa6-ab96-4485368d3e63] received 2024-04-03T04:12:01.247848620Z [2024-04-03 04:12:01,247: INFO/ForkPoolWorker-15] [8b3e5ef5-8ae9-4912-87a6-2c79a97104a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:12:01.264092549Z [2024-04-03 04:12:01,263: INFO/ForkPoolWorker-1] [59734422-a134-4aa6-ab96-4485368d3e63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:12:01.265427447Z [2024-04-03 04:12:01,264: INFO/ForkPoolWorker-16] [6650f0f7-725c-4b37-af89-db421c693906] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:12:01.652613331Z [2024-04-03 04:12:01,648: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:12:01.784552288Z [2024-04-03 04:12:01,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:12:01.819027662Z [2024-04-03 04:12:01,814: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:12:02.072560010Z [2024-04-03 04:12:02,071: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:12:02.627829341Z [2024-04-03 04:12:02,627: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b3e5ef5-8ae9-4912-87a6-2c79a97104a1] succeeded in 1.4019503320014337s: None 2024-04-03T04:12:03.236794448Z [2024-04-03 04:12:03,236: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:12:03.240581320Z [2024-04-03 04:12:03,240: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:12:03.323880346Z [2024-04-03 04:12:03,323: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:12:03.325078260Z [2024-04-03 04:12:03,324: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:12:03.325096232Z [2024-04-03 04:12:03,325: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:12:03.331193845Z [2024-04-03 04:12:03,330: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:12:03.331422729Z [2024-04-03 04:12:03,331: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:12:03.331434129Z [2024-04-03 04:12:03,331: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:12:03.331804453Z [2024-04-03 04:12:03,331: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:12:03.331813419Z [2024-04-03 04:12:03,331: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:12:03.357190153Z [2024-04-03 04:12:03,356: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:12:03.426944084Z [2024-04-03 04:12:03,426: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:12:03.430758277Z [2024-04-03 04:12:03,430: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:12:03.519084691Z [2024-04-03 04:12:03,518: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:12:03.520781237Z [2024-04-03 04:12:03,520: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:12:03.520822172Z [2024-04-03 04:12:03,520: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:12:03.520934888Z [2024-04-03 04:12:03,520: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:12:03.521121344Z [2024-04-03 04:12:03,520: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:12:03.521183420Z [2024-04-03 04:12:03,521: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:12:03.521476880Z [2024-04-03 04:12:03,521: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:12:03.521601654Z [2024-04-03 04:12:03,521: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:12:03.526704490Z [2024-04-03 04:12:03,526: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:12:03.527873379Z [2024-04-03 04:12:03,527: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:12:03.649710341Z [2024-04-03 04:12:03,649: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:12:05.558796568Z [2024-04-03 04:12:05,551: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59734422-a134-4aa6-ab96-4485368d3e63] succeeded in 4.3102565680001135s: None 2024-04-03T04:12:06.073571590Z [2024-04-03 04:12:06,073: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6650f0f7-725c-4b37-af89-db421c693906] succeeded in 4.8426248249998025s: None 2024-04-03T04:13:00.901477422Z [2024-04-03 04:13:00,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf5b52ad-9297-459e-84b6-438bfc4a563d] received 2024-04-03T04:13:00.921114752Z [2024-04-03 04:13:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba3d2172-eb2a-47de-a912-e8d0550b37d6] received 2024-04-03T04:13:00.937449012Z [2024-04-03 04:13:00,936: INFO/ForkPoolWorker-16] [ba3d2172-eb2a-47de-a912-e8d0550b37d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:13:00.938806231Z [2024-04-03 04:13:00,938: INFO/ForkPoolWorker-15] [bf5b52ad-9297-459e-84b6-438bfc4a563d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:13:01.377493807Z [2024-04-03 04:13:01,372: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:13:01.461639578Z [2024-04-03 04:13:01,448: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:13:03.228416162Z [2024-04-03 04:13:03,228: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:13:03.232105848Z [2024-04-03 04:13:03,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:13:03.304651768Z [2024-04-03 04:13:03,304: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:13:03.311811353Z [2024-04-03 04:13:03,311: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:13:03.311963421Z [2024-04-03 04:13:03,311: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:13:03.312067220Z [2024-04-03 04:13:03,311: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:13:03.312282715Z [2024-04-03 04:13:03,312: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:13:03.312395080Z [2024-04-03 04:13:03,312: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:13:03.312766180Z [2024-04-03 04:13:03,312: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:13:03.312880033Z [2024-04-03 04:13:03,312: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:13:03.319997177Z [2024-04-03 04:13:03,319: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:13:03.529962895Z [2024-04-03 04:13:03,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:13:03.602276775Z [2024-04-03 04:13:03,601: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:13:03.608251641Z [2024-04-03 04:13:03,607: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:13:03.691506335Z [2024-04-03 04:13:03,691: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:13:03.693718685Z [2024-04-03 04:13:03,693: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:13:03.694049153Z [2024-04-03 04:13:03,693: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:13:03.694425548Z [2024-04-03 04:13:03,693: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:13:03.694860961Z [2024-04-03 04:13:03,694: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:13:03.695062290Z [2024-04-03 04:13:03,694: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:13:03.695578898Z [2024-04-03 04:13:03,695: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:13:03.695874975Z [2024-04-03 04:13:03,695: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:13:03.704042739Z [2024-04-03 04:13:03,703: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:13:03.799421261Z [2024-04-03 04:13:03,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:13:05.746028350Z [2024-04-03 04:13:05,745: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf5b52ad-9297-459e-84b6-438bfc4a563d] succeeded in 4.836509341999772s: None 2024-04-03T04:13:06.252395109Z [2024-04-03 04:13:06,251: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ba3d2172-eb2a-47de-a912-e8d0550b37d6] succeeded in 5.327697000999251s: None 2024-04-03T04:14:00.427596195Z [2024-04-03 04:14:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d33c9fb-44fa-4844-b163-6a8dad26ad3b] received 2024-04-03T04:14:00.430750370Z [2024-04-03 04:14:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab77dbfe-7732-4d56-a530-24e32cfa06db] received 2024-04-03T04:14:00.441226660Z [2024-04-03 04:14:00,440: INFO/ForkPoolWorker-16] [ab77dbfe-7732-4d56-a530-24e32cfa06db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:14:00.446433396Z [2024-04-03 04:14:00,446: INFO/ForkPoolWorker-15] [5d33c9fb-44fa-4844-b163-6a8dad26ad3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:14:00.454969749Z [2024-04-03 04:14:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54ad3d2d-f84d-4d54-b873-2e8543299b18] received 2024-04-03T04:14:00.480776098Z [2024-04-03 04:14:00,480: INFO/ForkPoolWorker-1] [54ad3d2d-f84d-4d54-b873-2e8543299b18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:14:00.849604442Z [2024-04-03 04:14:00,838: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:14:01.044806367Z [2024-04-03 04:14:01,040: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:14:01.068456810Z [2024-04-03 04:14:01,061: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:14:01.427117316Z [2024-04-03 04:14:01,426: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:14:02.101602289Z [2024-04-03 04:14:02,101: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ab77dbfe-7732-4d56-a530-24e32cfa06db] succeeded in 1.6685521569997945s: None 2024-04-03T04:14:02.383589433Z [2024-04-03 04:14:02,383: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:14:02.386905996Z [2024-04-03 04:14:02,386: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:14:02.411412785Z [2024-04-03 04:14:02,411: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:14:02.415534897Z [2024-04-03 04:14:02,415: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:14:02.415610356Z [2024-04-03 04:14:02,415: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:14:02.415618176Z [2024-04-03 04:14:02,415: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:14:02.415737077Z [2024-04-03 04:14:02,415: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:14:02.415746261Z [2024-04-03 04:14:02,415: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:14:02.415992074Z [2024-04-03 04:14:02,415: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:14:02.416017091Z [2024-04-03 04:14:02,415: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:14:02.420781528Z [2024-04-03 04:14:02,420: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:14:02.492218532Z [2024-04-03 04:14:02,491: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:14:02.730022845Z [2024-04-03 04:14:02,729: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:14:02.733499788Z [2024-04-03 04:14:02,733: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:14:02.782583949Z [2024-04-03 04:14:02,782: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:14:02.787149592Z [2024-04-03 04:14:02,786: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:14:02.787181058Z [2024-04-03 04:14:02,787: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:14:02.787187257Z [2024-04-03 04:14:02,787: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:14:02.787340258Z [2024-04-03 04:14:02,787: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:14:02.787366511Z [2024-04-03 04:14:02,787: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:14:02.787599077Z [2024-04-03 04:14:02,787: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:14:02.787610667Z [2024-04-03 04:14:02,787: INFO/ForkPoolWorker-1] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:14:02.794038801Z [2024-04-03 04:14:02,793: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:14:02.933902197Z [2024-04-03 04:14:02,933: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:14:04.787198034Z [2024-04-03 04:14:04,786: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d33c9fb-44fa-4844-b163-6a8dad26ad3b] succeeded in 4.35489626999879s: None 2024-04-03T04:14:05.053066611Z [2024-04-03 04:14:05,052: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[54ad3d2d-f84d-4d54-b873-2e8543299b18] succeeded in 4.588810250999813s: None 2024-04-03T04:15:00.336325956Z [2024-04-03 04:15:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e69505d7-d5f7-44cd-9fcb-9f3ec8fe6b4d] received 2024-04-03T04:15:00.339372084Z [2024-04-03 04:15:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9cd8d67-8f51-403a-8fb1-8bd614317829] received 2024-04-03T04:15:00.354598134Z [2024-04-03 04:15:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a4ec916-8e39-4f4e-aa8d-b26171bd4c95] received 2024-04-03T04:15:00.356418205Z [2024-04-03 04:15:00,356: INFO/ForkPoolWorker-16] [b9cd8d67-8f51-403a-8fb1-8bd614317829] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:15:00.366947115Z [2024-04-03 04:15:00,366: INFO/ForkPoolWorker-15] [e69505d7-d5f7-44cd-9fcb-9f3ec8fe6b4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:15:00.367142122Z [2024-04-03 04:15:00,366: INFO/ForkPoolWorker-1] [4a4ec916-8e39-4f4e-aa8d-b26171bd4c95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:15:00.766299310Z [2024-04-03 04:15:00,761: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:15:00.953094839Z [2024-04-03 04:15:00,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:15:01.086386905Z [2024-04-03 04:15:01,082: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:15:02.365759213Z [2024-04-03 04:15:02,365: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:15:02.369794066Z [2024-04-03 04:15:02,369: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:15:02.427977710Z [2024-04-03 04:15:02,427: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:15:02.429393404Z [2024-04-03 04:15:02,429: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:15:02.429631220Z [2024-04-03 04:15:02,429: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:15:02.429831870Z [2024-04-03 04:15:02,429: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:15:02.430130225Z [2024-04-03 04:15:02,429: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:15:02.430322897Z [2024-04-03 04:15:02,430: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:15:02.430777794Z [2024-04-03 04:15:02,430: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:15:02.431085613Z [2024-04-03 04:15:02,430: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:15:02.438050166Z [2024-04-03 04:15:02,437: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:15:02.508377526Z [2024-04-03 04:15:02,507: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:15:02.510872435Z [2024-04-03 04:15:02,510: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:15:02.512020018Z [2024-04-03 04:15:02,511: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:15:02.577760649Z [2024-04-03 04:15:02,577: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:15:02.580341365Z [2024-04-03 04:15:02,580: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:15:02.580407121Z [2024-04-03 04:15:02,580: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:15:02.580500531Z [2024-04-03 04:15:02,580: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:15:02.581156576Z [2024-04-03 04:15:02,580: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:15:02.581241346Z [2024-04-03 04:15:02,581: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:15:02.581596842Z [2024-04-03 04:15:02,581: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:15:02.581640121Z [2024-04-03 04:15:02,581: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:15:02.590062099Z [2024-04-03 04:15:02,589: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:15:02.702194244Z [2024-04-03 04:15:02,701: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:15:03.405780183Z [2024-04-03 04:15:03,405: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a4ec916-8e39-4f4e-aa8d-b26171bd4c95] succeeded in 3.04732630000035s: None 2024-04-03T04:15:03.438585309Z [2024-04-03 04:15:03,438: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:15:03.443175576Z [2024-04-03 04:15:03,442: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:15:03.510075391Z [2024-04-03 04:15:03,509: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:15:03.514910037Z [2024-04-03 04:15:03,514: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:15:03.514938461Z [2024-04-03 04:15:03,514: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:15:03.514962377Z [2024-04-03 04:15:03,514: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:15:03.515066378Z [2024-04-03 04:15:03,514: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:15:03.515076530Z [2024-04-03 04:15:03,515: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:15:03.515459552Z [2024-04-03 04:15:03,515: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:15:03.515491227Z [2024-04-03 04:15:03,515: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:15:03.520958070Z [2024-04-03 04:15:03,520: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:15:03.607215801Z [2024-04-03 04:15:03,606: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:15:04.379600418Z [2024-04-03 04:15:04,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c3ff60b-9388-4a5e-b785-00910b2265d5] received 2024-04-03T04:15:04.400220719Z [2024-04-03 04:15:04,399: INFO/ForkPoolWorker-1] [1c3ff60b-9388-4a5e-b785-00910b2265d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:15:04.731635678Z [2024-04-03 04:15:04,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e69505d7-d5f7-44cd-9fcb-9f3ec8fe6b4d] succeeded in 4.389852927000902s: None 2024-04-03T04:15:04.845834667Z [2024-04-03 04:15:04,842: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:15:05.970242460Z [2024-04-03 04:15:05,969: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b9cd8d67-8f51-403a-8fb1-8bd614317829] succeeded in 5.624694111998906s: None 2024-04-03T04:15:06.066188971Z [2024-04-03 04:15:06,065: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:15:06.069623496Z [2024-04-03 04:15:06,069: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:15:06.105382507Z [2024-04-03 04:15:06,105: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:15:06.106828824Z [2024-04-03 04:15:06,106: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:15:06.106846521Z [2024-04-03 04:15:06,106: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:15:06.107036883Z [2024-04-03 04:15:06,106: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:15:06.107270843Z [2024-04-03 04:15:06,106: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:15:06.107485564Z [2024-04-03 04:15:06,107: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:15:06.108475717Z [2024-04-03 04:15:06,108: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:15:06.108534208Z [2024-04-03 04:15:06,108: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:15:06.115126286Z [2024-04-03 04:15:06,114: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:15:06.188143804Z [2024-04-03 04:15:06,187: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:15:06.885876629Z [2024-04-03 04:15:06,885: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c3ff60b-9388-4a5e-b785-00910b2265d5] succeeded in 2.5009504779991403s: None 2024-04-03T04:15:06.938076965Z [2024-04-03 04:15:06,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee315a7b-95e4-49a0-8a8a-f56c46645b62] received 2024-04-03T04:15:06.950554970Z [2024-04-03 04:15:06,950: INFO/ForkPoolWorker-15] [ee315a7b-95e4-49a0-8a8a-f56c46645b62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:15:07.242570558Z [2024-04-03 04:15:07,239: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:15:08.589935619Z [2024-04-03 04:15:08,589: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:15:08.598733486Z [2024-04-03 04:15:08,594: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:15:08.677859832Z [2024-04-03 04:15:08,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:15:08.679452742Z [2024-04-03 04:15:08,678: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:15:08.679473318Z [2024-04-03 04:15:08,679: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:15:08.679476554Z [2024-04-03 04:15:08,679: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:15:08.679479893Z [2024-04-03 04:15:08,679: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:15:08.679483196Z [2024-04-03 04:15:08,679: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:15:08.680937287Z [2024-04-03 04:15:08,679: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:15:08.680950736Z [2024-04-03 04:15:08,679: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:15:08.691233489Z [2024-04-03 04:15:08,690: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:15:08.784466324Z [2024-04-03 04:15:08,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:15:10.318488318Z [2024-04-03 04:15:10,317: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee315a7b-95e4-49a0-8a8a-f56c46645b62] succeeded in 3.376612426000065s: None 2024-04-03T04:15:10.473016541Z [2024-04-03 04:15:10,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c480e12-1136-4548-bee4-c4c56b7c6440] received 2024-04-03T04:15:10.485488591Z [2024-04-03 04:15:10,485: INFO/ForkPoolWorker-15] [9c480e12-1136-4548-bee4-c4c56b7c6440] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:15:10.818578445Z [2024-04-03 04:15:10,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:15:12.477957369Z [2024-04-03 04:15:12,477: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:15:12.481625191Z [2024-04-03 04:15:12,481: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:15:12.553505079Z [2024-04-03 04:15:12,553: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:15:12.554849107Z [2024-04-03 04:15:12,554: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:15:12.554905790Z [2024-04-03 04:15:12,554: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:15:12.555021769Z [2024-04-03 04:15:12,554: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:15:12.555254487Z [2024-04-03 04:15:12,554: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:15:12.555423606Z [2024-04-03 04:15:12,555: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:15:12.555763532Z [2024-04-03 04:15:12,555: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:15:12.555893138Z [2024-04-03 04:15:12,555: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:15:12.564030956Z [2024-04-03 04:15:12,563: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:15:12.652422272Z [2024-04-03 04:15:12,652: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:15:13.546977524Z [2024-04-03 04:15:13,546: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c480e12-1136-4548-bee4-c4c56b7c6440] succeeded in 3.0715221279988327s: None 2024-04-03T04:16:00.321291626Z [2024-04-03 04:16:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2debcc95-f835-46c5-8109-200dff426359] received 2024-04-03T04:16:00.326498116Z [2024-04-03 04:16:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ef51c9b-c62a-43e4-8f6c-66d4e82b2ecc] received 2024-04-03T04:16:00.328021013Z [2024-04-03 04:16:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21c3e336-eddc-4f3c-9ccb-14af5bb8137e] received 2024-04-03T04:16:00.337376048Z [2024-04-03 04:16:00,337: INFO/ForkPoolWorker-15] [2debcc95-f835-46c5-8109-200dff426359] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:16:00.342656116Z [2024-04-03 04:16:00,342: INFO/ForkPoolWorker-16] [5ef51c9b-c62a-43e4-8f6c-66d4e82b2ecc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:16:00.354759667Z [2024-04-03 04:16:00,354: INFO/ForkPoolWorker-1] [21c3e336-eddc-4f3c-9ccb-14af5bb8137e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:16:00.742442176Z [2024-04-03 04:16:00,738: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:16:00.862109098Z [2024-04-03 04:16:00,856: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:16:01.041756619Z [2024-04-03 04:16:01,041: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:16:01.068403302Z [2024-04-03 04:16:01,061: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:16:01.768600950Z [2024-04-03 04:16:01,768: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[21c3e336-eddc-4f3c-9ccb-14af5bb8137e] succeeded in 1.424887471999682s: None 2024-04-03T04:16:02.326862979Z [2024-04-03 04:16:02,326: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:16:02.330417384Z [2024-04-03 04:16:02,330: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:16:02.372655339Z [2024-04-03 04:16:02,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:16:02.373863053Z [2024-04-03 04:16:02,373: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:16:02.373995152Z [2024-04-03 04:16:02,373: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:16:02.374110722Z [2024-04-03 04:16:02,373: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:16:02.374396581Z [2024-04-03 04:16:02,374: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:16:02.374556094Z [2024-04-03 04:16:02,374: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:16:02.375051156Z [2024-04-03 04:16:02,374: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:16:02.375716257Z [2024-04-03 04:16:02,375: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:16:02.383469224Z [2024-04-03 04:16:02,383: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:16:02.460811078Z [2024-04-03 04:16:02,460: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:16:02.547893152Z [2024-04-03 04:16:02,547: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:16:02.551495989Z [2024-04-03 04:16:02,551: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:16:02.584801303Z [2024-04-03 04:16:02,584: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:16:02.586017058Z [2024-04-03 04:16:02,585: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:16:02.586046583Z [2024-04-03 04:16:02,585: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:16:02.586104511Z [2024-04-03 04:16:02,586: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:16:02.586233535Z [2024-04-03 04:16:02,586: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:16:02.586258928Z [2024-04-03 04:16:02,586: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:16:02.586523636Z [2024-04-03 04:16:02,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:16:02.586566855Z [2024-04-03 04:16:02,586: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:16:02.591444913Z [2024-04-03 04:16:02,591: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:16:02.669990518Z [2024-04-03 04:16:02,669: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:16:04.247365952Z [2024-04-03 04:16:04,246: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ef51c9b-c62a-43e4-8f6c-66d4e82b2ecc] succeeded in 3.9179008120008803s: None 2024-04-03T04:16:05.477552955Z [2024-04-03 04:16:05,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2debcc95-f835-46c5-8109-200dff426359] succeeded in 5.153157994000139s: None 2024-04-03T04:17:01.091876027Z [2024-04-03 04:17:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[080e9385-6e82-4bb9-a207-37104fb8d46d] received 2024-04-03T04:17:01.097585352Z [2024-04-03 04:17:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcda4824-7d55-4304-9ab3-1cae2fcb6a02] received 2024-04-03T04:17:01.110090146Z [2024-04-03 04:17:01,109: INFO/ForkPoolWorker-16] [fcda4824-7d55-4304-9ab3-1cae2fcb6a02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:17:01.119636449Z [2024-04-03 04:17:01,119: INFO/ForkPoolWorker-15] [080e9385-6e82-4bb9-a207-37104fb8d46d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:17:01.717511884Z [2024-04-03 04:17:01,713: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:17:01.727931550Z [2024-04-03 04:17:01,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:17:02.938726346Z [2024-04-03 04:17:02,938: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:17:02.942674439Z [2024-04-03 04:17:02,942: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:17:03.010462281Z [2024-04-03 04:17:03,010: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:17:03.011771140Z [2024-04-03 04:17:03,011: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:17:03.011825390Z [2024-04-03 04:17:03,011: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:17:03.012086442Z [2024-04-03 04:17:03,011: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:17:03.012096736Z [2024-04-03 04:17:03,011: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:17:03.012140165Z [2024-04-03 04:17:03,012: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:17:03.012459427Z [2024-04-03 04:17:03,012: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:17:03.012623189Z [2024-04-03 04:17:03,012: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:17:03.022989245Z [2024-04-03 04:17:03,022: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:17:03.076626187Z [2024-04-03 04:17:03,076: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:17:03.080344230Z [2024-04-03 04:17:03,079: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:17:03.117805778Z [2024-04-03 04:17:03,117: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:17:03.120640004Z [2024-04-03 04:17:03,120: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:17:03.123436899Z [2024-04-03 04:17:03,123: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:17:03.123630334Z [2024-04-03 04:17:03,123: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:17:03.123793871Z [2024-04-03 04:17:03,123: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:17:03.124048465Z [2024-04-03 04:17:03,123: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:17:03.124199937Z [2024-04-03 04:17:03,124: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:17:03.125638444Z [2024-04-03 04:17:03,124: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:17:03.125863238Z [2024-04-03 04:17:03,125: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:17:03.134745833Z [2024-04-03 04:17:03,134: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:17:03.235707151Z [2024-04-03 04:17:03,235: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:17:05.184391964Z [2024-04-03 04:17:05,183: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[080e9385-6e82-4bb9-a207-37104fb8d46d] succeeded in 4.082402960999389s: None 2024-04-03T04:17:05.969492536Z [2024-04-03 04:17:05,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fcda4824-7d55-4304-9ab3-1cae2fcb6a02] succeeded in 4.869605665999188s: None 2024-04-03T04:18:00.644052116Z [2024-04-03 04:18:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c0ef96a-e2e7-427d-b474-902fdbeb7cff] received 2024-04-03T04:18:00.662942673Z [2024-04-03 04:18:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3086670c-658a-44f2-97c0-7d1ac57d237e] received 2024-04-03T04:18:00.665444711Z [2024-04-03 04:18:00,664: INFO/ForkPoolWorker-15] [5c0ef96a-e2e7-427d-b474-902fdbeb7cff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:18:00.684283165Z [2024-04-03 04:18:00,683: INFO/ForkPoolWorker-16] [3086670c-658a-44f2-97c0-7d1ac57d237e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:18:00.694148333Z [2024-04-03 04:18:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcf8021d-f3a0-4772-a10a-e35d193d0547] received 2024-04-03T04:18:00.710622201Z [2024-04-03 04:18:00,710: INFO/ForkPoolWorker-1] [bcf8021d-f3a0-4772-a10a-e35d193d0547] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:18:01.169941067Z [2024-04-03 04:18:01,165: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:18:01.184829103Z [2024-04-03 04:18:01,180: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:18:01.425615692Z [2024-04-03 04:18:01,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:18:01.996991490Z [2024-04-03 04:18:01,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:18:02.571394697Z [2024-04-03 04:18:02,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c0ef96a-e2e7-427d-b474-902fdbeb7cff] succeeded in 1.9221064470002602s: None 2024-04-03T04:18:02.664630524Z [2024-04-03 04:18:02,664: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:18:02.668087334Z [2024-04-03 04:18:02,667: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:18:02.692748729Z [2024-04-03 04:18:02,692: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:18:02.693848981Z [2024-04-03 04:18:02,693: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:18:02.693864429Z [2024-04-03 04:18:02,693: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:18:02.693909572Z [2024-04-03 04:18:02,693: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:18:02.694032240Z [2024-04-03 04:18:02,693: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:18:02.694062784Z [2024-04-03 04:18:02,694: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:18:02.694264169Z [2024-04-03 04:18:02,694: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:18:02.694297259Z [2024-04-03 04:18:02,694: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:18:02.698834292Z [2024-04-03 04:18:02,698: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:18:02.717700011Z [2024-04-03 04:18:02,717: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:18:02.722627771Z [2024-04-03 04:18:02,722: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:18:02.778528421Z [2024-04-03 04:18:02,776: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:18:02.778548298Z [2024-04-03 04:18:02,778: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:18:02.781449433Z [2024-04-03 04:18:02,781: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:18:02.781493442Z [2024-04-03 04:18:02,781: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:18:02.781758491Z [2024-04-03 04:18:02,781: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:18:02.782149140Z [2024-04-03 04:18:02,781: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:18:02.782211327Z [2024-04-03 04:18:02,782: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:18:02.784672870Z [2024-04-03 04:18:02,782: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:18:02.790667368Z [2024-04-03 04:18:02,784: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:18:02.790685457Z [2024-04-03 04:18:02,790: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:18:02.899335408Z [2024-04-03 04:18:02,899: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:18:04.681220488Z [2024-04-03 04:18:04,680: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3086670c-658a-44f2-97c0-7d1ac57d237e] succeeded in 4.007018311000138s: None 2024-04-03T04:18:05.183628623Z [2024-04-03 04:18:05,183: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bcf8021d-f3a0-4772-a10a-e35d193d0547] succeeded in 4.486703271000806s: None 2024-04-03T04:19:00.997654516Z [2024-04-03 04:19:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20744b28-2d28-455d-a2af-f3721aa83e59] received 2024-04-03T04:19:01.020258241Z [2024-04-03 04:19:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2cb3874-ea8e-4266-9553-7a8534c014a4] received 2024-04-03T04:19:01.024959380Z [2024-04-03 04:19:01,024: INFO/ForkPoolWorker-15] [20744b28-2d28-455d-a2af-f3721aa83e59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:19:01.039699560Z [2024-04-03 04:19:01,039: INFO/ForkPoolWorker-16] [f2cb3874-ea8e-4266-9553-7a8534c014a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:19:01.363480727Z [2024-04-03 04:19:01,358: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:19:01.580615048Z [2024-04-03 04:19:01,575: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:19:02.781126746Z [2024-04-03 04:19:02,776: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:19:02.781153727Z [2024-04-03 04:19:02,779: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:19:02.868057296Z [2024-04-03 04:19:02,867: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:19:02.870932115Z [2024-04-03 04:19:02,870: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:19:02.872327633Z [2024-04-03 04:19:02,872: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:19:02.872549472Z [2024-04-03 04:19:02,872: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:19:02.872805796Z [2024-04-03 04:19:02,872: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:19:02.873027913Z [2024-04-03 04:19:02,872: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:19:02.873311579Z [2024-04-03 04:19:02,873: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:19:02.874573767Z [2024-04-03 04:19:02,874: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:19:02.874771132Z [2024-04-03 04:19:02,874: INFO/ForkPoolWorker-15] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:19:02.882832643Z [2024-04-03 04:19:02,881: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:19:02.884924241Z [2024-04-03 04:19:02,884: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:19:02.931616403Z [2024-04-03 04:19:02,931: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:19:02.933780153Z [2024-04-03 04:19:02,933: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:19:02.934439755Z [2024-04-03 04:19:02,934: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:19:02.934959082Z [2024-04-03 04:19:02,934: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:19:02.935442620Z [2024-04-03 04:19:02,935: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:19:02.935896176Z [2024-04-03 04:19:02,935: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:19:02.938275909Z [2024-04-03 04:19:02,938: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:19:02.938952496Z [2024-04-03 04:19:02,938: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:19:02.947602263Z [2024-04-03 04:19:02,947: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:19:02.997004363Z [2024-04-03 04:19:02,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:19:03.065886018Z [2024-04-03 04:19:03,065: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:19:04.886506458Z [2024-04-03 04:19:04,885: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20744b28-2d28-455d-a2af-f3721aa83e59] succeeded in 3.879942462001054s: None 2024-04-03T04:19:05.263617688Z [2024-04-03 04:19:05,262: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2cb3874-ea8e-4266-9553-7a8534c014a4] succeeded in 4.235113930000807s: None 2024-04-03T04:20:00.335684122Z [2024-04-03 04:20:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ea4a4d4-5661-4b3a-b521-253a26c71a90] received 2024-04-03T04:20:00.339180630Z [2024-04-03 04:20:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d9d47ad-58d6-46a4-91a5-a60c562c075a] received 2024-04-03T04:20:00.345278178Z [2024-04-03 04:20:00,344: INFO/ForkPoolWorker-15] [9ea4a4d4-5661-4b3a-b521-253a26c71a90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:20:00.363131024Z [2024-04-03 04:20:00,362: INFO/ForkPoolWorker-16] [5d9d47ad-58d6-46a4-91a5-a60c562c075a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:20:00.371320037Z [2024-04-03 04:20:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ed18305-6eba-449c-80c6-e58649c78bfb] received 2024-04-03T04:20:00.373280690Z [2024-04-03 04:20:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f9f4ae4-5199-4321-9d39-e384344a891d] received 2024-04-03T04:20:00.388554451Z [2024-04-03 04:20:00,388: INFO/ForkPoolWorker-1] [3ed18305-6eba-449c-80c6-e58649c78bfb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:20:00.409158293Z [2024-04-03 04:20:00,408: INFO/ForkPoolWorker-2] [4f9f4ae4-5199-4321-9d39-e384344a891d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:20:00.918065050Z [2024-04-03 04:20:00,908: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:20:00.943019122Z [2024-04-03 04:20:00,938: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:20:01.057213016Z [2024-04-03 04:20:01,053: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:20:01.237815407Z [2024-04-03 04:20:01,237: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:20:01.326802055Z [2024-04-03 04:20:01,314: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:20:02.271065556Z [2024-04-03 04:20:02,270: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3ed18305-6eba-449c-80c6-e58649c78bfb] succeeded in 1.8969378349993349s: None 2024-04-03T04:20:02.658149196Z [2024-04-03 04:20:02,657: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:20:02.662130771Z [2024-04-03 04:20:02,661: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:20:02.743131940Z [2024-04-03 04:20:02,742: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:20:02.744558902Z [2024-04-03 04:20:02,744: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:20:02.744634892Z [2024-04-03 04:20:02,744: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:20:02.744724282Z [2024-04-03 04:20:02,744: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:20:02.745030003Z [2024-04-03 04:20:02,744: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:20:02.745113812Z [2024-04-03 04:20:02,745: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:20:02.745360627Z [2024-04-03 04:20:02,745: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:20:02.745791113Z [2024-04-03 04:20:02,745: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:20:02.751999984Z [2024-04-03 04:20:02,751: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:20:02.875029679Z [2024-04-03 04:20:02,874: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-03T04:20:02.878847828Z [2024-04-03 04:20:02,878: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:20:02.891715357Z [2024-04-03 04:20:02,891: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:20:02.942220208Z [2024-04-03 04:20:02,941: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:20:02.943426256Z [2024-04-03 04:20:02,943: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-03T04:20:02.950037687Z [2024-04-03 04:20:02,949: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:20:02.961803022Z [2024-04-03 04:20:02,961: INFO/ForkPoolWorker-2] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:20:02.962828633Z [2024-04-03 04:20:02,961: INFO/ForkPoolWorker-2] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:20:02.963018654Z [2024-04-03 04:20:02,962: INFO/ForkPoolWorker-2] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:20:02.963299337Z [2024-04-03 04:20:02,962: INFO/ForkPoolWorker-2] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:20:02.965251880Z [2024-04-03 04:20:02,965: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-03T04:20:02.965636538Z [2024-04-03 04:20:02,965: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:20:02.965760100Z [2024-04-03 04:20:02,965: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:20:02.974732547Z [2024-04-03 04:20:02,974: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:20:02.993705370Z [2024-04-03 04:20:02,993: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:20:02.996580388Z [2024-04-03 04:20:02,996: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:20:03.002855924Z [2024-04-03 04:20:02,996: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:20:03.003095191Z [2024-04-03 04:20:03,002: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:20:03.003323214Z [2024-04-03 04:20:03,003: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:20:03.003488776Z [2024-04-03 04:20:03,003: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:20:03.005909512Z [2024-04-03 04:20:03,005: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:20:03.006907670Z [2024-04-03 04:20:03,005: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:20:03.026109047Z [2024-04-03 04:20:03,025: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:20:03.059212385Z [2024-04-03 04:20:03,059: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:20:03.215617191Z [2024-04-03 04:20:03,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:20:04.456092252Z [2024-04-03 04:20:04,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ea4a4d4-5661-4b3a-b521-253a26c71a90] succeeded in 4.117835033001029s: None 2024-04-03T04:20:04.855244960Z [2024-04-03 04:20:04,854: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d9d47ad-58d6-46a4-91a5-a60c562c075a] succeeded in 4.507797435999237s: None 2024-04-03T04:20:05.044000938Z [2024-04-03 04:20:05,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26df0566-8125-40e3-aaa3-85d5ffb18188] received 2024-04-03T04:20:05.055536537Z [2024-04-03 04:20:05,055: INFO/ForkPoolWorker-15] [26df0566-8125-40e3-aaa3-85d5ffb18188] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'split_metrics', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:20:05.338276552Z [2024-04-03 04:20:05,334: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:20:06.052017463Z [2024-04-03 04:20:06,051: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4f9f4ae4-5199-4321-9d39-e384344a891d] succeeded in 5.670641959000932s: None 2024-04-03T04:20:06.469944127Z [2024-04-03 04:20:06,469: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:20:06.473477471Z [2024-04-03 04:20:06,473: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:20:06.499963087Z [2024-04-03 04:20:06,499: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:20:06.501075575Z [2024-04-03 04:20:06,500: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:20:06.501146707Z [2024-04-03 04:20:06,501: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:20:06.501232161Z [2024-04-03 04:20:06,501: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:20:06.501401564Z [2024-04-03 04:20:06,501: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:20:06.501472907Z [2024-04-03 04:20:06,501: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:20:06.501744570Z [2024-04-03 04:20:06,501: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:20:06.501852435Z [2024-04-03 04:20:06,501: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:20:06.507699189Z [2024-04-03 04:20:06,507: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:20:06.582376914Z [2024-04-03 04:20:06,582: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:20:07.152289365Z [2024-04-03 04:20:07,151: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26df0566-8125-40e3-aaa3-85d5ffb18188] succeeded in 2.10407433599903s: None 2024-04-03T04:20:07.826672176Z [2024-04-03 04:20:07,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6b9f3fb-3dd9-49bc-b287-a80089eb8f74] received 2024-04-03T04:20:07.837617072Z [2024-04-03 04:20:07,837: INFO/ForkPoolWorker-15] [d6b9f3fb-3dd9-49bc-b287-a80089eb8f74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'collect_metrics', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-03T04:20:08.101715883Z [2024-04-03 04:20:08,098: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:20:09.273401181Z [2024-04-03 04:20:09,273: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:20:09.276725707Z [2024-04-03 04:20:09,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:20:09.324086844Z [2024-04-03 04:20:09,323: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:20:09.326907566Z [2024-04-03 04:20:09,325: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:20:09.326925974Z [2024-04-03 04:20:09,325: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:20:09.326929411Z [2024-04-03 04:20:09,325: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:20:09.326934559Z [2024-04-03 04:20:09,325: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:20:09.326938434Z [2024-04-03 04:20:09,325: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:20:09.326941439Z [2024-04-03 04:20:09,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:20:09.326944450Z [2024-04-03 04:20:09,325: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:20:09.332518557Z [2024-04-03 04:20:09,332: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:20:09.421414369Z [2024-04-03 04:20:09,421: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:20:09.934078281Z [2024-04-03 04:20:09,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6b9f3fb-3dd9-49bc-b287-a80089eb8f74] succeeded in 2.104913025999849s: None 2024-04-03T04:20:10.274318723Z [2024-04-03 04:20:10,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[680abe50-becf-4236-b321-4776dbf6c9a5] received 2024-04-03T04:20:10.283523862Z [2024-04-03 04:20:10,283: INFO/ForkPoolWorker-15] [680abe50-becf-4236-b321-4776dbf6c9a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'send_prometheus', 'scheduled__2024-04-03T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-03T04:20:10.580118554Z [2024-04-03 04:20:10,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-03T04:20:11.872671690Z [2024-04-03 04:20:11,872: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:20:11.876631533Z [2024-04-03 04:20:11,876: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:20:11.929722579Z [2024-04-03 04:20:11,929: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:20:11.935441725Z [2024-04-03 04:20:11,935: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:20:11.935985712Z [2024-04-03 04:20:11,935: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:20:11.936612741Z [2024-04-03 04:20:11,935: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:20:11.936921497Z [2024-04-03 04:20:11,936: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:20:11.938531093Z [2024-04-03 04:20:11,938: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:20:11.944450019Z [2024-04-03 04:20:11,944: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:20:11.944800611Z [2024-04-03 04:20:11,944: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:20:11.952196826Z [2024-04-03 04:20:11,951: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-03T04:20:12.035533874Z [2024-04-03 04:20:12,035: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:20:12.565181567Z [2024-04-03 04:20:12,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[680abe50-becf-4236-b321-4776dbf6c9a5] succeeded in 2.28843977500037s: None 2024-04-03T04:21:00.680181925Z [2024-04-03 04:21:00,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f4adf3a-e92f-405d-bd6a-45ba91f2643d] received 2024-04-03T04:21:00.694081028Z [2024-04-03 04:21:00,693: INFO/ForkPoolWorker-15] [7f4adf3a-e92f-405d-bd6a-45ba91f2643d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:21:00.701985549Z [2024-04-03 04:21:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[956cc218-0bde-4eb4-8399-88648a7afcb2] received 2024-04-03T04:21:00.723098409Z [2024-04-03 04:21:00,722: INFO/ForkPoolWorker-16] [956cc218-0bde-4eb4-8399-88648a7afcb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:21:01.299312990Z [2024-04-03 04:21:01,295: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:21:01.336979418Z [2024-04-03 04:21:01,318: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:21:02.881787197Z [2024-04-03 04:21:02,881: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:21:02.890730976Z [2024-04-03 04:21:02,888: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:21:02.907593302Z [2024-04-03 04:21:02,907: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:21:02.912963577Z [2024-04-03 04:21:02,912: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:21:02.950385015Z [2024-04-03 04:21:02,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:21:02.952794794Z [2024-04-03 04:21:02,952: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:21:02.953220038Z [2024-04-03 04:21:02,953: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:21:02.953494916Z [2024-04-03 04:21:02,953: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:21:02.953757417Z [2024-04-03 04:21:02,953: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:21:02.953905485Z [2024-04-03 04:21:02,953: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:21:02.954300695Z [2024-04-03 04:21:02,954: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:21:02.955183252Z [2024-04-03 04:21:02,954: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:21:02.963347403Z [2024-04-03 04:21:02,963: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:21:02.963362568Z [2024-04-03 04:21:02,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:21:02.968731641Z [2024-04-03 04:21:02,968: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:21:02.968933083Z [2024-04-03 04:21:02,968: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:21:02.969103519Z [2024-04-03 04:21:02,968: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:21:02.969391302Z [2024-04-03 04:21:02,969: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:21:02.969647791Z [2024-04-03 04:21:02,969: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:21:02.970141974Z [2024-04-03 04:21:02,969: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:21:02.970286843Z [2024-04-03 04:21:02,970: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:21:02.976734543Z [2024-04-03 04:21:02,976: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:21:03.076768988Z [2024-04-03 04:21:03,076: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:21:03.133455751Z [2024-04-03 04:21:03,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:21:05.356597461Z [2024-04-03 04:21:05,355: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[956cc218-0bde-4eb4-8399-88648a7afcb2] succeeded in 4.6518816290008544s: None 2024-04-03T04:21:06.127830479Z [2024-04-03 04:21:06,127: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f4adf3a-e92f-405d-bd6a-45ba91f2643d] succeeded in 5.4448632359999465s: None 2024-04-03T04:22:01.033907710Z [2024-04-03 04:22:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bfcba1d-7b50-4817-b360-6b91895df3d9] received 2024-04-03T04:22:01.038526559Z [2024-04-03 04:22:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ce4b27e-ca6c-410e-ab19-098a5bc51416] received 2024-04-03T04:22:01.040709598Z [2024-04-03 04:22:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcc79814-6d85-48c8-a213-d0e758f68ad4] received 2024-04-03T04:22:01.060926797Z [2024-04-03 04:22:01,060: INFO/ForkPoolWorker-15] [5bfcba1d-7b50-4817-b360-6b91895df3d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:22:01.061445034Z [2024-04-03 04:22:01,061: INFO/ForkPoolWorker-16] [9ce4b27e-ca6c-410e-ab19-098a5bc51416] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:22:01.062564763Z [2024-04-03 04:22:01,061: INFO/ForkPoolWorker-1] [bcc79814-6d85-48c8-a213-d0e758f68ad4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:22:01.424503381Z [2024-04-03 04:22:01,420: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:22:01.473624772Z [2024-04-03 04:22:01,466: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:22:01.671112069Z [2024-04-03 04:22:01,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:22:01.940363262Z [2024-04-03 04:22:01,940: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:22:02.458186436Z [2024-04-03 04:22:02,457: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bfcba1d-7b50-4817-b360-6b91895df3d9] succeeded in 1.4167856100011704s: None 2024-04-03T04:22:02.688169858Z [2024-04-03 04:22:02,687: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:22:02.691696543Z [2024-04-03 04:22:02,691: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:22:02.717437183Z [2024-04-03 04:22:02,717: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:22:02.719005888Z [2024-04-03 04:22:02,718: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:22:02.719034456Z [2024-04-03 04:22:02,718: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:22:02.719043039Z [2024-04-03 04:22:02,718: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:22:02.719195692Z [2024-04-03 04:22:02,719: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:22:02.719205945Z [2024-04-03 04:22:02,719: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:22:02.719423369Z [2024-04-03 04:22:02,719: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:22:02.719561690Z [2024-04-03 04:22:02,719: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:22:02.724233674Z [2024-04-03 04:22:02,723: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:22:02.835746648Z [2024-04-03 04:22:02,835: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:22:02.839309864Z [2024-04-03 04:22:02,838: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:22:02.856312752Z [2024-04-03 04:22:02,855: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:22:02.880191327Z [2024-04-03 04:22:02,879: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:22:02.881399504Z [2024-04-03 04:22:02,881: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:22:02.881565150Z [2024-04-03 04:22:02,881: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:22:02.881703083Z [2024-04-03 04:22:02,881: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:22:02.881924550Z [2024-04-03 04:22:02,881: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:22:02.882064190Z [2024-04-03 04:22:02,881: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:22:02.882448975Z [2024-04-03 04:22:02,882: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:22:02.882668574Z [2024-04-03 04:22:02,882: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:22:02.888670347Z [2024-04-03 04:22:02,888: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:22:02.966141224Z [2024-04-03 04:22:02,965: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:22:04.887723526Z [2024-04-03 04:22:04,887: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ce4b27e-ca6c-410e-ab19-098a5bc51416] succeeded in 3.8440357460003725s: None 2024-04-03T04:22:06.244769668Z [2024-04-03 04:22:06,244: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bcc79814-6d85-48c8-a213-d0e758f68ad4] succeeded in 5.2011593529987294s: None 2024-04-03T04:23:00.300941576Z [2024-04-03 04:23:00,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4502f5eb-23b8-41d9-9469-0d6bfab686a0] received 2024-04-03T04:23:00.310268639Z [2024-04-03 04:23:00,309: INFO/ForkPoolWorker-15] [4502f5eb-23b8-41d9-9469-0d6bfab686a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:23:00.320493152Z [2024-04-03 04:23:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6752016-3692-4aef-842b-c39318aab663] received 2024-04-03T04:23:00.335553536Z [2024-04-03 04:23:00,335: INFO/ForkPoolWorker-16] [d6752016-3692-4aef-842b-c39318aab663] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:23:00.638723180Z [2024-04-03 04:23:00,634: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:23:00.658345240Z [2024-04-03 04:23:00,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:23:02.106410679Z [2024-04-03 04:23:02,106: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:23:02.109902733Z [2024-04-03 04:23:02,109: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:23:02.134805491Z [2024-04-03 04:23:02,134: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:23:02.135946648Z [2024-04-03 04:23:02,135: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:23:02.136079002Z [2024-04-03 04:23:02,135: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:23:02.136124128Z [2024-04-03 04:23:02,136: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:23:02.136276970Z [2024-04-03 04:23:02,136: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:23:02.136304775Z [2024-04-03 04:23:02,136: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:23:02.136897027Z [2024-04-03 04:23:02,136: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:23:02.136933023Z [2024-04-03 04:23:02,136: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:23:02.141821210Z [2024-04-03 04:23:02,141: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:23:02.252229398Z [2024-04-03 04:23:02,251: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:23:02.328573010Z [2024-04-03 04:23:02,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-03T04:23:02.331990020Z [2024-04-03 04:23:02,331: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:23:02.369894594Z [2024-04-03 04:23:02,369: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-03T04:23:02.372696067Z [2024-04-03 04:23:02,372: INFO/ForkPoolWorker-15] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:23:02.372728321Z [2024-04-03 04:23:02,372: INFO/ForkPoolWorker-15] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:23:02.372882187Z [2024-04-03 04:23:02,372: INFO/ForkPoolWorker-15] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:23:02.373085969Z [2024-04-03 04:23:02,372: INFO/ForkPoolWorker-15] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:23:02.373143336Z [2024-04-03 04:23:02,373: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-03T04:23:02.373530266Z [2024-04-03 04:23:02,373: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:23:02.373554956Z [2024-04-03 04:23:02,373: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:23:02.380367667Z [2024-04-03 04:23:02,380: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:23:02.485833816Z [2024-04-03 04:23:02,485: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:23:04.067612988Z [2024-04-03 04:23:04,067: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d6752016-3692-4aef-842b-c39318aab663] succeeded in 3.745113061999291s: None 2024-04-03T04:23:05.064134115Z [2024-04-03 04:23:05,063: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4502f5eb-23b8-41d9-9469-0d6bfab686a0] succeeded in 4.760596103998978s: None 2024-04-03T04:24:00.648898970Z [2024-04-03 04:24:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e741ca4-2132-430b-bf74-cf51bf33db3e] received 2024-04-03T04:24:00.662135043Z [2024-04-03 04:24:00,661: INFO/ForkPoolWorker-15] [4e741ca4-2132-430b-bf74-cf51bf33db3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-03T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-03T04:24:00.675422971Z [2024-04-03 04:24:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb7deeb0-54ee-46ac-a7be-0616ac45f639] received 2024-04-03T04:24:00.691321002Z [2024-04-03 04:24:00,690: INFO/ForkPoolWorker-16] [fb7deeb0-54ee-46ac-a7be-0616ac45f639] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-03T04:24:00.697570213Z [2024-04-03 04:24:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cadd7f61-0104-419f-8b43-204946804e57] received 2024-04-03T04:24:00.724351827Z [2024-04-03 04:24:00,723: INFO/ForkPoolWorker-1] [cadd7f61-0104-419f-8b43-204946804e57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-03T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-03T04:24:01.142187800Z [2024-04-03 04:24:01,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-03T04:24:01.142552598Z [2024-04-03 04:24:01,138: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-03T04:24:01.191264448Z [2024-04-03 04:24:01,187: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-03T04:24:01.514403574Z [2024-04-03 04:24:01,514: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:24:02.205545792Z [2024-04-03 04:24:02,204: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e741ca4-2132-430b-bf74-cf51bf33db3e] succeeded in 1.5508387379995838s: None 2024-04-03T04:24:02.553711606Z [2024-04-03 04:24:02,553: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-03T04:24:02.557046484Z [2024-04-03 04:24:02,556: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:24:02.580290302Z [2024-04-03 04:24:02,580: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-03T04:24:02.581725213Z [2024-04-03 04:24:02,581: INFO/ForkPoolWorker-1] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:24:02.581770202Z [2024-04-03 04:24:02,581: INFO/ForkPoolWorker-1] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:24:02.581825379Z [2024-04-03 04:24:02,581: INFO/ForkPoolWorker-1] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:24:02.581961043Z [2024-04-03 04:24:02,581: INFO/ForkPoolWorker-1] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:24:02.582010233Z [2024-04-03 04:24:02,581: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-03T04:24:02.582234674Z [2024-04-03 04:24:02,582: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:24:02.582277989Z [2024-04-03 04:24:02,582: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:24:02.588270773Z [2024-04-03 04:24:02,588: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-03T04:24:02.625807171Z [2024-04-03 04:24:02,625: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-03T04:24:02.629458829Z [2024-04-03 04:24:02,629: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Kdq4RYtIxjP5UJQV9gbh1eLCc7NApr61'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-03T04:24:02.652757115Z [2024-04-03 04:24:02,652: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-03T04:24:02.654012020Z [2024-04-03 04:24:02,653: INFO/ForkPoolWorker-16] Read VIM 9fe26fcb-f927-4350-8fbc-4d176e83c9e7 (_system-osm-vim) 2024-04-03T04:24:02.654139596Z [2024-04-03 04:24:02,653: INFO/ForkPoolWorker-16] Read VIM 7a8df917-c55f-4ae7-a49d-b123d795de17 (osm) 2024-04-03T04:24:02.654255002Z [2024-04-03 04:24:02,654: INFO/ForkPoolWorker-16] Read VIM ba54a551-ceae-4c1d-94f4-7c80daa8a7f0 (k8s07_dummy) 2024-04-03T04:24:02.654447173Z [2024-04-03 04:24:02,654: INFO/ForkPoolWorker-16] [{'_id': '9fe26fcb-f927-4350-8fbc-4d176e83c9e7', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '7a8df917-c55f-4ae7-a49d-b123d795de17', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ba54a551-ceae-4c1d-94f4-7c80daa8a7f0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-03T04:24:02.654555641Z [2024-04-03 04:24:02,654: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-03T04:24:02.654894087Z [2024-04-03 04:24:02,654: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:24:02.655003649Z [2024-04-03 04:24:02,654: INFO/ForkPoolWorker-16] Creating DAG vim_status_7a8df917-c55f-4ae7-a49d-b123d795de17 2024-04-03T04:24:02.659679992Z [2024-04-03 04:24:02,659: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-03T04:24:02.674013810Z [2024-04-03 04:24:02,673: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:24:02.726185330Z [2024-04-03 04:24:02,725: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-03T04:24:04.787150044Z [2024-04-03 04:24:04,786: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb7deeb0-54ee-46ac-a7be-0616ac45f639] succeeded in 4.107927468001435s: None 2024-04-03T04:24:05.374829959Z [2024-04-03 04:24:05,374: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cadd7f61-0104-419f-8b43-204946804e57] succeeded in 4.670016161999229s: None 2024-04-03T01:26:16.711411031Z 2024-04-03T01:26:16.738421144Z Cleaning logs every 900 seconds 2024-04-03T01:26:16.738437289Z Trimming airflow logs to 15 days. 2024-04-03T01:30:00.924050498Z Trimming airflow logs to 15 days. 2024-04-03T01:30:01.979794637Z Trimming airflow logs to 15 days. 2024-04-03T01:45:00.035945557Z Trimming airflow logs to 15 days. 2024-04-03T01:45:01.074924920Z Trimming airflow logs to 15 days. 2024-04-03T02:00:00.152143457Z Trimming airflow logs to 15 days. 2024-04-03T02:00:01.236241881Z Trimming airflow logs to 15 days. 2024-04-03T02:15:00.318304141Z Trimming airflow logs to 15 days. 2024-04-03T02:15:01.343231561Z Trimming airflow logs to 15 days. 2024-04-03T02:30:00.406886177Z Trimming airflow logs to 15 days. 2024-04-03T02:30:01.439572022Z Trimming airflow logs to 15 days. 2024-04-03T02:45:00.512205826Z Trimming airflow logs to 15 days. 2024-04-03T02:45:01.562964387Z Trimming airflow logs to 15 days. 2024-04-03T03:00:00.642730093Z Trimming airflow logs to 15 days. 2024-04-03T03:00:01.777275776Z Trimming airflow logs to 15 days. 2024-04-03T03:15:00.860460012Z Trimming airflow logs to 15 days. 2024-04-03T03:15:01.907085950Z Trimming airflow logs to 15 days. 2024-04-03T03:30:00.969481170Z Trimming airflow logs to 15 days. 2024-04-03T03:45:00.062184537Z Trimming airflow logs to 15 days. 2024-04-03T03:45:01.175889164Z Trimming airflow logs to 15 days. 2024-04-03T04:00:00.257645600Z Trimming airflow logs to 15 days. 2024-04-03T04:00:01.341642879Z Trimming airflow logs to 15 days. 2024-04-03T04:15:00.439731794Z Trimming airflow logs to 15 days. 2024-04-03T04:15:01.589452297Z Trimming airflow logs to 15 days.