2024-04-25T17:34:44.196271213Z ... 2024-04-25T17:34:45.026568850Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-25T17:34:46.076133399Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-25T17:34:54.014850097Z [2024-04-25T17:34:54.013+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-25T17:34:55.018902010Z [2024-04-25T17:34:55.018+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-25T17:35:16.457321171Z 2024-04-25T17:35:19.182634311Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-25T17:35:23.518494209Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-25T17:35:34.264703636Z [2024-04-25 17:35:34 +0000] [15] [INFO] Starting gunicorn 20.1.0 2024-04-25T17:35:34.337012328Z [2024-04-25 17:35:34 +0000] [15] [INFO] Listening at: http://[::]:8793 (15) 2024-04-25T17:35:34.337026168Z [2024-04-25 17:35:34 +0000] [15] [INFO] Using worker: sync 2024-04-25T17:35:34.449258493Z [2024-04-25 17:35:34 +0000] [16] [INFO] Booting worker with pid: 16 2024-04-25T17:35:34.677327034Z [2024-04-25 17:35:34 +0000] [17] [INFO] Booting worker with pid: 17 2024-04-25T17:35:36.703579256Z 2024-04-25T17:35:36.703599237Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-04-25T17:35:36.703604255Z --- ***** ----- 2024-04-25T17:35:36.703607949Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-04-25 17:35:36 2024-04-25T17:35:36.703611228Z - *** --- * --- 2024-04-25T17:35:36.703632191Z - ** ---------- [config] 2024-04-25T17:35:36.703636608Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f957e1c4220 2024-04-25T17:35:36.703640187Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-04-25T17:35:36.703643480Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-04-25T17:35:36.703650112Z - *** --- * --- .> concurrency: 16 (prefork) 2024-04-25T17:35:36.703653223Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-04-25T17:35:36.703656348Z --- ***** ----- 2024-04-25T17:35:36.703659373Z -------------- [queues] 2024-04-25T17:35:36.703662611Z .> default exchange=default(direct) key=default 2024-04-25T17:35:36.703665718Z 2024-04-25T17:35:36.703668703Z 2024-04-25T17:35:36.703671767Z [tasks] 2024-04-25T17:35:36.703689717Z . airflow.executors.celery_executor.execute_command 2024-04-25T17:35:36.703692736Z 2024-04-25T17:35:49.693142235Z [2024-04-25 17:35:49,687: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-04-25T17:35:49.712634695Z [2024-04-25 17:35:49,712: INFO/MainProcess] mingle: searching for neighbors 2024-04-25T17:35:50.760428402Z [2024-04-25 17:35:50,759: INFO/MainProcess] mingle: all alone 2024-04-25T17:35:50.817442312Z [2024-04-25 17:35:50,816: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-04-25T17:35:56.272496020Z [2024-04-25 17:35:56,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2737c5f9-2307-4f23-a704-32cef966e0c7] received 2024-04-25T17:35:56.400179134Z [2024-04-25 17:35:56,396: INFO/ForkPoolWorker-15] [2737c5f9-2307-4f23-a704-32cef966e0c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:35:57.045349135Z [2024-04-25 17:35:57,038: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:35:57.647033010Z [2024-04-25 17:35:57,646: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:35:59.498598424Z [2024-04-25 17:35:59,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2737c5f9-2307-4f23-a704-32cef966e0c7] succeeded in 3.2195708479999894s: None 2024-04-25T17:36:09.558544246Z [2024-04-25 17:36:09,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[000ba5fd-3ae6-40ee-add5-978b4e8f4c38] received 2024-04-25T17:36:09.581154690Z [2024-04-25 17:36:09,580: INFO/ForkPoolWorker-15] [000ba5fd-3ae6-40ee-add5-978b4e8f4c38] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:36:11.923897763Z [2024-04-25 17:36:11,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:36:12.725888094Z [2024-04-25 17:36:12,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:36:14.483655966Z [2024-04-25 17:36:14,483: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[000ba5fd-3ae6-40ee-add5-978b4e8f4c38] succeeded in 4.920508013000017s: None 2024-04-25T17:36:16.732546920Z [2024-04-25 17:36:16,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f877986a-4f76-4e24-ac69-97a95c47ed8d] received 2024-04-25T17:36:16.773139267Z [2024-04-25 17:36:16,772: INFO/ForkPoolWorker-15] [f877986a-4f76-4e24-ac69-97a95c47ed8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:36:18.073194006Z [2024-04-25 17:36:18,043: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:36:18.571074664Z [2024-04-25 17:36:18,570: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:36:19.707550597Z [2024-04-25 17:36:19,704: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f877986a-4f76-4e24-ac69-97a95c47ed8d] succeeded in 2.971038701999987s: None 2024-04-25T17:36:30.721804273Z [2024-04-25 17:36:30,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a286e4d2-bdeb-4af0-baf6-fb59cb27029f] received 2024-04-25T17:36:30.746945822Z [2024-04-25 17:36:30,746: INFO/ForkPoolWorker-15] [a286e4d2-bdeb-4af0-baf6-fb59cb27029f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:36:31.317204114Z [2024-04-25 17:36:31,314: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:36:32.113780660Z [2024-04-25 17:36:32,113: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:36:34.280333422Z [2024-04-25 17:36:34,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a286e4d2-bdeb-4af0-baf6-fb59cb27029f] succeeded in 3.5548568169999726s: None 2024-04-25T17:38:00.567977852Z [2024-04-25 17:38:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83477fdb-da85-4534-895a-a0cda4028b4b] received 2024-04-25T17:38:00.592135479Z [2024-04-25 17:38:00,591: INFO/ForkPoolWorker-15] [83477fdb-da85-4534-895a-a0cda4028b4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:38:01.059182919Z [2024-04-25 17:38:01,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:38:01.524182148Z [2024-04-25 17:38:01,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:38:02.449606042Z [2024-04-25 17:38:02,449: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83477fdb-da85-4534-895a-a0cda4028b4b] succeeded in 1.877343633999999s: None 2024-04-25T17:40:00.115986719Z [2024-04-25 17:40:00,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1563427-e877-44f6-9733-342a16401488] received 2024-04-25T17:40:00.131051734Z [2024-04-25 17:40:00,130: INFO/ForkPoolWorker-15] [a1563427-e877-44f6-9733-342a16401488] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:40:00.528718911Z [2024-04-25 17:40:00,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:40:00.892423507Z [2024-04-25 17:40:00,892: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:40:01.562602780Z [2024-04-25 17:40:01,562: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1563427-e877-44f6-9733-342a16401488] succeeded in 1.443965503999948s: None 2024-04-25T17:42:00.988961092Z [2024-04-25 17:42:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52bc3adc-1893-47be-9efc-e42be30a9ee5] received 2024-04-25T17:42:01.037850128Z [2024-04-25 17:42:01,036: INFO/ForkPoolWorker-15] [52bc3adc-1893-47be-9efc-e42be30a9ee5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:42:01.443686210Z [2024-04-25 17:42:01,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:42:01.781133782Z [2024-04-25 17:42:01,780: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:42:02.519324551Z [2024-04-25 17:42:02,518: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52bc3adc-1893-47be-9efc-e42be30a9ee5] succeeded in 1.5271528360000275s: None 2024-04-25T17:42:45.945008893Z [2024-04-25 17:42:45,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73e7c3f0-86f0-4c6c-9a6a-146cef39ce72] received 2024-04-25T17:42:46.019912333Z [2024-04-25 17:42:46,019: INFO/ForkPoolWorker-15] [73e7c3f0-86f0-4c6c-9a6a-146cef39ce72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:42:46.591141536Z [2024-04-25 17:42:46,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:42:48.489876495Z [2024-04-25 17:42:48,489: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:42:48.493505852Z [2024-04-25 17:42:48,493: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:42:48.542720293Z [2024-04-25 17:42:48,542: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:42:48.585716346Z [2024-04-25 17:42:48,584: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:42:48.585953673Z [2024-04-25 17:42:48,585: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:42:48.586177351Z [2024-04-25 17:42:48,585: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:42:48.586427511Z [2024-04-25 17:42:48,586: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:42:48.587940690Z [2024-04-25 17:42:48,587: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:42:48.588056224Z [2024-04-25 17:42:48,587: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:42:48.685904090Z [2024-04-25 17:42:48,685: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:42:50.733820286Z [2024-04-25 17:42:50,733: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[73e7c3f0-86f0-4c6c-9a6a-146cef39ce72] succeeded in 4.728092546000084s: None 2024-04-25T17:42:51.558163681Z [2024-04-25 17:42:51,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d68a79a-ea99-4f4f-a31d-ee841f99b09d] received 2024-04-25T17:42:51.584626222Z [2024-04-25 17:42:51,584: INFO/ForkPoolWorker-15] [7d68a79a-ea99-4f4f-a31d-ee841f99b09d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-25T17:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:42:51.776308783Z [2024-04-25 17:42:51,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c4ed420-4ed9-4c2f-aa6c-c585db04e927] received 2024-04-25T17:42:51.974421049Z [2024-04-25 17:42:51,973: INFO/ForkPoolWorker-16] [1c4ed420-4ed9-4c2f-aa6c-c585db04e927] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:42:52.028115768Z [2024-04-25 17:42:52,025: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:42:52.657516795Z [2024-04-25 17:42:52,653: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:42:54.145332035Z [2024-04-25 17:42:54,145: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:42:54.149257679Z [2024-04-25 17:42:54,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:42:54.190000638Z [2024-04-25 17:42:54,189: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:42:54.192002810Z [2024-04-25 17:42:54,191: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:42:54.192051956Z [2024-04-25 17:42:54,191: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:42:54.192174538Z [2024-04-25 17:42:54,191: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:42:54.192268454Z [2024-04-25 17:42:54,192: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:42:54.192590825Z [2024-04-25 17:42:54,192: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:42:54.192654887Z [2024-04-25 17:42:54,192: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:42:54.299903576Z [2024-04-25 17:42:54,299: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:42:54.637112002Z [2024-04-25 17:42:54,636: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:42:54.642562194Z [2024-04-25 17:42:54,641: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:42:54.722826899Z [2024-04-25 17:42:54,722: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:42:54.727348314Z [2024-04-25 17:42:54,727: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:42:54.727465323Z [2024-04-25 17:42:54,727: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:42:54.727612560Z [2024-04-25 17:42:54,727: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:42:54.727689594Z [2024-04-25 17:42:54,727: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:42:54.727942282Z [2024-04-25 17:42:54,727: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:42:54.728995875Z [2024-04-25 17:42:54,728: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:42:54.905097957Z [2024-04-25 17:42:54,904: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:42:54.959910877Z [2024-04-25 17:42:54,956: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d68a79a-ea99-4f4f-a31d-ee841f99b09d] succeeded in 3.396273799000028s: None 2024-04-25T17:42:55.041150146Z [2024-04-25 17:42:55,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f08bd44-7a1a-4cae-a238-63cf893dee2f] received 2024-04-25T17:42:55.055024155Z [2024-04-25 17:42:55,054: INFO/ForkPoolWorker-15] [6f08bd44-7a1a-4cae-a238-63cf893dee2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'split_metrics', 'scheduled__2024-04-25T17:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:42:55.482440527Z [2024-04-25 17:42:55,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:42:56.486764858Z [2024-04-25 17:42:56,486: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c4ed420-4ed9-4c2f-aa6c-c585db04e927] succeeded in 4.701251727999988s: None 2024-04-25T17:42:56.878444842Z [2024-04-25 17:42:56,878: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:42:56.882051531Z [2024-04-25 17:42:56,881: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:42:56.908585311Z [2024-04-25 17:42:56,908: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:42:56.910309233Z [2024-04-25 17:42:56,910: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:42:56.910468260Z [2024-04-25 17:42:56,910: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:42:56.910631214Z [2024-04-25 17:42:56,910: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:42:56.910698152Z [2024-04-25 17:42:56,910: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:42:56.910948126Z [2024-04-25 17:42:56,910: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:42:56.911419496Z [2024-04-25 17:42:56,911: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:42:57.017043273Z [2024-04-25 17:42:57,016: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:42:57.844387702Z [2024-04-25 17:42:57,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f08bd44-7a1a-4cae-a238-63cf893dee2f] succeeded in 2.801111707000018s: None 2024-04-25T17:42:58.656282837Z [2024-04-25 17:42:58,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4855df4d-8ca7-4db8-b4ec-a72acb7108f9] received 2024-04-25T17:42:58.684419500Z [2024-04-25 17:42:58,673: INFO/ForkPoolWorker-15] [4855df4d-8ca7-4db8-b4ec-a72acb7108f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'collect_metrics', 'scheduled__2024-04-25T17:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-25T17:42:59.031330465Z [2024-04-25 17:42:59,028: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:43:00.364922502Z [2024-04-25 17:43:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28f08355-f8e6-40f8-99fc-feb2400abf8c] received 2024-04-25T17:43:00.368998940Z [2024-04-25 17:43:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29bd4ebc-4417-4263-8a8a-29069d205f2d] received 2024-04-25T17:43:00.383781412Z [2024-04-25 17:43:00,383: INFO/ForkPoolWorker-16] [28f08355-f8e6-40f8-99fc-feb2400abf8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:43:00.422724517Z [2024-04-25 17:43:00,422: INFO/ForkPoolWorker-1] [29bd4ebc-4417-4263-8a8a-29069d205f2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:43:00.587904709Z [2024-04-25 17:43:00,587: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:43:00.592103244Z [2024-04-25 17:43:00,591: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:43:00.644019034Z [2024-04-25 17:43:00,643: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:43:00.645950361Z [2024-04-25 17:43:00,645: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:43:00.645987188Z [2024-04-25 17:43:00,645: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:43:00.646184031Z [2024-04-25 17:43:00,645: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:43:00.646211563Z [2024-04-25 17:43:00,646: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:43:00.647095230Z [2024-04-25 17:43:00,646: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:43:00.647182967Z [2024-04-25 17:43:00,647: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:43:00.744782397Z [2024-04-25 17:43:00,744: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:43:00.782245943Z [2024-04-25 17:43:00,777: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:43:00.805670691Z [2024-04-25 17:43:00,801: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:43:01.464655754Z [2024-04-25 17:43:01,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4855df4d-8ca7-4db8-b4ec-a72acb7108f9] succeeded in 2.8048905970000533s: None 2024-04-25T17:43:01.760534190Z [2024-04-25 17:43:01,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6bb9bd2-1b2b-4282-a924-451cb2be218d] received 2024-04-25T17:43:01.773587480Z [2024-04-25 17:43:01,773: INFO/ForkPoolWorker-15] [a6bb9bd2-1b2b-4282-a924-451cb2be218d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'send_prometheus', 'scheduled__2024-04-25T17:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:43:02.241955519Z [2024-04-25 17:43:02,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:43:02.424744591Z [2024-04-25 17:43:02,424: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:43:02.430536482Z [2024-04-25 17:43:02,428: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:43:02.496094386Z [2024-04-25 17:43:02,495: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:43:02.500711214Z [2024-04-25 17:43:02,500: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:43:02.501409244Z [2024-04-25 17:43:02,500: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:43:02.502146670Z [2024-04-25 17:43:02,501: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:43:02.502275338Z [2024-04-25 17:43:02,502: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:43:02.503071356Z [2024-04-25 17:43:02,502: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:43:02.503395526Z [2024-04-25 17:43:02,503: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:43:02.616739809Z [2024-04-25 17:43:02,616: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:43:02.775923310Z [2024-04-25 17:43:02,775: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:43:02.779808438Z [2024-04-25 17:43:02,779: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:43:02.894790385Z [2024-04-25 17:43:02,894: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:43:02.901725393Z [2024-04-25 17:43:02,901: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:43:02.901749819Z [2024-04-25 17:43:02,901: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:43:02.902010989Z [2024-04-25 17:43:02,901: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:43:02.902099244Z [2024-04-25 17:43:02,901: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:43:02.902419176Z [2024-04-25 17:43:02,902: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:43:02.902484196Z [2024-04-25 17:43:02,902: INFO/ForkPoolWorker-1] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:43:03.123417691Z [2024-04-25 17:43:03,123: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:43:04.153420295Z [2024-04-25 17:43:04,153: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:43:04.159923260Z [2024-04-25 17:43:04,159: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:43:04.222587085Z [2024-04-25 17:43:04,222: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:43:04.225834259Z [2024-04-25 17:43:04,225: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:43:04.225898830Z [2024-04-25 17:43:04,225: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:43:04.226045373Z [2024-04-25 17:43:04,225: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:43:04.226129709Z [2024-04-25 17:43:04,226: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:43:04.226390316Z [2024-04-25 17:43:04,226: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:43:04.226469772Z [2024-04-25 17:43:04,226: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:43:04.329767279Z [2024-04-25 17:43:04,329: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:43:04.985938696Z [2024-04-25 17:43:04,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29bd4ebc-4417-4263-8a8a-29069d205f2d] succeeded in 4.6105352509999875s: None 2024-04-25T17:43:04.995040589Z [2024-04-25 17:43:04,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[28f08355-f8e6-40f8-99fc-feb2400abf8c] succeeded in 4.627644804999932s: None 2024-04-25T17:43:04.998346348Z [2024-04-25 17:43:04,997: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6bb9bd2-1b2b-4282-a924-451cb2be218d] succeeded in 3.2336284909999904s: None 2024-04-25T17:44:00.558507029Z [2024-04-25 17:44:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcaff11f-7eaa-4aca-9311-fba687991be1] received 2024-04-25T17:44:00.563564673Z [2024-04-25 17:44:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc591698-3963-42c7-97ea-d33ea2442030] received 2024-04-25T17:44:00.569706750Z [2024-04-25 17:44:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abbe32a8-995d-48d3-9c9c-72a2cfb1085d] received 2024-04-25T17:44:00.579167492Z [2024-04-25 17:44:00,578: INFO/ForkPoolWorker-16] [cc591698-3963-42c7-97ea-d33ea2442030] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:44:00.580412786Z [2024-04-25 17:44:00,580: INFO/ForkPoolWorker-1] [abbe32a8-995d-48d3-9c9c-72a2cfb1085d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:44:00.598308537Z [2024-04-25 17:44:00,597: INFO/ForkPoolWorker-15] [dcaff11f-7eaa-4aca-9311-fba687991be1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:44:00.926659780Z [2024-04-25 17:44:00,923: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:44:01.146705532Z [2024-04-25 17:44:01,143: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:44:01.242843031Z [2024-04-25 17:44:01,237: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:44:01.577730301Z [2024-04-25 17:44:01,577: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:44:02.517560370Z [2024-04-25 17:44:02,514: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dcaff11f-7eaa-4aca-9311-fba687991be1] succeeded in 1.9490032470000642s: None 2024-04-25T17:44:02.952796177Z [2024-04-25 17:44:02,952: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:44:02.956559640Z [2024-04-25 17:44:02,956: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:44:02.992600653Z [2024-04-25 17:44:02,992: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:44:02.994184256Z [2024-04-25 17:44:02,993: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:44:02.994355610Z [2024-04-25 17:44:02,994: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:44:02.994544910Z [2024-04-25 17:44:02,994: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:44:02.994635571Z [2024-04-25 17:44:02,994: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:44:02.994756937Z [2024-04-25 17:44:02,994: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:44:02.994854683Z [2024-04-25 17:44:02,994: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:44:03.045247787Z [2024-04-25 17:44:03,044: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:44:03.048386763Z [2024-04-25 17:44:03,047: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:44:03.080641872Z [2024-04-25 17:44:03,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:44:03.082067838Z [2024-04-25 17:44:03,081: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:44:03.082096049Z [2024-04-25 17:44:03,081: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:44:03.082221766Z [2024-04-25 17:44:03,082: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:44:03.082233283Z [2024-04-25 17:44:03,082: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:44:03.082463802Z [2024-04-25 17:44:03,082: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:44:03.082475078Z [2024-04-25 17:44:03,082: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:44:03.106275003Z [2024-04-25 17:44:03,105: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:44:03.177317790Z [2024-04-25 17:44:03,177: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:44:05.061997947Z [2024-04-25 17:44:05,061: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cc591698-3963-42c7-97ea-d33ea2442030] succeeded in 4.489381169999888s: None 2024-04-25T17:44:05.436326956Z [2024-04-25 17:44:05,435: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abbe32a8-995d-48d3-9c9c-72a2cfb1085d] succeeded in 4.863056058999973s: None 2024-04-25T17:45:00.685636476Z [2024-04-25 17:45:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d046fe16-efda-4c1a-9f1a-ee42e1a11509] received 2024-04-25T17:45:00.701819033Z [2024-04-25 17:45:00,701: INFO/ForkPoolWorker-15] [d046fe16-efda-4c1a-9f1a-ee42e1a11509] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:45:00.708262962Z [2024-04-25 17:45:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fa1bcbe-50dd-4c9a-a482-47b45c79a43c] received 2024-04-25T17:45:00.714910057Z [2024-04-25 17:45:00,714: INFO/ForkPoolWorker-16] [4fa1bcbe-50dd-4c9a-a482-47b45c79a43c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:45:00.715367481Z [2024-04-25 17:45:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d4e745e-9120-49dd-a978-eafd4d1e5b14] received 2024-04-25T17:45:00.732202587Z [2024-04-25 17:45:00,731: INFO/ForkPoolWorker-1] [1d4e745e-9120-49dd-a978-eafd4d1e5b14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-25T17:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:45:01.308297181Z [2024-04-25 17:45:01,305: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:45:01.348630370Z [2024-04-25 17:45:01,339: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:45:01.388955295Z [2024-04-25 17:45:01,385: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:45:03.322838846Z [2024-04-25 17:45:03,322: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:45:03.326302224Z [2024-04-25 17:45:03,325: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:45:03.420469187Z [2024-04-25 17:45:03,419: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:45:03.424500721Z [2024-04-25 17:45:03,421: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:45:03.424521135Z [2024-04-25 17:45:03,421: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:45:03.424525140Z [2024-04-25 17:45:03,421: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:45:03.424529285Z [2024-04-25 17:45:03,421: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:45:03.424543603Z [2024-04-25 17:45:03,421: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:45:03.424546669Z [2024-04-25 17:45:03,421: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:45:03.480029444Z [2024-04-25 17:45:03,479: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:45:03.487844623Z [2024-04-25 17:45:03,487: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:45:03.523577640Z [2024-04-25 17:45:03,523: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:45:03.529334742Z [2024-04-25 17:45:03,529: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:45:03.532985366Z [2024-04-25 17:45:03,532: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:45:03.532999091Z [2024-04-25 17:45:03,532: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:45:03.533104626Z [2024-04-25 17:45:03,532: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:45:03.533133911Z [2024-04-25 17:45:03,533: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:45:03.533397772Z [2024-04-25 17:45:03,533: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:45:03.533411070Z [2024-04-25 17:45:03,533: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:45:03.641510401Z [2024-04-25 17:45:03,641: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:45:03.644867553Z [2024-04-25 17:45:03,644: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:45:03.665458286Z [2024-04-25 17:45:03,665: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:45:03.693072154Z [2024-04-25 17:45:03,692: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:45:03.696065208Z [2024-04-25 17:45:03,695: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:45:03.696087595Z [2024-04-25 17:45:03,695: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:45:03.696586586Z [2024-04-25 17:45:03,696: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:45:03.696699329Z [2024-04-25 17:45:03,696: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:45:03.696959127Z [2024-04-25 17:45:03,696: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:45:03.696967855Z [2024-04-25 17:45:03,696: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:45:03.802463449Z [2024-04-25 17:45:03,802: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:45:04.526221426Z [2024-04-25 17:45:04,525: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d4e745e-9120-49dd-a978-eafd4d1e5b14] succeeded in 3.808404352000025s: None 2024-04-25T17:45:04.857889631Z [2024-04-25 17:45:04,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf719b48-b5d9-44bd-8ae4-dfe3781cb8f9] received 2024-04-25T17:45:04.880381854Z [2024-04-25 17:45:04,868: INFO/ForkPoolWorker-1] [cf719b48-b5d9-44bd-8ae4-dfe3781cb8f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'split_metrics', 'scheduled__2024-04-25T17:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:45:05.326870616Z [2024-04-25 17:45:05,326: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fa1bcbe-50dd-4c9a-a482-47b45c79a43c] succeeded in 4.616943185000082s: None 2024-04-25T17:45:05.392341874Z [2024-04-25 17:45:05,386: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:45:05.903196861Z [2024-04-25 17:45:05,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d046fe16-efda-4c1a-9f1a-ee42e1a11509] succeeded in 5.215209264000123s: None 2024-04-25T17:45:06.885624080Z [2024-04-25 17:45:06,880: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:45:06.888981611Z [2024-04-25 17:45:06,887: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:45:06.954668416Z [2024-04-25 17:45:06,954: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:45:06.960101455Z [2024-04-25 17:45:06,959: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:45:06.960723695Z [2024-04-25 17:45:06,960: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:45:06.960743131Z [2024-04-25 17:45:06,960: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:45:06.960771189Z [2024-04-25 17:45:06,960: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:45:06.961249316Z [2024-04-25 17:45:06,961: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:45:06.961391153Z [2024-04-25 17:45:06,961: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:45:07.074435033Z [2024-04-25 17:45:07,074: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:45:07.818666114Z [2024-04-25 17:45:07,818: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf719b48-b5d9-44bd-8ae4-dfe3781cb8f9] succeeded in 2.9654255250000006s: None 2024-04-25T17:45:08.155998241Z [2024-04-25 17:45:08,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c5e354f-be01-4d05-9317-c12902cc7b4f] received 2024-04-25T17:45:08.164158198Z [2024-04-25 17:45:08,163: INFO/ForkPoolWorker-15] [1c5e354f-be01-4d05-9317-c12902cc7b4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'collect_metrics', 'scheduled__2024-04-25T17:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-25T17:45:08.529479382Z [2024-04-25 17:45:08,526: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:45:09.823279240Z [2024-04-25 17:45:09,822: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:45:09.837188596Z [2024-04-25 17:45:09,832: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:45:09.885938921Z [2024-04-25 17:45:09,885: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:45:09.887303117Z [2024-04-25 17:45:09,887: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:45:09.887322523Z [2024-04-25 17:45:09,887: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:45:09.887525503Z [2024-04-25 17:45:09,887: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:45:09.887558519Z [2024-04-25 17:45:09,887: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:45:09.888612045Z [2024-04-25 17:45:09,888: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:45:09.888627174Z [2024-04-25 17:45:09,888: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:45:09.971505757Z [2024-04-25 17:45:09,971: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:45:10.509641319Z [2024-04-25 17:45:10,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[419ceedf-43d8-458f-a717-4ef790eb7e07] received 2024-04-25T17:45:10.517009048Z [2024-04-25 17:45:10,516: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c5e354f-be01-4d05-9317-c12902cc7b4f] succeeded in 2.358571177000158s: None 2024-04-25T17:45:10.518420068Z [2024-04-25 17:45:10,518: INFO/ForkPoolWorker-16] [419ceedf-43d8-458f-a717-4ef790eb7e07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'send_prometheus', 'scheduled__2024-04-25T17:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:45:10.861036169Z [2024-04-25 17:45:10,854: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:45:12.669214124Z [2024-04-25 17:45:12,664: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:45:12.669257909Z [2024-04-25 17:45:12,667: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:45:12.719791869Z [2024-04-25 17:45:12,719: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:45:12.721534303Z [2024-04-25 17:45:12,721: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:45:12.721658298Z [2024-04-25 17:45:12,721: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:45:12.721974842Z [2024-04-25 17:45:12,721: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:45:12.722108467Z [2024-04-25 17:45:12,721: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:45:12.722504669Z [2024-04-25 17:45:12,722: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:45:12.723128302Z [2024-04-25 17:45:12,722: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:45:12.826441173Z [2024-04-25 17:45:12,826: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:45:13.473904373Z [2024-04-25 17:45:13,473: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[419ceedf-43d8-458f-a717-4ef790eb7e07] succeeded in 2.9624115770000117s: None 2024-04-25T17:46:00.781065735Z [2024-04-25 17:46:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f70f4a49-1c67-415d-b570-d147b9301664] received 2024-04-25T17:46:00.792241970Z [2024-04-25 17:46:00,791: INFO/ForkPoolWorker-15] [f70f4a49-1c67-415d-b570-d147b9301664] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:46:00.801076546Z [2024-04-25 17:46:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[237db781-e3e4-4286-a185-78fd9823746a] received 2024-04-25T17:46:00.812935479Z [2024-04-25 17:46:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88e42881-86ba-49ce-aa30-575057c5a7b2] received 2024-04-25T17:46:00.819998582Z [2024-04-25 17:46:00,819: INFO/ForkPoolWorker-16] [237db781-e3e4-4286-a185-78fd9823746a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:46:00.830046617Z [2024-04-25 17:46:00,829: INFO/ForkPoolWorker-1] [88e42881-86ba-49ce-aa30-575057c5a7b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:46:01.415980753Z [2024-04-25 17:46:01,411: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:46:01.660189783Z [2024-04-25 17:46:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:46:01.806399412Z [2024-04-25 17:46:01,802: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:46:02.400522780Z [2024-04-25 17:46:02,400: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:46:03.989641217Z [2024-04-25 17:46:03,989: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f70f4a49-1c67-415d-b570-d147b9301664] succeeded in 3.206010173000095s: None 2024-04-25T17:46:04.233414004Z [2024-04-25 17:46:04,233: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:46:04.237757299Z [2024-04-25 17:46:04,237: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:46:04.287857401Z [2024-04-25 17:46:04,287: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:46:04.290532161Z [2024-04-25 17:46:04,290: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:46:04.290545305Z [2024-04-25 17:46:04,290: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:46:04.290782758Z [2024-04-25 17:46:04,290: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:46:04.290829063Z [2024-04-25 17:46:04,290: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:46:04.291192543Z [2024-04-25 17:46:04,291: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:46:04.291318655Z [2024-04-25 17:46:04,291: INFO/ForkPoolWorker-1] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:46:04.409363059Z [2024-04-25 17:46:04,408: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:46:04.416537659Z [2024-04-25 17:46:04,415: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:46:04.465613506Z [2024-04-25 17:46:04,465: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:46:04.514961526Z [2024-04-25 17:46:04,514: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:46:04.519398763Z [2024-04-25 17:46:04,519: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:46:04.521232210Z [2024-04-25 17:46:04,519: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:46:04.524560934Z [2024-04-25 17:46:04,521: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:46:04.524933896Z [2024-04-25 17:46:04,524: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:46:04.525301467Z [2024-04-25 17:46:04,525: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:46:04.525484959Z [2024-04-25 17:46:04,525: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:46:04.670284582Z [2024-04-25 17:46:04,670: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:46:06.472055275Z [2024-04-25 17:46:06,471: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88e42881-86ba-49ce-aa30-575057c5a7b2] succeeded in 5.655695368999886s: None 2024-04-25T17:46:06.801720905Z [2024-04-25 17:46:06,800: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[237db781-e3e4-4286-a185-78fd9823746a] succeeded in 5.998444066000047s: None 2024-04-25T17:47:00.869121511Z [2024-04-25 17:47:00,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c625ef1c-c364-4cf8-b76b-bb07ddd4fac6] received 2024-04-25T17:47:00.873605677Z [2024-04-25 17:47:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24c66558-0242-4780-a884-1f206229a15d] received 2024-04-25T17:47:00.876821317Z [2024-04-25 17:47:00,876: INFO/ForkPoolWorker-15] [c625ef1c-c364-4cf8-b76b-bb07ddd4fac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:47:00.890791233Z [2024-04-25 17:47:00,890: INFO/ForkPoolWorker-16] [24c66558-0242-4780-a884-1f206229a15d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:47:01.230982563Z [2024-04-25 17:47:01,227: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:47:01.413491044Z [2024-04-25 17:47:01,410: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:47:03.117968075Z [2024-04-25 17:47:03,117: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:47:03.123286244Z [2024-04-25 17:47:03,121: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:47:03.156813777Z [2024-04-25 17:47:03,156: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:47:03.159692101Z [2024-04-25 17:47:03,159: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:47:03.159704691Z [2024-04-25 17:47:03,159: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:47:03.159930784Z [2024-04-25 17:47:03,159: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:47:03.162135098Z [2024-04-25 17:47:03,159: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:47:03.162524355Z [2024-04-25 17:47:03,162: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:47:03.162657477Z [2024-04-25 17:47:03,162: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:47:03.243602504Z [2024-04-25 17:47:03,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:47:03.252826976Z [2024-04-25 17:47:03,252: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:47:03.260404697Z [2024-04-25 17:47:03,259: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:47:03.334504373Z [2024-04-25 17:47:03,334: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:47:03.335620676Z [2024-04-25 17:47:03,335: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:47:03.335658039Z [2024-04-25 17:47:03,335: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:47:03.335796991Z [2024-04-25 17:47:03,335: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:47:03.335844515Z [2024-04-25 17:47:03,335: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:47:03.336436263Z [2024-04-25 17:47:03,335: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:47:03.336453647Z [2024-04-25 17:47:03,336: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:47:03.447163275Z [2024-04-25 17:47:03,446: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:47:04.948987782Z [2024-04-25 17:47:04,948: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24c66558-0242-4780-a884-1f206229a15d] succeeded in 4.067269154000087s: None 2024-04-25T17:47:05.272572850Z [2024-04-25 17:47:05,272: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c625ef1c-c364-4cf8-b76b-bb07ddd4fac6] succeeded in 4.400532666000117s: None 2024-04-25T17:48:00.879203115Z [2024-04-25 17:48:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7cea73e-4118-4567-bf9e-1611c586b65a] received 2024-04-25T17:48:00.881431513Z [2024-04-25 17:48:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01e2557c-c339-4535-b0ec-5692206ae66c] received 2024-04-25T17:48:00.884395901Z [2024-04-25 17:48:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d692393e-cf07-4c01-b8bf-adebee863431] received 2024-04-25T17:48:00.888617574Z [2024-04-25 17:48:00,888: INFO/ForkPoolWorker-16] [01e2557c-c339-4535-b0ec-5692206ae66c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:48:00.909689717Z [2024-04-25 17:48:00,908: INFO/ForkPoolWorker-15] [e7cea73e-4118-4567-bf9e-1611c586b65a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:48:00.910917075Z [2024-04-25 17:48:00,910: INFO/ForkPoolWorker-1] [d692393e-cf07-4c01-b8bf-adebee863431] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:48:01.423348918Z [2024-04-25 17:48:01,419: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:48:01.486681441Z [2024-04-25 17:48:01,483: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:48:01.503829646Z [2024-04-25 17:48:01,499: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:48:02.219518739Z [2024-04-25 17:48:02,219: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:48:03.153959552Z [2024-04-25 17:48:03,153: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01e2557c-c339-4535-b0ec-5692206ae66c] succeeded in 2.2711013559999174s: None 2024-04-25T17:48:03.468327386Z [2024-04-25 17:48:03,467: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:48:03.471146322Z [2024-04-25 17:48:03,470: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:48:03.482447879Z [2024-04-25 17:48:03,482: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:48:03.493210820Z [2024-04-25 17:48:03,492: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:48:03.519548177Z [2024-04-25 17:48:03,519: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:48:03.520771369Z [2024-04-25 17:48:03,520: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:48:03.521142051Z [2024-04-25 17:48:03,520: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:48:03.521413288Z [2024-04-25 17:48:03,521: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:48:03.521663405Z [2024-04-25 17:48:03,521: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:48:03.522211198Z [2024-04-25 17:48:03,522: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:48:03.522673174Z [2024-04-25 17:48:03,522: INFO/ForkPoolWorker-1] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:48:03.534710370Z [2024-04-25 17:48:03,534: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:48:03.549565563Z [2024-04-25 17:48:03,549: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:48:03.549583821Z [2024-04-25 17:48:03,549: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:48:03.549790668Z [2024-04-25 17:48:03,549: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:48:03.549866114Z [2024-04-25 17:48:03,549: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:48:03.550129726Z [2024-04-25 17:48:03,549: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:48:03.550166348Z [2024-04-25 17:48:03,550: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:48:03.646841940Z [2024-04-25 17:48:03,646: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:48:03.690334906Z [2024-04-25 17:48:03,688: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:48:05.484125235Z [2024-04-25 17:48:05,483: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d692393e-cf07-4c01-b8bf-adebee863431] succeeded in 4.5970000059999165s: None 2024-04-25T17:48:05.881361710Z [2024-04-25 17:48:05,881: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7cea73e-4118-4567-bf9e-1611c586b65a] succeeded in 4.998625246000074s: None 2024-04-25T17:49:00.393292347Z [2024-04-25 17:49:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f879d77d-f920-413d-87f8-d40d2b9c8310] received 2024-04-25T17:49:00.399203562Z [2024-04-25 17:49:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[966ce6d8-c521-4a41-b015-b48eb71d0622] received 2024-04-25T17:49:00.408845595Z [2024-04-25 17:49:00,408: INFO/ForkPoolWorker-16] [966ce6d8-c521-4a41-b015-b48eb71d0622] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:49:00.414233183Z [2024-04-25 17:49:00,413: INFO/ForkPoolWorker-15] [f879d77d-f920-413d-87f8-d40d2b9c8310] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:49:00.795199516Z [2024-04-25 17:49:00,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:49:00.840763331Z [2024-04-25 17:49:00,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:49:02.309286120Z [2024-04-25 17:49:02,308: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:49:02.317243363Z [2024-04-25 17:49:02,316: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:49:02.389399858Z [2024-04-25 17:49:02,389: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:49:02.397639846Z [2024-04-25 17:49:02,396: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:49:02.397985672Z [2024-04-25 17:49:02,397: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:49:02.400554557Z [2024-04-25 17:49:02,397: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:49:02.401153616Z [2024-04-25 17:49:02,400: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:49:02.401510655Z [2024-04-25 17:49:02,401: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:49:02.408009637Z [2024-04-25 17:49:02,401: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:49:02.523157227Z [2024-04-25 17:49:02,522: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:49:02.529118872Z [2024-04-25 17:49:02,528: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:49:02.531730292Z [2024-04-25 17:49:02,531: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:49:02.558346281Z [2024-04-25 17:49:02,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:49:02.562273697Z [2024-04-25 17:49:02,562: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:49:02.562786115Z [2024-04-25 17:49:02,562: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:49:02.563042241Z [2024-04-25 17:49:02,562: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:49:02.563157339Z [2024-04-25 17:49:02,563: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:49:02.564980960Z [2024-04-25 17:49:02,564: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:49:02.565062465Z [2024-04-25 17:49:02,564: INFO/ForkPoolWorker-15] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:49:02.688805240Z [2024-04-25 17:49:02,688: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:49:04.570560655Z [2024-04-25 17:49:04,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f879d77d-f920-413d-87f8-d40d2b9c8310] succeeded in 4.167299301999947s: None 2024-04-25T17:49:04.790741953Z [2024-04-25 17:49:04,790: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[966ce6d8-c521-4a41-b015-b48eb71d0622] succeeded in 4.388527973999999s: None 2024-04-25T17:50:00.353859306Z [2024-04-25 17:50:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54191ab7-2669-45a5-9818-6c3f7e68baa7] received 2024-04-25T17:50:00.364537558Z [2024-04-25 17:50:00,364: INFO/ForkPoolWorker-15] [54191ab7-2669-45a5-9818-6c3f7e68baa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-25T17:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:50:00.370043055Z [2024-04-25 17:50:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a1316f6-5ad2-4c1d-9fc8-2fe5013a92ed] received 2024-04-25T17:50:00.371188091Z [2024-04-25 17:50:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d152b16-5d7b-4166-a3d9-61679878dc3a] received 2024-04-25T17:50:00.373713843Z [2024-04-25 17:50:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b448ca6c-605f-4143-8323-b38c9ec61431] received 2024-04-25T17:50:00.401073014Z [2024-04-25 17:50:00,400: INFO/ForkPoolWorker-16] [2a1316f6-5ad2-4c1d-9fc8-2fe5013a92ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:50:00.418570978Z [2024-04-25 17:50:00,418: INFO/ForkPoolWorker-1] [6d152b16-5d7b-4166-a3d9-61679878dc3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:50:00.462592310Z [2024-04-25 17:50:00,461: INFO/ForkPoolWorker-2] [b448ca6c-605f-4143-8323-b38c9ec61431] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:50:00.717172177Z [2024-04-25 17:50:00,713: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:50:00.762114332Z [2024-04-25 17:50:00,758: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:50:00.904395771Z [2024-04-25 17:50:00,900: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:50:01.136336104Z [2024-04-25 17:50:01,130: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:50:01.136351570Z [2024-04-25 17:50:01,136: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:50:01.998495259Z [2024-04-25 17:50:01,998: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2a1316f6-5ad2-4c1d-9fc8-2fe5013a92ed] succeeded in 1.625513686999966s: None 2024-04-25T17:50:02.959920156Z [2024-04-25 17:50:02,959: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:50:02.963816129Z [2024-04-25 17:50:02,963: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:50:02.997032998Z [2024-04-25 17:50:02,996: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:50:03.028382283Z [2024-04-25 17:50:03,016: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:50:03.028401658Z [2024-04-25 17:50:03,011: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:50:03.036252569Z [2024-04-25 17:50:03,035: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:50:03.036538925Z [2024-04-25 17:50:03,036: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:50:03.037007807Z [2024-04-25 17:50:03,036: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:50:03.037155635Z [2024-04-25 17:50:03,037: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:50:03.037530196Z [2024-04-25 17:50:03,037: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:50:03.037676962Z [2024-04-25 17:50:03,037: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:50:03.122772598Z [2024-04-25 17:50:03,122: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:50:03.125507719Z [2024-04-25 17:50:03,125: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:50:03.125625395Z [2024-04-25 17:50:03,125: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:50:03.125927662Z [2024-04-25 17:50:03,125: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:50:03.126017704Z [2024-04-25 17:50:03,125: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:50:03.130286274Z [2024-04-25 17:50:03,130: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:50:03.130597192Z [2024-04-25 17:50:03,130: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:50:03.231921271Z [2024-04-25 17:50:03,231: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:50:03.240981229Z [2024-04-25 17:50:03,240: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:50:03.310618378Z [2024-04-25 17:50:03,310: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-25T17:50:03.315509577Z [2024-04-25 17:50:03,315: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:50:03.437858291Z [2024-04-25 17:50:03,437: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-25T17:50:03.438895878Z [2024-04-25 17:50:03,438: INFO/ForkPoolWorker-2] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:50:03.438971460Z [2024-04-25 17:50:03,438: INFO/ForkPoolWorker-2] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:50:03.439176274Z [2024-04-25 17:50:03,438: INFO/ForkPoolWorker-2] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:50:03.439228205Z [2024-04-25 17:50:03,439: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-25T17:50:03.439489225Z [2024-04-25 17:50:03,439: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:50:03.439930586Z [2024-04-25 17:50:03,439: INFO/ForkPoolWorker-2] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:50:03.552966932Z [2024-04-25 17:50:03,552: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:50:04.051250519Z [2024-04-25 17:50:04,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df33cf01-0e8e-47e2-a460-ddba0797b6e8] received 2024-04-25T17:50:04.058944138Z [2024-04-25 17:50:04,058: INFO/ForkPoolWorker-16] [df33cf01-0e8e-47e2-a460-ddba0797b6e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'split_metrics', 'scheduled__2024-04-25T17:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:50:04.150578671Z [2024-04-25 17:50:04,150: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54191ab7-2669-45a5-9818-6c3f7e68baa7] succeeded in 3.794505674999982s: None 2024-04-25T17:50:04.496976753Z [2024-04-25 17:50:04,493: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:50:05.528883310Z [2024-04-25 17:50:05,528: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d152b16-5d7b-4166-a3d9-61679878dc3a] succeeded in 5.149845162999782s: None 2024-04-25T17:50:05.947516965Z [2024-04-25 17:50:05,947: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:50:05.950928547Z [2024-04-25 17:50:05,950: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:50:05.998135223Z [2024-04-25 17:50:05,997: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:50:06.007587282Z [2024-04-25 17:50:06,007: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:50:06.007602969Z [2024-04-25 17:50:06,007: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:50:06.008982301Z [2024-04-25 17:50:06,007: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:50:06.009227024Z [2024-04-25 17:50:06,008: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:50:06.009754471Z [2024-04-25 17:50:06,009: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:50:06.009808993Z [2024-04-25 17:50:06,009: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:50:06.106138039Z [2024-04-25 17:50:06,105: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:50:06.337529816Z [2024-04-25 17:50:06,337: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b448ca6c-605f-4143-8323-b38c9ec61431] succeeded in 5.958241674999954s: None 2024-04-25T17:50:06.833721335Z [2024-04-25 17:50:06,833: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df33cf01-0e8e-47e2-a460-ddba0797b6e8] succeeded in 2.7808201710001867s: None 2024-04-25T17:50:07.652843877Z [2024-04-25 17:50:07,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfd6d857-bfba-4ee8-a28d-2ccb87c2765b] received 2024-04-25T17:50:07.667631944Z [2024-04-25 17:50:07,667: INFO/ForkPoolWorker-15] [dfd6d857-bfba-4ee8-a28d-2ccb87c2765b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'collect_metrics', 'scheduled__2024-04-25T17:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-25T17:50:08.080872533Z [2024-04-25 17:50:08,076: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:50:09.720447100Z [2024-04-25 17:50:09,720: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:50:09.724095912Z [2024-04-25 17:50:09,723: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:50:09.771973276Z [2024-04-25 17:50:09,771: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:50:09.775688114Z [2024-04-25 17:50:09,775: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:50:09.776555737Z [2024-04-25 17:50:09,776: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:50:09.776822564Z [2024-04-25 17:50:09,776: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:50:09.777005545Z [2024-04-25 17:50:09,776: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:50:09.777344167Z [2024-04-25 17:50:09,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:50:09.778454295Z [2024-04-25 17:50:09,777: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:50:09.880284568Z [2024-04-25 17:50:09,880: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:50:10.435832443Z [2024-04-25 17:50:10,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfd6d857-bfba-4ee8-a28d-2ccb87c2765b] succeeded in 2.7795504900000196s: None 2024-04-25T17:50:10.617039379Z [2024-04-25 17:50:10,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a29225d-159f-4b3a-934d-5d635fdcac41] received 2024-04-25T17:50:10.627100138Z [2024-04-25 17:50:10,624: INFO/ForkPoolWorker-15] [9a29225d-159f-4b3a-934d-5d635fdcac41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'send_prometheus', 'scheduled__2024-04-25T17:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:50:11.157010493Z [2024-04-25 17:50:11,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:50:12.825712704Z [2024-04-25 17:50:12,825: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:50:12.830066144Z [2024-04-25 17:50:12,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:50:12.888422546Z [2024-04-25 17:50:12,888: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:50:12.891034981Z [2024-04-25 17:50:12,890: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:50:12.897180854Z [2024-04-25 17:50:12,890: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:50:12.897390453Z [2024-04-25 17:50:12,897: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:50:12.897466962Z [2024-04-25 17:50:12,897: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:50:12.897758653Z [2024-04-25 17:50:12,897: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:50:12.897776901Z [2024-04-25 17:50:12,897: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:50:13.062925996Z [2024-04-25 17:50:13,062: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:50:13.712170419Z [2024-04-25 17:50:13,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a29225d-159f-4b3a-934d-5d635fdcac41] succeeded in 3.092023073999826s: None 2024-04-25T17:51:00.238486770Z [2024-04-25 17:51:00,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cd08367-deea-427f-aa82-bcbd9344e1ad] received 2024-04-25T17:51:00.248519399Z [2024-04-25 17:51:00,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eaa3bc5-babe-4e13-a209-b7951e6ddb80] received 2024-04-25T17:51:00.255680443Z [2024-04-25 17:51:00,255: INFO/ForkPoolWorker-15] [4cd08367-deea-427f-aa82-bcbd9344e1ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:51:00.274538356Z [2024-04-25 17:51:00,274: INFO/ForkPoolWorker-16] [0eaa3bc5-babe-4e13-a209-b7951e6ddb80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:51:00.624746814Z [2024-04-25 17:51:00,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:51:00.707913806Z [2024-04-25 17:51:00,703: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:51:01.925072000Z [2024-04-25 17:51:01,924: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:51:01.936989933Z [2024-04-25 17:51:01,934: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:51:02.011922895Z [2024-04-25 17:51:02,011: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:51:02.014613875Z [2024-04-25 17:51:02,014: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:51:02.014630636Z [2024-04-25 17:51:02,014: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:51:02.014721178Z [2024-04-25 17:51:02,014: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:51:02.014732123Z [2024-04-25 17:51:02,014: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:51:02.015377228Z [2024-04-25 17:51:02,015: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:51:02.015422564Z [2024-04-25 17:51:02,015: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:51:02.185541194Z [2024-04-25 17:51:02,185: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:51:02.239244163Z [2024-04-25 17:51:02,238: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:51:02.244606652Z [2024-04-25 17:51:02,244: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:51:02.296892229Z [2024-04-25 17:51:02,294: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:51:02.300560453Z [2024-04-25 17:51:02,300: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:51:02.300699459Z [2024-04-25 17:51:02,300: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:51:02.300944205Z [2024-04-25 17:51:02,300: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:51:02.301103840Z [2024-04-25 17:51:02,300: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:51:02.301525910Z [2024-04-25 17:51:02,301: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:51:02.301761058Z [2024-04-25 17:51:02,301: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:51:02.417144583Z [2024-04-25 17:51:02,416: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:51:04.121955888Z [2024-04-25 17:51:04,121: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cd08367-deea-427f-aa82-bcbd9344e1ad] succeeded in 3.8760435070000767s: None 2024-04-25T17:51:04.328721711Z [2024-04-25 17:51:04,327: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0eaa3bc5-babe-4e13-a209-b7951e6ddb80] succeeded in 4.073503739999978s: None 2024-04-25T17:52:01.278390690Z [2024-04-25 17:52:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60508ccc-4cc5-43f9-b436-fba506b1d557] received 2024-04-25T17:52:01.284602505Z [2024-04-25 17:52:01,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0371cde-6a5f-43ce-a137-3be12cd8f803] received 2024-04-25T17:52:01.286059211Z [2024-04-25 17:52:01,285: INFO/ForkPoolWorker-15] [60508ccc-4cc5-43f9-b436-fba506b1d557] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:52:01.286338318Z [2024-04-25 17:52:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b14e595e-2929-41aa-97c0-6f71f7247436] received 2024-04-25T17:52:01.293619594Z [2024-04-25 17:52:01,293: INFO/ForkPoolWorker-1] [b14e595e-2929-41aa-97c0-6f71f7247436] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:52:01.310484054Z [2024-04-25 17:52:01,310: INFO/ForkPoolWorker-16] [f0371cde-6a5f-43ce-a137-3be12cd8f803] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:52:01.731888085Z [2024-04-25 17:52:01,727: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:52:01.786482355Z [2024-04-25 17:52:01,783: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:52:01.847838094Z [2024-04-25 17:52:01,844: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:52:02.095482136Z [2024-04-25 17:52:02,095: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:52:02.879066784Z [2024-04-25 17:52:02,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b14e595e-2929-41aa-97c0-6f71f7247436] succeeded in 1.5909195850001652s: None 2024-04-25T17:52:03.293256258Z [2024-04-25 17:52:03,292: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:52:03.293269696Z [2024-04-25 17:52:03,292: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:52:03.296794640Z [2024-04-25 17:52:03,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:52:03.297109151Z [2024-04-25 17:52:03,296: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:52:03.344028951Z [2024-04-25 17:52:03,343: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:52:03.345905313Z [2024-04-25 17:52:03,345: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:52:03.345938129Z [2024-04-25 17:52:03,345: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:52:03.346055118Z [2024-04-25 17:52:03,345: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:52:03.346089863Z [2024-04-25 17:52:03,346: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:52:03.346278533Z [2024-04-25 17:52:03,346: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:52:03.346313811Z [2024-04-25 17:52:03,346: INFO/ForkPoolWorker-15] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:52:03.355467657Z [2024-04-25 17:52:03,355: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:52:03.358846600Z [2024-04-25 17:52:03,358: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:52:03.358951782Z [2024-04-25 17:52:03,358: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:52:03.359835888Z [2024-04-25 17:52:03,358: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:52:03.359852704Z [2024-04-25 17:52:03,359: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:52:03.359856520Z [2024-04-25 17:52:03,359: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:52:03.359863032Z [2024-04-25 17:52:03,359: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:52:03.489113355Z [2024-04-25 17:52:03,488: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:52:03.516784715Z [2024-04-25 17:52:03,516: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:52:04.969801424Z [2024-04-25 17:52:04,969: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60508ccc-4cc5-43f9-b436-fba506b1d557] succeeded in 3.6887119670000175s: None 2024-04-25T17:52:05.270394552Z [2024-04-25 17:52:05,269: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0371cde-6a5f-43ce-a137-3be12cd8f803] succeeded in 3.983346264999909s: None 2024-04-25T17:53:00.165647920Z [2024-04-25 17:53:00,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d0eb2e4-de9b-4a51-92aa-7f89623b4c3a] received 2024-04-25T17:53:00.167836315Z [2024-04-25 17:53:00,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efdafe4c-8771-432d-805e-d3a647a14b88] received 2024-04-25T17:53:00.178044885Z [2024-04-25 17:53:00,177: INFO/ForkPoolWorker-15] [1d0eb2e4-de9b-4a51-92aa-7f89623b4c3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:53:00.182270568Z [2024-04-25 17:53:00,182: INFO/ForkPoolWorker-16] [efdafe4c-8771-432d-805e-d3a647a14b88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:53:00.491495480Z [2024-04-25 17:53:00,487: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:53:00.565417656Z [2024-04-25 17:53:00,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:53:02.213805178Z [2024-04-25 17:53:02,213: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:53:02.218536521Z [2024-04-25 17:53:02,218: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:53:02.232570166Z [2024-04-25 17:53:02,232: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:53:02.236478029Z [2024-04-25 17:53:02,235: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:53:02.281401315Z [2024-04-25 17:53:02,281: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:53:02.285576419Z [2024-04-25 17:53:02,285: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:53:02.286672660Z [2024-04-25 17:53:02,285: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:53:02.307270088Z [2024-04-25 17:53:02,286: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:53:02.307447459Z [2024-04-25 17:53:02,307: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:53:02.308553831Z [2024-04-25 17:53:02,308: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:53:02.308617072Z [2024-04-25 17:53:02,308: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:53:02.315687824Z [2024-04-25 17:53:02,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:53:02.319328305Z [2024-04-25 17:53:02,319: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:53:02.320178397Z [2024-04-25 17:53:02,319: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:53:02.322146124Z [2024-04-25 17:53:02,320: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:53:02.322373521Z [2024-04-25 17:53:02,322: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:53:02.322722062Z [2024-04-25 17:53:02,322: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:53:02.323250269Z [2024-04-25 17:53:02,323: INFO/ForkPoolWorker-15] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:53:02.419082041Z [2024-04-25 17:53:02,418: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:53:02.422407221Z [2024-04-25 17:53:02,422: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:53:04.413112433Z [2024-04-25 17:53:04,412: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d0eb2e4-de9b-4a51-92aa-7f89623b4c3a] succeeded in 4.240782969000065s: None 2024-04-25T17:53:04.699719833Z [2024-04-25 17:53:04,698: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efdafe4c-8771-432d-805e-d3a647a14b88] succeeded in 4.529377484999941s: None 2024-04-25T17:54:01.090993820Z [2024-04-25 17:54:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ace44df-49be-4ca3-8143-dd781252cb2e] received 2024-04-25T17:54:01.099489277Z [2024-04-25 17:54:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c778ba7c-8667-48cc-ab08-ff32a0f27744] received 2024-04-25T17:54:01.112533169Z [2024-04-25 17:54:01,112: INFO/ForkPoolWorker-15] [7ace44df-49be-4ca3-8143-dd781252cb2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:54:01.114632834Z [2024-04-25 17:54:01,114: INFO/ForkPoolWorker-16] [c778ba7c-8667-48cc-ab08-ff32a0f27744] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:54:01.121353415Z [2024-04-25 17:54:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e94006b-b701-4ef6-af20-c5225dbec709] received 2024-04-25T17:54:01.146564570Z [2024-04-25 17:54:01,143: INFO/ForkPoolWorker-1] [4e94006b-b701-4ef6-af20-c5225dbec709] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:54:01.541361232Z [2024-04-25 17:54:01,538: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:54:01.695366696Z [2024-04-25 17:54:01,691: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:54:01.820659871Z [2024-04-25 17:54:01,816: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:54:02.229022826Z [2024-04-25 17:54:02,228: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:54:03.063528096Z [2024-04-25 17:54:03,063: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e94006b-b701-4ef6-af20-c5225dbec709] succeeded in 1.9393369500000972s: None 2024-04-25T17:54:03.428344246Z [2024-04-25 17:54:03,427: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:54:03.437089608Z [2024-04-25 17:54:03,435: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:54:03.478676953Z [2024-04-25 17:54:03,478: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:54:03.480133246Z [2024-04-25 17:54:03,479: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:54:03.480364163Z [2024-04-25 17:54:03,480: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:54:03.480503171Z [2024-04-25 17:54:03,480: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:54:03.480734181Z [2024-04-25 17:54:03,480: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:54:03.482413206Z [2024-04-25 17:54:03,482: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:54:03.484088461Z [2024-04-25 17:54:03,483: INFO/ForkPoolWorker-15] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:54:03.577125850Z [2024-04-25 17:54:03,576: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:54:03.599815654Z [2024-04-25 17:54:03,599: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:54:03.603218658Z [2024-04-25 17:54:03,602: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:54:03.645225853Z [2024-04-25 17:54:03,644: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:54:03.647735897Z [2024-04-25 17:54:03,647: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:54:03.647754405Z [2024-04-25 17:54:03,647: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:54:03.649116879Z [2024-04-25 17:54:03,647: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:54:03.649157660Z [2024-04-25 17:54:03,647: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:54:03.649163858Z [2024-04-25 17:54:03,648: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:54:03.649169523Z [2024-04-25 17:54:03,648: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:54:03.757948100Z [2024-04-25 17:54:03,757: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:54:05.221832781Z [2024-04-25 17:54:05,220: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ace44df-49be-4ca3-8143-dd781252cb2e] succeeded in 4.127852763999954s: None 2024-04-25T17:54:05.603332143Z [2024-04-25 17:54:05,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c778ba7c-8667-48cc-ab08-ff32a0f27744] succeeded in 4.500408908999816s: None 2024-04-25T17:55:01.176645601Z [2024-04-25 17:55:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f233ac58-b392-4521-b0d7-c57ecbe2f78c] received 2024-04-25T17:55:01.179238843Z [2024-04-25 17:55:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[711cb1d5-0edf-4299-9951-ee00c56f2eed] received 2024-04-25T17:55:01.181513618Z [2024-04-25 17:55:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e956efeb-0674-4950-ac73-de6f7511a914] received 2024-04-25T17:55:01.185250351Z [2024-04-25 17:55:01,184: INFO/ForkPoolWorker-15] [f233ac58-b392-4521-b0d7-c57ecbe2f78c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:55:01.187997298Z [2024-04-25 17:55:01,187: INFO/ForkPoolWorker-16] [711cb1d5-0edf-4299-9951-ee00c56f2eed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-25T17:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:55:01.202938660Z [2024-04-25 17:55:01,202: INFO/ForkPoolWorker-1] [e956efeb-0674-4950-ac73-de6f7511a914] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:55:01.668425050Z [2024-04-25 17:55:01,662: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:55:01.750478929Z [2024-04-25 17:55:01,747: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:55:01.831094010Z [2024-04-25 17:55:01,815: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:55:03.710546390Z [2024-04-25 17:55:03,710: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:55:03.714744268Z [2024-04-25 17:55:03,714: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:55:03.751620623Z [2024-04-25 17:55:03,751: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:55:03.754091676Z [2024-04-25 17:55:03,752: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:55:03.754108818Z [2024-04-25 17:55:03,752: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:55:03.754113085Z [2024-04-25 17:55:03,753: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:55:03.754129334Z [2024-04-25 17:55:03,753: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:55:03.754132591Z [2024-04-25 17:55:03,753: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:55:03.754135586Z [2024-04-25 17:55:03,753: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:55:03.832114510Z [2024-04-25 17:55:03,831: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:55:03.838003650Z [2024-04-25 17:55:03,837: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:55:03.870014142Z [2024-04-25 17:55:03,869: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:55:03.896493641Z [2024-04-25 17:55:03,896: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:55:03.898137589Z [2024-04-25 17:55:03,897: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:55:03.901808743Z [2024-04-25 17:55:03,898: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:55:03.902212667Z [2024-04-25 17:55:03,901: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:55:03.902365194Z [2024-04-25 17:55:03,902: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:55:03.902949894Z [2024-04-25 17:55:03,902: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:55:03.903068087Z [2024-04-25 17:55:03,902: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:55:03.984831128Z [2024-04-25 17:55:03,984: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:55:04.222596819Z [2024-04-25 17:55:04,222: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:55:04.226111698Z [2024-04-25 17:55:04,225: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:55:04.281526130Z [2024-04-25 17:55:04,281: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:55:04.283436900Z [2024-04-25 17:55:04,283: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:55:04.283586381Z [2024-04-25 17:55:04,283: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:55:04.284615511Z [2024-04-25 17:55:04,283: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:55:04.286732109Z [2024-04-25 17:55:04,286: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:55:04.287050387Z [2024-04-25 17:55:04,286: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:55:04.287199346Z [2024-04-25 17:55:04,287: INFO/ForkPoolWorker-1] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:55:04.425228539Z [2024-04-25 17:55:04,424: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:55:04.677379516Z [2024-04-25 17:55:04,676: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[711cb1d5-0edf-4299-9951-ee00c56f2eed] succeeded in 3.494419146999917s: None 2024-04-25T17:55:05.268184048Z [2024-04-25 17:55:05,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e561e47d-7a7f-4b16-8155-1b29e5fd0cdc] received 2024-04-25T17:55:05.275255268Z [2024-04-25 17:55:05,275: INFO/ForkPoolWorker-16] [e561e47d-7a7f-4b16-8155-1b29e5fd0cdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'split_metrics', 'scheduled__2024-04-25T17:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:55:05.624558758Z [2024-04-25 17:55:05,621: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:55:06.036764054Z [2024-04-25 17:55:06,036: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f233ac58-b392-4521-b0d7-c57ecbe2f78c] succeeded in 4.856468197999902s: None 2024-04-25T17:55:06.042479222Z [2024-04-25 17:55:06,042: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e956efeb-0674-4950-ac73-de6f7511a914] succeeded in 4.8483599310000045s: None 2024-04-25T17:55:06.904278512Z [2024-04-25 17:55:06,902: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:55:06.906858962Z [2024-04-25 17:55:06,906: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:55:06.945182626Z [2024-04-25 17:55:06,944: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:55:06.946697714Z [2024-04-25 17:55:06,946: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:55:06.947075505Z [2024-04-25 17:55:06,946: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:55:06.947333458Z [2024-04-25 17:55:06,947: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:55:06.947521643Z [2024-04-25 17:55:06,947: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:55:06.947825041Z [2024-04-25 17:55:06,947: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:55:06.948471113Z [2024-04-25 17:55:06,948: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:55:07.070040135Z [2024-04-25 17:55:07,069: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:55:07.753181227Z [2024-04-25 17:55:07,752: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e561e47d-7a7f-4b16-8155-1b29e5fd0cdc] succeeded in 2.4833933039999465s: None 2024-04-25T17:55:08.165306249Z [2024-04-25 17:55:08,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6f93e25-0765-499b-97fc-6de3b2c09626] received 2024-04-25T17:55:08.178348383Z [2024-04-25 17:55:08,178: INFO/ForkPoolWorker-15] [d6f93e25-0765-499b-97fc-6de3b2c09626] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'collect_metrics', 'scheduled__2024-04-25T17:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-25T17:55:08.553506534Z [2024-04-25 17:55:08,550: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:55:09.846618647Z [2024-04-25 17:55:09,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:55:09.850944074Z [2024-04-25 17:55:09,850: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:55:09.896665792Z [2024-04-25 17:55:09,896: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:55:09.898162289Z [2024-04-25 17:55:09,897: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:55:09.898432339Z [2024-04-25 17:55:09,898: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:55:09.899173485Z [2024-04-25 17:55:09,898: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:55:09.899187228Z [2024-04-25 17:55:09,898: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:55:09.899191853Z [2024-04-25 17:55:09,898: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:55:09.899195173Z [2024-04-25 17:55:09,898: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:55:09.998243610Z [2024-04-25 17:55:09,998: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:55:11.502725278Z [2024-04-25 17:55:11,502: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d6f93e25-0765-499b-97fc-6de3b2c09626] succeeded in 3.3319234819998655s: None 2024-04-25T17:55:11.784781175Z [2024-04-25 17:55:11,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[beadf473-9dc3-40ab-b034-68fb109c1e78] received 2024-04-25T17:55:11.827828065Z [2024-04-25 17:55:11,827: INFO/ForkPoolWorker-15] [beadf473-9dc3-40ab-b034-68fb109c1e78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'send_prometheus', 'scheduled__2024-04-25T17:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T17:55:12.255554141Z [2024-04-25 17:55:12,252: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T17:55:13.679023963Z [2024-04-25 17:55:13,678: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:55:13.682565662Z [2024-04-25 17:55:13,682: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:55:13.757388762Z [2024-04-25 17:55:13,752: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:55:13.757412744Z [2024-04-25 17:55:13,753: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:55:13.757417146Z [2024-04-25 17:55:13,754: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:55:13.757421137Z [2024-04-25 17:55:13,754: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:55:13.757425313Z [2024-04-25 17:55:13,754: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:55:13.757428352Z [2024-04-25 17:55:13,754: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T17:55:13.757431254Z [2024-04-25 17:55:13,754: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:55:13.864439870Z [2024-04-25 17:55:13,864: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:55:14.435958576Z [2024-04-25 17:55:14,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[beadf473-9dc3-40ab-b034-68fb109c1e78] succeeded in 2.6488899000000856s: None 2024-04-25T17:56:01.235710760Z [2024-04-25 17:56:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79be8696-650d-41db-aec1-7251b3fa3ab7] received 2024-04-25T17:56:01.238128165Z [2024-04-25 17:56:01,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79758e51-5379-4ffb-85ff-9ba135852fad] received 2024-04-25T17:56:01.244057183Z [2024-04-25 17:56:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d69ddf4b-5d08-4042-81b5-eb4cc643c20a] received 2024-04-25T17:56:01.257294273Z [2024-04-25 17:56:01,256: INFO/ForkPoolWorker-15] [79be8696-650d-41db-aec1-7251b3fa3ab7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:56:01.262835581Z [2024-04-25 17:56:01,262: INFO/ForkPoolWorker-16] [79758e51-5379-4ffb-85ff-9ba135852fad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:56:01.262856036Z [2024-04-25 17:56:01,262: INFO/ForkPoolWorker-1] [d69ddf4b-5d08-4042-81b5-eb4cc643c20a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:56:01.681360664Z [2024-04-25 17:56:01,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:56:01.720817451Z [2024-04-25 17:56:01,713: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:56:01.903859055Z [2024-04-25 17:56:01,900: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:56:02.286639034Z [2024-04-25 17:56:02,286: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:56:03.015289731Z [2024-04-25 17:56:03,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79be8696-650d-41db-aec1-7251b3fa3ab7] succeeded in 1.773676943000055s: None 2024-04-25T17:56:03.469268296Z [2024-04-25 17:56:03,468: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:56:03.473167041Z [2024-04-25 17:56:03,472: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:56:03.511302011Z [2024-04-25 17:56:03,511: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:56:03.513163917Z [2024-04-25 17:56:03,512: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:56:03.513341190Z [2024-04-25 17:56:03,513: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:56:03.513502863Z [2024-04-25 17:56:03,513: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:56:03.513600011Z [2024-04-25 17:56:03,513: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:56:03.513872305Z [2024-04-25 17:56:03,513: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:56:03.513967026Z [2024-04-25 17:56:03,513: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:56:03.575821324Z [2024-04-25 17:56:03,575: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:56:03.579555290Z [2024-04-25 17:56:03,579: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:56:03.658489209Z [2024-04-25 17:56:03,658: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:56:03.662464601Z [2024-04-25 17:56:03,661: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:56:03.678337951Z [2024-04-25 17:56:03,664: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:56:03.678355722Z [2024-04-25 17:56:03,664: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:56:03.678360016Z [2024-04-25 17:56:03,664: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:56:03.678364129Z [2024-04-25 17:56:03,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:56:03.678367675Z [2024-04-25 17:56:03,665: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:56:03.678370999Z [2024-04-25 17:56:03,665: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:56:03.794788639Z [2024-04-25 17:56:03,794: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:56:05.275362658Z [2024-04-25 17:56:05,274: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[79758e51-5379-4ffb-85ff-9ba135852fad] succeeded in 4.034766312999864s: None 2024-04-25T17:56:05.649940828Z [2024-04-25 17:56:05,649: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d69ddf4b-5d08-4042-81b5-eb4cc643c20a] succeeded in 4.403568527000061s: None 2024-04-25T17:57:01.046617259Z [2024-04-25 17:57:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f662a5ea-2e1f-4cee-8512-6d5037f33842] received 2024-04-25T17:57:01.050938732Z [2024-04-25 17:57:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[689fa028-50c3-4fc1-97ee-02db19c460c3] received 2024-04-25T17:57:01.072328092Z [2024-04-25 17:57:01,071: INFO/ForkPoolWorker-16] [689fa028-50c3-4fc1-97ee-02db19c460c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:57:01.093874926Z [2024-04-25 17:57:01,093: INFO/ForkPoolWorker-15] [f662a5ea-2e1f-4cee-8512-6d5037f33842] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:57:01.506971722Z [2024-04-25 17:57:01,502: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:57:01.568848463Z [2024-04-25 17:57:01,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:57:03.036930932Z [2024-04-25 17:57:03,036: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:57:03.040555806Z [2024-04-25 17:57:03,040: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:57:03.065944768Z [2024-04-25 17:57:03,063: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:57:03.071004398Z [2024-04-25 17:57:03,070: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:57:03.073679138Z [2024-04-25 17:57:03,073: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:57:03.074149964Z [2024-04-25 17:57:03,073: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:57:03.074403257Z [2024-04-25 17:57:03,074: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:57:03.074559232Z [2024-04-25 17:57:03,074: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:57:03.074954481Z [2024-04-25 17:57:03,074: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:57:03.075098403Z [2024-04-25 17:57:03,074: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:57:03.075824320Z [2024-04-25 17:57:03,074: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:57:03.111789314Z [2024-04-25 17:57:03,111: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:57:03.113641209Z [2024-04-25 17:57:03,113: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:57:03.113670300Z [2024-04-25 17:57:03,113: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:57:03.113794211Z [2024-04-25 17:57:03,113: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:57:03.113825237Z [2024-04-25 17:57:03,113: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:57:03.114027351Z [2024-04-25 17:57:03,113: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:57:03.114087799Z [2024-04-25 17:57:03,114: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:57:03.165634370Z [2024-04-25 17:57:03,165: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:57:03.209842415Z [2024-04-25 17:57:03,209: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:57:04.886951729Z [2024-04-25 17:57:04,885: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[689fa028-50c3-4fc1-97ee-02db19c460c3] succeeded in 3.8277279820001695s: None 2024-04-25T17:57:05.431095444Z [2024-04-25 17:57:05,430: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f662a5ea-2e1f-4cee-8512-6d5037f33842] succeeded in 4.371944777999943s: None 2024-04-25T17:58:00.819456691Z [2024-04-25 17:58:00,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdff51a1-5b5b-4a1f-9612-463ccb86ca89] received 2024-04-25T17:58:00.825040745Z [2024-04-25 17:58:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3574e64c-97e0-4f71-9126-6e8d8311d890] received 2024-04-25T17:58:00.833815625Z [2024-04-25 17:58:00,833: INFO/ForkPoolWorker-15] [cdff51a1-5b5b-4a1f-9612-463ccb86ca89] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T17:58:00.838893331Z [2024-04-25 17:58:00,838: INFO/ForkPoolWorker-16] [3574e64c-97e0-4f71-9126-6e8d8311d890] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:58:00.848725297Z [2024-04-25 17:58:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ba8394f-4df9-4a0c-910f-2ff8faea9ca6] received 2024-04-25T17:58:00.870657436Z [2024-04-25 17:58:00,870: INFO/ForkPoolWorker-1] [8ba8394f-4df9-4a0c-910f-2ff8faea9ca6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:58:01.343272621Z [2024-04-25 17:58:01,339: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:58:01.417596128Z [2024-04-25 17:58:01,413: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:58:01.422876455Z [2024-04-25 17:58:01,419: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T17:58:01.855086899Z [2024-04-25 17:58:01,854: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:58:02.586657958Z [2024-04-25 17:58:02,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cdff51a1-5b5b-4a1f-9612-463ccb86ca89] succeeded in 1.759728917000075s: None 2024-04-25T17:58:03.134209218Z [2024-04-25 17:58:03,133: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:58:03.138858909Z [2024-04-25 17:58:03,138: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:58:03.175936214Z [2024-04-25 17:58:03,175: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:58:03.181315418Z [2024-04-25 17:58:03,180: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:58:03.181525351Z [2024-04-25 17:58:03,181: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:58:03.181851406Z [2024-04-25 17:58:03,181: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:58:03.181896682Z [2024-04-25 17:58:03,181: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:58:03.182673123Z [2024-04-25 17:58:03,182: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:58:03.182832145Z [2024-04-25 17:58:03,182: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:58:03.186449649Z [2024-04-25 17:58:03,186: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T17:58:03.189622721Z [2024-04-25 17:58:03,189: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:58:03.214604596Z [2024-04-25 17:58:03,214: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T17:58:03.215678394Z [2024-04-25 17:58:03,215: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:58:03.215689973Z [2024-04-25 17:58:03,215: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:58:03.215842268Z [2024-04-25 17:58:03,215: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:58:03.215853853Z [2024-04-25 17:58:03,215: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T17:58:03.216079237Z [2024-04-25 17:58:03,215: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:58:03.216096493Z [2024-04-25 17:58:03,216: INFO/ForkPoolWorker-1] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:58:03.266021208Z [2024-04-25 17:58:03,265: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:58:03.297497319Z [2024-04-25 17:58:03,297: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:58:05.035753951Z [2024-04-25 17:58:05,035: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ba8394f-4df9-4a0c-910f-2ff8faea9ca6] succeeded in 4.185362065999925s: None 2024-04-25T17:58:05.253750321Z [2024-04-25 17:58:05,253: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3574e64c-97e0-4f71-9126-6e8d8311d890] succeeded in 4.426577447999989s: None 2024-04-25T17:59:01.105371050Z [2024-04-25 17:59:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f2e0ee6-0bc0-4e1a-8a37-7cdf9a2a3d90] received 2024-04-25T17:59:01.109880646Z [2024-04-25 17:59:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53439a98-af27-4cc0-8a63-3d29ee85006c] received 2024-04-25T17:59:01.126504765Z [2024-04-25 17:59:01,126: INFO/ForkPoolWorker-15] [7f2e0ee6-0bc0-4e1a-8a37-7cdf9a2a3d90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T17:59:01.127071031Z [2024-04-25 17:59:01,126: INFO/ForkPoolWorker-16] [53439a98-af27-4cc0-8a63-3d29ee85006c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T17:59:01.529804535Z [2024-04-25 17:59:01,526: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T17:59:01.530430658Z [2024-04-25 17:59:01,527: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T17:59:02.951543197Z [2024-04-25 17:59:02,951: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T17:59:02.973381238Z [2024-04-25 17:59:02,972: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T17:59:02.979921448Z [2024-04-25 17:59:02,979: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:59:02.980018168Z [2024-04-25 17:59:02,979: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T17:59:03.003570086Z [2024-04-25 17:59:03,003: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T17:59:03.005078862Z [2024-04-25 17:59:03,004: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:59:03.005244663Z [2024-04-25 17:59:03,005: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:59:03.005494090Z [2024-04-25 17:59:03,005: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:59:03.005664511Z [2024-04-25 17:59:03,005: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T17:59:03.006749753Z [2024-04-25 17:59:03,006: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T17:59:03.007034687Z [2024-04-25 17:59:03,006: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:59:03.024490075Z [2024-04-25 17:59:03,024: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T17:59:03.026377541Z [2024-04-25 17:59:03,026: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T17:59:03.026392883Z [2024-04-25 17:59:03,026: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T17:59:03.026534212Z [2024-04-25 17:59:03,026: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T17:59:03.026567259Z [2024-04-25 17:59:03,026: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T17:59:03.026961601Z [2024-04-25 17:59:03,026: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T17:59:03.027038049Z [2024-04-25 17:59:03,026: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T17:59:03.113259766Z [2024-04-25 17:59:03,112: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:59:03.163901639Z [2024-04-25 17:59:03,163: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T17:59:04.905486988Z [2024-04-25 17:59:04,905: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53439a98-af27-4cc0-8a63-3d29ee85006c] succeeded in 3.793216290999908s: None 2024-04-25T17:59:05.479041823Z [2024-04-25 17:59:05,478: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f2e0ee6-0bc0-4e1a-8a37-7cdf9a2a3d90] succeeded in 4.369325151000112s: None 2024-04-25T18:00:00.599284458Z [2024-04-25 18:00:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a125bed1-509c-4ee9-a9ee-27e769d0e1bc] received 2024-04-25T18:00:00.600831089Z [2024-04-25 18:00:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fdb0555-34a3-40f6-9a31-92cd15080158] received 2024-04-25T18:00:00.607362625Z [2024-04-25 18:00:00,607: INFO/ForkPoolWorker-15] [a125bed1-509c-4ee9-a9ee-27e769d0e1bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-25T17:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T18:00:00.615144203Z [2024-04-25 18:00:00,614: INFO/ForkPoolWorker-16] [9fdb0555-34a3-40f6-9a31-92cd15080158] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T17:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T18:00:00.618093563Z [2024-04-25 18:00:00,617: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6db0bae0-62f1-422b-a7e1-6661e555a091] received 2024-04-25T18:00:00.637282268Z [2024-04-25 18:00:00,636: INFO/ForkPoolWorker-1] [6db0bae0-62f1-422b-a7e1-6661e555a091] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T18:00:00.656839979Z [2024-04-25 18:00:00,656: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ed86b04-2313-4540-b5b3-ad8e5ffadebd] received 2024-04-25T18:00:00.672914228Z [2024-04-25 18:00:00,672: INFO/ForkPoolWorker-2] [2ed86b04-2313-4540-b5b3-ad8e5ffadebd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T17:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T18:00:01.212338893Z [2024-04-25 18:00:01,207: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T18:00:01.248991047Z [2024-04-25 18:00:01,245: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T18:00:01.471981791Z [2024-04-25 18:00:01,467: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T18:00:01.559371018Z [2024-04-25 18:00:01,551: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T18:00:01.995042353Z [2024-04-25 18:00:01,994: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:00:03.039041633Z [2024-04-25 18:00:03,038: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9fdb0555-34a3-40f6-9a31-92cd15080158] succeeded in 2.431084779999992s: None 2024-04-25T18:00:03.052910609Z [2024-04-25 18:00:03,052: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:00:03.059247243Z [2024-04-25 18:00:03,055: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:00:03.142141938Z [2024-04-25 18:00:03,141: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:00:03.149039828Z [2024-04-25 18:00:03,148: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:00:03.149312225Z [2024-04-25 18:00:03,149: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:00:03.149562246Z [2024-04-25 18:00:03,149: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:00:03.149735419Z [2024-04-25 18:00:03,149: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:00:03.150097102Z [2024-04-25 18:00:03,149: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T18:00:03.150388687Z [2024-04-25 18:00:03,150: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:00:03.263746056Z [2024-04-25 18:00:03,263: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:00:03.452960873Z [2024-04-25 18:00:03,452: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-25T18:00:03.456856385Z [2024-04-25 18:00:03,456: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:00:03.499857778Z [2024-04-25 18:00:03,499: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-25T18:00:03.504446715Z [2024-04-25 18:00:03,504: INFO/ForkPoolWorker-2] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:00:03.504487450Z [2024-04-25 18:00:03,504: INFO/ForkPoolWorker-2] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:00:03.528143847Z [2024-04-25 18:00:03,504: INFO/ForkPoolWorker-2] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:00:03.528362038Z [2024-04-25 18:00:03,528: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-25T18:00:03.528785159Z [2024-04-25 18:00:03,528: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-25T18:00:03.529513464Z [2024-04-25 18:00:03,528: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:00:03.599935844Z [2024-04-25 18:00:03,599: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T18:00:03.603339059Z [2024-04-25 18:00:03,602: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:00:03.659078699Z [2024-04-25 18:00:03,658: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:00:03.672175473Z [2024-04-25 18:00:03,670: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T18:00:03.678002624Z [2024-04-25 18:00:03,677: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:00:03.678091747Z [2024-04-25 18:00:03,677: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:00:03.678311294Z [2024-04-25 18:00:03,677: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:00:03.678423514Z [2024-04-25 18:00:03,678: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T18:00:03.678662192Z [2024-04-25 18:00:03,678: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T18:00:03.678673251Z [2024-04-25 18:00:03,678: INFO/ForkPoolWorker-1] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:00:03.766906596Z [2024-04-25 18:00:03,766: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:00:04.127782304Z [2024-04-25 18:00:04,127: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a125bed1-509c-4ee9-a9ee-27e769d0e1bc] succeeded in 3.5257211410000764s: None 2024-04-25T18:00:04.239469271Z [2024-04-25 18:00:04,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4759dfe2-69b2-4189-bb0f-c8cd31c62193] received 2024-04-25T18:00:04.249086091Z [2024-04-25 18:00:04,248: INFO/ForkPoolWorker-15] [4759dfe2-69b2-4189-bb0f-c8cd31c62193] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'split_metrics', 'scheduled__2024-04-25T17:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T18:00:04.583383367Z [2024-04-25 18:00:04,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T18:00:05.332144711Z [2024-04-25 18:00:05,331: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6db0bae0-62f1-422b-a7e1-6661e555a091] succeeded in 4.707818922999877s: None 2024-04-25T18:00:05.649499596Z [2024-04-25 18:00:05,648: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2ed86b04-2313-4540-b5b3-ad8e5ffadebd] succeeded in 4.990174846999935s: None 2024-04-25T18:00:06.091893439Z [2024-04-25 18:00:06,091: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:00:06.101798477Z [2024-04-25 18:00:06,101: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:00:06.146446636Z [2024-04-25 18:00:06,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:00:06.147918467Z [2024-04-25 18:00:06,147: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:00:06.148148520Z [2024-04-25 18:00:06,147: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:00:06.148588257Z [2024-04-25 18:00:06,148: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:00:06.148819233Z [2024-04-25 18:00:06,148: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:00:06.149476922Z [2024-04-25 18:00:06,149: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T18:00:06.149956301Z [2024-04-25 18:00:06,149: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:00:06.241215526Z [2024-04-25 18:00:06,240: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:00:06.927581768Z [2024-04-25 18:00:06,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4759dfe2-69b2-4189-bb0f-c8cd31c62193] succeeded in 2.685489413000141s: None 2024-04-25T18:00:07.754581902Z [2024-04-25 18:00:07,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a35c39f5-e2b8-4573-b8ca-0a13e6d03dcb] received 2024-04-25T18:00:07.777169697Z [2024-04-25 18:00:07,776: INFO/ForkPoolWorker-15] [a35c39f5-e2b8-4573-b8ca-0a13e6d03dcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'collect_metrics', 'scheduled__2024-04-25T17:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-25T18:00:08.196078409Z [2024-04-25 18:00:08,192: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T18:00:09.656794683Z [2024-04-25 18:00:09,655: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:00:09.662491852Z [2024-04-25 18:00:09,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:00:09.702896370Z [2024-04-25 18:00:09,702: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:00:09.709041623Z [2024-04-25 18:00:09,708: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:00:09.709325317Z [2024-04-25 18:00:09,709: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:00:09.709553426Z [2024-04-25 18:00:09,709: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:00:09.709701798Z [2024-04-25 18:00:09,709: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:00:09.710077018Z [2024-04-25 18:00:09,709: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T18:00:09.710228974Z [2024-04-25 18:00:09,710: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:00:09.814824158Z [2024-04-25 18:00:09,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:00:11.446668578Z [2024-04-25 18:00:11,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a35c39f5-e2b8-4573-b8ca-0a13e6d03dcb] succeeded in 3.6793466680001075s: None 2024-04-25T18:00:11.604310493Z [2024-04-25 18:00:11,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d44368b-e721-4245-9c02-29c685825c54] received 2024-04-25T18:00:11.612945724Z [2024-04-25 18:00:11,612: INFO/ForkPoolWorker-15] [4d44368b-e721-4245-9c02-29c685825c54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'send_prometheus', 'scheduled__2024-04-25T17:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T18:00:12.002431597Z [2024-04-25 18:00:11,997: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T18:00:13.514086841Z [2024-04-25 18:00:13,513: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:00:13.518021855Z [2024-04-25 18:00:13,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:00:13.549589747Z [2024-04-25 18:00:13,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:00:13.551377817Z [2024-04-25 18:00:13,551: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:00:13.551698453Z [2024-04-25 18:00:13,551: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:00:13.553039323Z [2024-04-25 18:00:13,551: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:00:13.553394200Z [2024-04-25 18:00:13,553: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:00:13.554283994Z [2024-04-25 18:00:13,553: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T18:00:13.554595599Z [2024-04-25 18:00:13,554: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:00:13.652845709Z [2024-04-25 18:00:13,652: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:00:14.281521530Z [2024-04-25 18:00:14,281: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d44368b-e721-4245-9c02-29c685825c54] succeeded in 2.6751911590001782s: None 2024-04-25T18:01:01.049708873Z [2024-04-25 18:01:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55b7fdae-f53a-4e1a-af87-6ffc481b87ba] received 2024-04-25T18:01:01.058454510Z [2024-04-25 18:01:01,058: INFO/ForkPoolWorker-15] [55b7fdae-f53a-4e1a-af87-6ffc481b87ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T18:01:01.067550656Z [2024-04-25 18:01:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85e9b258-1583-4b68-9d9b-5581e214d939] received 2024-04-25T18:01:01.090368429Z [2024-04-25 18:01:01,084: INFO/ForkPoolWorker-16] [85e9b258-1583-4b68-9d9b-5581e214d939] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T18:01:01.583784048Z [2024-04-25 18:01:01,580: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T18:01:01.640719655Z [2024-04-25 18:01:01,636: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T18:01:03.210246055Z [2024-04-25 18:01:03,209: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:01:03.214052839Z [2024-04-25 18:01:03,213: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:01:03.233988847Z [2024-04-25 18:01:03,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:01:03.239345035Z [2024-04-25 18:01:03,239: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:01:03.239579472Z [2024-04-25 18:01:03,239: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:01:03.245996093Z [2024-04-25 18:01:03,244: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:01:03.246083442Z [2024-04-25 18:01:03,245: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:01:03.247056453Z [2024-04-25 18:01:03,246: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T18:01:03.247338956Z [2024-04-25 18:01:03,247: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:01:03.328331031Z [2024-04-25 18:01:03,327: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T18:01:03.334155694Z [2024-04-25 18:01:03,333: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:01:03.362597416Z [2024-04-25 18:01:03,359: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:01:03.451583809Z [2024-04-25 18:01:03,451: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T18:01:03.454204297Z [2024-04-25 18:01:03,453: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:01:03.454274998Z [2024-04-25 18:01:03,454: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:01:03.454482801Z [2024-04-25 18:01:03,454: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:01:03.454603806Z [2024-04-25 18:01:03,454: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T18:01:03.454948564Z [2024-04-25 18:01:03,454: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T18:01:03.455011055Z [2024-04-25 18:01:03,454: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:01:03.577721415Z [2024-04-25 18:01:03,577: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:01:05.349687556Z [2024-04-25 18:01:05,348: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85e9b258-1583-4b68-9d9b-5581e214d939] succeeded in 4.279923356999916s: None 2024-04-25T18:01:05.627946689Z [2024-04-25 18:01:05,627: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55b7fdae-f53a-4e1a-af87-6ffc481b87ba] succeeded in 4.576437307000106s: None 2024-04-25T18:01:38.551546225Z [2024-04-25 18:01:38,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef70de17-116b-4535-a3bb-ddfecd98d4a2] received 2024-04-25T18:01:38.580549546Z [2024-04-25 18:01:38,580: INFO/ForkPoolWorker-15] [ef70de17-116b-4535-a3bb-ddfecd98d4a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240425180136_449451', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-25T18:01:38.888753548Z [2024-04-25 18:01:38,885: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-25T18:01:39.213803975Z [2024-04-25 18:01:39,213: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:01:39.823102322Z [2024-04-25 18:01:39,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef70de17-116b-4535-a3bb-ddfecd98d4a2] succeeded in 1.2691418099998373s: None 2024-04-25T18:02:00.926892949Z [2024-04-25 18:02:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a8b4d93-6b24-4844-b957-2b627ec9d7db] received 2024-04-25T18:02:00.934712060Z [2024-04-25 18:02:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e5b76e4-b215-4608-9ea9-66655b916d30] received 2024-04-25T18:02:00.939584001Z [2024-04-25 18:02:00,939: INFO/ForkPoolWorker-15] [4a8b4d93-6b24-4844-b957-2b627ec9d7db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T18:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T18:02:00.949605401Z [2024-04-25 18:02:00,949: INFO/ForkPoolWorker-16] [9e5b76e4-b215-4608-9ea9-66655b916d30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T18:02:00.950138784Z [2024-04-25 18:02:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25bb4e48-722d-4656-95cf-5e32067c354f] received 2024-04-25T18:02:00.987780509Z [2024-04-25 18:02:00,987: INFO/ForkPoolWorker-1] [25bb4e48-722d-4656-95cf-5e32067c354f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T18:02:01.355934332Z [2024-04-25 18:02:01,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T18:02:01.788775807Z [2024-04-25 18:02:01,785: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T18:02:01.858617316Z [2024-04-25 18:02:01,852: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T18:02:01.883882791Z [2024-04-25 18:02:01,883: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:02:02.783994177Z [2024-04-25 18:02:02,783: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a8b4d93-6b24-4844-b957-2b627ec9d7db] succeeded in 1.8553000460001385s: None 2024-04-25T18:02:03.839015805Z [2024-04-25 18:02:03,838: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T18:02:03.842879586Z [2024-04-25 18:02:03,841: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:02:03.876519791Z [2024-04-25 18:02:03,876: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T18:02:03.877672534Z [2024-04-25 18:02:03,877: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:02:03.877816485Z [2024-04-25 18:02:03,877: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:02:03.878359025Z [2024-04-25 18:02:03,878: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:02:03.878995251Z [2024-04-25 18:02:03,878: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T18:02:03.879582505Z [2024-04-25 18:02:03,879: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T18:02:03.879685220Z [2024-04-25 18:02:03,879: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:02:03.891472548Z [2024-04-25 18:02:03,891: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T18:02:03.895350264Z [2024-04-25 18:02:03,894: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:02:03.918114446Z [2024-04-25 18:02:03,917: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T18:02:03.919289247Z [2024-04-25 18:02:03,919: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:02:03.919304709Z [2024-04-25 18:02:03,919: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:02:03.919411283Z [2024-04-25 18:02:03,919: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:02:03.919436675Z [2024-04-25 18:02:03,919: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T18:02:03.919644352Z [2024-04-25 18:02:03,919: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-25T18:02:03.919667013Z [2024-04-25 18:02:03,919: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:02:04.002350068Z [2024-04-25 18:02:04,002: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:02:04.030606599Z [2024-04-25 18:02:04,029: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:02:05.583068073Z [2024-04-25 18:02:05,582: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e5b76e4-b215-4608-9ea9-66655b916d30] succeeded in 4.645224275000146s: None 2024-04-25T18:02:05.892173651Z [2024-04-25 18:02:05,891: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[25bb4e48-722d-4656-95cf-5e32067c354f] succeeded in 4.939100822s: None 2024-04-25T18:03:00.670738283Z [2024-04-25 18:03:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce368d43-ccf3-4d55-8066-c8d8f6b8d545] received 2024-04-25T18:03:00.677849939Z [2024-04-25 18:03:00,677: INFO/ForkPoolWorker-15] [ce368d43-ccf3-4d55-8066-c8d8f6b8d545] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T18:03:00.700780960Z [2024-04-25 18:03:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[448383eb-c23b-4c40-b065-a80c81e33af9] received 2024-04-25T18:03:00.711545728Z [2024-04-25 18:03:00,710: INFO/ForkPoolWorker-16] [448383eb-c23b-4c40-b065-a80c81e33af9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T18:03:01.244851818Z [2024-04-25 18:03:01,241: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T18:03:01.293108980Z [2024-04-25 18:03:01,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T18:03:02.511597154Z [2024-04-25 18:03:02,511: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T18:03:02.515999735Z [2024-04-25 18:03:02,515: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:03:02.576179925Z [2024-04-25 18:03:02,575: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T18:03:02.577815229Z [2024-04-25 18:03:02,577: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:03:02.577889791Z [2024-04-25 18:03:02,577: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:03:02.578104509Z [2024-04-25 18:03:02,577: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:03:02.578191487Z [2024-04-25 18:03:02,578: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T18:03:02.578594886Z [2024-04-25 18:03:02,578: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T18:03:02.578650242Z [2024-04-25 18:03:02,578: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:03:02.679588135Z [2024-04-25 18:03:02,679: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:03:02.732493979Z [2024-04-25 18:03:02,732: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:03:02.736087080Z [2024-04-25 18:03:02,735: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:03:02.781089459Z [2024-04-25 18:03:02,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:03:02.782806663Z [2024-04-25 18:03:02,782: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:03:02.783100896Z [2024-04-25 18:03:02,782: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:03:02.783390173Z [2024-04-25 18:03:02,783: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:03:02.783587110Z [2024-04-25 18:03:02,783: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:03:02.784004906Z [2024-04-25 18:03:02,783: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-25T18:03:02.784770154Z [2024-04-25 18:03:02,784: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:03:02.919409181Z [2024-04-25 18:03:02,919: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:03:04.695641170Z [2024-04-25 18:03:04,695: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[448383eb-c23b-4c40-b065-a80c81e33af9] succeeded in 3.9924346709999554s: None 2024-04-25T18:03:05.278179138Z [2024-04-25 18:03:05,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce368d43-ccf3-4d55-8066-c8d8f6b8d545] succeeded in 4.605298687999948s: None 2024-04-25T18:04:01.147251524Z [2024-04-25 18:04:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d40f8747-f95d-4259-81a1-ece0b5b9ecc6] received 2024-04-25T18:04:01.150132295Z [2024-04-25 18:04:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[896ecd9a-7aa0-4576-a13f-393d346d82a6] received 2024-04-25T18:04:01.156911577Z [2024-04-25 18:04:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91ee9a32-fe3d-45f7-99dc-da25b106ab22] received 2024-04-25T18:04:01.167724606Z [2024-04-25 18:04:01,167: INFO/ForkPoolWorker-15] [d40f8747-f95d-4259-81a1-ece0b5b9ecc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T18:04:01.167961686Z [2024-04-25 18:04:01,167: INFO/ForkPoolWorker-16] [896ecd9a-7aa0-4576-a13f-393d346d82a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-25T18:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-25T18:04:01.182806868Z [2024-04-25 18:04:01,182: INFO/ForkPoolWorker-1] [91ee9a32-fe3d-45f7-99dc-da25b106ab22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T18:04:01.525155802Z [2024-04-25 18:04:01,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T18:04:01.699854037Z [2024-04-25 18:04:01,694: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T18:04:01.766747759Z [2024-04-25 18:04:01,748: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-25T18:04:02.468101353Z [2024-04-25 18:04:02,467: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:04:03.245139030Z [2024-04-25 18:04:03,244: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[896ecd9a-7aa0-4576-a13f-393d346d82a6] succeeded in 2.0895299080002587s: None 2024-04-25T18:04:03.282483760Z [2024-04-25 18:04:03,282: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:04:03.286690894Z [2024-04-25 18:04:03,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:04:03.326137671Z [2024-04-25 18:04:03,325: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:04:03.327458752Z [2024-04-25 18:04:03,327: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:04:03.327473167Z [2024-04-25 18:04:03,327: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:04:03.327657204Z [2024-04-25 18:04:03,327: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:04:03.327684766Z [2024-04-25 18:04:03,327: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:04:03.328830799Z [2024-04-25 18:04:03,328: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T18:04:03.329036535Z [2024-04-25 18:04:03,328: INFO/ForkPoolWorker-15] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:04:03.432243259Z [2024-04-25 18:04:03,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:04:03.902836412Z [2024-04-25 18:04:03,902: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T18:04:03.907637488Z [2024-04-25 18:04:03,906: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:04:03.951585423Z [2024-04-25 18:04:03,951: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T18:04:03.955630225Z [2024-04-25 18:04:03,955: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:04:03.955944822Z [2024-04-25 18:04:03,955: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:04:03.956446260Z [2024-04-25 18:04:03,956: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:04:03.956666974Z [2024-04-25 18:04:03,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T18:04:03.957427584Z [2024-04-25 18:04:03,957: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-25T18:04:03.957925379Z [2024-04-25 18:04:03,957: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:04:04.050149265Z [2024-04-25 18:04:04,049: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:04:04.886321184Z [2024-04-25 18:04:04,885: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d40f8747-f95d-4259-81a1-ece0b5b9ecc6] succeeded in 3.7332786819997636s: None 2024-04-25T18:04:05.847722551Z [2024-04-25 18:04:05,847: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[91ee9a32-fe3d-45f7-99dc-da25b106ab22] succeeded in 4.6839419469997665s: None 2024-04-25T18:05:00.381519988Z [2024-04-25 18:05:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f396d0b-1093-4b54-9487-10e90a64d4a4] received 2024-04-25T18:05:00.385831878Z [2024-04-25 18:05:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a09ca7ea-cfcb-4543-9e6e-67f6881c1e67] received 2024-04-25T18:05:00.397422004Z [2024-04-25 18:05:00,397: INFO/ForkPoolWorker-16] [a09ca7ea-cfcb-4543-9e6e-67f6881c1e67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-25T18:05:00.398064138Z [2024-04-25 18:05:00,397: INFO/ForkPoolWorker-15] [2f396d0b-1093-4b54-9487-10e90a64d4a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-25T18:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T18:05:00.402571885Z [2024-04-25 18:05:00,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27b2c7f4-4a03-4211-a059-d95e0ab7da80] received 2024-04-25T18:05:00.407902002Z [2024-04-25 18:05:00,407: INFO/ForkPoolWorker-1] [27b2c7f4-4a03-4211-a059-d95e0ab7da80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-25T18:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-25T18:05:00.775750262Z [2024-04-25 18:05:00,770: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T18:05:00.801727638Z [2024-04-25 18:05:00,798: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-25T18:05:00.815825293Z [2024-04-25 18:05:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-25T18:05:02.432526229Z [2024-04-25 18:05:02,432: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-25T18:05:02.436251036Z [2024-04-25 18:05:02,435: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:05:02.461394203Z [2024-04-25 18:05:02,461: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-25T18:05:02.465536547Z [2024-04-25 18:05:02,465: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:05:02.491948672Z [2024-04-25 18:05:02,491: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:05:02.495451758Z [2024-04-25 18:05:02,494: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:05:02.514237538Z [2024-04-25 18:05:02,514: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-25T18:05:02.517270815Z [2024-04-25 18:05:02,515: INFO/ForkPoolWorker-1] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:05:02.517744143Z [2024-04-25 18:05:02,517: INFO/ForkPoolWorker-1] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:05:02.518018167Z [2024-04-25 18:05:02,517: INFO/ForkPoolWorker-1] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:05:02.518177779Z [2024-04-25 18:05:02,517: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-25T18:05:02.518637624Z [2024-04-25 18:05:02,518: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-25T18:05:02.518887511Z [2024-04-25 18:05:02,518: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:05:02.557937188Z [2024-04-25 18:05:02,557: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:05:02.572848391Z [2024-04-25 18:05:02,572: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-25T18:05:02.576569026Z [2024-04-25 18:05:02,576: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:05:02.577015400Z [2024-04-25 18:05:02,576: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:05:02.577604977Z [2024-04-25 18:05:02,577: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:05:02.577678822Z [2024-04-25 18:05:02,577: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:05:02.577947419Z [2024-04-25 18:05:02,577: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T18:05:02.578070236Z [2024-04-25 18:05:02,577: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:05:02.578632606Z [2024-04-25 18:05:02,578: INFO/ForkPoolWorker-16] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:05:02.578874959Z [2024-04-25 18:05:02,578: INFO/ForkPoolWorker-16] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:05:02.579097491Z [2024-04-25 18:05:02,578: INFO/ForkPoolWorker-16] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:05:02.579754330Z [2024-04-25 18:05:02,579: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-25T18:05:02.580086432Z [2024-04-25 18:05:02,579: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-25T18:05:02.580322228Z [2024-04-25 18:05:02,580: INFO/ForkPoolWorker-16] Creating DAG vim_status_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:05:02.666374437Z [2024-04-25 18:05:02,666: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:05:02.692150043Z [2024-04-25 18:05:02,691: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:05:02.748764232Z [2024-04-25 18:05:02,748: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:05:03.757014040Z [2024-04-25 18:05:03,756: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f396d0b-1093-4b54-9487-10e90a64d4a4] succeeded in 3.3663857030001054s: None 2024-04-25T18:05:04.077135205Z [2024-04-25 18:05:04,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b9a9f52-2c1f-4eaa-8725-6cde9dd4e378] received 2024-04-25T18:05:04.083718132Z [2024-04-25 18:05:04,083: INFO/ForkPoolWorker-15] [6b9a9f52-2c1f-4eaa-8725-6cde9dd4e378] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'split_metrics', 'scheduled__2024-04-25T18:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T18:05:04.484608286Z [2024-04-25 18:05:04,479: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T18:05:04.491723478Z [2024-04-25 18:05:04,491: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a09ca7ea-cfcb-4543-9e6e-67f6881c1e67] succeeded in 4.1015675550002015s: None 2024-04-25T18:05:05.245367009Z [2024-04-25 18:05:05,245: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[27b2c7f4-4a03-4211-a059-d95e0ab7da80] succeeded in 4.841535455999747s: None 2024-04-25T18:05:05.890075226Z [2024-04-25 18:05:05,889: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:05:05.894513055Z [2024-04-25 18:05:05,894: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:05:05.923902420Z [2024-04-25 18:05:05,923: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:05:05.925982074Z [2024-04-25 18:05:05,925: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:05:05.926579236Z [2024-04-25 18:05:05,926: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:05:05.926927106Z [2024-04-25 18:05:05,926: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:05:05.926974233Z [2024-04-25 18:05:05,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:05:05.928175678Z [2024-04-25 18:05:05,927: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T18:05:05.928477495Z [2024-04-25 18:05:05,928: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:05:06.037311164Z [2024-04-25 18:05:06,037: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:05:06.744756667Z [2024-04-25 18:05:06,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b9a9f52-2c1f-4eaa-8725-6cde9dd4e378] succeeded in 2.6651199069997347s: None 2024-04-25T18:05:07.585159924Z [2024-04-25 18:05:07,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6f25c8e-16a4-4d71-8368-30445035c5ce] received 2024-04-25T18:05:07.605267747Z [2024-04-25 18:05:07,604: INFO/ForkPoolWorker-15] [f6f25c8e-16a4-4d71-8368-30445035c5ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'collect_metrics', 'scheduled__2024-04-25T18:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-25T18:05:07.991454702Z [2024-04-25 18:05:07,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T18:05:09.419843316Z [2024-04-25 18:05:09,419: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:05:09.423692519Z [2024-04-25 18:05:09,423: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:05:09.455825260Z [2024-04-25 18:05:09,455: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:05:09.457902142Z [2024-04-25 18:05:09,457: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:05:09.457952598Z [2024-04-25 18:05:09,457: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:05:09.458065861Z [2024-04-25 18:05:09,457: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:05:09.458209873Z [2024-04-25 18:05:09,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:05:09.458444899Z [2024-04-25 18:05:09,458: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T18:05:09.458470071Z [2024-04-25 18:05:09,458: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:05:09.557341576Z [2024-04-25 18:05:09,557: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:05:11.585126783Z [2024-04-25 18:05:11,584: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6f25c8e-16a4-4d71-8368-30445035c5ce] succeeded in 3.9979033399999935s: None 2024-04-25T18:05:11.896537341Z [2024-04-25 18:05:11,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[262c62e9-f4c6-4501-a4c9-4a61102ecfdd] received 2024-04-25T18:05:11.911131542Z [2024-04-25 18:05:11,910: INFO/ForkPoolWorker-15] [262c62e9-f4c6-4501-a4c9-4a61102ecfdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291', 'send_prometheus', 'scheduled__2024-04-25T18:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-25T18:05:12.346366182Z [2024-04-25 18:05:12,342: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-25T18:05:13.778680613Z [2024-04-25 18:05:13,778: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-25T18:05:13.784692489Z [2024-04-25 18:05:13,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'AjuxlfW9OjGwSKrwcKaplNN0mfVLSYZi'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-25T18:05:13.841777030Z [2024-04-25 18:05:13,841: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-25T18:05:13.845771000Z [2024-04-25 18:05:13,845: INFO/ForkPoolWorker-15] Read VIM 0ec25617-2254-4eca-bf8b-4c561c82bfdb (_system-osm-vim) 2024-04-25T18:05:13.845909445Z [2024-04-25 18:05:13,845: INFO/ForkPoolWorker-15] Read VIM 383e6ef5-984f-4df2-9cff-009261fbc291 (osm) 2024-04-25T18:05:13.846253115Z [2024-04-25 18:05:13,845: INFO/ForkPoolWorker-15] [{'_id': '0ec25617-2254-4eca-bf8b-4c561c82bfdb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '383e6ef5-984f-4df2-9cff-009261fbc291', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-25T18:05:13.846402681Z [2024-04-25 18:05:13,846: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-25T18:05:13.846973251Z [2024-04-25 18:05:13,846: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-25T18:05:13.847115012Z [2024-04-25 18:05:13,846: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_383e6ef5-984f-4df2-9cff-009261fbc291 2024-04-25T18:05:13.953082191Z [2024-04-25 18:05:13,952: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-25T18:05:14.554065410Z [2024-04-25 18:05:14,553: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[262c62e9-f4c6-4501-a4c9-4a61102ecfdd] succeeded in 2.655602495000039s: None 2024-04-25T17:35:18.340851513Z 2024-04-25T17:35:18.368109244Z Cleaning logs every 900 seconds 2024-04-25T17:35:18.368128091Z Trimming airflow logs to 15 days. 2024-04-25T17:45:00.490805285Z Trimming airflow logs to 15 days. 2024-04-25T17:45:01.535665770Z Trimming airflow logs to 15 days. 2024-04-25T18:00:00.601074726Z Trimming airflow logs to 15 days. 2024-04-25T18:00:01.638204314Z Trimming airflow logs to 15 days.