2024-04-17T09:42:30.307412221Z .. 2024-04-17T09:42:31.898123637Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-17T09:42:34.028988001Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-17T09:42:39.598016138Z [2024-04-17T09:42:39.596+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-17T09:42:40.601328752Z [2024-04-17T09:42:40.601+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-17T09:42:41.609420701Z [2024-04-17T09:42:41.609+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-04-17T09:42:57.760066938Z 2024-04-17T09:42:59.050080409Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-17T09:43:03.670382500Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-17T09:43:11.466978618Z [2024-04-17 09:43:11 +0000] [15] [INFO] Starting gunicorn 20.1.0 2024-04-17T09:43:11.487006580Z [2024-04-17 09:43:11 +0000] [15] [INFO] Listening at: http://[::]:8793 (15) 2024-04-17T09:43:11.504299749Z [2024-04-17 09:43:11 +0000] [15] [INFO] Using worker: sync 2024-04-17T09:43:11.528894648Z [2024-04-17 09:43:11 +0000] [16] [INFO] Booting worker with pid: 16 2024-04-17T09:43:11.602096895Z [2024-04-17 09:43:11 +0000] [17] [INFO] Booting worker with pid: 17 2024-04-17T09:43:14.500036451Z 2024-04-17T09:43:14.500070865Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-04-17T09:43:14.500076047Z --- ***** ----- 2024-04-17T09:43:14.500079850Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-04-17 09:43:14 2024-04-17T09:43:14.500082911Z - *** --- * --- 2024-04-17T09:43:14.500087681Z - ** ---------- [config] 2024-04-17T09:43:14.500091476Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f8014e9c220 2024-04-17T09:43:14.500094661Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-04-17T09:43:14.500097784Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-04-17T09:43:14.500103242Z - *** --- * --- .> concurrency: 16 (prefork) 2024-04-17T09:43:14.500106355Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-04-17T09:43:14.500109320Z --- ***** ----- 2024-04-17T09:43:14.500112596Z -------------- [queues] 2024-04-17T09:43:14.500115734Z .> default exchange=default(direct) key=default 2024-04-17T09:43:14.500118691Z 2024-04-17T09:43:14.500121472Z 2024-04-17T09:43:14.500124471Z [tasks] 2024-04-17T09:43:14.500127624Z . airflow.executors.celery_executor.execute_command 2024-04-17T09:43:14.500130432Z 2024-04-17T09:43:26.259426456Z [2024-04-17 09:43:26,255: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-04-17T09:43:26.263065464Z [2024-04-17 09:43:26,262: INFO/MainProcess] mingle: searching for neighbors 2024-04-17T09:43:27.282178641Z [2024-04-17 09:43:27,281: INFO/MainProcess] mingle: all alone 2024-04-17T09:43:27.323249093Z [2024-04-17 09:43:27,322: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-04-17T09:43:27.332643073Z [2024-04-17 09:43:27,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7002a571-1b12-4b53-ba6b-6b811317cb9d] received 2024-04-17T09:43:27.389300667Z [2024-04-17 09:43:27,385: INFO/ForkPoolWorker-15] [7002a571-1b12-4b53-ba6b-6b811317cb9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:43:27.938975653Z [2024-04-17 09:43:27,932: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:43:28.357072262Z [2024-04-17 09:43:28,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:43:29.411354874Z [2024-04-17 09:43:29,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7002a571-1b12-4b53-ba6b-6b811317cb9d] succeeded in 2.075087394000036s: None 2024-04-17T09:43:39.593030295Z [2024-04-17 09:43:39,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3970d0b-2e6d-425d-8906-c9850c2fc326] received 2024-04-17T09:43:39.607831834Z [2024-04-17 09:43:39,606: INFO/ForkPoolWorker-15] [c3970d0b-2e6d-425d-8906-c9850c2fc326] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:43:39.888965430Z [2024-04-17 09:43:39,883: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:43:40.119805720Z [2024-04-17 09:43:40,119: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:43:40.877768434Z [2024-04-17 09:43:40,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3970d0b-2e6d-425d-8906-c9850c2fc326] succeeded in 1.2832237660000487s: None 2024-04-17T09:44:01.175006824Z [2024-04-17 09:44:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ceb5fb8-4326-4039-aefd-642d0f9a91d5] received 2024-04-17T09:44:01.245822418Z [2024-04-17 09:44:01,245: INFO/ForkPoolWorker-15] [6ceb5fb8-4326-4039-aefd-642d0f9a91d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:44:02.999139530Z [2024-04-17 09:44:02,985: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:44:03.807881282Z [2024-04-17 09:44:03,807: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:44:05.128053120Z [2024-04-17 09:44:05,127: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ceb5fb8-4326-4039-aefd-642d0f9a91d5] succeeded in 3.9093219970000064s: None 2024-04-17T09:44:15.473947259Z [2024-04-17 09:44:15,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a72168c5-b178-4bc5-957b-74d8e0b397cd] received 2024-04-17T09:44:15.500976861Z [2024-04-17 09:44:15,500: INFO/ForkPoolWorker-15] [a72168c5-b178-4bc5-957b-74d8e0b397cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:44:16.190412736Z [2024-04-17 09:44:16,184: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:44:16.653003284Z [2024-04-17 09:44:16,651: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:44:17.526029778Z [2024-04-17 09:44:17,523: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a72168c5-b178-4bc5-957b-74d8e0b397cd] succeeded in 2.0522654099999045s: None 2024-04-17T09:46:00.453116786Z [2024-04-17 09:46:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[493c9c91-cab1-4c3a-b67e-8585fe7ad580] received 2024-04-17T09:46:00.487795621Z [2024-04-17 09:46:00,487: INFO/ForkPoolWorker-15] [493c9c91-cab1-4c3a-b67e-8585fe7ad580] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:46:00.934070951Z [2024-04-17 09:46:00,930: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:46:01.294485611Z [2024-04-17 09:46:01,294: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:46:01.872472729Z [2024-04-17 09:46:01,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[493c9c91-cab1-4c3a-b67e-8585fe7ad580] succeeded in 1.4105145380000295s: None 2024-04-17T09:48:00.377789965Z [2024-04-17 09:48:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9a59f2b-d183-4a16-8eb3-906a00fbe0ed] received 2024-04-17T09:48:00.419738274Z [2024-04-17 09:48:00,410: INFO/ForkPoolWorker-15] [d9a59f2b-d183-4a16-8eb3-906a00fbe0ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:48:00.893843557Z [2024-04-17 09:48:00,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:48:01.226192444Z [2024-04-17 09:48:01,225: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:48:01.995083389Z [2024-04-17 09:48:01,994: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9a59f2b-d183-4a16-8eb3-906a00fbe0ed] succeeded in 1.61551611699997s: None 2024-04-17T09:49:52.649774802Z [2024-04-17 09:49:52,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf772b2d-194d-485b-90f3-0afe4bd903b6] received 2024-04-17T09:49:52.690903906Z [2024-04-17 09:49:52,688: INFO/ForkPoolWorker-15] [cf772b2d-194d-485b-90f3-0afe4bd903b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:49:53.264804311Z [2024-04-17 09:49:53,250: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:49:54.153266083Z [2024-04-17 09:49:54,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e6cf7c9-2124-4966-9086-3f501158238c] received 2024-04-17T09:49:54.269920900Z [2024-04-17 09:49:54,269: INFO/ForkPoolWorker-16] [8e6cf7c9-2124-4966-9086-3f501158238c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:49:55.294163133Z [2024-04-17 09:49:55,282: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:49:55.700619449Z [2024-04-17 09:49:55,700: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:49:55.705504719Z [2024-04-17 09:49:55,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:49:55.748198465Z [2024-04-17 09:49:55,748: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:49:55.749457240Z [2024-04-17 09:49:55,749: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:49:55.749639791Z [2024-04-17 09:49:55,749: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:49:55.750040531Z [2024-04-17 09:49:55,749: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:49:55.750212544Z [2024-04-17 09:49:55,750: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:49:55.750686871Z [2024-04-17 09:49:55,750: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:49:55.750894798Z [2024-04-17 09:49:55,750: INFO/ForkPoolWorker-15] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:49:55.845832556Z [2024-04-17 09:49:55,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:49:57.116364631Z [2024-04-17 09:49:57,116: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:49:57.127405225Z [2024-04-17 09:49:57,126: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:49:57.154619210Z [2024-04-17 09:49:57,154: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:49:57.157512648Z [2024-04-17 09:49:57,156: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:49:57.157619191Z [2024-04-17 09:49:57,157: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:49:57.157823807Z [2024-04-17 09:49:57,157: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:49:57.157864139Z [2024-04-17 09:49:57,157: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:49:57.158484297Z [2024-04-17 09:49:57,158: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:49:57.158540248Z [2024-04-17 09:49:57,158: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:49:57.242400238Z [2024-04-17 09:49:57,242: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:49:57.470156366Z [2024-04-17 09:49:57,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf772b2d-194d-485b-90f3-0afe4bd903b6] succeeded in 4.799121667999998s: None 2024-04-17T09:49:59.017587103Z [2024-04-17 09:49:59,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6cb7032-af23-405f-a75c-d2c80b32414f] received 2024-04-17T09:49:59.028173197Z [2024-04-17 09:49:59,027: INFO/ForkPoolWorker-15] [c6cb7032-af23-405f-a75c-d2c80b32414f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-17T09:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:49:59.210160546Z [2024-04-17 09:49:59,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e6cf7c9-2124-4966-9086-3f501158238c] succeeded in 5.053332750000095s: None 2024-04-17T09:49:59.370574118Z [2024-04-17 09:49:59,366: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:50:00.354950421Z [2024-04-17 09:50:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b45f06ba-51cd-426a-8f07-9abaccb6eaf2] received 2024-04-17T09:50:00.357498044Z [2024-04-17 09:50:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cf74786-dfad-4c34-ac53-76c7d17f88a9] received 2024-04-17T09:50:00.373031646Z [2024-04-17 09:50:00,371: INFO/ForkPoolWorker-16] [b45f06ba-51cd-426a-8f07-9abaccb6eaf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-17T09:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:50:00.419033788Z [2024-04-17 09:50:00,418: INFO/ForkPoolWorker-1] [4cf74786-dfad-4c34-ac53-76c7d17f88a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:50:00.426711578Z [2024-04-17 09:50:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dadbe55a-94eb-4866-8025-fe5b0c6a61c0] received 2024-04-17T09:50:00.432677659Z [2024-04-17 09:50:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9825cc93-9c74-4cdf-a491-2dde077a4960] received 2024-04-17T09:50:00.473060461Z [2024-04-17 09:50:00,471: INFO/ForkPoolWorker-2] [dadbe55a-94eb-4866-8025-fe5b0c6a61c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:50:00.522086820Z [2024-04-17 09:50:00,521: INFO/ForkPoolWorker-3] [9825cc93-9c74-4cdf-a491-2dde077a4960] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:50:01.001925282Z [2024-04-17 09:50:00,996: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:50:01.093826704Z [2024-04-17 09:50:01,090: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:50:01.275253539Z [2024-04-17 09:50:01,251: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:50:01.490430566Z [2024-04-17 09:50:01,490: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:50:01.503098407Z [2024-04-17 09:50:01,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:01.591920410Z [2024-04-17 09:50:01,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:50:01.593596935Z [2024-04-17 09:50:01,593: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:01.594372891Z [2024-04-17 09:50:01,593: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:01.594731988Z [2024-04-17 09:50:01,594: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:01.594828028Z [2024-04-17 09:50:01,594: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:50:01.595318001Z [2024-04-17 09:50:01,595: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:50:01.595362776Z [2024-04-17 09:50:01,595: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:01.695551505Z [2024-04-17 09:50:01,691: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:50:01.816219322Z [2024-04-17 09:50:01,815: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:01.937394234Z [2024-04-17 09:50:01,937: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:03.472318972Z [2024-04-17 09:50:03,471: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4cf74786-dfad-4c34-ac53-76c7d17f88a9] succeeded in 3.1078576940000175s: None 2024-04-17T09:50:03.900620590Z [2024-04-17 09:50:03,900: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-17T09:50:03.904507761Z [2024-04-17 09:50:03,904: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:03.908229334Z [2024-04-17 09:50:03,907: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-17T09:50:03.909738306Z [2024-04-17 09:50:03,909: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6cb7032-af23-405f-a75c-d2c80b32414f] succeeded in 4.890226290000101s: None 2024-04-17T09:50:03.915187041Z [2024-04-17 09:50:03,914: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:04.017801689Z [2024-04-17 09:50:04,017: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-17T09:50:04.033597893Z [2024-04-17 09:50:04,033: INFO/ForkPoolWorker-3] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:04.033645877Z [2024-04-17 09:50:04,033: INFO/ForkPoolWorker-3] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:04.033766289Z [2024-04-17 09:50:04,033: INFO/ForkPoolWorker-3] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:04.033798974Z [2024-04-17 09:50:04,033: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-17T09:50:04.034130684Z [2024-04-17 09:50:04,033: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:50:04.034182842Z [2024-04-17 09:50:04,034: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:04.046192610Z [2024-04-17 09:50:04,045: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-17T09:50:04.047982824Z [2024-04-17 09:50:04,047: INFO/ForkPoolWorker-2] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:04.047995239Z [2024-04-17 09:50:04,047: INFO/ForkPoolWorker-2] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:04.049366374Z [2024-04-17 09:50:04,049: INFO/ForkPoolWorker-2] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:04.050398323Z [2024-04-17 09:50:04,050: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-17T09:50:04.057372751Z [2024-04-17 09:50:04,052: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:50:04.057610395Z [2024-04-17 09:50:04,057: INFO/ForkPoolWorker-2] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:04.201823105Z [2024-04-17 09:50:04,201: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:04.343203383Z [2024-04-17 09:50:04,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaf544dd-eb71-40e3-84af-ba39bd49fe0d] received 2024-04-17T09:50:04.358963315Z [2024-04-17 09:50:04,358: INFO/ForkPoolWorker-15] [eaf544dd-eb71-40e3-84af-ba39bd49fe0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'split_metrics', 'scheduled__2024-04-17T09:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:50:04.415742217Z [2024-04-17 09:50:04,415: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:04.435964161Z [2024-04-17 09:50:04,435: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:50:04.439555706Z [2024-04-17 09:50:04,439: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:04.610277080Z [2024-04-17 09:50:04,608: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:50:04.619885964Z [2024-04-17 09:50:04,617: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:04.619902464Z [2024-04-17 09:50:04,617: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:04.619905713Z [2024-04-17 09:50:04,617: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:04.619909415Z [2024-04-17 09:50:04,618: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:50:04.633680337Z [2024-04-17 09:50:04,618: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:50:04.634164799Z [2024-04-17 09:50:04,633: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:05.110167434Z [2024-04-17 09:50:05,068: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:50:05.131807626Z [2024-04-17 09:50:05,131: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:06.144732540Z [2024-04-17 09:50:06,144: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b45f06ba-51cd-426a-8f07-9abaccb6eaf2] succeeded in 5.784159961s: None 2024-04-17T09:50:06.898378905Z [2024-04-17 09:50:06,897: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:50:06.902351262Z [2024-04-17 09:50:06,901: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:06.934736857Z [2024-04-17 09:50:06,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a6de261-29d8-4096-a862-34694ddba1a5] received 2024-04-17T09:50:06.949746593Z [2024-04-17 09:50:06,949: INFO/ForkPoolWorker-16] [1a6de261-29d8-4096-a862-34694ddba1a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'split_metrics', 'scheduled__2024-04-17T09:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:50:06.952112527Z [2024-04-17 09:50:06,951: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:50:06.954717371Z [2024-04-17 09:50:06,954: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:06.954739249Z [2024-04-17 09:50:06,954: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:06.954913214Z [2024-04-17 09:50:06,954: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:06.954983760Z [2024-04-17 09:50:06,954: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:50:06.955224271Z [2024-04-17 09:50:06,955: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:50:06.955626615Z [2024-04-17 09:50:06,955: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:07.081749521Z [2024-04-17 09:50:07,081: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:07.393196873Z [2024-04-17 09:50:07,390: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:50:07.424660142Z [2024-04-17 09:50:07,423: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dadbe55a-94eb-4866-8025-fe5b0c6a61c0] succeeded in 6.992425271999991s: None 2024-04-17T09:50:07.749987296Z [2024-04-17 09:50:07,748: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9825cc93-9c74-4cdf-a491-2dde077a4960] succeeded in 7.316328009000017s: None 2024-04-17T09:50:07.770638282Z [2024-04-17 09:50:07,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eaf544dd-eb71-40e3-84af-ba39bd49fe0d] succeeded in 3.4259263879999935s: None 2024-04-17T09:50:08.184684119Z [2024-04-17 09:50:08,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ead0c97-e811-48be-9cfb-26bc60260640] received 2024-04-17T09:50:08.192715290Z [2024-04-17 09:50:08,192: INFO/ForkPoolWorker-15] [1ead0c97-e811-48be-9cfb-26bc60260640] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'collect_metrics', 'scheduled__2024-04-17T09:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-17T09:50:08.490407074Z [2024-04-17 09:50:08,487: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:50:08.785561554Z [2024-04-17 09:50:08,785: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:50:08.788777535Z [2024-04-17 09:50:08,788: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:08.816374153Z [2024-04-17 09:50:08,816: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:50:08.818178607Z [2024-04-17 09:50:08,818: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:08.818638540Z [2024-04-17 09:50:08,818: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:08.819133083Z [2024-04-17 09:50:08,818: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:08.819264070Z [2024-04-17 09:50:08,819: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:50:08.819771501Z [2024-04-17 09:50:08,819: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:50:08.819882977Z [2024-04-17 09:50:08,819: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:08.901262174Z [2024-04-17 09:50:08,901: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:09.441549153Z [2024-04-17 09:50:09,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e8cc58a-c644-4e54-b032-fe8470fb3163] received 2024-04-17T09:50:09.442379343Z [2024-04-17 09:50:09,441: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1a6de261-29d8-4096-a862-34694ddba1a5] succeeded in 2.5039416220000703s: None 2024-04-17T09:50:09.448844403Z [2024-04-17 09:50:09,448: INFO/ForkPoolWorker-16] [2e8cc58a-c644-4e54-b032-fe8470fb3163] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'collect_metrics', 'scheduled__2024-04-17T09:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-17T09:50:09.831167687Z [2024-04-17 09:50:09,828: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:50:09.916483117Z [2024-04-17 09:50:09,916: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:50:09.920244853Z [2024-04-17 09:50:09,919: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:09.953049571Z [2024-04-17 09:50:09,952: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:50:09.955042143Z [2024-04-17 09:50:09,954: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:09.955330279Z [2024-04-17 09:50:09,955: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:09.955584347Z [2024-04-17 09:50:09,955: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:09.955748967Z [2024-04-17 09:50:09,955: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:50:09.956018198Z [2024-04-17 09:50:09,955: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:50:09.956200101Z [2024-04-17 09:50:09,956: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:10.043845726Z [2024-04-17 09:50:10,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:10.707508095Z [2024-04-17 09:50:10,707: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ead0c97-e811-48be-9cfb-26bc60260640] succeeded in 2.5200104399999645s: None 2024-04-17T09:50:10.990073199Z [2024-04-17 09:50:10,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c524e9c7-2243-40f8-bc2e-3b114961ceff] received 2024-04-17T09:50:11.011529747Z [2024-04-17 09:50:11,011: INFO/ForkPoolWorker-15] [c524e9c7-2243-40f8-bc2e-3b114961ceff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'send_prometheus', 'scheduled__2024-04-17T09:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:50:11.329848770Z [2024-04-17 09:50:11,329: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:50:11.333426435Z [2024-04-17 09:50:11,333: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:11.371821434Z [2024-04-17 09:50:11,371: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:50:11.373772539Z [2024-04-17 09:50:11,373: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:11.373786285Z [2024-04-17 09:50:11,373: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:11.373939966Z [2024-04-17 09:50:11,373: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:11.374008089Z [2024-04-17 09:50:11,373: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:50:11.374488641Z [2024-04-17 09:50:11,374: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:50:11.374537023Z [2024-04-17 09:50:11,374: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:11.427850594Z [2024-04-17 09:50:11,424: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:50:11.471666786Z [2024-04-17 09:50:11,471: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:12.032355993Z [2024-04-17 09:50:12,031: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e8cc58a-c644-4e54-b032-fe8470fb3163] succeeded in 2.58718993399998s: None 2024-04-17T09:50:12.798596361Z [2024-04-17 09:50:12,798: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:50:12.803195598Z [2024-04-17 09:50:12,802: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:12.832705594Z [2024-04-17 09:50:12,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff29a962-e6b0-48aa-a930-0106c2ae4115] received 2024-04-17T09:50:12.841938485Z [2024-04-17 09:50:12,841: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:50:12.845282461Z [2024-04-17 09:50:12,845: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:12.851271478Z [2024-04-17 09:50:12,851: INFO/ForkPoolWorker-16] [ff29a962-e6b0-48aa-a930-0106c2ae4115] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'send_prometheus', 'scheduled__2024-04-17T09:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:50:12.851474607Z [2024-04-17 09:50:12,845: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:12.851775696Z [2024-04-17 09:50:12,851: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:12.853544026Z [2024-04-17 09:50:12,851: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:50:12.853923906Z [2024-04-17 09:50:12,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:50:12.854518012Z [2024-04-17 09:50:12,853: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:12.970344031Z [2024-04-17 09:50:12,970: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:13.232922630Z [2024-04-17 09:50:13,230: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:50:13.725152665Z [2024-04-17 09:50:13,724: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c524e9c7-2243-40f8-bc2e-3b114961ceff] succeeded in 2.727728855999999s: None 2024-04-17T09:50:14.675046159Z [2024-04-17 09:50:14,674: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:50:14.681444819Z [2024-04-17 09:50:14,680: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:50:14.722122029Z [2024-04-17 09:50:14,721: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:50:14.724024046Z [2024-04-17 09:50:14,723: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:50:14.724651338Z [2024-04-17 09:50:14,723: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:50:14.725183230Z [2024-04-17 09:50:14,724: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:50:14.725353896Z [2024-04-17 09:50:14,725: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:50:14.725734306Z [2024-04-17 09:50:14,725: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:50:14.726234396Z [2024-04-17 09:50:14,725: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:50:14.808504573Z [2024-04-17 09:50:14,808: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:50:15.296126152Z [2024-04-17 09:50:15,295: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff29a962-e6b0-48aa-a930-0106c2ae4115] succeeded in 2.461591968999983s: None 2024-04-17T09:51:00.225725563Z [2024-04-17 09:51:00,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c1f75fd-6cec-46c6-a109-5950a5bc2d96] received 2024-04-17T09:51:00.227754515Z [2024-04-17 09:51:00,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6427601c-21fc-4c07-9671-82ec3eb3be94] received 2024-04-17T09:51:00.250087643Z [2024-04-17 09:51:00,249: INFO/ForkPoolWorker-15] [1c1f75fd-6cec-46c6-a109-5950a5bc2d96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:51:00.261380256Z [2024-04-17 09:51:00,261: INFO/ForkPoolWorker-16] [6427601c-21fc-4c07-9671-82ec3eb3be94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:51:00.666601608Z [2024-04-17 09:51:00,663: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:51:00.679712687Z [2024-04-17 09:51:00,671: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:51:02.225530818Z [2024-04-17 09:51:02,225: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:51:02.231685543Z [2024-04-17 09:51:02,230: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:51:02.297784444Z [2024-04-17 09:51:02,297: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:51:02.298822167Z [2024-04-17 09:51:02,298: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:51:02.298861706Z [2024-04-17 09:51:02,298: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:51:02.299029195Z [2024-04-17 09:51:02,298: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:51:02.299078831Z [2024-04-17 09:51:02,298: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:51:02.299314075Z [2024-04-17 09:51:02,299: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:51:02.299403822Z [2024-04-17 09:51:02,299: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:51:02.374815696Z [2024-04-17 09:51:02,374: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:51:02.502238980Z [2024-04-17 09:51:02,501: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:51:02.506120977Z [2024-04-17 09:51:02,505: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:51:02.564039708Z [2024-04-17 09:51:02,563: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:51:02.573198127Z [2024-04-17 09:51:02,572: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:51:02.573302272Z [2024-04-17 09:51:02,573: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:51:02.573522738Z [2024-04-17 09:51:02,573: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:51:02.573580709Z [2024-04-17 09:51:02,573: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:51:02.573910762Z [2024-04-17 09:51:02,573: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:51:02.573948188Z [2024-04-17 09:51:02,573: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:51:02.709139068Z [2024-04-17 09:51:02,708: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:51:04.609834110Z [2024-04-17 09:51:04,608: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c1f75fd-6cec-46c6-a109-5950a5bc2d96] succeeded in 4.380478754000023s: None 2024-04-17T09:51:04.739969253Z [2024-04-17 09:51:04,739: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6427601c-21fc-4c07-9671-82ec3eb3be94] succeeded in 4.509507506999967s: None 2024-04-17T09:52:01.289574785Z [2024-04-17 09:52:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ca55586-3cb3-4686-8327-e75dc1c58ee6] received 2024-04-17T09:52:01.295681447Z [2024-04-17 09:52:01,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ce6d244-87a8-49d9-baa1-437e7033f1b8] received 2024-04-17T09:52:01.302092182Z [2024-04-17 09:52:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de334ca3-9afa-447d-b881-f9632ff1df59] received 2024-04-17T09:52:01.345151080Z [2024-04-17 09:52:01,344: INFO/ForkPoolWorker-1] [de334ca3-9afa-447d-b881-f9632ff1df59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:52:01.399744445Z [2024-04-17 09:52:01,399: INFO/ForkPoolWorker-16] [2ce6d244-87a8-49d9-baa1-437e7033f1b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:52:01.425387954Z [2024-04-17 09:52:01,412: INFO/ForkPoolWorker-15] [7ca55586-3cb3-4686-8327-e75dc1c58ee6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:52:01.998327525Z [2024-04-17 09:52:01,972: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:52:02.223276463Z [2024-04-17 09:52:02,219: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:52:02.551264743Z [2024-04-17 09:52:02,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:52:03.238816413Z [2024-04-17 09:52:03,238: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:52:04.198472633Z [2024-04-17 09:52:04,198: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T09:52:04.201853316Z [2024-04-17 09:52:04,201: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:52:04.242877841Z [2024-04-17 09:52:04,242: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:52:04.247239687Z [2024-04-17 09:52:04,246: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:52:04.297693349Z [2024-04-17 09:52:04,297: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T09:52:04.301522171Z [2024-04-17 09:52:04,301: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:52:04.305087169Z [2024-04-17 09:52:04,304: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:52:04.305297724Z [2024-04-17 09:52:04,305: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:52:04.305442950Z [2024-04-17 09:52:04,305: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T09:52:04.308098890Z [2024-04-17 09:52:04,305: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:52:04.308345128Z [2024-04-17 09:52:04,308: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:52:04.314403402Z [2024-04-17 09:52:04,314: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:52:04.315578178Z [2024-04-17 09:52:04,315: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:52:04.315593542Z [2024-04-17 09:52:04,315: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:52:04.315694713Z [2024-04-17 09:52:04,315: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:52:04.315722985Z [2024-04-17 09:52:04,315: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:52:04.315934609Z [2024-04-17 09:52:04,315: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:52:04.316018197Z [2024-04-17 09:52:04,315: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:52:04.325119919Z [2024-04-17 09:52:04,324: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ca55586-3cb3-4686-8327-e75dc1c58ee6] succeeded in 3.0063104539999586s: None 2024-04-17T09:52:04.398984084Z [2024-04-17 09:52:04,397: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:52:04.403420812Z [2024-04-17 09:52:04,403: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:52:06.902230495Z [2024-04-17 09:52:06,901: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ce6d244-87a8-49d9-baa1-437e7033f1b8] succeeded in 5.590231185999983s: None 2024-04-17T09:52:08.850047942Z [2024-04-17 09:52:08,849: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de334ca3-9afa-447d-b881-f9632ff1df59] succeeded in 7.543479742000045s: None 2024-04-17T09:53:00.597045867Z [2024-04-17 09:53:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48203235-4560-414f-964c-7227c6cd549e] received 2024-04-17T09:53:00.600829922Z [2024-04-17 09:53:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca81f771-deb0-4a41-855d-479f5aac319a] received 2024-04-17T09:53:00.625835476Z [2024-04-17 09:53:00,625: INFO/ForkPoolWorker-15] [48203235-4560-414f-964c-7227c6cd549e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:53:00.634577953Z [2024-04-17 09:53:00,634: INFO/ForkPoolWorker-16] [ca81f771-deb0-4a41-855d-479f5aac319a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:53:01.125714034Z [2024-04-17 09:53:01,122: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:53:01.396394472Z [2024-04-17 09:53:01,389: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:53:02.873785880Z [2024-04-17 09:53:02,873: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:53:02.877801952Z [2024-04-17 09:53:02,877: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:53:02.916954136Z [2024-04-17 09:53:02,916: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:53:02.918843823Z [2024-04-17 09:53:02,918: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:53:02.918949161Z [2024-04-17 09:53:02,918: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:53:02.919145885Z [2024-04-17 09:53:02,918: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:53:02.919279527Z [2024-04-17 09:53:02,919: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:53:02.919840770Z [2024-04-17 09:53:02,919: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:53:02.920233946Z [2024-04-17 09:53:02,920: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:53:03.031186711Z [2024-04-17 09:53:03,030: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:53:03.301857379Z [2024-04-17 09:53:03,301: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:53:03.305748025Z [2024-04-17 09:53:03,305: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:53:03.372556974Z [2024-04-17 09:53:03,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:53:03.376915476Z [2024-04-17 09:53:03,375: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:53:03.377034623Z [2024-04-17 09:53:03,376: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:53:03.377298612Z [2024-04-17 09:53:03,377: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:53:03.377414439Z [2024-04-17 09:53:03,377: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:53:03.378059273Z [2024-04-17 09:53:03,377: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:53:03.378214994Z [2024-04-17 09:53:03,378: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:53:03.486574694Z [2024-04-17 09:53:03,486: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:53:05.766370003Z [2024-04-17 09:53:05,765: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca81f771-deb0-4a41-855d-479f5aac319a] succeeded in 5.160266526999976s: None 2024-04-17T09:53:07.347411070Z [2024-04-17 09:53:07,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48203235-4560-414f-964c-7227c6cd549e] succeeded in 6.748766239000133s: None 2024-04-17T09:54:00.870890929Z [2024-04-17 09:54:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9de448e-1ee7-4240-aba1-d9c19ed900a6] received 2024-04-17T09:54:00.881384289Z [2024-04-17 09:54:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b37ad78e-e619-4e82-9443-fd93f0b82755] received 2024-04-17T09:54:00.890786957Z [2024-04-17 09:54:00,890: INFO/ForkPoolWorker-15] [e9de448e-1ee7-4240-aba1-d9c19ed900a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:54:00.896627962Z [2024-04-17 09:54:00,896: INFO/ForkPoolWorker-16] [b37ad78e-e619-4e82-9443-fd93f0b82755] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:54:00.910491540Z [2024-04-17 09:54:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73a1427c-4b80-4556-aeec-e61ce43ae368] received 2024-04-17T09:54:00.941665494Z [2024-04-17 09:54:00,941: INFO/ForkPoolWorker-1] [73a1427c-4b80-4556-aeec-e61ce43ae368] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:54:01.482657839Z [2024-04-17 09:54:01,477: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:54:01.546850680Z [2024-04-17 09:54:01,537: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:54:02.010627808Z [2024-04-17 09:54:02,004: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:54:02.527814054Z [2024-04-17 09:54:02,527: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:54:03.124979349Z [2024-04-17 09:54:03,124: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:54:03.137121995Z [2024-04-17 09:54:03,132: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:54:03.213706648Z [2024-04-17 09:54:03,213: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:54:03.224619173Z [2024-04-17 09:54:03,224: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:54:03.227482381Z [2024-04-17 09:54:03,227: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:54:03.227661213Z [2024-04-17 09:54:03,227: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:54:03.227741246Z [2024-04-17 09:54:03,227: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:54:03.228032226Z [2024-04-17 09:54:03,227: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:54:03.228134656Z [2024-04-17 09:54:03,228: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:54:03.502558444Z [2024-04-17 09:54:03,502: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:54:03.572362474Z [2024-04-17 09:54:03,569: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9de448e-1ee7-4240-aba1-d9c19ed900a6] succeeded in 2.6908991959999184s: None 2024-04-17T09:54:04.033569126Z [2024-04-17 09:54:04,033: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T09:54:04.038978748Z [2024-04-17 09:54:04,038: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:54:04.098685903Z [2024-04-17 09:54:04,098: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T09:54:04.107729318Z [2024-04-17 09:54:04,107: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:54:04.107956536Z [2024-04-17 09:54:04,107: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:54:04.108633290Z [2024-04-17 09:54:04,108: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:54:04.109062782Z [2024-04-17 09:54:04,108: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T09:54:04.109412505Z [2024-04-17 09:54:04,109: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:54:04.109939764Z [2024-04-17 09:54:04,109: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:54:04.202299075Z [2024-04-17 09:54:04,202: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:54:05.978229499Z [2024-04-17 09:54:05,977: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b37ad78e-e619-4e82-9443-fd93f0b82755] succeeded in 5.094441576999998s: None 2024-04-17T09:54:06.595640289Z [2024-04-17 09:54:06,594: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73a1427c-4b80-4556-aeec-e61ce43ae368] succeeded in 5.677631714999961s: None 2024-04-17T09:55:01.030413507Z [2024-04-17 09:55:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b8d242e-2f5b-4298-a04d-d946bcd14b2d] received 2024-04-17T09:55:01.032768113Z [2024-04-17 09:55:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[844543e0-e0de-4260-b846-936560b38696] received 2024-04-17T09:55:01.052833155Z [2024-04-17 09:55:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ded8fc0-037c-41fa-9320-0a6110980c21] received 2024-04-17T09:55:01.054072327Z [2024-04-17 09:55:01,053: INFO/ForkPoolWorker-15] [8b8d242e-2f5b-4298-a04d-d946bcd14b2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-17T09:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:55:01.076367830Z [2024-04-17 09:55:01,076: INFO/ForkPoolWorker-16] [844543e0-e0de-4260-b846-936560b38696] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:55:01.081160284Z [2024-04-17 09:55:01,080: INFO/ForkPoolWorker-1] [2ded8fc0-037c-41fa-9320-0a6110980c21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:55:01.486194047Z [2024-04-17 09:55:01,481: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:55:01.545502561Z [2024-04-17 09:55:01,539: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:55:01.672624023Z [2024-04-17 09:55:01,660: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:55:03.437870077Z [2024-04-17 09:55:03,437: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:55:03.443416488Z [2024-04-17 09:55:03,442: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:55:03.543255564Z [2024-04-17 09:55:03,543: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:55:03.549569544Z [2024-04-17 09:55:03,549: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:55:03.549591246Z [2024-04-17 09:55:03,549: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:55:03.549784527Z [2024-04-17 09:55:03,549: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:55:03.549840729Z [2024-04-17 09:55:03,549: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:55:03.550310968Z [2024-04-17 09:55:03,550: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:55:03.550358812Z [2024-04-17 09:55:03,550: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:55:03.608415002Z [2024-04-17 09:55:03,608: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:55:03.612289015Z [2024-04-17 09:55:03,611: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:55:03.745184058Z [2024-04-17 09:55:03,744: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:55:03.748047100Z [2024-04-17 09:55:03,747: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:55:03.748061240Z [2024-04-17 09:55:03,747: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:55:03.748110216Z [2024-04-17 09:55:03,747: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:55:03.748140467Z [2024-04-17 09:55:03,748: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:55:03.748445588Z [2024-04-17 09:55:03,748: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:55:03.748480377Z [2024-04-17 09:55:03,748: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:55:03.834178717Z [2024-04-17 09:55:03,833: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:55:03.871762684Z [2024-04-17 09:55:03,871: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T09:55:03.876360604Z [2024-04-17 09:55:03,875: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:55:03.937435816Z [2024-04-17 09:55:03,937: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T09:55:03.941987725Z [2024-04-17 09:55:03,941: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:55:03.942085909Z [2024-04-17 09:55:03,941: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:55:03.942292780Z [2024-04-17 09:55:03,942: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:55:03.942382101Z [2024-04-17 09:55:03,942: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T09:55:03.942766849Z [2024-04-17 09:55:03,942: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:55:03.942946060Z [2024-04-17 09:55:03,942: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:55:03.976824066Z [2024-04-17 09:55:03,976: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:55:04.088070257Z [2024-04-17 09:55:04,087: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:55:05.055521628Z [2024-04-17 09:55:05,055: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b8d242e-2f5b-4298-a04d-d946bcd14b2d] succeeded in 4.016780008000069s: None 2024-04-17T09:55:05.100727952Z [2024-04-17 09:55:05,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7be6f7bf-95cc-43ae-91a6-24a2abac66b4] received 2024-04-17T09:55:05.108713210Z [2024-04-17 09:55:05,108: INFO/ForkPoolWorker-15] [7be6f7bf-95cc-43ae-91a6-24a2abac66b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'split_metrics', 'scheduled__2024-04-17T09:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:55:05.461550674Z [2024-04-17 09:55:05,457: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:55:05.995056032Z [2024-04-17 09:55:05,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[844543e0-e0de-4260-b846-936560b38696] succeeded in 4.942558438999868s: None 2024-04-17T09:55:06.812020033Z [2024-04-17 09:55:06,811: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:55:06.815289937Z [2024-04-17 09:55:06,814: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:55:06.841782835Z [2024-04-17 09:55:06,841: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:55:06.843125885Z [2024-04-17 09:55:06,842: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:55:06.843142531Z [2024-04-17 09:55:06,843: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:55:06.843258232Z [2024-04-17 09:55:06,843: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:55:06.843269054Z [2024-04-17 09:55:06,843: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:55:06.843447724Z [2024-04-17 09:55:06,843: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:55:06.843486320Z [2024-04-17 09:55:06,843: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:55:06.917442508Z [2024-04-17 09:55:06,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:55:07.502534490Z [2024-04-17 09:55:07,502: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ded8fc0-037c-41fa-9320-0a6110980c21] succeeded in 6.4397207560000425s: None 2024-04-17T09:55:07.564462159Z [2024-04-17 09:55:07,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7be6f7bf-95cc-43ae-91a6-24a2abac66b4] succeeded in 2.461541668000109s: None 2024-04-17T09:55:07.574783179Z [2024-04-17 09:55:07,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1630816-d306-4ca4-ba20-d296c56c721a] received 2024-04-17T09:55:07.588767351Z [2024-04-17 09:55:07,588: INFO/ForkPoolWorker-15] [c1630816-d306-4ca4-ba20-d296c56c721a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'collect_metrics', 'scheduled__2024-04-17T09:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-17T09:55:07.895490541Z [2024-04-17 09:55:07,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:55:09.245053612Z [2024-04-17 09:55:09,244: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:55:09.249199684Z [2024-04-17 09:55:09,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:55:09.301050301Z [2024-04-17 09:55:09,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:55:09.304330343Z [2024-04-17 09:55:09,304: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:55:09.305021772Z [2024-04-17 09:55:09,304: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:55:09.305658177Z [2024-04-17 09:55:09,305: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:55:09.313084966Z [2024-04-17 09:55:09,312: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:55:09.317066433Z [2024-04-17 09:55:09,313: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:55:09.317234268Z [2024-04-17 09:55:09,317: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:55:09.414593590Z [2024-04-17 09:55:09,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:55:09.899105148Z [2024-04-17 09:55:09,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4455e21f-afb2-4774-bac5-dbafa88b6f24] received 2024-04-17T09:55:09.910644500Z [2024-04-17 09:55:09,910: INFO/ForkPoolWorker-16] [4455e21f-afb2-4774-bac5-dbafa88b6f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'send_prometheus', 'scheduled__2024-04-17T09:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T09:55:09.962613855Z [2024-04-17 09:55:09,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1630816-d306-4ca4-ba20-d296c56c721a] succeeded in 2.3854254390000733s: None 2024-04-17T09:55:10.318167437Z [2024-04-17 09:55:10,314: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T09:55:11.807444298Z [2024-04-17 09:55:11,807: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:55:11.811132692Z [2024-04-17 09:55:11,810: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:55:11.853055426Z [2024-04-17 09:55:11,852: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:55:11.854740403Z [2024-04-17 09:55:11,854: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:55:11.855498936Z [2024-04-17 09:55:11,854: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:55:11.856134090Z [2024-04-17 09:55:11,855: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:55:11.856321472Z [2024-04-17 09:55:11,856: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:55:11.856840035Z [2024-04-17 09:55:11,856: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T09:55:11.857123118Z [2024-04-17 09:55:11,856: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:55:11.955899185Z [2024-04-17 09:55:11,955: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:55:12.499073361Z [2024-04-17 09:55:12,498: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4455e21f-afb2-4774-bac5-dbafa88b6f24] succeeded in 2.596892503999925s: None 2024-04-17T09:56:00.859752235Z [2024-04-17 09:56:00,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fe63def-6d3c-4f52-b2a2-8738b5f5dd2c] received 2024-04-17T09:56:00.872860184Z [2024-04-17 09:56:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8743f8e1-611c-42e6-bec8-15902d440593] received 2024-04-17T09:56:00.879262126Z [2024-04-17 09:56:00,878: INFO/ForkPoolWorker-15] [6fe63def-6d3c-4f52-b2a2-8738b5f5dd2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:56:00.883366708Z [2024-04-17 09:56:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77162f71-b773-4e06-9f41-379a590ab259] received 2024-04-17T09:56:00.884210706Z [2024-04-17 09:56:00,883: INFO/ForkPoolWorker-16] [8743f8e1-611c-42e6-bec8-15902d440593] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:56:00.928069781Z [2024-04-17 09:56:00,927: INFO/ForkPoolWorker-1] [77162f71-b773-4e06-9f41-379a590ab259] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:56:01.428256678Z [2024-04-17 09:56:01,423: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:56:01.428395075Z [2024-04-17 09:56:01,424: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:56:01.508173551Z [2024-04-17 09:56:01,502: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:56:01.837984935Z [2024-04-17 09:56:01,837: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:56:02.753382188Z [2024-04-17 09:56:02,753: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6fe63def-6d3c-4f52-b2a2-8738b5f5dd2c] succeeded in 1.887815049999972s: None 2024-04-17T09:56:03.229901157Z [2024-04-17 09:56:03,229: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:56:03.233153640Z [2024-04-17 09:56:03,232: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:56:03.298804138Z [2024-04-17 09:56:03,298: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:56:03.301267939Z [2024-04-17 09:56:03,301: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:56:03.301290510Z [2024-04-17 09:56:03,301: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:56:03.301435195Z [2024-04-17 09:56:03,301: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:56:03.301472598Z [2024-04-17 09:56:03,301: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:56:03.301844249Z [2024-04-17 09:56:03,301: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:56:03.301890352Z [2024-04-17 09:56:03,301: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:56:03.326192149Z [2024-04-17 09:56:03,325: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T09:56:03.329544309Z [2024-04-17 09:56:03,329: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:56:03.366073922Z [2024-04-17 09:56:03,365: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T09:56:03.367619991Z [2024-04-17 09:56:03,367: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:56:03.367962381Z [2024-04-17 09:56:03,367: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:56:03.368138050Z [2024-04-17 09:56:03,367: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:56:03.368810876Z [2024-04-17 09:56:03,368: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T09:56:03.369314365Z [2024-04-17 09:56:03,369: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:56:03.369490393Z [2024-04-17 09:56:03,369: INFO/ForkPoolWorker-1] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:56:03.464325437Z [2024-04-17 09:56:03,464: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:56:03.516370948Z [2024-04-17 09:56:03,516: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:56:06.518848678Z [2024-04-17 09:56:06,518: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77162f71-b773-4e06-9f41-379a590ab259] succeeded in 5.626364985000009s: None 2024-04-17T09:56:07.235227939Z [2024-04-17 09:56:07,234: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8743f8e1-611c-42e6-bec8-15902d440593] succeeded in 6.359421839000106s: None 2024-04-17T09:57:00.608636571Z [2024-04-17 09:57:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1760e029-482d-460b-bf32-5b0b3cb6b212] received 2024-04-17T09:57:00.622744673Z [2024-04-17 09:57:00,622: INFO/ForkPoolWorker-15] [1760e029-482d-460b-bf32-5b0b3cb6b212] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:57:00.624106007Z [2024-04-17 09:57:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0d314c6-19ea-4691-83ee-30702c0f8f77] received 2024-04-17T09:57:00.649886909Z [2024-04-17 09:57:00,649: INFO/ForkPoolWorker-16] [d0d314c6-19ea-4691-83ee-30702c0f8f77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:57:01.120706849Z [2024-04-17 09:57:01,116: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:57:01.147729393Z [2024-04-17 09:57:01,144: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:57:02.653961096Z [2024-04-17 09:57:02,653: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:57:02.657365033Z [2024-04-17 09:57:02,657: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:57:02.706269669Z [2024-04-17 09:57:02,706: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:57:02.707505702Z [2024-04-17 09:57:02,707: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:57:02.707712554Z [2024-04-17 09:57:02,707: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:57:02.707927123Z [2024-04-17 09:57:02,707: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:57:02.708195004Z [2024-04-17 09:57:02,707: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:57:02.708375930Z [2024-04-17 09:57:02,708: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:57:02.708493146Z [2024-04-17 09:57:02,708: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:57:02.741072092Z [2024-04-17 09:57:02,740: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:57:02.746847773Z [2024-04-17 09:57:02,746: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:57:02.772731365Z [2024-04-17 09:57:02,772: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:57:02.777947290Z [2024-04-17 09:57:02,777: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:57:02.778069741Z [2024-04-17 09:57:02,777: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:57:02.778199380Z [2024-04-17 09:57:02,778: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:57:02.778227871Z [2024-04-17 09:57:02,778: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:57:02.778426756Z [2024-04-17 09:57:02,778: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:57:02.778456416Z [2024-04-17 09:57:02,778: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:57:02.818292251Z [2024-04-17 09:57:02,818: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:57:02.880216049Z [2024-04-17 09:57:02,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:57:05.490613650Z [2024-04-17 09:57:05,490: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0d314c6-19ea-4691-83ee-30702c0f8f77] succeeded in 4.864219653000191s: None 2024-04-17T09:57:06.357724473Z [2024-04-17 09:57:06,357: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1760e029-482d-460b-bf32-5b0b3cb6b212] succeeded in 5.745336258000179s: None 2024-04-17T09:58:00.303326688Z [2024-04-17 09:58:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ddc3cd2-eaea-4ece-be21-9cec2e745539] received 2024-04-17T09:58:00.331316133Z [2024-04-17 09:58:00,330: INFO/ForkPoolWorker-15] [9ddc3cd2-eaea-4ece-be21-9cec2e745539] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:58:00.339641525Z [2024-04-17 09:58:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1403bb7c-4a61-49dc-b878-97b43070f21f] received 2024-04-17T09:58:00.348016840Z [2024-04-17 09:58:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f95d53c-f05a-42db-8af0-551f6fb11427] received 2024-04-17T09:58:00.358645054Z [2024-04-17 09:58:00,358: INFO/ForkPoolWorker-16] [1403bb7c-4a61-49dc-b878-97b43070f21f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T09:58:00.376730443Z [2024-04-17 09:58:00,376: INFO/ForkPoolWorker-1] [5f95d53c-f05a-42db-8af0-551f6fb11427] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:58:00.837422877Z [2024-04-17 09:58:00,833: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:58:01.005486959Z [2024-04-17 09:58:00,995: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T09:58:01.134795253Z [2024-04-17 09:58:01,131: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:58:01.605766913Z [2024-04-17 09:58:01,605: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:58:02.459702593Z [2024-04-17 09:58:02,459: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1403bb7c-4a61-49dc-b878-97b43070f21f] succeeded in 2.1177655210001376s: None 2024-04-17T09:58:02.800757418Z [2024-04-17 09:58:02,800: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T09:58:02.803981905Z [2024-04-17 09:58:02,803: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:58:02.841174909Z [2024-04-17 09:58:02,840: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T09:58:02.844668178Z [2024-04-17 09:58:02,844: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:58:02.844700414Z [2024-04-17 09:58:02,844: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:58:02.844789251Z [2024-04-17 09:58:02,844: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:58:02.844849961Z [2024-04-17 09:58:02,844: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T09:58:02.853392686Z [2024-04-17 09:58:02,853: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:58:02.853638916Z [2024-04-17 09:58:02,853: INFO/ForkPoolWorker-1] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:58:02.940425279Z [2024-04-17 09:58:02,940: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:58:03.106410814Z [2024-04-17 09:58:03,106: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:58:03.119558292Z [2024-04-17 09:58:03,119: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:58:03.160975798Z [2024-04-17 09:58:03,160: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:58:03.163065295Z [2024-04-17 09:58:03,162: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:58:03.163086601Z [2024-04-17 09:58:03,163: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:58:03.163216417Z [2024-04-17 09:58:03,163: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:58:03.163260560Z [2024-04-17 09:58:03,163: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:58:03.163475342Z [2024-04-17 09:58:03,163: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:58:03.163502662Z [2024-04-17 09:58:03,163: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:58:03.303691604Z [2024-04-17 09:58:03,303: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:58:05.660757942Z [2024-04-17 09:58:05,660: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f95d53c-f05a-42db-8af0-551f6fb11427] succeeded in 5.3094618099999025s: None 2024-04-17T09:58:06.991754334Z [2024-04-17 09:58:06,991: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ddc3cd2-eaea-4ece-be21-9cec2e745539] succeeded in 6.6840601530000185s: None 2024-04-17T09:59:01.025652809Z [2024-04-17 09:59:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0aaa9455-a222-4656-bdeb-ad573afdb68a] received 2024-04-17T09:59:01.027758380Z [2024-04-17 09:59:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68463b52-6ff0-4d10-b46c-274bece2793f] received 2024-04-17T09:59:01.050562305Z [2024-04-17 09:59:01,050: INFO/ForkPoolWorker-15] [0aaa9455-a222-4656-bdeb-ad573afdb68a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T09:59:01.060646857Z [2024-04-17 09:59:01,060: INFO/ForkPoolWorker-16] [68463b52-6ff0-4d10-b46c-274bece2793f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T09:59:01.524744627Z [2024-04-17 09:59:01,520: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T09:59:01.568107823Z [2024-04-17 09:59:01,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T09:59:03.313599989Z [2024-04-17 09:59:03,313: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T09:59:03.317277458Z [2024-04-17 09:59:03,316: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:59:03.421236065Z [2024-04-17 09:59:03,420: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T09:59:03.424657760Z [2024-04-17 09:59:03,424: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T09:59:03.430468043Z [2024-04-17 09:59:03,430: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T09:59:03.445429441Z [2024-04-17 09:59:03,445: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:59:03.445652607Z [2024-04-17 09:59:03,445: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:59:03.445870731Z [2024-04-17 09:59:03,445: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:59:03.446042059Z [2024-04-17 09:59:03,445: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T09:59:03.446469171Z [2024-04-17 09:59:03,446: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T09:59:03.447288395Z [2024-04-17 09:59:03,447: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:59:03.514684704Z [2024-04-17 09:59:03,514: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T09:59:03.521247829Z [2024-04-17 09:59:03,521: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T09:59:03.521261266Z [2024-04-17 09:59:03,521: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T09:59:03.521372276Z [2024-04-17 09:59:03,521: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T09:59:03.521381403Z [2024-04-17 09:59:03,521: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T09:59:03.521580262Z [2024-04-17 09:59:03,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T09:59:03.521602271Z [2024-04-17 09:59:03,521: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T09:59:03.531301634Z [2024-04-17 09:59:03,531: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:59:03.764353814Z [2024-04-17 09:59:03,764: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T09:59:05.653533686Z [2024-04-17 09:59:05,653: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[68463b52-6ff0-4d10-b46c-274bece2793f] succeeded in 4.61386781300007s: None 2024-04-17T09:59:06.145530685Z [2024-04-17 09:59:06,145: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0aaa9455-a222-4656-bdeb-ad573afdb68a] succeeded in 5.111267696999903s: None 2024-04-17T10:00:00.282858819Z [2024-04-17 10:00:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe6d99da-8a33-4228-831c-d0ca020c84e7] received 2024-04-17T10:00:00.285880237Z [2024-04-17 10:00:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[142af261-ac28-46d1-b871-f23a8e352009] received 2024-04-17T10:00:00.294706416Z [2024-04-17 10:00:00,294: INFO/ForkPoolWorker-15] [fe6d99da-8a33-4228-831c-d0ca020c84e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:00:00.298750869Z [2024-04-17 10:00:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6db2f43e-64e0-400b-9771-eddbcb017318] received 2024-04-17T10:00:00.305118673Z [2024-04-17 10:00:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[541533e2-c8c6-40db-93a1-e1d9635a5931] received 2024-04-17T10:00:00.310426864Z [2024-04-17 10:00:00,310: INFO/ForkPoolWorker-16] [142af261-ac28-46d1-b871-f23a8e352009] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T09:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:00:00.323126728Z [2024-04-17 10:00:00,322: INFO/ForkPoolWorker-1] [6db2f43e-64e0-400b-9771-eddbcb017318] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-17T09:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:00:00.342477583Z [2024-04-17 10:00:00,341: INFO/ForkPoolWorker-2] [541533e2-c8c6-40db-93a1-e1d9635a5931] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T09:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T10:00:00.887024220Z [2024-04-17 10:00:00,881: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:00:01.014185948Z [2024-04-17 10:00:00,999: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:00:01.075435845Z [2024-04-17 10:00:01,048: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:00:01.213412166Z [2024-04-17 10:00:01,208: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T10:00:01.922663945Z [2024-04-17 10:00:01,922: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:00:02.746616519Z [2024-04-17 10:00:02,746: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[541533e2-c8c6-40db-93a1-e1d9635a5931] succeeded in 2.4360991329999706s: None 2024-04-17T10:00:03.204875904Z [2024-04-17 10:00:03,204: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:00:03.209568455Z [2024-04-17 10:00:03,208: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:00:03.358036988Z [2024-04-17 10:00:03,357: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:00:03.360533479Z [2024-04-17 10:00:03,360: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:00:03.360547665Z [2024-04-17 10:00:03,360: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:00:03.369243409Z [2024-04-17 10:00:03,360: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:00:03.372527102Z [2024-04-17 10:00:03,369: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:00:03.373478179Z [2024-04-17 10:00:03,373: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:00:03.377334666Z [2024-04-17 10:00:03,373: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:00:03.907237926Z [2024-04-17 10:00:03,907: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:00:05.104520189Z [2024-04-17 10:00:05,104: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:00:05.133023225Z [2024-04-17 10:00:05,125: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:00:05.179215966Z [2024-04-17 10:00:05,178: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:00:05.198827016Z [2024-04-17 10:00:05,198: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:00:05.250611940Z [2024-04-17 10:00:05,250: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:00:05.256396371Z [2024-04-17 10:00:05,256: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:00:05.257069740Z [2024-04-17 10:00:05,256: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:00:05.257249455Z [2024-04-17 10:00:05,256: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:00:05.257448736Z [2024-04-17 10:00:05,257: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:00:05.257746082Z [2024-04-17 10:00:05,257: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:00:05.257887251Z [2024-04-17 10:00:05,257: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:00:05.296131191Z [2024-04-17 10:00:05,295: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6db2f43e-64e0-400b-9771-eddbcb017318] succeeded in 4.993138516999807s: None 2024-04-17T10:00:05.318385262Z [2024-04-17 10:00:05,318: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:00:05.335711694Z [2024-04-17 10:00:05,335: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:00:05.335727262Z [2024-04-17 10:00:05,335: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:00:05.335825881Z [2024-04-17 10:00:05,335: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:00:05.335858540Z [2024-04-17 10:00:05,335: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:00:05.336084793Z [2024-04-17 10:00:05,335: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:00:05.336098469Z [2024-04-17 10:00:05,336: INFO/ForkPoolWorker-15] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:00:05.344540389Z [2024-04-17 10:00:05,344: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:00:05.562610352Z [2024-04-17 10:00:05,562: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:00:06.132105895Z [2024-04-17 10:00:06,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e38a181-df58-402e-ad6e-a35069a43517] received 2024-04-17T10:00:06.150735101Z [2024-04-17 10:00:06,150: INFO/ForkPoolWorker-1] [7e38a181-df58-402e-ad6e-a35069a43517] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'split_metrics', 'scheduled__2024-04-17T09:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:00:06.604330113Z [2024-04-17 10:00:06,600: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:00:07.560503141Z [2024-04-17 10:00:07,560: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe6d99da-8a33-4228-831c-d0ca020c84e7] succeeded in 7.272569475999944s: None 2024-04-17T10:00:07.949752443Z [2024-04-17 10:00:07,949: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:00:07.953652962Z [2024-04-17 10:00:07,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:00:08.018910152Z [2024-04-17 10:00:08,018: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:00:08.021739262Z [2024-04-17 10:00:08,020: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:00:08.023048659Z [2024-04-17 10:00:08,021: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:00:08.023154106Z [2024-04-17 10:00:08,023: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:00:08.023358739Z [2024-04-17 10:00:08,023: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:00:08.023613697Z [2024-04-17 10:00:08,023: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:00:08.023618501Z [2024-04-17 10:00:08,023: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:00:08.129689528Z [2024-04-17 10:00:08,129: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:00:08.234679295Z [2024-04-17 10:00:08,234: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[142af261-ac28-46d1-b871-f23a8e352009] succeeded in 7.946362944000157s: None 2024-04-17T10:00:08.741056025Z [2024-04-17 10:00:08,740: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e38a181-df58-402e-ad6e-a35069a43517] succeeded in 2.6042056809999394s: None 2024-04-17T10:00:08.796266611Z [2024-04-17 10:00:08,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[332a4685-a8a3-4a9c-b187-7287fcf8314b] received 2024-04-17T10:00:08.807268011Z [2024-04-17 10:00:08,807: INFO/ForkPoolWorker-15] [332a4685-a8a3-4a9c-b187-7287fcf8314b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'collect_metrics', 'scheduled__2024-04-17T09:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-17T10:00:09.147682861Z [2024-04-17 10:00:09,142: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:00:10.439860312Z [2024-04-17 10:00:10,439: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:00:10.445693897Z [2024-04-17 10:00:10,444: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:00:10.480630973Z [2024-04-17 10:00:10,480: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:00:10.483098288Z [2024-04-17 10:00:10,482: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:00:10.483327024Z [2024-04-17 10:00:10,483: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:00:10.483588587Z [2024-04-17 10:00:10,483: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:00:10.484256712Z [2024-04-17 10:00:10,484: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:00:10.485022988Z [2024-04-17 10:00:10,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:00:10.485523697Z [2024-04-17 10:00:10,485: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:00:10.569318753Z [2024-04-17 10:00:10,569: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:00:12.408325227Z [2024-04-17 10:00:12,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[332a4685-a8a3-4a9c-b187-7287fcf8314b] succeeded in 3.6085624199999984s: None 2024-04-17T10:00:12.789589547Z [2024-04-17 10:00:12,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5658c041-0ba7-4d39-945c-bff4c4494287] received 2024-04-17T10:00:12.821718920Z [2024-04-17 10:00:12,821: INFO/ForkPoolWorker-15] [5658c041-0ba7-4d39-945c-bff4c4494287] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'send_prometheus', 'scheduled__2024-04-17T09:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:00:13.288909899Z [2024-04-17 10:00:13,284: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:00:14.785315121Z [2024-04-17 10:00:14,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:00:14.788999456Z [2024-04-17 10:00:14,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:00:14.824392038Z [2024-04-17 10:00:14,824: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:00:14.825845490Z [2024-04-17 10:00:14,825: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:00:14.825864496Z [2024-04-17 10:00:14,825: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:00:14.826035000Z [2024-04-17 10:00:14,825: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:00:14.826069752Z [2024-04-17 10:00:14,825: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:00:14.826339581Z [2024-04-17 10:00:14,826: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:00:14.826359682Z [2024-04-17 10:00:14,826: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:00:14.930827474Z [2024-04-17 10:00:14,930: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:00:15.497784397Z [2024-04-17 10:00:15,497: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5658c041-0ba7-4d39-945c-bff4c4494287] succeeded in 2.6877281839999796s: None 2024-04-17T10:01:00.492109128Z [2024-04-17 10:01:00,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc269566-1cc4-43e2-ba09-ff5fc714ea64] received 2024-04-17T10:01:00.505299140Z [2024-04-17 10:01:00,504: INFO/ForkPoolWorker-15] [dc269566-1cc4-43e2-ba09-ff5fc714ea64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:01:00.511148830Z [2024-04-17 10:01:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89c08e9c-486c-498b-be5b-30dc71976b9d] received 2024-04-17T10:01:00.529091396Z [2024-04-17 10:01:00,528: INFO/ForkPoolWorker-16] [89c08e9c-486c-498b-be5b-30dc71976b9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:01:00.946011631Z [2024-04-17 10:01:00,939: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:01:00.946340850Z [2024-04-17 10:01:00,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:01:02.857463053Z [2024-04-17 10:01:02,856: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:01:02.860836836Z [2024-04-17 10:01:02,860: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:01:02.899724795Z [2024-04-17 10:01:02,899: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:01:02.901058179Z [2024-04-17 10:01:02,900: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:01:02.901328324Z [2024-04-17 10:01:02,901: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:01:02.901486258Z [2024-04-17 10:01:02,901: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:01:02.901619283Z [2024-04-17 10:01:02,901: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:01:02.901959531Z [2024-04-17 10:01:02,901: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:01:02.902260113Z [2024-04-17 10:01:02,902: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:01:02.942794381Z [2024-04-17 10:01:02,942: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:01:02.947413227Z [2024-04-17 10:01:02,946: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:01:03.007615100Z [2024-04-17 10:01:03,007: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:01:03.012339051Z [2024-04-17 10:01:03,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:01:03.014170491Z [2024-04-17 10:01:03,013: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:01:03.014442265Z [2024-04-17 10:01:03,014: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:01:03.014844274Z [2024-04-17 10:01:03,014: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:01:03.015021912Z [2024-04-17 10:01:03,014: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:01:03.015344553Z [2024-04-17 10:01:03,015: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:01:03.015476140Z [2024-04-17 10:01:03,015: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:01:03.149313239Z [2024-04-17 10:01:03,144: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:01:05.866723230Z [2024-04-17 10:01:05,866: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89c08e9c-486c-498b-be5b-30dc71976b9d] succeeded in 5.351320723000072s: None 2024-04-17T10:01:06.531723546Z [2024-04-17 10:01:06,531: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc269566-1cc4-43e2-ba09-ff5fc714ea64] succeeded in 6.036400505999836s: None 2024-04-17T10:02:00.855092683Z [2024-04-17 10:02:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d0ca16f-663c-4024-9665-7f95e3397028] received 2024-04-17T10:02:00.870666683Z [2024-04-17 10:02:00,870: INFO/ForkPoolWorker-15] [9d0ca16f-663c-4024-9665-7f95e3397028] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:02:00.896121980Z [2024-04-17 10:02:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26c6b155-da54-4b53-8a41-8a4d5dea0ef4] received 2024-04-17T10:02:00.900231404Z [2024-04-17 10:02:00,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9913fbfb-8ef6-4300-80e5-83b6ab673fbe] received 2024-04-17T10:02:00.933339143Z [2024-04-17 10:02:00,932: INFO/ForkPoolWorker-1] [9913fbfb-8ef6-4300-80e5-83b6ab673fbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:02:00.949634493Z [2024-04-17 10:02:00,948: INFO/ForkPoolWorker-16] [26c6b155-da54-4b53-8a41-8a4d5dea0ef4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T10:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T10:02:01.455605573Z [2024-04-17 10:02:01,449: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T10:02:01.573621775Z [2024-04-17 10:02:01,569: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:02:01.586033527Z [2024-04-17 10:02:01,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:02:01.999823583Z [2024-04-17 10:02:01,999: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:02:02.801599450Z [2024-04-17 10:02:02,801: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26c6b155-da54-4b53-8a41-8a4d5dea0ef4] succeeded in 1.894987323000123s: None 2024-04-17T10:02:03.672355581Z [2024-04-17 10:02:03,671: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:02:03.676114861Z [2024-04-17 10:02:03,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:02:03.695595826Z [2024-04-17 10:02:03,695: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:02:03.699969498Z [2024-04-17 10:02:03,699: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:02:03.714654075Z [2024-04-17 10:02:03,714: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:02:03.716210016Z [2024-04-17 10:02:03,716: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:02:03.716227156Z [2024-04-17 10:02:03,716: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:02:03.716339736Z [2024-04-17 10:02:03,716: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:02:03.716370860Z [2024-04-17 10:02:03,716: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:02:03.716586416Z [2024-04-17 10:02:03,716: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:02:03.716721301Z [2024-04-17 10:02:03,716: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:02:03.753776418Z [2024-04-17 10:02:03,753: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:02:03.755143321Z [2024-04-17 10:02:03,754: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:02:03.755186566Z [2024-04-17 10:02:03,755: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:02:03.755787180Z [2024-04-17 10:02:03,755: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:02:03.755888791Z [2024-04-17 10:02:03,755: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:02:03.756507663Z [2024-04-17 10:02:03,756: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:02:03.756568900Z [2024-04-17 10:02:03,756: INFO/ForkPoolWorker-1] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:02:03.841353039Z [2024-04-17 10:02:03,841: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:02:03.911200411Z [2024-04-17 10:02:03,911: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:02:06.406034602Z [2024-04-17 10:02:06,405: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9913fbfb-8ef6-4300-80e5-83b6ab673fbe] succeeded in 5.501240738999968s: None 2024-04-17T10:02:06.738426309Z [2024-04-17 10:02:06,738: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d0ca16f-663c-4024-9665-7f95e3397028] succeeded in 5.879689949999829s: None 2024-04-17T10:03:00.574610677Z [2024-04-17 10:03:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b5c5784-5e00-4033-9e35-fda7c0f88bc5] received 2024-04-17T10:03:00.589461946Z [2024-04-17 10:03:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6e79286-f334-480d-9553-ce17eb24fa91] received 2024-04-17T10:03:00.597204726Z [2024-04-17 10:03:00,596: INFO/ForkPoolWorker-15] [1b5c5784-5e00-4033-9e35-fda7c0f88bc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:03:00.608188086Z [2024-04-17 10:03:00,607: INFO/ForkPoolWorker-16] [d6e79286-f334-480d-9553-ce17eb24fa91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:03:01.055001926Z [2024-04-17 10:03:01,051: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:03:01.132511077Z [2024-04-17 10:03:01,128: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:03:02.760678431Z [2024-04-17 10:03:02,760: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:03:02.765920438Z [2024-04-17 10:03:02,765: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:03:02.817195527Z [2024-04-17 10:03:02,813: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:03:02.818790725Z [2024-04-17 10:03:02,818: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:03:02.818806811Z [2024-04-17 10:03:02,818: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:03:02.818923790Z [2024-04-17 10:03:02,818: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:03:02.818954765Z [2024-04-17 10:03:02,818: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:03:02.819181609Z [2024-04-17 10:03:02,819: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:03:02.819226703Z [2024-04-17 10:03:02,819: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:03:02.899044906Z [2024-04-17 10:03:02,898: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:03:02.941652107Z [2024-04-17 10:03:02,941: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:03:02.945507518Z [2024-04-17 10:03:02,945: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:03:02.972405675Z [2024-04-17 10:03:02,972: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:03:02.973523799Z [2024-04-17 10:03:02,973: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:03:02.973610890Z [2024-04-17 10:03:02,973: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:03:02.973752383Z [2024-04-17 10:03:02,973: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:03:02.973823301Z [2024-04-17 10:03:02,973: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:03:02.974197325Z [2024-04-17 10:03:02,973: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:03:02.974304183Z [2024-04-17 10:03:02,974: INFO/ForkPoolWorker-15] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:03:03.128279254Z [2024-04-17 10:03:03,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:03:05.614620844Z [2024-04-17 10:03:05,614: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b5c5784-5e00-4033-9e35-fda7c0f88bc5] succeeded in 5.035521036000091s: None 2024-04-17T10:03:06.335262541Z [2024-04-17 10:03:06,334: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d6e79286-f334-480d-9553-ce17eb24fa91] succeeded in 5.74033931200006s: None 2024-04-17T10:04:00.180773011Z [2024-04-17 10:04:00,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[173234d7-0d53-420c-8adf-c0a2740ee819] received 2024-04-17T10:04:00.184827405Z [2024-04-17 10:04:00,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5f4b6f8-ae6e-4bcd-9eaa-560475f3b512] received 2024-04-17T10:04:00.201690985Z [2024-04-17 10:04:00,200: INFO/ForkPoolWorker-15] [173234d7-0d53-420c-8adf-c0a2740ee819] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:04:00.202646797Z [2024-04-17 10:04:00,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80ebf87d-1d7e-40c3-8fcd-af521dbf5b46] received 2024-04-17T10:04:00.219191300Z [2024-04-17 10:04:00,218: INFO/ForkPoolWorker-1] [80ebf87d-1d7e-40c3-8fcd-af521dbf5b46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:04:00.221783311Z [2024-04-17 10:04:00,221: INFO/ForkPoolWorker-16] [f5f4b6f8-ae6e-4bcd-9eaa-560475f3b512] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T10:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T10:04:00.693693912Z [2024-04-17 10:04:00,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:04:00.719133967Z [2024-04-17 10:04:00,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T10:04:00.844497150Z [2024-04-17 10:04:00,839: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:04:01.215340502Z [2024-04-17 10:04:01,215: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:04:02.139865015Z [2024-04-17 10:04:02,139: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5f4b6f8-ae6e-4bcd-9eaa-560475f3b512] succeeded in 1.9261688439999034s: None 2024-04-17T10:04:02.701028965Z [2024-04-17 10:04:02,700: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:04:02.705777412Z [2024-04-17 10:04:02,704: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:04:02.751618582Z [2024-04-17 10:04:02,751: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:04:02.752945848Z [2024-04-17 10:04:02,752: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:04:02.752986732Z [2024-04-17 10:04:02,752: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:04:02.753174249Z [2024-04-17 10:04:02,753: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:04:02.753297829Z [2024-04-17 10:04:02,753: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:04:02.753561326Z [2024-04-17 10:04:02,753: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:04:02.753771497Z [2024-04-17 10:04:02,753: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:04:02.835047565Z [2024-04-17 10:04:02,834: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:04:02.838707432Z [2024-04-17 10:04:02,838: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:04:02.858057799Z [2024-04-17 10:04:02,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:04:02.874799937Z [2024-04-17 10:04:02,874: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:04:02.878351349Z [2024-04-17 10:04:02,878: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:04:02.878370244Z [2024-04-17 10:04:02,878: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:04:02.879068488Z [2024-04-17 10:04:02,878: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:04:02.879122242Z [2024-04-17 10:04:02,879: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:04:02.879346049Z [2024-04-17 10:04:02,879: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:04:02.879379637Z [2024-04-17 10:04:02,879: INFO/ForkPoolWorker-1] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:04:02.972495993Z [2024-04-17 10:04:02,972: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:04:05.599524545Z [2024-04-17 10:04:05,599: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[80ebf87d-1d7e-40c3-8fcd-af521dbf5b46] succeeded in 5.392046856000206s: None 2024-04-17T10:04:06.377465154Z [2024-04-17 10:04:06,376: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[173234d7-0d53-420c-8adf-c0a2740ee819] succeeded in 6.19236578999994s: None 2024-04-17T10:05:00.857011647Z [2024-04-17 10:05:00,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac21eed8-ee98-4e75-8439-4e1000bcdd4d] received 2024-04-17T10:05:00.873506212Z [2024-04-17 10:05:00,873: INFO/ForkPoolWorker-15] [ac21eed8-ee98-4e75-8439-4e1000bcdd4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-17T10:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:05:00.887046562Z [2024-04-17 10:05:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9971bf9-501a-4e8a-8e87-b0e81909f8d0] received 2024-04-17T10:05:00.901859414Z [2024-04-17 10:05:00,901: INFO/ForkPoolWorker-16] [c9971bf9-501a-4e8a-8e87-b0e81909f8d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:05:00.947279250Z [2024-04-17 10:05:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60e2f336-9a50-4d67-8624-e3cfe04643d4] received 2024-04-17T10:05:00.982375268Z [2024-04-17 10:05:00,982: INFO/ForkPoolWorker-1] [60e2f336-9a50-4d67-8624-e3cfe04643d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:05:01.352766352Z [2024-04-17 10:05:01,348: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:05:01.507299575Z [2024-04-17 10:05:01,502: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:05:01.594259147Z [2024-04-17 10:05:01,588: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:05:03.093878296Z [2024-04-17 10:05:03,088: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:05:03.097054774Z [2024-04-17 10:05:03,093: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:05:03.218778431Z [2024-04-17 10:05:03,218: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:05:03.220647168Z [2024-04-17 10:05:03,220: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:05:03.220668283Z [2024-04-17 10:05:03,220: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:05:03.220838249Z [2024-04-17 10:05:03,220: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:05:03.220897446Z [2024-04-17 10:05:03,220: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:05:03.221182638Z [2024-04-17 10:05:03,221: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:05:03.221228945Z [2024-04-17 10:05:03,221: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:05:03.390604249Z [2024-04-17 10:05:03,390: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:05:03.463408124Z [2024-04-17 10:05:03,462: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:05:03.473829177Z [2024-04-17 10:05:03,471: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:05:03.526877416Z [2024-04-17 10:05:03,526: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:05:03.531600991Z [2024-04-17 10:05:03,531: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:05:03.531655990Z [2024-04-17 10:05:03,531: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:05:03.531919665Z [2024-04-17 10:05:03,531: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:05:03.532228857Z [2024-04-17 10:05:03,532: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:05:03.532503267Z [2024-04-17 10:05:03,532: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:05:03.532848174Z [2024-04-17 10:05:03,532: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:05:03.708409074Z [2024-04-17 10:05:03,708: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:05:03.713220285Z [2024-04-17 10:05:03,712: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:05:03.778202995Z [2024-04-17 10:05:03,777: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:05:03.780099489Z [2024-04-17 10:05:03,779: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:05:03.784667650Z [2024-04-17 10:05:03,784: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:05:03.784679457Z [2024-04-17 10:05:03,784: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:05:03.785008032Z [2024-04-17 10:05:03,784: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:05:03.785040916Z [2024-04-17 10:05:03,784: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:05:03.785261379Z [2024-04-17 10:05:03,785: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:05:03.785287997Z [2024-04-17 10:05:03,785: INFO/ForkPoolWorker-1] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:05:03.921383924Z [2024-04-17 10:05:03,921: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:05:04.683395980Z [2024-04-17 10:05:04,682: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac21eed8-ee98-4e75-8439-4e1000bcdd4d] succeeded in 3.8227885649998825s: None 2024-04-17T10:05:04.994000713Z [2024-04-17 10:05:04,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4016d51e-3907-4a2b-9158-82a8e90450b7] received 2024-04-17T10:05:05.006352780Z [2024-04-17 10:05:05,006: INFO/ForkPoolWorker-15] [4016d51e-3907-4a2b-9158-82a8e90450b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'split_metrics', 'scheduled__2024-04-17T10:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:05:05.337999778Z [2024-04-17 10:05:05,334: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:05:06.427960636Z [2024-04-17 10:05:06,427: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60e2f336-9a50-4d67-8624-e3cfe04643d4] succeeded in 5.475563618000024s: None 2024-04-17T10:05:06.787524129Z [2024-04-17 10:05:06,787: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:05:06.791530289Z [2024-04-17 10:05:06,791: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:05:06.843084207Z [2024-04-17 10:05:06,842: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:05:06.845092197Z [2024-04-17 10:05:06,844: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:05:06.845104516Z [2024-04-17 10:05:06,844: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:05:06.845415894Z [2024-04-17 10:05:06,844: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:05:06.845468414Z [2024-04-17 10:05:06,845: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:05:06.845752766Z [2024-04-17 10:05:06,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:05:06.845788610Z [2024-04-17 10:05:06,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:05:06.927658331Z [2024-04-17 10:05:06,927: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9971bf9-501a-4e8a-8e87-b0e81909f8d0] succeeded in 6.034568884999999s: None 2024-04-17T10:05:06.936939283Z [2024-04-17 10:05:06,936: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:05:07.683080068Z [2024-04-17 10:05:07,682: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4016d51e-3907-4a2b-9158-82a8e90450b7] succeeded in 2.685038005999786s: None 2024-04-17T10:05:07.769042601Z [2024-04-17 10:05:07,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b22932ed-1521-4960-9286-428fb13fd165] received 2024-04-17T10:05:07.793722130Z [2024-04-17 10:05:07,793: INFO/ForkPoolWorker-15] [b22932ed-1521-4960-9286-428fb13fd165] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'collect_metrics', 'scheduled__2024-04-17T10:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-17T10:05:08.150065248Z [2024-04-17 10:05:08,146: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:05:09.451481301Z [2024-04-17 10:05:09,451: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:05:09.455532350Z [2024-04-17 10:05:09,454: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:05:09.486200908Z [2024-04-17 10:05:09,485: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:05:09.487492724Z [2024-04-17 10:05:09,487: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:05:09.487574461Z [2024-04-17 10:05:09,487: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:05:09.487702414Z [2024-04-17 10:05:09,487: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:05:09.487722590Z [2024-04-17 10:05:09,487: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:05:09.487932439Z [2024-04-17 10:05:09,487: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:05:09.487971696Z [2024-04-17 10:05:09,487: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:05:09.601216592Z [2024-04-17 10:05:09,600: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:05:11.099310384Z [2024-04-17 10:05:11,098: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b22932ed-1521-4960-9286-428fb13fd165] succeeded in 3.31495943799996s: None 2024-04-17T10:05:11.977272501Z [2024-04-17 10:05:11,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f11c382-d5a8-4104-92f8-a0e64541f3ad] received 2024-04-17T10:05:11.987685020Z [2024-04-17 10:05:11,987: INFO/ForkPoolWorker-15] [3f11c382-d5a8-4104-92f8-a0e64541f3ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'send_prometheus', 'scheduled__2024-04-17T10:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:05:12.312492909Z [2024-04-17 10:05:12,308: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:05:13.573351774Z [2024-04-17 10:05:13,569: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:05:13.580998340Z [2024-04-17 10:05:13,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:05:13.686441946Z [2024-04-17 10:05:13,686: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:05:13.687866581Z [2024-04-17 10:05:13,687: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:05:13.687878929Z [2024-04-17 10:05:13,687: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:05:13.687997140Z [2024-04-17 10:05:13,687: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:05:13.688022673Z [2024-04-17 10:05:13,687: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:05:13.688217849Z [2024-04-17 10:05:13,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:05:13.688248574Z [2024-04-17 10:05:13,688: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:05:13.781210040Z [2024-04-17 10:05:13,780: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:05:14.368732608Z [2024-04-17 10:05:14,367: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f11c382-d5a8-4104-92f8-a0e64541f3ad] succeeded in 2.3876980229999845s: None 2024-04-17T10:06:00.327122753Z [2024-04-17 10:06:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[444334c9-b972-465c-80ac-5a35c0460208] received 2024-04-17T10:06:00.337541423Z [2024-04-17 10:06:00,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca48b652-5cdd-417b-8e6f-53d6ff01e5a6] received 2024-04-17T10:06:00.341359062Z [2024-04-17 10:06:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bed0831b-f767-494c-b725-c2963a440efd] received 2024-04-17T10:06:00.345399422Z [2024-04-17 10:06:00,344: INFO/ForkPoolWorker-15] [444334c9-b972-465c-80ac-5a35c0460208] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T10:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T10:06:00.359842522Z [2024-04-17 10:06:00,358: INFO/ForkPoolWorker-1] [bed0831b-f767-494c-b725-c2963a440efd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:06:00.360097459Z [2024-04-17 10:06:00,359: INFO/ForkPoolWorker-16] [ca48b652-5cdd-417b-8e6f-53d6ff01e5a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:06:00.855615355Z [2024-04-17 10:06:00,847: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:06:00.856844852Z [2024-04-17 10:06:00,848: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:06:01.540669264Z [2024-04-17 10:06:01,527: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T10:06:02.040046353Z [2024-04-17 10:06:02,039: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:06:02.643139467Z [2024-04-17 10:06:02,642: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:06:02.647203315Z [2024-04-17 10:06:02,646: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:06:02.711890924Z [2024-04-17 10:06:02,711: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:06:02.714139655Z [2024-04-17 10:06:02,713: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:06:02.714156319Z [2024-04-17 10:06:02,714: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:06:02.714314009Z [2024-04-17 10:06:02,714: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:06:02.714342683Z [2024-04-17 10:06:02,714: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:06:02.715404307Z [2024-04-17 10:06:02,715: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:06:02.715420848Z [2024-04-17 10:06:02,715: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:06:02.874466512Z [2024-04-17 10:06:02,874: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:06:02.947322273Z [2024-04-17 10:06:02,946: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[444334c9-b972-465c-80ac-5a35c0460208] succeeded in 2.6161775850000595s: None 2024-04-17T10:06:03.243988804Z [2024-04-17 10:06:03,243: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:06:03.247612316Z [2024-04-17 10:06:03,247: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:06:03.290813785Z [2024-04-17 10:06:03,290: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:06:03.292306057Z [2024-04-17 10:06:03,292: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:06:03.293569786Z [2024-04-17 10:06:03,292: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:06:03.293799525Z [2024-04-17 10:06:03,293: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:06:03.294421969Z [2024-04-17 10:06:03,294: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:06:03.295229505Z [2024-04-17 10:06:03,295: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:06:03.295448444Z [2024-04-17 10:06:03,295: INFO/ForkPoolWorker-1] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:06:03.453528465Z [2024-04-17 10:06:03,453: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:06:05.785648585Z [2024-04-17 10:06:05,785: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bed0831b-f767-494c-b725-c2963a440efd] succeeded in 5.440214216999948s: None 2024-04-17T10:06:06.031128075Z [2024-04-17 10:06:06,030: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca48b652-5cdd-417b-8e6f-53d6ff01e5a6] succeeded in 5.685425788999964s: None 2024-04-17T10:07:00.761291549Z [2024-04-17 10:07:00,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0c409e4-dd17-40c6-9d6e-dd18252f8b10] received 2024-04-17T10:07:00.767787957Z [2024-04-17 10:07:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54156dd9-1727-4480-8e67-509d08bc022f] received 2024-04-17T10:07:00.787222028Z [2024-04-17 10:07:00,786: INFO/ForkPoolWorker-16] [54156dd9-1727-4480-8e67-509d08bc022f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:07:00.791312305Z [2024-04-17 10:07:00,791: INFO/ForkPoolWorker-15] [f0c409e4-dd17-40c6-9d6e-dd18252f8b10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:07:01.220324576Z [2024-04-17 10:07:01,213: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:07:01.225516298Z [2024-04-17 10:07:01,222: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:07:02.917825552Z [2024-04-17 10:07:02,917: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:07:02.923164307Z [2024-04-17 10:07:02,922: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:07:02.942608689Z [2024-04-17 10:07:02,942: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:07:02.948184380Z [2024-04-17 10:07:02,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:07:02.963636437Z [2024-04-17 10:07:02,963: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:07:02.965236133Z [2024-04-17 10:07:02,965: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:07:02.965253042Z [2024-04-17 10:07:02,965: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:07:02.965394774Z [2024-04-17 10:07:02,965: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:07:02.965405817Z [2024-04-17 10:07:02,965: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:07:02.966055961Z [2024-04-17 10:07:02,965: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:07:02.966204604Z [2024-04-17 10:07:02,966: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:07:02.994500068Z [2024-04-17 10:07:02,994: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:07:02.995906011Z [2024-04-17 10:07:02,995: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:07:02.995916839Z [2024-04-17 10:07:02,995: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:07:02.996027029Z [2024-04-17 10:07:02,995: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:07:02.996036546Z [2024-04-17 10:07:02,995: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:07:02.996266698Z [2024-04-17 10:07:02,996: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:07:02.996273476Z [2024-04-17 10:07:02,996: INFO/ForkPoolWorker-15] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:07:03.150379537Z [2024-04-17 10:07:03,150: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:07:03.168481729Z [2024-04-17 10:07:03,168: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:07:06.043366104Z [2024-04-17 10:07:06,043: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0c409e4-dd17-40c6-9d6e-dd18252f8b10] succeeded in 5.27680268600011s: None 2024-04-17T10:07:07.075818671Z [2024-04-17 10:07:07,075: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[54156dd9-1727-4480-8e67-509d08bc022f] succeeded in 6.304201898999963s: None 2024-04-17T10:08:00.630532447Z [2024-04-17 10:08:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4725b3ac-ed48-44e1-aded-e4e9d9e94b83] received 2024-04-17T10:08:00.645510644Z [2024-04-17 10:08:00,645: INFO/ForkPoolWorker-15] [4725b3ac-ed48-44e1-aded-e4e9d9e94b83] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T10:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T10:08:00.652031524Z [2024-04-17 10:08:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94185894-448d-4b33-9424-2ad6ecf28a18] received 2024-04-17T10:08:00.657407502Z [2024-04-17 10:08:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33e51683-1f37-4857-be37-bed89118a7d7] received 2024-04-17T10:08:00.678481690Z [2024-04-17 10:08:00,678: INFO/ForkPoolWorker-1] [33e51683-1f37-4857-be37-bed89118a7d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:08:00.697550141Z [2024-04-17 10:08:00,697: INFO/ForkPoolWorker-16] [94185894-448d-4b33-9424-2ad6ecf28a18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:08:01.274874954Z [2024-04-17 10:08:01,270: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:08:01.327759162Z [2024-04-17 10:08:01,322: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:08:01.376039265Z [2024-04-17 10:08:01,370: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T10:08:01.878498789Z [2024-04-17 10:08:01,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:08:02.914587778Z [2024-04-17 10:08:02,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4725b3ac-ed48-44e1-aded-e4e9d9e94b83] succeeded in 2.279734453999936s: None 2024-04-17T10:08:03.240336861Z [2024-04-17 10:08:03,239: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:08:03.244085520Z [2024-04-17 10:08:03,243: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:08:03.300342272Z [2024-04-17 10:08:03,300: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:08:03.309163345Z [2024-04-17 10:08:03,308: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:08:03.309221903Z [2024-04-17 10:08:03,309: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:08:03.309495643Z [2024-04-17 10:08:03,309: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:08:03.309557286Z [2024-04-17 10:08:03,309: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:08:03.309898199Z [2024-04-17 10:08:03,309: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:08:03.309968810Z [2024-04-17 10:08:03,309: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:08:03.440432868Z [2024-04-17 10:08:03,440: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:08:03.845315891Z [2024-04-17 10:08:03,844: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:08:03.849454722Z [2024-04-17 10:08:03,849: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:08:03.922742478Z [2024-04-17 10:08:03,922: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:08:03.925751619Z [2024-04-17 10:08:03,925: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:08:03.926005344Z [2024-04-17 10:08:03,925: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:08:03.926516757Z [2024-04-17 10:08:03,926: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:08:03.926680976Z [2024-04-17 10:08:03,926: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:08:03.927067331Z [2024-04-17 10:08:03,926: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:08:03.927345657Z [2024-04-17 10:08:03,927: INFO/ForkPoolWorker-1] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:08:04.103110787Z [2024-04-17 10:08:04,102: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:08:06.345239477Z [2024-04-17 10:08:06,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33e51683-1f37-4857-be37-bed89118a7d7] succeeded in 5.684007630999986s: None 2024-04-17T10:08:06.835900939Z [2024-04-17 10:08:06,835: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94185894-448d-4b33-9424-2ad6ecf28a18] succeeded in 6.1805107119998866s: None 2024-04-17T10:09:00.256236564Z [2024-04-17 10:09:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[504325e7-8a27-4035-acca-cf721a31f15c] received 2024-04-17T10:09:00.266986578Z [2024-04-17 10:09:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2632c762-5c45-4c92-9bc9-2aded3300c5e] received 2024-04-17T10:09:00.285290815Z [2024-04-17 10:09:00,284: INFO/ForkPoolWorker-15] [504325e7-8a27-4035-acca-cf721a31f15c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:09:00.286614432Z [2024-04-17 10:09:00,286: INFO/ForkPoolWorker-16] [2632c762-5c45-4c92-9bc9-2aded3300c5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:09:00.721268623Z [2024-04-17 10:09:00,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:09:00.763135622Z [2024-04-17 10:09:00,758: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:09:02.354583123Z [2024-04-17 10:09:02,354: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:09:02.358462903Z [2024-04-17 10:09:02,358: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:09:02.370391441Z [2024-04-17 10:09:02,369: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:09:02.373956007Z [2024-04-17 10:09:02,373: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:09:02.400820395Z [2024-04-17 10:09:02,400: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:09:02.402399848Z [2024-04-17 10:09:02,402: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:09:02.402983740Z [2024-04-17 10:09:02,402: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:09:02.403211350Z [2024-04-17 10:09:02,403: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:09:02.403318671Z [2024-04-17 10:09:02,403: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:09:02.403642254Z [2024-04-17 10:09:02,403: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:09:02.403750385Z [2024-04-17 10:09:02,403: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:09:02.409306950Z [2024-04-17 10:09:02,409: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:09:02.410363533Z [2024-04-17 10:09:02,410: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:09:02.410402443Z [2024-04-17 10:09:02,410: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:09:02.410569065Z [2024-04-17 10:09:02,410: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:09:02.410618753Z [2024-04-17 10:09:02,410: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:09:02.410852091Z [2024-04-17 10:09:02,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:09:02.411752505Z [2024-04-17 10:09:02,410: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:09:02.481879993Z [2024-04-17 10:09:02,481: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:09:02.494915192Z [2024-04-17 10:09:02,494: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:09:04.291926678Z [2024-04-17 10:09:04,291: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2632c762-5c45-4c92-9bc9-2aded3300c5e] succeeded in 4.01813152800014s: None 2024-04-17T10:09:04.711001311Z [2024-04-17 10:09:04,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[504325e7-8a27-4035-acca-cf721a31f15c] succeeded in 4.448252785000022s: None 2024-04-17T10:10:01.046247525Z [2024-04-17 10:10:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4eed1fed-a2cb-4835-a958-a3d167eb5575] received 2024-04-17T10:10:01.049347017Z [2024-04-17 10:10:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0a4040a-e495-4e81-8f0b-0ca3cca16213] received 2024-04-17T10:10:01.064289151Z [2024-04-17 10:10:01,063: INFO/ForkPoolWorker-15] [4eed1fed-a2cb-4835-a958-a3d167eb5575] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-17T10:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:10:01.068386720Z [2024-04-17 10:10:01,067: INFO/ForkPoolWorker-16] [b0a4040a-e495-4e81-8f0b-0ca3cca16213] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T10:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T10:10:01.094550486Z [2024-04-17 10:10:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57642d2f-bb2b-418b-96e3-e0cdea887a9a] received 2024-04-17T10:10:01.116420546Z [2024-04-17 10:10:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2fd8adf-6c04-4449-8542-fcaca2170834] received 2024-04-17T10:10:01.131826179Z [2024-04-17 10:10:01,131: INFO/ForkPoolWorker-2] [a2fd8adf-6c04-4449-8542-fcaca2170834] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:10:01.157359895Z [2024-04-17 10:10:01,155: INFO/ForkPoolWorker-1] [57642d2f-bb2b-418b-96e3-e0cdea887a9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:10:01.622957306Z [2024-04-17 10:10:01,613: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T10:10:01.792482464Z [2024-04-17 10:10:01,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:10:01.803001726Z [2024-04-17 10:10:01,789: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:10:01.917720647Z [2024-04-17 10:10:01,913: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:10:02.067530926Z [2024-04-17 10:10:02,067: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:10:03.291308161Z [2024-04-17 10:10:03,290: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0a4040a-e495-4e81-8f0b-0ca3cca16213] succeeded in 2.2398482879998483s: None 2024-04-17T10:10:04.008148804Z [2024-04-17 10:10:04,007: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:10:04.016695646Z [2024-04-17 10:10:04,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:10:04.138259957Z [2024-04-17 10:10:04,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:10:04.139661419Z [2024-04-17 10:10:04,139: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:10:04.139762270Z [2024-04-17 10:10:04,139: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:10:04.139960342Z [2024-04-17 10:10:04,139: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:10:04.140060609Z [2024-04-17 10:10:04,139: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:10:04.140396901Z [2024-04-17 10:10:04,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:10:04.140555647Z [2024-04-17 10:10:04,140: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:10:04.148274229Z [2024-04-17 10:10:04,147: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-17T10:10:04.152804646Z [2024-04-17 10:10:04,152: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:10:04.241225537Z [2024-04-17 10:10:04,240: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-17T10:10:04.243392896Z [2024-04-17 10:10:04,243: INFO/ForkPoolWorker-2] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:10:04.243412618Z [2024-04-17 10:10:04,243: INFO/ForkPoolWorker-2] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:10:04.243518732Z [2024-04-17 10:10:04,243: INFO/ForkPoolWorker-2] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:10:04.243529216Z [2024-04-17 10:10:04,243: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-17T10:10:04.243820431Z [2024-04-17 10:10:04,243: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:10:04.243829617Z [2024-04-17 10:10:04,243: INFO/ForkPoolWorker-2] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:10:04.270132011Z [2024-04-17 10:10:04,269: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:10:04.348534207Z [2024-04-17 10:10:04,348: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:10:04.799410863Z [2024-04-17 10:10:04,799: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:10:04.806176784Z [2024-04-17 10:10:04,805: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:10:04.868273863Z [2024-04-17 10:10:04,868: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:10:04.873250286Z [2024-04-17 10:10:04,871: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:10:04.873521427Z [2024-04-17 10:10:04,873: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:10:04.873741442Z [2024-04-17 10:10:04,873: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:10:04.874473429Z [2024-04-17 10:10:04,874: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:10:04.875287235Z [2024-04-17 10:10:04,874: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:10:04.875433400Z [2024-04-17 10:10:04,875: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:10:04.994496430Z [2024-04-17 10:10:04,994: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:10:05.387536741Z [2024-04-17 10:10:05,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4eed1fed-a2cb-4835-a958-a3d167eb5575] succeeded in 4.337684779000028s: None 2024-04-17T10:10:05.415783367Z [2024-04-17 10:10:05,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9c03d04-d551-4dd0-ad78-82d0fc14af07] received 2024-04-17T10:10:05.429509979Z [2024-04-17 10:10:05,429: INFO/ForkPoolWorker-15] [c9c03d04-d551-4dd0-ad78-82d0fc14af07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'split_metrics', 'scheduled__2024-04-17T10:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:10:05.892120090Z [2024-04-17 10:10:05,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:10:06.448144687Z [2024-04-17 10:10:06,447: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a2fd8adf-6c04-4449-8542-fcaca2170834] succeeded in 5.32773930500025s: None 2024-04-17T10:10:07.271276208Z [2024-04-17 10:10:07,270: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:10:07.276048917Z [2024-04-17 10:10:07,275: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:10:07.315072693Z [2024-04-17 10:10:07,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:10:07.316832001Z [2024-04-17 10:10:07,316: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:10:07.317016471Z [2024-04-17 10:10:07,316: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:10:07.317256117Z [2024-04-17 10:10:07,317: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:10:07.317943407Z [2024-04-17 10:10:07,317: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:10:07.318299862Z [2024-04-17 10:10:07,318: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:10:07.318480066Z [2024-04-17 10:10:07,318: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:10:07.378708581Z [2024-04-17 10:10:07,378: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[57642d2f-bb2b-418b-96e3-e0cdea887a9a] succeeded in 6.275467854999988s: None 2024-04-17T10:10:07.399803294Z [2024-04-17 10:10:07,399: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:10:08.011872269Z [2024-04-17 10:10:08,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b88c3b3-2c52-4b14-81a8-b52244426e9a] received 2024-04-17T10:10:08.025799017Z [2024-04-17 10:10:08,025: INFO/ForkPoolWorker-16] [6b88c3b3-2c52-4b14-81a8-b52244426e9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'collect_metrics', 'scheduled__2024-04-17T10:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-17T10:10:08.091970752Z [2024-04-17 10:10:08,091: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9c03d04-d551-4dd0-ad78-82d0fc14af07] succeeded in 2.671955777000221s: None 2024-04-17T10:10:08.414521467Z [2024-04-17 10:10:08,410: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:10:09.832127184Z [2024-04-17 10:10:09,827: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:10:09.832155755Z [2024-04-17 10:10:09,831: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:10:09.872448232Z [2024-04-17 10:10:09,870: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:10:09.875391332Z [2024-04-17 10:10:09,874: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:10:09.875406275Z [2024-04-17 10:10:09,874: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:10:09.875410208Z [2024-04-17 10:10:09,874: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:10:09.875413927Z [2024-04-17 10:10:09,874: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:10:09.875416981Z [2024-04-17 10:10:09,874: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:10:09.875456421Z [2024-04-17 10:10:09,875: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:10:09.962324937Z [2024-04-17 10:10:09,962: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:10:11.506384663Z [2024-04-17 10:10:11,505: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b88c3b3-2c52-4b14-81a8-b52244426e9a] succeeded in 3.4924344519999977s: None 2024-04-17T10:10:11.525804087Z [2024-04-17 10:10:11,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a45ed9b0-8597-4814-85ff-41384942a692] received 2024-04-17T10:10:11.543288545Z [2024-04-17 10:10:11,543: INFO/ForkPoolWorker-15] [a45ed9b0-8597-4814-85ff-41384942a692] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'send_prometheus', 'scheduled__2024-04-17T10:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:10:11.899773994Z [2024-04-17 10:10:11,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:10:13.286445192Z [2024-04-17 10:10:13,286: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:10:13.290375164Z [2024-04-17 10:10:13,289: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:10:13.341740240Z [2024-04-17 10:10:13,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:10:13.343056682Z [2024-04-17 10:10:13,342: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:10:13.343202979Z [2024-04-17 10:10:13,343: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:10:13.343407563Z [2024-04-17 10:10:13,343: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:10:13.343593301Z [2024-04-17 10:10:13,343: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:10:13.343903730Z [2024-04-17 10:10:13,343: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:10:13.344099046Z [2024-04-17 10:10:13,344: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:10:13.480672705Z [2024-04-17 10:10:13,480: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:10:14.082999687Z [2024-04-17 10:10:14,082: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a45ed9b0-8597-4814-85ff-41384942a692] succeeded in 2.552279523999914s: None 2024-04-17T10:11:01.069911957Z [2024-04-17 10:11:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd4f741c-271c-44fa-b939-85c2f6ba1a8f] received 2024-04-17T10:11:01.072740451Z [2024-04-17 10:11:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36f832d9-bf6f-4abc-9f15-6519a9568860] received 2024-04-17T10:11:01.084632123Z [2024-04-17 10:11:01,084: INFO/ForkPoolWorker-16] [36f832d9-bf6f-4abc-9f15-6519a9568860] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:11:01.087339072Z [2024-04-17 10:11:01,087: INFO/ForkPoolWorker-15] [cd4f741c-271c-44fa-b939-85c2f6ba1a8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:11:01.553875832Z [2024-04-17 10:11:01,550: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:11:01.567694438Z [2024-04-17 10:11:01,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:11:03.190984833Z [2024-04-17 10:11:03,190: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:11:03.194515127Z [2024-04-17 10:11:03,194: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:11:03.240387196Z [2024-04-17 10:11:03,240: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:11:03.246318761Z [2024-04-17 10:11:03,246: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:11:03.246341374Z [2024-04-17 10:11:03,246: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:11:03.246489133Z [2024-04-17 10:11:03,246: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:11:03.246512757Z [2024-04-17 10:11:03,246: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:11:03.246857082Z [2024-04-17 10:11:03,246: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:11:03.246870014Z [2024-04-17 10:11:03,246: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:11:03.256324135Z [2024-04-17 10:11:03,256: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:11:03.259949119Z [2024-04-17 10:11:03,259: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:11:03.291284545Z [2024-04-17 10:11:03,291: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:11:03.301260234Z [2024-04-17 10:11:03,300: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:11:03.301382882Z [2024-04-17 10:11:03,301: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:11:03.301515606Z [2024-04-17 10:11:03,301: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:11:03.301549962Z [2024-04-17 10:11:03,301: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:11:03.302889977Z [2024-04-17 10:11:03,301: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:11:03.303001428Z [2024-04-17 10:11:03,302: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:11:03.414356316Z [2024-04-17 10:11:03,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:11:03.439819622Z [2024-04-17 10:11:03,439: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:11:05.791635900Z [2024-04-17 10:11:05,790: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36f832d9-bf6f-4abc-9f15-6519a9568860] succeeded in 4.716847627000334s: None 2024-04-17T10:11:06.403391424Z [2024-04-17 10:11:06,402: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd4f741c-271c-44fa-b939-85c2f6ba1a8f] succeeded in 5.326223731999562s: None 2024-04-17T10:11:38.676813682Z [2024-04-17 10:11:38,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09f855c3-ed44-4a67-a014-18a4e0a796fb] received 2024-04-17T10:11:38.693917432Z [2024-04-17 10:11:38,693: INFO/ForkPoolWorker-15] [09f855c3-ed44-4a67-a014-18a4e0a796fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240417101137_413539', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-17T10:11:39.019869236Z [2024-04-17 10:11:39,015: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-17T10:11:39.356560305Z [2024-04-17 10:11:39,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:11:40.011350484Z [2024-04-17 10:11:40,010: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09f855c3-ed44-4a67-a014-18a4e0a796fb] succeeded in 1.3296746599999096s: None 2024-04-17T10:12:01.087673590Z [2024-04-17 10:12:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a440aaf-3c47-4405-bf2a-a4f8c9ae56d4] received 2024-04-17T10:12:01.093931355Z [2024-04-17 10:12:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3862dce2-e618-4cf1-b5af-2e25addefd9d] received 2024-04-17T10:12:01.095904669Z [2024-04-17 10:12:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39738d22-c3e3-4be5-9058-0ae8d345a5fc] received 2024-04-17T10:12:01.100981448Z [2024-04-17 10:12:01,100: INFO/ForkPoolWorker-15] [6a440aaf-3c47-4405-bf2a-a4f8c9ae56d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T10:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T10:12:01.105384741Z [2024-04-17 10:12:01,105: INFO/ForkPoolWorker-16] [3862dce2-e618-4cf1-b5af-2e25addefd9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:12:01.111898942Z [2024-04-17 10:12:01,111: INFO/ForkPoolWorker-1] [39738d22-c3e3-4be5-9058-0ae8d345a5fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:12:01.622735782Z [2024-04-17 10:12:01,617: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:12:01.695677217Z [2024-04-17 10:12:01,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T10:12:01.880438668Z [2024-04-17 10:12:01,875: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:12:02.171694585Z [2024-04-17 10:12:02,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:12:03.208180938Z [2024-04-17 10:12:03,207: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a440aaf-3c47-4405-bf2a-a4f8c9ae56d4] succeeded in 2.1162435349997395s: None 2024-04-17T10:12:03.645007921Z [2024-04-17 10:12:03,644: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:12:03.652090631Z [2024-04-17 10:12:03,651: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:12:03.712941508Z [2024-04-17 10:12:03,712: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:12:03.714005961Z [2024-04-17 10:12:03,713: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:12:03.714189036Z [2024-04-17 10:12:03,714: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:12:03.714340438Z [2024-04-17 10:12:03,714: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:12:03.714423883Z [2024-04-17 10:12:03,714: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:12:03.714641160Z [2024-04-17 10:12:03,714: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:12:03.714989625Z [2024-04-17 10:12:03,714: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:12:03.759162014Z [2024-04-17 10:12:03,758: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:12:03.763727483Z [2024-04-17 10:12:03,763: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:12:03.815759438Z [2024-04-17 10:12:03,815: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:12:03.837715705Z [2024-04-17 10:12:03,837: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:12:03.837863422Z [2024-04-17 10:12:03,837: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:12:03.838072233Z [2024-04-17 10:12:03,837: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:12:03.838570307Z [2024-04-17 10:12:03,838: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:12:03.839187953Z [2024-04-17 10:12:03,839: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:12:03.839381426Z [2024-04-17 10:12:03,839: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:12:03.857515918Z [2024-04-17 10:12:03,857: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:12:03.929042013Z [2024-04-17 10:12:03,928: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:12:06.274945082Z [2024-04-17 10:12:06,274: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3862dce2-e618-4cf1-b5af-2e25addefd9d] succeeded in 5.178646320000098s: None 2024-04-17T10:12:06.720383960Z [2024-04-17 10:12:06,718: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39738d22-c3e3-4be5-9058-0ae8d345a5fc] succeeded in 5.619741236000209s: None 2024-04-17T10:13:00.848578142Z [2024-04-17 10:13:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a164ef6b-c4e2-49d8-aba8-06dfc6b6706e] received 2024-04-17T10:13:00.865841335Z [2024-04-17 10:13:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[968cae5d-f172-49c3-baa5-23f7399f97fe] received 2024-04-17T10:13:00.876052027Z [2024-04-17 10:13:00,875: INFO/ForkPoolWorker-15] [a164ef6b-c4e2-49d8-aba8-06dfc6b6706e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:13:00.895543176Z [2024-04-17 10:13:00,895: INFO/ForkPoolWorker-16] [968cae5d-f172-49c3-baa5-23f7399f97fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:13:01.467555106Z [2024-04-17 10:13:01,457: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:13:01.534605868Z [2024-04-17 10:13:01,526: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:13:03.280647592Z [2024-04-17 10:13:03,280: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:13:03.289023417Z [2024-04-17 10:13:03,287: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:13:03.348113928Z [2024-04-17 10:13:03,347: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:13:03.349924172Z [2024-04-17 10:13:03,349: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:13:03.352523985Z [2024-04-17 10:13:03,352: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:13:03.352543918Z [2024-04-17 10:13:03,352: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:13:03.352678077Z [2024-04-17 10:13:03,352: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:13:03.352684837Z [2024-04-17 10:13:03,352: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:13:03.353768262Z [2024-04-17 10:13:03,353: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:13:03.353782368Z [2024-04-17 10:13:03,353: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:13:03.353786628Z [2024-04-17 10:13:03,352: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:13:03.407364482Z [2024-04-17 10:13:03,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:13:03.409404959Z [2024-04-17 10:13:03,409: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:13:03.409423901Z [2024-04-17 10:13:03,409: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:13:03.409539274Z [2024-04-17 10:13:03,409: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:13:03.409566325Z [2024-04-17 10:13:03,409: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:13:03.409769622Z [2024-04-17 10:13:03,409: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:13:03.409802123Z [2024-04-17 10:13:03,409: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:13:03.453192090Z [2024-04-17 10:13:03,452: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:13:03.506356574Z [2024-04-17 10:13:03,506: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:13:06.337586510Z [2024-04-17 10:13:06,337: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[968cae5d-f172-49c3-baa5-23f7399f97fe] succeeded in 5.466467747000024s: None 2024-04-17T10:13:06.845951746Z [2024-04-17 10:13:06,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a164ef6b-c4e2-49d8-aba8-06dfc6b6706e] succeeded in 5.993823699999666s: None 2024-04-17T10:14:01.188229746Z [2024-04-17 10:14:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f76c18e3-6bf9-4f3d-8548-f190f1a131ec] received 2024-04-17T10:14:01.203254606Z [2024-04-17 10:14:01,202: INFO/ForkPoolWorker-15] [f76c18e3-6bf9-4f3d-8548-f190f1a131ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:14:01.210763251Z [2024-04-17 10:14:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bb8e6c4-7dc3-4080-9070-7ebe4fdd55ce] received 2024-04-17T10:14:01.223726014Z [2024-04-17 10:14:01,223: INFO/ForkPoolWorker-16] [2bb8e6c4-7dc3-4080-9070-7ebe4fdd55ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-17T10:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-17T10:14:01.239021886Z [2024-04-17 10:14:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9beeadb2-ca88-439b-98a3-3df5bd0b6bc7] received 2024-04-17T10:14:01.275728010Z [2024-04-17 10:14:01,275: INFO/ForkPoolWorker-1] [9beeadb2-ca88-439b-98a3-3df5bd0b6bc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:14:01.695862232Z [2024-04-17 10:14:01,675: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:14:01.860798273Z [2024-04-17 10:14:01,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:14:01.923612100Z [2024-04-17 10:14:01,917: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-17T10:14:02.448062345Z [2024-04-17 10:14:02,447: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:14:03.831166258Z [2024-04-17 10:14:03,830: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2bb8e6c4-7dc3-4080-9070-7ebe4fdd55ce] succeeded in 2.614875960000063s: None 2024-04-17T10:14:04.091384667Z [2024-04-17 10:14:04,090: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:14:04.111423512Z [2024-04-17 10:14:04,110: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:14:04.182927501Z [2024-04-17 10:14:04,182: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:14:04.193152729Z [2024-04-17 10:14:04,192: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:14:04.193273632Z [2024-04-17 10:14:04,193: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:14:04.193426433Z [2024-04-17 10:14:04,193: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:14:04.193474881Z [2024-04-17 10:14:04,193: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:14:04.193892788Z [2024-04-17 10:14:04,193: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:14:04.193951659Z [2024-04-17 10:14:04,193: INFO/ForkPoolWorker-1] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:14:04.278923913Z [2024-04-17 10:14:04,278: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:14:04.288642496Z [2024-04-17 10:14:04,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:14:04.420658606Z [2024-04-17 10:14:04,420: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:14:04.437396261Z [2024-04-17 10:14:04,437: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:14:04.437842247Z [2024-04-17 10:14:04,437: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:14:04.438155156Z [2024-04-17 10:14:04,437: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:14:04.438285422Z [2024-04-17 10:14:04,438: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:14:04.438667284Z [2024-04-17 10:14:04,438: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:14:04.438779513Z [2024-04-17 10:14:04,438: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:14:04.513501211Z [2024-04-17 10:14:04,511: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:14:04.675661038Z [2024-04-17 10:14:04,675: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:14:06.623914205Z [2024-04-17 10:14:06,622: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9beeadb2-ca88-439b-98a3-3df5bd0b6bc7] succeeded in 5.376367847999973s: None 2024-04-17T10:14:06.855438649Z [2024-04-17 10:14:06,855: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f76c18e3-6bf9-4f3d-8548-f190f1a131ec] succeeded in 5.661656198999935s: None 2024-04-17T10:15:00.975681388Z [2024-04-17 10:15:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b21fc1d-ea7b-4a55-8d34-665ecc28ab20] received 2024-04-17T10:15:00.988084268Z [2024-04-17 10:15:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22578992-0696-4971-a334-9c529dfbab2a] received 2024-04-17T10:15:00.992313066Z [2024-04-17 10:15:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b82f272-d9c6-4ece-8c31-95dbd3151855] received 2024-04-17T10:15:01.007041781Z [2024-04-17 10:15:01,006: INFO/ForkPoolWorker-1] [1b82f272-d9c6-4ece-8c31-95dbd3151855] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-17T10:15:01.014745312Z [2024-04-17 10:15:01,014: INFO/ForkPoolWorker-16] [22578992-0696-4971-a334-9c529dfbab2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-17T10:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-17T10:15:01.016940342Z [2024-04-17 10:15:01,015: INFO/ForkPoolWorker-15] [2b21fc1d-ea7b-4a55-8d34-665ecc28ab20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-17T10:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:15:01.517627523Z [2024-04-17 10:15:01,513: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-17T10:15:01.611752366Z [2024-04-17 10:15:01,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:15:01.762171758Z [2024-04-17 10:15:01,743: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-17T10:15:03.224789475Z [2024-04-17 10:15:03,224: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:15:03.228100214Z [2024-04-17 10:15:03,227: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:15:03.235469917Z [2024-04-17 10:15:03,235: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-17T10:15:03.239460065Z [2024-04-17 10:15:03,239: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:15:03.256599574Z [2024-04-17 10:15:03,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:15:03.259122816Z [2024-04-17 10:15:03,258: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:15:03.259451343Z [2024-04-17 10:15:03,259: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:15:03.259814581Z [2024-04-17 10:15:03,259: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:15:03.259905895Z [2024-04-17 10:15:03,259: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:15:03.260311074Z [2024-04-17 10:15:03,260: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:15:03.260377717Z [2024-04-17 10:15:03,260: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:15:03.305860855Z [2024-04-17 10:15:03,305: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-17T10:15:03.306877723Z [2024-04-17 10:15:03,306: INFO/ForkPoolWorker-1] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:15:03.306921370Z [2024-04-17 10:15:03,306: INFO/ForkPoolWorker-1] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:15:03.307034889Z [2024-04-17 10:15:03,306: INFO/ForkPoolWorker-1] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:15:03.307081497Z [2024-04-17 10:15:03,307: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-17T10:15:03.307279301Z [2024-04-17 10:15:03,307: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-17T10:15:03.307318680Z [2024-04-17 10:15:03,307: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:15:03.347654308Z [2024-04-17 10:15:03,347: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:15:03.425174860Z [2024-04-17 10:15:03,424: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:15:03.597498783Z [2024-04-17 10:15:03,590: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-17T10:15:03.597527084Z [2024-04-17 10:15:03,594: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:15:03.686638047Z [2024-04-17 10:15:03,686: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-17T10:15:03.688942290Z [2024-04-17 10:15:03,688: INFO/ForkPoolWorker-16] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:15:03.689012805Z [2024-04-17 10:15:03,688: INFO/ForkPoolWorker-16] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:15:03.689152296Z [2024-04-17 10:15:03,689: INFO/ForkPoolWorker-16] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:15:03.689232213Z [2024-04-17 10:15:03,689: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-17T10:15:03.689685439Z [2024-04-17 10:15:03,689: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-17T10:15:03.689837208Z [2024-04-17 10:15:03,689: INFO/ForkPoolWorker-16] Creating DAG vim_status_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:15:03.789386592Z [2024-04-17 10:15:03,789: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:15:04.485204314Z [2024-04-17 10:15:04,484: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b21fc1d-ea7b-4a55-8d34-665ecc28ab20] succeeded in 3.5033546930003467s: None 2024-04-17T10:15:04.926162387Z [2024-04-17 10:15:04,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ecf4a87-48a3-4880-88b9-7a99d421cc23] received 2024-04-17T10:15:04.931346320Z [2024-04-17 10:15:04,931: INFO/ForkPoolWorker-15] [2ecf4a87-48a3-4880-88b9-7a99d421cc23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'split_metrics', 'scheduled__2024-04-17T10:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:15:05.229372449Z [2024-04-17 10:15:05,226: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:15:06.305995763Z [2024-04-17 10:15:06,305: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22578992-0696-4971-a334-9c529dfbab2a] succeeded in 5.3152919939998355s: None 2024-04-17T10:15:06.365890628Z [2024-04-17 10:15:06,365: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:15:06.369296944Z [2024-04-17 10:15:06,368: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:15:06.392327838Z [2024-04-17 10:15:06,392: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:15:06.395927062Z [2024-04-17 10:15:06,395: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:15:06.395941250Z [2024-04-17 10:15:06,395: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:15:06.396087962Z [2024-04-17 10:15:06,395: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:15:06.396199262Z [2024-04-17 10:15:06,396: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:15:06.396518328Z [2024-04-17 10:15:06,396: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:15:06.396528711Z [2024-04-17 10:15:06,396: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:15:06.471734846Z [2024-04-17 10:15:06,471: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:15:06.867761903Z [2024-04-17 10:15:06,867: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1b82f272-d9c6-4ece-8c31-95dbd3151855] succeeded in 5.872843432999616s: None 2024-04-17T10:15:07.118018976Z [2024-04-17 10:15:07,117: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ecf4a87-48a3-4880-88b9-7a99d421cc23] succeeded in 2.1905695159998686s: None 2024-04-17T10:15:07.282870423Z [2024-04-17 10:15:07,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[623a099b-141a-481d-8a8b-e2668ab0a1de] received 2024-04-17T10:15:07.293466507Z [2024-04-17 10:15:07,293: INFO/ForkPoolWorker-15] [623a099b-141a-481d-8a8b-e2668ab0a1de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'collect_metrics', 'scheduled__2024-04-17T10:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-17T10:15:07.667171393Z [2024-04-17 10:15:07,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:15:09.012553748Z [2024-04-17 10:15:09,012: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:15:09.016735983Z [2024-04-17 10:15:09,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:15:09.078277663Z [2024-04-17 10:15:09,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:15:09.079779516Z [2024-04-17 10:15:09,079: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:15:09.079794452Z [2024-04-17 10:15:09,079: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:15:09.080012523Z [2024-04-17 10:15:09,079: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:15:09.080041925Z [2024-04-17 10:15:09,079: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:15:09.080262159Z [2024-04-17 10:15:09,080: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:15:09.080293995Z [2024-04-17 10:15:09,080: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:15:09.176262121Z [2024-04-17 10:15:09,176: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:15:09.774434780Z [2024-04-17 10:15:09,774: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[623a099b-141a-481d-8a8b-e2668ab0a1de] succeeded in 2.488386831999833s: None 2024-04-17T10:15:10.018094927Z [2024-04-17 10:15:10,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2aba884-ce1e-4889-8a87-d34d7ffa6177] received 2024-04-17T10:15:10.023557190Z [2024-04-17 10:15:10,023: INFO/ForkPoolWorker-15] [b2aba884-ce1e-4889-8a87-d34d7ffa6177] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30', 'send_prometheus', 'scheduled__2024-04-17T10:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-17T10:15:10.383601092Z [2024-04-17 10:15:10,380: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-17T10:15:12.017675820Z [2024-04-17 10:15:12,017: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-17T10:15:12.025997130Z [2024-04-17 10:15:12,025: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'SpzhoS67hwDlyWTWJJ2dYqZo7floM81X'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-17T10:15:12.052554929Z [2024-04-17 10:15:12,052: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-17T10:15:12.055973226Z [2024-04-17 10:15:12,055: INFO/ForkPoolWorker-15] Read VIM 95505763-23e1-4828-b73d-8f6cc05074b5 (_system-osm-vim) 2024-04-17T10:15:12.056320765Z [2024-04-17 10:15:12,055: INFO/ForkPoolWorker-15] Read VIM 40f0e229-0955-4cfe-b894-0ca954a46a30 (osm) 2024-04-17T10:15:12.056668934Z [2024-04-17 10:15:12,056: INFO/ForkPoolWorker-15] [{'_id': '95505763-23e1-4828-b73d-8f6cc05074b5', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '40f0e229-0955-4cfe-b894-0ca954a46a30', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-17T10:15:12.056973309Z [2024-04-17 10:15:12,056: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-17T10:15:12.057325971Z [2024-04-17 10:15:12,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-17T10:15:12.057393589Z [2024-04-17 10:15:12,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_40f0e229-0955-4cfe-b894-0ca954a46a30 2024-04-17T10:15:12.146929460Z [2024-04-17 10:15:12,146: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-17T10:15:12.637255751Z [2024-04-17 10:15:12,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2aba884-ce1e-4889-8a87-d34d7ffa6177] succeeded in 2.6176663109999936s: None 2024-04-17T09:42:54.211307421Z 2024-04-17T09:42:54.226309101Z Cleaning logs every 900 seconds 2024-04-17T09:42:54.226327072Z Trimming airflow logs to 15 days. 2024-04-17T09:45:00.265788028Z Trimming airflow logs to 15 days. 2024-04-17T09:45:01.326434436Z Trimming airflow logs to 15 days. 2024-04-17T10:00:00.388349274Z Trimming airflow logs to 15 days. 2024-04-17T10:00:01.497238788Z Trimming airflow logs to 15 days. 2024-04-17T10:15:00.606099395Z Trimming airflow logs to 15 days. 2024-04-17T10:15:01.637304179Z Trimming airflow logs to 15 days.