2024-05-09T19:57:29.491245051Z 2024-05-09T19:57:29.525011035Z Cleaning logs every 900 seconds 2024-05-09T19:57:29.525029438Z Trimming airflow logs to 15 days. 2024-05-09T20:00:00.655813410Z Trimming airflow logs to 15 days. 2024-05-09T20:00:01.680254113Z Trimming airflow logs to 15 days. 2024-05-09T20:15:00.751159431Z Trimming airflow logs to 15 days. 2024-05-09T20:15:01.776251704Z Trimming airflow logs to 15 days. 2024-05-09T20:30:00.835066795Z Trimming airflow logs to 15 days. 2024-05-09T20:30:01.881522728Z Trimming airflow logs to 15 days. 2024-05-09T19:56:49.945027433Z . 2024-05-09T19:56:50.562817619Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-09T19:56:52.023256723Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-09T19:57:00.928391182Z [2024-05-09T19:57:00.919+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-05-09T19:57:01.923332636Z [2024-05-09T19:57:01.922+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-05-09T19:57:02.930316745Z [2024-05-09T19:57:02.927+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-05-09T19:57:03.935419594Z [2024-05-09T19:57:03.934+0000] {db.py:755} INFO - Waiting for migrations... 3 second(s) 2024-05-09T19:57:04.953672397Z [2024-05-09T19:57:04.938+0000] {db.py:755} INFO - Waiting for migrations... 4 second(s) 2024-05-09T19:57:05.947366649Z [2024-05-09T19:57:05.946+0000] {db.py:755} INFO - Waiting for migrations... 5 second(s) 2024-05-09T19:57:06.959089708Z [2024-05-09T19:57:06.958+0000] {db.py:755} INFO - Waiting for migrations... 6 second(s) 2024-05-09T19:57:23.580700270Z 2024-05-09T19:57:25.377692047Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-09T19:57:31.440211537Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-09T19:57:46.240516096Z [2024-05-09 19:57:46 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-05-09T19:57:46.289832834Z [2024-05-09 19:57:46 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-05-09T19:57:46.289925837Z [2024-05-09 19:57:46 +0000] [16] [INFO] Using worker: sync 2024-05-09T19:57:46.468063593Z [2024-05-09 19:57:46 +0000] [17] [INFO] Booting worker with pid: 17 2024-05-09T19:57:46.590772008Z [2024-05-09 19:57:46 +0000] [18] [INFO] Booting worker with pid: 18 2024-05-09T19:57:53.261125393Z 2024-05-09T19:57:53.261146623Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-05-09T19:57:53.261151268Z --- ***** ----- 2024-05-09T19:57:53.261155221Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-05-09 19:57:53 2024-05-09T19:57:53.261158628Z - *** --- * --- 2024-05-09T19:57:53.261162424Z - ** ---------- [config] 2024-05-09T19:57:53.261166195Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f22033a4100 2024-05-09T19:57:53.261169367Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-05-09T19:57:53.261172561Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-05-09T19:57:53.261177217Z - *** --- * --- .> concurrency: 16 (prefork) 2024-05-09T19:57:53.261180474Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-05-09T19:57:53.261183665Z --- ***** ----- 2024-05-09T19:57:53.261187483Z -------------- [queues] 2024-05-09T19:57:53.261190677Z .> default exchange=default(direct) key=default 2024-05-09T19:57:53.261193878Z 2024-05-09T19:57:53.261196912Z 2024-05-09T19:57:53.261200034Z [tasks] 2024-05-09T19:57:53.261203287Z . airflow.executors.celery_executor.execute_command 2024-05-09T19:57:53.261206650Z 2024-05-09T19:58:21.422179358Z [2024-05-09 19:58:21,417: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-05-09T19:58:21.475393767Z [2024-05-09 19:58:21,475: INFO/MainProcess] mingle: searching for neighbors 2024-05-09T19:58:22.690475532Z [2024-05-09 19:58:22,683: INFO/MainProcess] mingle: all alone 2024-05-09T19:58:22.818856684Z [2024-05-09 19:58:22,817: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-05-09T19:58:22.832239446Z [2024-05-09 19:58:22,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41154ef3-3a33-44ed-8927-8493bceb33bf] received 2024-05-09T19:58:22.992567352Z [2024-05-09 19:58:22,992: INFO/ForkPoolWorker-15] [41154ef3-3a33-44ed-8927-8493bceb33bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T19:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T19:58:24.124177912Z [2024-05-09 19:58:24,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T19:58:24.687771722Z [2024-05-09 19:58:24,687: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T19:58:25.689456543Z [2024-05-09 19:58:25,687: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41154ef3-3a33-44ed-8927-8493bceb33bf] succeeded in 2.848552418000054s: None 2024-05-09T19:58:36.614775951Z [2024-05-09 19:58:36,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4aa08dc-410d-4e7c-a230-3347a5e6e79b] received 2024-05-09T19:58:36.635022841Z [2024-05-09 19:58:36,634: INFO/ForkPoolWorker-15] [e4aa08dc-410d-4e7c-a230-3347a5e6e79b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T19:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T19:58:37.151608640Z [2024-05-09 19:58:37,147: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T19:58:37.520379619Z [2024-05-09 19:58:37,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T19:58:38.203732958Z [2024-05-09 19:58:38,202: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4aa08dc-410d-4e7c-a230-3347a5e6e79b] succeeded in 1.5840569959999584s: None 2024-05-09T20:00:00.907593604Z [2024-05-09 20:00:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45bc81ec-4a46-4fab-81d5-ecfbaae09623] received 2024-05-09T20:00:00.931704710Z [2024-05-09 20:00:00,931: INFO/ForkPoolWorker-15] [45bc81ec-4a46-4fab-81d5-ecfbaae09623] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T19:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:00:01.356551792Z [2024-05-09 20:00:01,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:00:01.753823798Z [2024-05-09 20:00:01,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:00:02.841865939Z [2024-05-09 20:00:02,841: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45bc81ec-4a46-4fab-81d5-ecfbaae09623] succeeded in 1.9284996680000859s: None 2024-05-09T20:02:00.593394681Z [2024-05-09 20:02:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e72c1e11-9e12-45f7-bc1c-727cdd9cfe8c] received 2024-05-09T20:02:00.613196247Z [2024-05-09 20:02:00,612: INFO/ForkPoolWorker-15] [e72c1e11-9e12-45f7-bc1c-727cdd9cfe8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:02:00.969815245Z [2024-05-09 20:02:00,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:02:01.335182939Z [2024-05-09 20:02:01,334: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:02:02.079958736Z [2024-05-09 20:02:02,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e72c1e11-9e12-45f7-bc1c-727cdd9cfe8c] succeeded in 1.4823120089999975s: None 2024-05-09T20:04:00.309221826Z [2024-05-09 20:04:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[882d7849-7c58-4f7e-b27f-625f17f8a493] received 2024-05-09T20:04:00.323013634Z [2024-05-09 20:04:00,322: INFO/ForkPoolWorker-15] [882d7849-7c58-4f7e-b27f-625f17f8a493] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:04:00.756505975Z [2024-05-09 20:04:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:04:01.192632144Z [2024-05-09 20:04:01,192: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:04:01.906655953Z [2024-05-09 20:04:01,906: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[882d7849-7c58-4f7e-b27f-625f17f8a493] succeeded in 1.5915765679999367s: None 2024-05-09T20:04:57.733620120Z [2024-05-09 20:04:57,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[820ff699-bf97-459e-83f5-2936bab2c7e9] received 2024-05-09T20:04:57.762037310Z [2024-05-09 20:04:57,761: INFO/ForkPoolWorker-15] [820ff699-bf97-459e-83f5-2936bab2c7e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:04:58.265259679Z [2024-05-09 20:04:58,257: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:04:59.293181462Z [2024-05-09 20:04:59,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5be4327f-53c3-4f4c-8c0d-7a3f58efdba2] received 2024-05-09T20:04:59.371162216Z [2024-05-09 20:04:59,370: INFO/ForkPoolWorker-16] [5be4327f-53c3-4f4c-8c0d-7a3f58efdba2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-09T19:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:04:59.784872880Z [2024-05-09 20:04:59,780: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:04:59.907286387Z [2024-05-09 20:04:59,906: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:04:59.913360440Z [2024-05-09 20:04:59,912: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:04:59.953073731Z [2024-05-09 20:04:59,952: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:04:59.957473329Z [2024-05-09 20:04:59,957: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:04:59.957488940Z [2024-05-09 20:04:59,957: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:04:59.957628534Z [2024-05-09 20:04:59,957: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:04:59.957654023Z [2024-05-09 20:04:59,957: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:04:59.957879380Z [2024-05-09 20:04:59,957: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:04:59.957891379Z [2024-05-09 20:04:59,957: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:00.046726784Z [2024-05-09 20:05:00,046: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:00.675749578Z [2024-05-09 20:05:00,675: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52b6b980-a570-4998-bfd3-ffe3059cb85f] received 2024-05-09T20:05:00.737896318Z [2024-05-09 20:05:00,737: INFO/ForkPoolWorker-1] [52b6b980-a570-4998-bfd3-ffe3059cb85f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-09T20:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:05:01.103360106Z [2024-05-09 20:05:01,098: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:05:01.263264034Z [2024-05-09 20:05:01,262: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:05:01.267275041Z [2024-05-09 20:05:01,266: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:01.309056549Z [2024-05-09 20:05:01,308: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:05:01.311101881Z [2024-05-09 20:05:01,310: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:01.311160209Z [2024-05-09 20:05:01,311: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:01.311323013Z [2024-05-09 20:05:01,311: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:01.311380043Z [2024-05-09 20:05:01,311: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:05:01.311798231Z [2024-05-09 20:05:01,311: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:05:01.311922085Z [2024-05-09 20:05:01,311: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:01.423776491Z [2024-05-09 20:05:01,423: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:01.871745155Z [2024-05-09 20:05:01,871: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[820ff699-bf97-459e-83f5-2936bab2c7e9] succeeded in 4.133488499000009s: None 2024-05-09T20:05:02.170530356Z [2024-05-09 20:05:02,169: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5be4327f-53c3-4f4c-8c0d-7a3f58efdba2] succeeded in 2.867688788999999s: None 2024-05-09T20:05:02.783405136Z [2024-05-09 20:05:02,783: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:05:02.787018317Z [2024-05-09 20:05:02,786: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:02.817354124Z [2024-05-09 20:05:02,817: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:05:02.819278498Z [2024-05-09 20:05:02,819: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:02.819374642Z [2024-05-09 20:05:02,819: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:02.819558288Z [2024-05-09 20:05:02,819: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:02.819633748Z [2024-05-09 20:05:02,819: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:05:02.820415126Z [2024-05-09 20:05:02,820: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:05:02.820509960Z [2024-05-09 20:05:02,820: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:02.912177810Z [2024-05-09 20:05:02,911: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:03.222430075Z [2024-05-09 20:05:03,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63596a2c-324a-409e-95dd-3d02c7218135] received 2024-05-09T20:05:03.247739783Z [2024-05-09 20:05:03,247: INFO/ForkPoolWorker-15] [63596a2c-324a-409e-95dd-3d02c7218135] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'split_metrics', 'scheduled__2024-05-09T19:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:05:03.269734084Z [2024-05-09 20:05:03,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[854c1944-e699-4bfe-b73c-aacdebc06461] received 2024-05-09T20:05:03.309851322Z [2024-05-09 20:05:03,309: INFO/ForkPoolWorker-16] [854c1944-e699-4bfe-b73c-aacdebc06461] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:05:03.686385149Z [2024-05-09 20:05:03,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be003c78-8326-4a5c-af14-ceba34334c87] received 2024-05-09T20:05:03.759836144Z [2024-05-09 20:05:03,752: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:05:03.772287794Z [2024-05-09 20:05:03,769: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:05:03.775004886Z [2024-05-09 20:05:03,774: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52b6b980-a570-4998-bfd3-ffe3059cb85f] succeeded in 3.093783141000017s: None 2024-05-09T20:05:03.805040734Z [2024-05-09 20:05:03,804: INFO/ForkPoolWorker-2] [be003c78-8326-4a5c-af14-ceba34334c87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'split_metrics', 'scheduled__2024-05-09T20:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:05:04.267978568Z [2024-05-09 20:05:04,263: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:05:05.524672216Z [2024-05-09 20:05:05,524: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:05:05.530219611Z [2024-05-09 20:05:05,529: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:05.602677170Z [2024-05-09 20:05:05,602: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:05:05.604942074Z [2024-05-09 20:05:05,604: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:05.605197512Z [2024-05-09 20:05:05,604: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:05.605533779Z [2024-05-09 20:05:05,605: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:05.605814537Z [2024-05-09 20:05:05,605: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:05:05.606551025Z [2024-05-09 20:05:05,606: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:05:05.607216210Z [2024-05-09 20:05:05,606: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:05.714337650Z [2024-05-09 20:05:05,713: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:05.757602133Z [2024-05-09 20:05:05,757: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:05:05.761100429Z [2024-05-09 20:05:05,760: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:05.837211998Z [2024-05-09 20:05:05,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:05:05.840740825Z [2024-05-09 20:05:05,840: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:05.840756360Z [2024-05-09 20:05:05,840: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:05.841513246Z [2024-05-09 20:05:05,840: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:05.841641359Z [2024-05-09 20:05:05,841: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:05:05.842030053Z [2024-05-09 20:05:05,841: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:05:05.842059675Z [2024-05-09 20:05:05,841: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:05.984451318Z [2024-05-09 20:05:05,984: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:06.348841659Z [2024-05-09 20:05:06,348: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-09T20:05:06.353140668Z [2024-05-09 20:05:06,352: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:06.401499925Z [2024-05-09 20:05:06,401: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-09T20:05:06.403007192Z [2024-05-09 20:05:06,402: INFO/ForkPoolWorker-2] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:06.403059800Z [2024-05-09 20:05:06,402: INFO/ForkPoolWorker-2] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:06.403238838Z [2024-05-09 20:05:06,403: INFO/ForkPoolWorker-2] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:06.403321605Z [2024-05-09 20:05:06,403: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-09T20:05:06.403797895Z [2024-05-09 20:05:06,403: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:05:06.403813139Z [2024-05-09 20:05:06,403: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:06.509470871Z [2024-05-09 20:05:06,508: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:06.676850931Z [2024-05-09 20:05:06,676: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63596a2c-324a-409e-95dd-3d02c7218135] succeeded in 3.4406229549999807s: None 2024-05-09T20:05:07.026790981Z [2024-05-09 20:05:07,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42255e92-c495-4441-b4be-ba8163d1c044] received 2024-05-09T20:05:07.026812647Z [2024-05-09 20:05:07,020: INFO/ForkPoolWorker-15] [42255e92-c495-4441-b4be-ba8163d1c044] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'collect_metrics', 'scheduled__2024-05-09T19:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-09T20:05:07.280900727Z [2024-05-09 20:05:07,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5b21a20-6cb0-4c59-824a-91875524f8b4] received 2024-05-09T20:05:07.303789446Z [2024-05-09 20:05:07,303: INFO/ForkPoolWorker-1] [b5b21a20-6cb0-4c59-824a-91875524f8b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'collect_metrics', 'scheduled__2024-05-09T20:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-09T20:05:07.309430747Z [2024-05-09 20:05:07,309: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[be003c78-8326-4a5c-af14-ceba34334c87] succeeded in 3.6135959950000824s: None 2024-05-09T20:05:07.554413500Z [2024-05-09 20:05:07,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:05:07.695650159Z [2024-05-09 20:05:07,695: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[854c1944-e699-4bfe-b73c-aacdebc06461] succeeded in 4.399049633999994s: None 2024-05-09T20:05:07.780988098Z [2024-05-09 20:05:07,778: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:05:09.276025353Z [2024-05-09 20:05:09,275: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:05:09.279559793Z [2024-05-09 20:05:09,279: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:09.309117049Z [2024-05-09 20:05:09,308: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:05:09.310244981Z [2024-05-09 20:05:09,310: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:09.310417109Z [2024-05-09 20:05:09,310: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:09.310639029Z [2024-05-09 20:05:09,310: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:09.310856594Z [2024-05-09 20:05:09,310: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:05:09.311173407Z [2024-05-09 20:05:09,311: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:05:09.311323847Z [2024-05-09 20:05:09,311: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:09.353356547Z [2024-05-09 20:05:09,352: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:05:09.356495165Z [2024-05-09 20:05:09,356: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:09.400430142Z [2024-05-09 20:05:09,400: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:05:09.401501820Z [2024-05-09 20:05:09,401: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:09.401513687Z [2024-05-09 20:05:09,401: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:09.401716473Z [2024-05-09 20:05:09,401: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:09.401853580Z [2024-05-09 20:05:09,401: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:05:09.402103882Z [2024-05-09 20:05:09,401: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:05:09.402178793Z [2024-05-09 20:05:09,402: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:09.409646502Z [2024-05-09 20:05:09,409: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:09.514383700Z [2024-05-09 20:05:09,514: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:10.105661646Z [2024-05-09 20:05:10,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[42255e92-c495-4441-b4be-ba8163d1c044] succeeded in 3.091740691000041s: None 2024-05-09T20:05:10.306684349Z [2024-05-09 20:05:10,306: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5b21a20-6cb0-4c59-824a-91875524f8b4] succeeded in 3.0228861930000903s: None 2024-05-09T20:05:10.874764065Z [2024-05-09 20:05:10,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e58997da-fae4-49a5-a9ca-0d0fceeb6339] received 2024-05-09T20:05:10.880463555Z [2024-05-09 20:05:10,880: INFO/ForkPoolWorker-15] [e58997da-fae4-49a5-a9ca-0d0fceeb6339] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'send_prometheus', 'scheduled__2024-05-09T20:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:05:10.881762670Z [2024-05-09 20:05:10,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f6a55c2-cb30-4f82-be34-96039223178d] received 2024-05-09T20:05:10.887474670Z [2024-05-09 20:05:10,887: INFO/ForkPoolWorker-16] [4f6a55c2-cb30-4f82-be34-96039223178d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'send_prometheus', 'scheduled__2024-05-09T19:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:05:11.259743182Z [2024-05-09 20:05:11,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:05:11.408107850Z [2024-05-09 20:05:11,403: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:05:13.076467510Z [2024-05-09 20:05:13,076: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:05:13.082096912Z [2024-05-09 20:05:13,081: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:13.167702364Z [2024-05-09 20:05:13,167: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:05:13.170567042Z [2024-05-09 20:05:13,170: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:13.170919069Z [2024-05-09 20:05:13,170: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:13.171094263Z [2024-05-09 20:05:13,170: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:13.171210309Z [2024-05-09 20:05:13,171: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:05:13.171686164Z [2024-05-09 20:05:13,171: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:05:13.171727652Z [2024-05-09 20:05:13,171: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:13.310121293Z [2024-05-09 20:05:13,309: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:13.317653469Z [2024-05-09 20:05:13,317: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:05:13.322806576Z [2024-05-09 20:05:13,322: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:13.378758614Z [2024-05-09 20:05:13,378: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:05:13.379921991Z [2024-05-09 20:05:13,379: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:13.379939880Z [2024-05-09 20:05:13,379: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:13.380038374Z [2024-05-09 20:05:13,379: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:13.380049062Z [2024-05-09 20:05:13,379: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:05:13.380292462Z [2024-05-09 20:05:13,380: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:05:13.380519462Z [2024-05-09 20:05:13,380: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:13.476489597Z [2024-05-09 20:05:13,476: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:14.007549233Z [2024-05-09 20:05:14,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e58997da-fae4-49a5-a9ca-0d0fceeb6339] succeeded in 3.1242598709999356s: None 2024-05-09T20:05:14.181184561Z [2024-05-09 20:05:14,180: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f6a55c2-cb30-4f82-be34-96039223178d] succeeded in 3.298049438000021s: None 2024-05-09T20:05:26.296939558Z [2024-05-09 20:05:26,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cb5587e-d20e-40c7-84d2-3636a8e3b0af] received 2024-05-09T20:05:26.309749855Z [2024-05-09 20:05:26,309: INFO/ForkPoolWorker-15] [7cb5587e-d20e-40c7-84d2-3636a8e3b0af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:05:26.710494127Z [2024-05-09 20:05:26,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:05:28.245297172Z [2024-05-09 20:05:28,244: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:05:28.249671315Z [2024-05-09 20:05:28,249: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:05:28.308239803Z [2024-05-09 20:05:28,308: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:05:28.309635856Z [2024-05-09 20:05:28,309: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:05:28.309745766Z [2024-05-09 20:05:28,309: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:05:28.309932520Z [2024-05-09 20:05:28,309: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:05:28.310046832Z [2024-05-09 20:05:28,309: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:05:28.310720542Z [2024-05-09 20:05:28,310: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:05:28.310745708Z [2024-05-09 20:05:28,310: INFO/ForkPoolWorker-15] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:05:28.397373039Z [2024-05-09 20:05:28,397: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:05:30.218235187Z [2024-05-09 20:05:30,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7cb5587e-d20e-40c7-84d2-3636a8e3b0af] succeeded in 3.9196180090000325s: None 2024-05-09T20:06:01.275974995Z [2024-05-09 20:06:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[697dce5a-92d4-4b5a-851f-cab133e848ff] received 2024-05-09T20:06:01.288705870Z [2024-05-09 20:06:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2b6877f-b064-46da-8e6c-9757019be94b] received 2024-05-09T20:06:01.300724785Z [2024-05-09 20:06:01,300: INFO/ForkPoolWorker-15] [697dce5a-92d4-4b5a-851f-cab133e848ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:06:01.304368151Z [2024-05-09 20:06:01,304: INFO/ForkPoolWorker-16] [f2b6877f-b064-46da-8e6c-9757019be94b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:06:01.327892444Z [2024-05-09 20:06:01,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9db7b08d-13b6-4e3d-93fa-e3cfd79beba0] received 2024-05-09T20:06:01.360844160Z [2024-05-09 20:06:01,360: INFO/ForkPoolWorker-1] [9db7b08d-13b6-4e3d-93fa-e3cfd79beba0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:06:01.832032732Z [2024-05-09 20:06:01,815: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:06:02.016003382Z [2024-05-09 20:06:02,010: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:06:02.034554421Z [2024-05-09 20:06:02,031: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:06:02.501580451Z [2024-05-09 20:06:02,501: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:06:03.412926064Z [2024-05-09 20:06:03,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[697dce5a-92d4-4b5a-851f-cab133e848ff] succeeded in 2.133189259999881s: None 2024-05-09T20:06:03.696503629Z [2024-05-09 20:06:03,696: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:06:03.700521080Z [2024-05-09 20:06:03,700: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:06:03.757938069Z [2024-05-09 20:06:03,757: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:06:03.759341264Z [2024-05-09 20:06:03,759: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:06:03.759478822Z [2024-05-09 20:06:03,759: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:06:03.759652743Z [2024-05-09 20:06:03,759: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:06:03.759740282Z [2024-05-09 20:06:03,759: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:06:03.760046153Z [2024-05-09 20:06:03,759: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:06:03.760067256Z [2024-05-09 20:06:03,759: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:06:03.860122893Z [2024-05-09 20:06:03,859: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:06:03.863455931Z [2024-05-09 20:06:03,863: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:06:03.871657275Z [2024-05-09 20:06:03,871: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:06:03.896562172Z [2024-05-09 20:06:03,896: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:06:03.898476988Z [2024-05-09 20:06:03,898: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:06:03.898870607Z [2024-05-09 20:06:03,898: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:06:03.899062799Z [2024-05-09 20:06:03,898: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:06:03.899183873Z [2024-05-09 20:06:03,899: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:06:03.899446941Z [2024-05-09 20:06:03,899: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:06:03.899999948Z [2024-05-09 20:06:03,899: INFO/ForkPoolWorker-1] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:06:03.995926652Z [2024-05-09 20:06:03,995: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:06:05.604190841Z [2024-05-09 20:06:05,603: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9db7b08d-13b6-4e3d-93fa-e3cfd79beba0] succeeded in 4.258839817999842s: None 2024-05-09T20:06:05.835518301Z [2024-05-09 20:06:05,835: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2b6877f-b064-46da-8e6c-9757019be94b] succeeded in 4.545099083999958s: None 2024-05-09T20:07:00.406138447Z [2024-05-09 20:07:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fa95020-9ecc-461a-b19d-39c3e6202fa6] received 2024-05-09T20:07:00.409069666Z [2024-05-09 20:07:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34cea994-3e5d-489c-9d32-8a9985f53e17] received 2024-05-09T20:07:00.424620479Z [2024-05-09 20:07:00,423: INFO/ForkPoolWorker-16] [34cea994-3e5d-489c-9d32-8a9985f53e17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:07:00.433970513Z [2024-05-09 20:07:00,433: INFO/ForkPoolWorker-15] [5fa95020-9ecc-461a-b19d-39c3e6202fa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:07:00.840331733Z [2024-05-09 20:07:00,833: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:07:00.868816799Z [2024-05-09 20:07:00,865: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:07:02.549218825Z [2024-05-09 20:07:02,548: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:07:02.562825103Z [2024-05-09 20:07:02,561: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:07:02.671552121Z [2024-05-09 20:07:02,671: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:07:02.675156007Z [2024-05-09 20:07:02,674: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:07:02.675522712Z [2024-05-09 20:07:02,675: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:07:02.675955642Z [2024-05-09 20:07:02,675: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:07:02.676233211Z [2024-05-09 20:07:02,676: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:07:02.676985700Z [2024-05-09 20:07:02,676: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:07:02.677404515Z [2024-05-09 20:07:02,677: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:07:02.721124890Z [2024-05-09 20:07:02,720: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:07:02.727207939Z [2024-05-09 20:07:02,726: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:07:02.768249700Z [2024-05-09 20:07:02,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:07:02.769448528Z [2024-05-09 20:07:02,769: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:07:02.769553205Z [2024-05-09 20:07:02,769: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:07:02.769801501Z [2024-05-09 20:07:02,769: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:07:02.769990602Z [2024-05-09 20:07:02,769: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:07:02.770413489Z [2024-05-09 20:07:02,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:07:02.770574372Z [2024-05-09 20:07:02,770: INFO/ForkPoolWorker-15] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:07:02.785157664Z [2024-05-09 20:07:02,784: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:07:02.879250811Z [2024-05-09 20:07:02,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:07:04.800647033Z [2024-05-09 20:07:04,800: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fa95020-9ecc-461a-b19d-39c3e6202fa6] succeeded in 4.390041578999899s: None 2024-05-09T20:07:05.142958876Z [2024-05-09 20:07:05,142: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[34cea994-3e5d-489c-9d32-8a9985f53e17] succeeded in 4.731935925000016s: None 2024-05-09T20:08:01.008485692Z [2024-05-09 20:08:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa056870-f430-447b-918b-fcd35583afed] received 2024-05-09T20:08:01.013139379Z [2024-05-09 20:08:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff082c13-0e09-403e-b4bc-574ac972d400] received 2024-05-09T20:08:01.016080909Z [2024-05-09 20:08:01,015: INFO/ForkPoolWorker-15] [fa056870-f430-447b-918b-fcd35583afed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:08:01.025084529Z [2024-05-09 20:08:01,024: INFO/ForkPoolWorker-16] [ff082c13-0e09-403e-b4bc-574ac972d400] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:08:01.030428428Z [2024-05-09 20:08:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3594ae5-5473-4d84-a2d6-6495321b3c68] received 2024-05-09T20:08:01.046181641Z [2024-05-09 20:08:01,045: INFO/ForkPoolWorker-1] [a3594ae5-5473-4d84-a2d6-6495321b3c68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:08:01.399147204Z [2024-05-09 20:08:01,395: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:08:01.405742599Z [2024-05-09 20:08:01,400: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:08:01.460214425Z [2024-05-09 20:08:01,455: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:08:01.724028593Z [2024-05-09 20:08:01,723: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:08:02.466245365Z [2024-05-09 20:08:02,465: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa056870-f430-447b-918b-fcd35583afed] succeeded in 1.4557092610000382s: None 2024-05-09T20:08:02.863769866Z [2024-05-09 20:08:02,862: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:08:02.867565019Z [2024-05-09 20:08:02,867: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:08:02.909302601Z [2024-05-09 20:08:02,909: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:08:02.911645417Z [2024-05-09 20:08:02,911: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:08:02.911657492Z [2024-05-09 20:08:02,911: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:08:02.911766399Z [2024-05-09 20:08:02,911: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:08:02.911795417Z [2024-05-09 20:08:02,911: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:08:02.915045202Z [2024-05-09 20:08:02,914: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:08:02.915098939Z [2024-05-09 20:08:02,914: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:08:03.000842492Z [2024-05-09 20:08:03,000: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:08:03.242454395Z [2024-05-09 20:08:03,242: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:08:03.246207836Z [2024-05-09 20:08:03,245: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:08:03.277042198Z [2024-05-09 20:08:03,276: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:08:03.278431853Z [2024-05-09 20:08:03,278: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:08:03.278645070Z [2024-05-09 20:08:03,278: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:08:03.278952869Z [2024-05-09 20:08:03,278: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:08:03.279139062Z [2024-05-09 20:08:03,279: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:08:03.280068152Z [2024-05-09 20:08:03,279: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:08:03.280273307Z [2024-05-09 20:08:03,280: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:08:03.383021543Z [2024-05-09 20:08:03,382: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:08:04.517799388Z [2024-05-09 20:08:04,517: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff082c13-0e09-403e-b4bc-574ac972d400] succeeded in 3.497958345000143s: None 2024-05-09T20:08:05.306298913Z [2024-05-09 20:08:05,305: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a3594ae5-5473-4d84-a2d6-6495321b3c68] succeeded in 4.2706120270001975s: None 2024-05-09T20:09:01.072612453Z [2024-05-09 20:09:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbd6e8b0-202a-4ccd-836a-ab299c71f42d] received 2024-05-09T20:09:01.084572414Z [2024-05-09 20:09:01,084: INFO/ForkPoolWorker-15] [dbd6e8b0-202a-4ccd-836a-ab299c71f42d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:09:01.085811352Z [2024-05-09 20:09:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aeb9e3d-bf6f-40b8-8fb8-5504098ef0c2] received 2024-05-09T20:09:01.096363219Z [2024-05-09 20:09:01,096: INFO/ForkPoolWorker-16] [5aeb9e3d-bf6f-40b8-8fb8-5504098ef0c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:09:01.435616241Z [2024-05-09 20:09:01,432: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:09:01.504780870Z [2024-05-09 20:09:01,498: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:09:02.962433433Z [2024-05-09 20:09:02,962: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:09:02.967618127Z [2024-05-09 20:09:02,967: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:09:02.993581289Z [2024-05-09 20:09:02,993: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:09:02.995245051Z [2024-05-09 20:09:02,994: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:09:02.995258253Z [2024-05-09 20:09:02,994: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:09:02.995263711Z [2024-05-09 20:09:02,994: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:09:02.995268608Z [2024-05-09 20:09:02,995: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:09:02.995493129Z [2024-05-09 20:09:02,995: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:09:02.995960214Z [2024-05-09 20:09:02,995: INFO/ForkPoolWorker-15] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:09:03.048072928Z [2024-05-09 20:09:03,047: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:09:03.053149358Z [2024-05-09 20:09:03,052: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:09:03.107886447Z [2024-05-09 20:09:03,107: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:09:03.111471748Z [2024-05-09 20:09:03,111: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:09:03.111584742Z [2024-05-09 20:09:03,111: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:09:03.111794095Z [2024-05-09 20:09:03,111: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:09:03.111947864Z [2024-05-09 20:09:03,111: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:09:03.112555388Z [2024-05-09 20:09:03,112: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:09:03.112713000Z [2024-05-09 20:09:03,112: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:09:03.118853828Z [2024-05-09 20:09:03,118: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:09:03.218223219Z [2024-05-09 20:09:03,217: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:09:04.644210001Z [2024-05-09 20:09:04,643: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dbd6e8b0-202a-4ccd-836a-ab299c71f42d] succeeded in 3.5693961829999807s: None 2024-05-09T20:09:05.064745474Z [2024-05-09 20:09:05,064: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5aeb9e3d-bf6f-40b8-8fb8-5504098ef0c2] succeeded in 3.9751960260000487s: None 2024-05-09T20:10:00.692944847Z [2024-05-09 20:10:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c46c673b-b8b6-4c07-a083-18d26305b6db] received 2024-05-09T20:10:00.697291098Z [2024-05-09 20:10:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[324a94da-bfbc-4845-96e0-8e7ad29c0f97] received 2024-05-09T20:10:00.704043933Z [2024-05-09 20:10:00,703: INFO/ForkPoolWorker-16] [324a94da-bfbc-4845-96e0-8e7ad29c0f97] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:10:00.708113769Z [2024-05-09 20:10:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[132a5bfc-9276-4684-a5c0-71a73c0fa5b0] received 2024-05-09T20:10:00.710114785Z [2024-05-09 20:10:00,709: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[015029ef-69b9-4810-9ade-d36e8e95fd48] received 2024-05-09T20:10:00.734224110Z [2024-05-09 20:10:00,733: INFO/ForkPoolWorker-2] [015029ef-69b9-4810-9ade-d36e8e95fd48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:10:00.736521657Z [2024-05-09 20:10:00,736: INFO/ForkPoolWorker-1] [132a5bfc-9276-4684-a5c0-71a73c0fa5b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:10:00.743297985Z [2024-05-09 20:10:00,743: INFO/ForkPoolWorker-15] [c46c673b-b8b6-4c07-a083-18d26305b6db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-09T20:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:10:01.311972477Z [2024-05-09 20:10:01,308: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:10:01.349155428Z [2024-05-09 20:10:01,345: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:10:01.457515960Z [2024-05-09 20:10:01,449: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:10:01.663709865Z [2024-05-09 20:10:01,647: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:10:02.868100256Z [2024-05-09 20:10:02,867: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:10:03.584896257Z [2024-05-09 20:10:03,584: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:10:03.588916588Z [2024-05-09 20:10:03,588: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:10:03.688172118Z [2024-05-09 20:10:03,687: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:10:03.690811976Z [2024-05-09 20:10:03,690: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:10:03.691136330Z [2024-05-09 20:10:03,690: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:10:03.691276361Z [2024-05-09 20:10:03,691: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:10:03.691346701Z [2024-05-09 20:10:03,691: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:10:03.691608366Z [2024-05-09 20:10:03,691: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:10:03.691773125Z [2024-05-09 20:10:03,691: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:10:03.812898239Z [2024-05-09 20:10:03,812: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:10:03.949471098Z [2024-05-09 20:10:03,949: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[324a94da-bfbc-4845-96e0-8e7ad29c0f97] succeeded in 3.2534876610000083s: None 2024-05-09T20:10:04.179567264Z [2024-05-09 20:10:04,179: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:10:04.183624865Z [2024-05-09 20:10:04,183: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:10:04.277492751Z [2024-05-09 20:10:04,277: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-09T20:10:04.284391555Z [2024-05-09 20:10:04,283: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:10:04.323975526Z [2024-05-09 20:10:04,323: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-09T20:10:04.325656681Z [2024-05-09 20:10:04,325: INFO/ForkPoolWorker-2] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:10:04.325668981Z [2024-05-09 20:10:04,325: INFO/ForkPoolWorker-2] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:10:04.325773775Z [2024-05-09 20:10:04,325: INFO/ForkPoolWorker-2] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:10:04.325784086Z [2024-05-09 20:10:04,325: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-09T20:10:04.326343836Z [2024-05-09 20:10:04,326: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:10:04.326354287Z [2024-05-09 20:10:04,326: INFO/ForkPoolWorker-2] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:10:04.359946776Z [2024-05-09 20:10:04,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:10:04.363607239Z [2024-05-09 20:10:04,363: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:10:04.363928628Z [2024-05-09 20:10:04,363: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:10:04.364408673Z [2024-05-09 20:10:04,363: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:10:04.364476209Z [2024-05-09 20:10:04,364: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:10:04.364709105Z [2024-05-09 20:10:04,364: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:10:04.364720015Z [2024-05-09 20:10:04,364: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:10:04.479594189Z [2024-05-09 20:10:04,479: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:10:04.485668739Z [2024-05-09 20:10:04,485: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:10:05.296734859Z [2024-05-09 20:10:05,296: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c46c673b-b8b6-4c07-a083-18d26305b6db] succeeded in 4.566412384000159s: None 2024-05-09T20:10:05.826214541Z [2024-05-09 20:10:05,825: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[132a5bfc-9276-4684-a5c0-71a73c0fa5b0] succeeded in 5.098322081999868s: None 2024-05-09T20:10:05.936472395Z [2024-05-09 20:10:05,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ae90f0c-0a52-4084-bcef-007b29ffb98b] received 2024-05-09T20:10:05.949393197Z [2024-05-09 20:10:05,949: INFO/ForkPoolWorker-15] [2ae90f0c-0a52-4084-bcef-007b29ffb98b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'split_metrics', 'scheduled__2024-05-09T20:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:10:06.216246221Z [2024-05-09 20:10:06,215: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[015029ef-69b9-4810-9ade-d36e8e95fd48] succeeded in 5.504098577999912s: None 2024-05-09T20:10:06.365779420Z [2024-05-09 20:10:06,361: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:10:08.025269285Z [2024-05-09 20:10:08,024: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:10:08.029779898Z [2024-05-09 20:10:08,029: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:10:08.193829653Z [2024-05-09 20:10:08,190: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:10:08.193860352Z [2024-05-09 20:10:08,192: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:10:08.193866814Z [2024-05-09 20:10:08,192: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:10:08.193873546Z [2024-05-09 20:10:08,192: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:10:08.193898558Z [2024-05-09 20:10:08,192: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:10:08.193903504Z [2024-05-09 20:10:08,192: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:10:08.193908548Z [2024-05-09 20:10:08,192: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:10:08.281626782Z [2024-05-09 20:10:08,281: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:10:09.051532289Z [2024-05-09 20:10:09,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ae90f0c-0a52-4084-bcef-007b29ffb98b] succeeded in 3.113077331000113s: None 2024-05-09T20:10:09.506076515Z [2024-05-09 20:10:09,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[706d62aa-7dff-4d99-8046-f5f4cb4bbe6e] received 2024-05-09T20:10:09.514408843Z [2024-05-09 20:10:09,514: INFO/ForkPoolWorker-15] [706d62aa-7dff-4d99-8046-f5f4cb4bbe6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'collect_metrics', 'scheduled__2024-05-09T20:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-09T20:10:09.885396128Z [2024-05-09 20:10:09,881: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:10:11.142148388Z [2024-05-09 20:10:11,141: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:10:11.146048272Z [2024-05-09 20:10:11,145: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:10:11.187411132Z [2024-05-09 20:10:11,187: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:10:11.189266423Z [2024-05-09 20:10:11,188: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:10:11.189591145Z [2024-05-09 20:10:11,189: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:10:11.189913512Z [2024-05-09 20:10:11,189: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:10:11.190180437Z [2024-05-09 20:10:11,189: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:10:11.190782028Z [2024-05-09 20:10:11,190: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:10:11.191538491Z [2024-05-09 20:10:11,191: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:10:11.292446693Z [2024-05-09 20:10:11,292: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:10:11.831741070Z [2024-05-09 20:10:11,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[706d62aa-7dff-4d99-8046-f5f4cb4bbe6e] succeeded in 2.322632436000049s: None 2024-05-09T20:10:12.418114531Z [2024-05-09 20:10:12,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77aedd17-10de-4c7d-8077-e67b3e00013d] received 2024-05-09T20:10:12.440126131Z [2024-05-09 20:10:12,431: INFO/ForkPoolWorker-15] [77aedd17-10de-4c7d-8077-e67b3e00013d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'send_prometheus', 'scheduled__2024-05-09T20:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:10:12.801067455Z [2024-05-09 20:10:12,798: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:10:14.115280943Z [2024-05-09 20:10:14,114: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:10:14.118882027Z [2024-05-09 20:10:14,118: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:10:14.143617579Z [2024-05-09 20:10:14,143: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:10:14.144723656Z [2024-05-09 20:10:14,144: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:10:14.144733135Z [2024-05-09 20:10:14,144: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:10:14.144896011Z [2024-05-09 20:10:14,144: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:10:14.144979144Z [2024-05-09 20:10:14,144: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:10:14.145135842Z [2024-05-09 20:10:14,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:10:14.145174299Z [2024-05-09 20:10:14,145: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:10:14.259121307Z [2024-05-09 20:10:14,258: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:10:14.928672441Z [2024-05-09 20:10:14,928: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77aedd17-10de-4c7d-8077-e67b3e00013d] succeeded in 2.515313913s: None 2024-05-09T20:11:00.736609387Z [2024-05-09 20:11:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[300de9d2-4a52-48a2-b49d-dcc2d9cb7c6d] received 2024-05-09T20:11:00.740382711Z [2024-05-09 20:11:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2534be04-0edf-4f51-a91a-0465894b0b37] received 2024-05-09T20:11:00.744802038Z [2024-05-09 20:11:00,744: INFO/ForkPoolWorker-15] [300de9d2-4a52-48a2-b49d-dcc2d9cb7c6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:11:00.751839205Z [2024-05-09 20:11:00,751: INFO/ForkPoolWorker-16] [2534be04-0edf-4f51-a91a-0465894b0b37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:11:01.084869293Z [2024-05-09 20:11:01,080: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:11:01.095747723Z [2024-05-09 20:11:01,091: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:11:02.532243381Z [2024-05-09 20:11:02,531: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:11:02.537704534Z [2024-05-09 20:11:02,535: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:11:02.594385234Z [2024-05-09 20:11:02,593: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:11:02.599579252Z [2024-05-09 20:11:02,596: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:11:02.599603734Z [2024-05-09 20:11:02,596: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:11:02.599612811Z [2024-05-09 20:11:02,596: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:11:02.599643632Z [2024-05-09 20:11:02,596: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:11:02.599650650Z [2024-05-09 20:11:02,597: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:11:02.599655360Z [2024-05-09 20:11:02,597: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:11:02.706739119Z [2024-05-09 20:11:02,706: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:11:02.744515333Z [2024-05-09 20:11:02,743: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:11:02.747806626Z [2024-05-09 20:11:02,747: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:11:02.794860367Z [2024-05-09 20:11:02,791: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:11:02.794884665Z [2024-05-09 20:11:02,792: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:11:02.794889081Z [2024-05-09 20:11:02,792: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:11:02.794892920Z [2024-05-09 20:11:02,792: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:11:02.794896854Z [2024-05-09 20:11:02,792: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:11:02.794899933Z [2024-05-09 20:11:02,792: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:11:02.794903154Z [2024-05-09 20:11:02,793: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:11:02.899460664Z [2024-05-09 20:11:02,899: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:11:04.633822143Z [2024-05-09 20:11:04,633: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2534be04-0edf-4f51-a91a-0465894b0b37] succeeded in 3.887146238000014s: None 2024-05-09T20:11:05.487375051Z [2024-05-09 20:11:05,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[300de9d2-4a52-48a2-b49d-dcc2d9cb7c6d] succeeded in 4.7492872259999785s: None 2024-05-09T20:12:00.848583291Z [2024-05-09 20:12:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adde772f-2533-4970-936a-0d4a71217a29] received 2024-05-09T20:12:00.851201742Z [2024-05-09 20:12:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[485cc618-0fed-4985-b464-1f1a9bfc0afd] received 2024-05-09T20:12:00.859425054Z [2024-05-09 20:12:00,859: INFO/ForkPoolWorker-16] [485cc618-0fed-4985-b464-1f1a9bfc0afd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:12:00.860027388Z [2024-05-09 20:12:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7c7a1fc-8a97-44d0-8fe9-cc5ab5278222] received 2024-05-09T20:12:00.869850192Z [2024-05-09 20:12:00,869: INFO/ForkPoolWorker-15] [adde772f-2533-4970-936a-0d4a71217a29] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:12:00.886904871Z [2024-05-09 20:12:00,885: INFO/ForkPoolWorker-1] [b7c7a1fc-8a97-44d0-8fe9-cc5ab5278222] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:12:01.281516328Z [2024-05-09 20:12:01,278: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:12:01.338111509Z [2024-05-09 20:12:01,330: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:12:01.411410518Z [2024-05-09 20:12:01,408: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:12:01.615818354Z [2024-05-09 20:12:01,615: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:12:02.427189086Z [2024-05-09 20:12:02,424: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[adde772f-2533-4970-936a-0d4a71217a29] succeeded in 1.5628117579999525s: None 2024-05-09T20:12:03.268872729Z [2024-05-09 20:12:03,268: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:12:03.272910531Z [2024-05-09 20:12:03,272: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:12:03.306388473Z [2024-05-09 20:12:03,306: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:12:03.314605969Z [2024-05-09 20:12:03,314: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:12:03.325500505Z [2024-05-09 20:12:03,325: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:12:03.326759207Z [2024-05-09 20:12:03,326: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:12:03.326874824Z [2024-05-09 20:12:03,326: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:12:03.327082001Z [2024-05-09 20:12:03,326: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:12:03.327120079Z [2024-05-09 20:12:03,327: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:12:03.327478132Z [2024-05-09 20:12:03,327: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:12:03.327494726Z [2024-05-09 20:12:03,327: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:12:03.363007065Z [2024-05-09 20:12:03,362: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:12:03.364015866Z [2024-05-09 20:12:03,363: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:12:03.364042110Z [2024-05-09 20:12:03,363: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:12:03.364167712Z [2024-05-09 20:12:03,364: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:12:03.364248034Z [2024-05-09 20:12:03,364: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:12:03.364411416Z [2024-05-09 20:12:03,364: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:12:03.364437691Z [2024-05-09 20:12:03,364: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:12:03.427826835Z [2024-05-09 20:12:03,427: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:12:03.490226812Z [2024-05-09 20:12:03,489: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:12:04.867388359Z [2024-05-09 20:12:04,867: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[485cc618-0fed-4985-b464-1f1a9bfc0afd] succeeded in 4.014858631000152s: None 2024-05-09T20:12:05.475394530Z [2024-05-09 20:12:05,475: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b7c7a1fc-8a97-44d0-8fe9-cc5ab5278222] succeeded in 4.606608701999903s: None 2024-05-09T20:13:01.188275572Z [2024-05-09 20:13:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4dcdfd6-9d0e-47c6-aa5a-7dfc74b49897] received 2024-05-09T20:13:01.203078773Z [2024-05-09 20:13:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e64741c-4aad-4bca-b704-540bac227ab7] received 2024-05-09T20:13:01.209753702Z [2024-05-09 20:13:01,209: INFO/ForkPoolWorker-15] [e4dcdfd6-9d0e-47c6-aa5a-7dfc74b49897] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:13:01.220425416Z [2024-05-09 20:13:01,219: INFO/ForkPoolWorker-16] [1e64741c-4aad-4bca-b704-540bac227ab7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:13:01.634132505Z [2024-05-09 20:13:01,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:13:01.674864361Z [2024-05-09 20:13:01,666: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:13:03.291702208Z [2024-05-09 20:13:03,291: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:13:03.296778525Z [2024-05-09 20:13:03,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:13:03.318999687Z [2024-05-09 20:13:03,318: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:13:03.324934482Z [2024-05-09 20:13:03,324: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:13:03.325124739Z [2024-05-09 20:13:03,324: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:13:03.325476729Z [2024-05-09 20:13:03,325: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:13:03.325669482Z [2024-05-09 20:13:03,325: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:13:03.326291100Z [2024-05-09 20:13:03,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:13:03.327061055Z [2024-05-09 20:13:03,326: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:13:03.416923162Z [2024-05-09 20:13:03,416: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:13:03.477873242Z [2024-05-09 20:13:03,477: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:13:03.481402775Z [2024-05-09 20:13:03,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:13:03.511016625Z [2024-05-09 20:13:03,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:13:03.512242089Z [2024-05-09 20:13:03,512: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:13:03.512350867Z [2024-05-09 20:13:03,512: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:13:03.512750959Z [2024-05-09 20:13:03,512: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:13:03.512939500Z [2024-05-09 20:13:03,512: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:13:03.513228951Z [2024-05-09 20:13:03,513: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:13:03.513706978Z [2024-05-09 20:13:03,513: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:13:03.621229226Z [2024-05-09 20:13:03,620: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:13:05.085322674Z [2024-05-09 20:13:05,084: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e64741c-4aad-4bca-b704-540bac227ab7] succeeded in 3.876689709999937s: None 2024-05-09T20:13:07.297461335Z [2024-05-09 20:13:07,297: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4dcdfd6-9d0e-47c6-aa5a-7dfc74b49897] succeeded in 6.104293337000172s: None 2024-05-09T20:14:01.090951650Z [2024-05-09 20:14:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44bce0b4-9512-46f6-9111-e843a1b9b1f8] received 2024-05-09T20:14:01.095334732Z [2024-05-09 20:14:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4ffbde3-e1f5-4bc1-8c15-e27781e47033] received 2024-05-09T20:14:01.103876192Z [2024-05-09 20:14:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a34703bd-7286-4f94-bcf8-9a6eb6f21fd9] received 2024-05-09T20:14:01.113913436Z [2024-05-09 20:14:01,113: INFO/ForkPoolWorker-16] [c4ffbde3-e1f5-4bc1-8c15-e27781e47033] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:14:01.114314914Z [2024-05-09 20:14:01,113: INFO/ForkPoolWorker-15] [44bce0b4-9512-46f6-9111-e843a1b9b1f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:14:01.139591824Z [2024-05-09 20:14:01,139: INFO/ForkPoolWorker-1] [a34703bd-7286-4f94-bcf8-9a6eb6f21fd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:14:01.646782168Z [2024-05-09 20:14:01,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:14:01.656848927Z [2024-05-09 20:14:01,651: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:14:01.677577789Z [2024-05-09 20:14:01,672: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:14:01.959598252Z [2024-05-09 20:14:01,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:14:02.781357247Z [2024-05-09 20:14:02,780: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44bce0b4-9512-46f6-9111-e843a1b9b1f8] succeeded in 1.6830231730000378s: None 2024-05-09T20:14:03.237414287Z [2024-05-09 20:14:03,237: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:14:03.240447242Z [2024-05-09 20:14:03,240: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:14:03.294954381Z [2024-05-09 20:14:03,294: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:14:03.296835633Z [2024-05-09 20:14:03,296: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:14:03.296846278Z [2024-05-09 20:14:03,296: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:14:03.297139100Z [2024-05-09 20:14:03,296: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:14:03.297185011Z [2024-05-09 20:14:03,296: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:14:03.297566683Z [2024-05-09 20:14:03,297: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:14:03.297597557Z [2024-05-09 20:14:03,297: INFO/ForkPoolWorker-1] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:14:03.402317342Z [2024-05-09 20:14:03,402: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:14:03.446641894Z [2024-05-09 20:14:03,444: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:14:03.453158789Z [2024-05-09 20:14:03,452: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:14:03.497845346Z [2024-05-09 20:14:03,497: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:14:03.500852563Z [2024-05-09 20:14:03,500: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:14:03.501014362Z [2024-05-09 20:14:03,500: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:14:03.501600813Z [2024-05-09 20:14:03,501: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:14:03.502266869Z [2024-05-09 20:14:03,502: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:14:03.502611813Z [2024-05-09 20:14:03,502: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:14:03.503496048Z [2024-05-09 20:14:03,503: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:14:03.597936108Z [2024-05-09 20:14:03,597: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:14:04.895052098Z [2024-05-09 20:14:04,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a34703bd-7286-4f94-bcf8-9a6eb6f21fd9] succeeded in 3.7846179030000258s: None 2024-05-09T20:14:05.499606243Z [2024-05-09 20:14:05,499: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4ffbde3-e1f5-4bc1-8c15-e27781e47033] succeeded in 4.402247616000068s: None 2024-05-09T20:15:00.953649975Z [2024-05-09 20:15:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5df563f-2125-4d2a-ab87-ce37f971b996] received 2024-05-09T20:15:00.965657724Z [2024-05-09 20:15:00,965: INFO/ForkPoolWorker-15] [a5df563f-2125-4d2a-ab87-ce37f971b996] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:15:00.985269185Z [2024-05-09 20:15:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7652d11-a670-47b9-8ac3-1f4f08640e9d] received 2024-05-09T20:15:00.989239472Z [2024-05-09 20:15:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de37bb66-4f9e-412f-8aa5-fee6a4efeda5] received 2024-05-09T20:15:00.999790961Z [2024-05-09 20:15:00,999: INFO/ForkPoolWorker-16] [f7652d11-a670-47b9-8ac3-1f4f08640e9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-09T20:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:15:01.008259542Z [2024-05-09 20:15:01,008: INFO/ForkPoolWorker-1] [de37bb66-4f9e-412f-8aa5-fee6a4efeda5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:15:01.431629269Z [2024-05-09 20:15:01,428: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:15:01.460319718Z [2024-05-09 20:15:01,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:15:01.741957969Z [2024-05-09 20:15:01,738: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:15:03.157095460Z [2024-05-09 20:15:03,156: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:15:03.161615517Z [2024-05-09 20:15:03,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:15:03.222680196Z [2024-05-09 20:15:03,222: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:15:03.224177837Z [2024-05-09 20:15:03,223: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:15:03.228448462Z [2024-05-09 20:15:03,228: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:15:03.228527673Z [2024-05-09 20:15:03,228: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:15:03.228740622Z [2024-05-09 20:15:03,228: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:15:03.229748820Z [2024-05-09 20:15:03,228: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:15:03.230070981Z [2024-05-09 20:15:03,229: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:15:03.230181176Z [2024-05-09 20:15:03,230: INFO/ForkPoolWorker-15] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:15:03.232608518Z [2024-05-09 20:15:03,231: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:15:03.281982621Z [2024-05-09 20:15:03,281: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:15:03.283967273Z [2024-05-09 20:15:03,283: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:15:03.285990573Z [2024-05-09 20:15:03,285: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:15:03.286150840Z [2024-05-09 20:15:03,285: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:15:03.286234695Z [2024-05-09 20:15:03,286: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:15:03.287147333Z [2024-05-09 20:15:03,286: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:15:03.287457808Z [2024-05-09 20:15:03,287: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:15:03.334532622Z [2024-05-09 20:15:03,334: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:15:03.394535453Z [2024-05-09 20:15:03,394: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:15:03.545478970Z [2024-05-09 20:15:03,544: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:15:03.551083098Z [2024-05-09 20:15:03,550: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:15:03.607285471Z [2024-05-09 20:15:03,607: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:15:03.610604361Z [2024-05-09 20:15:03,610: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:15:03.610622300Z [2024-05-09 20:15:03,610: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:15:03.610831374Z [2024-05-09 20:15:03,610: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:15:03.610839273Z [2024-05-09 20:15:03,610: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:15:03.615233278Z [2024-05-09 20:15:03,615: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:15:03.615251399Z [2024-05-09 20:15:03,615: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:15:03.751042630Z [2024-05-09 20:15:03,750: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:15:04.116628140Z [2024-05-09 20:15:04,116: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7652d11-a670-47b9-8ac3-1f4f08640e9d] succeeded in 3.125710010000148s: None 2024-05-09T20:15:04.633220165Z [2024-05-09 20:15:04,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fea3cc3-e11d-45b7-b40c-9f260ba9b845] received 2024-05-09T20:15:04.641097578Z [2024-05-09 20:15:04,640: INFO/ForkPoolWorker-16] [6fea3cc3-e11d-45b7-b40c-9f260ba9b845] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'split_metrics', 'scheduled__2024-05-09T20:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:15:05.031303891Z [2024-05-09 20:15:05,030: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a5df563f-2125-4d2a-ab87-ce37f971b996] succeeded in 4.074300127000015s: None 2024-05-09T20:15:05.035159044Z [2024-05-09 20:15:05,032: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:15:05.631129453Z [2024-05-09 20:15:05,630: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de37bb66-4f9e-412f-8aa5-fee6a4efeda5] succeeded in 4.640419587999986s: None 2024-05-09T20:15:06.547486220Z [2024-05-09 20:15:06,547: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:15:06.556157275Z [2024-05-09 20:15:06,555: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:15:06.623867123Z [2024-05-09 20:15:06,609: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:15:06.623877628Z [2024-05-09 20:15:06,614: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:15:06.623881922Z [2024-05-09 20:15:06,614: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:15:06.623888172Z [2024-05-09 20:15:06,614: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:15:06.623893606Z [2024-05-09 20:15:06,614: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:15:06.623896697Z [2024-05-09 20:15:06,614: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:15:06.623899893Z [2024-05-09 20:15:06,614: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:15:06.733406499Z [2024-05-09 20:15:06,733: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:15:07.339923562Z [2024-05-09 20:15:07,339: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6fea3cc3-e11d-45b7-b40c-9f260ba9b845] succeeded in 2.704294826000023s: None 2024-05-09T20:15:07.514251692Z [2024-05-09 20:15:07,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4ab013f-b2a1-4952-9d14-b33225b3afbf] received 2024-05-09T20:15:07.533657950Z [2024-05-09 20:15:07,531: INFO/ForkPoolWorker-15] [b4ab013f-b2a1-4952-9d14-b33225b3afbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'collect_metrics', 'scheduled__2024-05-09T20:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-09T20:15:07.885554340Z [2024-05-09 20:15:07,881: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:15:09.396550754Z [2024-05-09 20:15:09,396: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:15:09.401258011Z [2024-05-09 20:15:09,400: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:15:09.468047647Z [2024-05-09 20:15:09,467: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:15:09.472973334Z [2024-05-09 20:15:09,472: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:15:09.473192747Z [2024-05-09 20:15:09,473: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:15:09.475215393Z [2024-05-09 20:15:09,474: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:15:09.475356696Z [2024-05-09 20:15:09,475: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:15:09.475643439Z [2024-05-09 20:15:09,475: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:15:09.475771074Z [2024-05-09 20:15:09,475: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:15:09.603226055Z [2024-05-09 20:15:09,602: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:15:11.126655266Z [2024-05-09 20:15:11,126: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4ab013f-b2a1-4952-9d14-b33225b3afbf] succeeded in 3.608288831000209s: None 2024-05-09T20:15:11.448344892Z [2024-05-09 20:15:11,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12b7d027-b680-4393-91ea-3734a777f357] received 2024-05-09T20:15:11.462755470Z [2024-05-09 20:15:11,462: INFO/ForkPoolWorker-15] [12b7d027-b680-4393-91ea-3734a777f357] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'send_prometheus', 'scheduled__2024-05-09T20:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:15:11.826034421Z [2024-05-09 20:15:11,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:15:13.265288056Z [2024-05-09 20:15:13,264: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:15:13.268692927Z [2024-05-09 20:15:13,268: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:15:13.296004024Z [2024-05-09 20:15:13,295: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:15:13.297907669Z [2024-05-09 20:15:13,297: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:15:13.297923014Z [2024-05-09 20:15:13,297: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:15:13.298054074Z [2024-05-09 20:15:13,297: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:15:13.298063585Z [2024-05-09 20:15:13,298: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:15:13.298304652Z [2024-05-09 20:15:13,298: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:15:13.298325425Z [2024-05-09 20:15:13,298: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:15:13.387542967Z [2024-05-09 20:15:13,387: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:15:13.986056422Z [2024-05-09 20:15:13,985: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12b7d027-b680-4393-91ea-3734a777f357] succeeded in 2.5348302469999453s: None 2024-05-09T20:16:00.999703640Z [2024-05-09 20:16:00,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5385e6fd-1bed-4e35-a96c-f2dffab2b91e] received 2024-05-09T20:16:01.007672716Z [2024-05-09 20:16:01,007: INFO/ForkPoolWorker-15] [5385e6fd-1bed-4e35-a96c-f2dffab2b91e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:16:01.028351508Z [2024-05-09 20:16:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9ebb179-f3ee-49b2-8c5f-0980819dbfee] received 2024-05-09T20:16:01.041520966Z [2024-05-09 20:16:01,041: INFO/ForkPoolWorker-16] [a9ebb179-f3ee-49b2-8c5f-0980819dbfee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:16:01.042395374Z [2024-05-09 20:16:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75206795-9d60-4bca-8abc-faa342f3bcca] received 2024-05-09T20:16:01.064442751Z [2024-05-09 20:16:01,064: INFO/ForkPoolWorker-1] [75206795-9d60-4bca-8abc-faa342f3bcca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:16:01.380438109Z [2024-05-09 20:16:01,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:16:01.434417631Z [2024-05-09 20:16:01,430: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:16:01.508479880Z [2024-05-09 20:16:01,504: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:16:01.698278466Z [2024-05-09 20:16:01,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:16:02.499660447Z [2024-05-09 20:16:02,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5385e6fd-1bed-4e35-a96c-f2dffab2b91e] succeeded in 1.4979614080000374s: None 2024-05-09T20:16:03.201818957Z [2024-05-09 20:16:03,201: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:16:03.207193844Z [2024-05-09 20:16:03,206: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:16:03.245088808Z [2024-05-09 20:16:03,244: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:16:03.247568116Z [2024-05-09 20:16:03,247: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:16:03.247586608Z [2024-05-09 20:16:03,247: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:16:03.247827890Z [2024-05-09 20:16:03,247: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:16:03.247976805Z [2024-05-09 20:16:03,247: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:16:03.248224449Z [2024-05-09 20:16:03,248: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:16:03.252324468Z [2024-05-09 20:16:03,248: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:16:03.280691377Z [2024-05-09 20:16:03,280: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:16:03.284093033Z [2024-05-09 20:16:03,283: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:16:03.334431542Z [2024-05-09 20:16:03,334: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:16:03.336574164Z [2024-05-09 20:16:03,336: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:16:03.336914896Z [2024-05-09 20:16:03,336: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:16:03.337457903Z [2024-05-09 20:16:03,337: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:16:03.337741309Z [2024-05-09 20:16:03,337: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:16:03.338512211Z [2024-05-09 20:16:03,338: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:16:03.338744110Z [2024-05-09 20:16:03,338: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:16:03.355755366Z [2024-05-09 20:16:03,354: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:16:03.457379141Z [2024-05-09 20:16:03,457: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:16:04.968762925Z [2024-05-09 20:16:04,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9ebb179-f3ee-49b2-8c5f-0980819dbfee] succeeded in 3.9377433409999867s: None 2024-05-09T20:16:05.447852668Z [2024-05-09 20:16:05,447: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[75206795-9d60-4bca-8abc-faa342f3bcca] succeeded in 4.399831462999828s: None 2024-05-09T20:17:01.050594371Z [2024-05-09 20:17:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f303c5e3-8682-4d76-a126-6fabf9c7362a] received 2024-05-09T20:17:01.056611521Z [2024-05-09 20:17:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7e5b06d-d67a-4279-9f73-292bbaa92553] received 2024-05-09T20:17:01.068391611Z [2024-05-09 20:17:01,067: INFO/ForkPoolWorker-15] [f303c5e3-8682-4d76-a126-6fabf9c7362a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:17:01.072431992Z [2024-05-09 20:17:01,072: INFO/ForkPoolWorker-16] [e7e5b06d-d67a-4279-9f73-292bbaa92553] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:17:01.426223481Z [2024-05-09 20:17:01,423: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:17:01.445099185Z [2024-05-09 20:17:01,441: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:17:02.991858923Z [2024-05-09 20:17:02,991: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:17:02.995528800Z [2024-05-09 20:17:02,995: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:17:02.998343217Z [2024-05-09 20:17:02,997: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:17:03.003708244Z [2024-05-09 20:17:03,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:17:03.020308820Z [2024-05-09 20:17:03,020: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:17:03.021595490Z [2024-05-09 20:17:03,021: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:17:03.021744556Z [2024-05-09 20:17:03,021: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:17:03.021919749Z [2024-05-09 20:17:03,021: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:17:03.022113648Z [2024-05-09 20:17:03,021: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:17:03.022446995Z [2024-05-09 20:17:03,022: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:17:03.022565646Z [2024-05-09 20:17:03,022: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:17:03.043577638Z [2024-05-09 20:17:03,043: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:17:03.045511472Z [2024-05-09 20:17:03,045: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:17:03.045578151Z [2024-05-09 20:17:03,045: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:17:03.045830489Z [2024-05-09 20:17:03,045: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:17:03.045897522Z [2024-05-09 20:17:03,045: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:17:03.046416561Z [2024-05-09 20:17:03,046: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:17:03.046598050Z [2024-05-09 20:17:03,046: INFO/ForkPoolWorker-15] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:17:03.145581498Z [2024-05-09 20:17:03,145: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:17:03.158421878Z [2024-05-09 20:17:03,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:17:05.329043609Z [2024-05-09 20:17:05,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f303c5e3-8682-4d76-a126-6fabf9c7362a] succeeded in 4.2760943170001156s: None 2024-05-09T20:17:05.455617179Z [2024-05-09 20:17:05,455: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7e5b06d-d67a-4279-9f73-292bbaa92553] succeeded in 4.397121428999981s: None 2024-05-09T20:18:01.278807372Z [2024-05-09 20:18:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eeb5c0f-9586-437e-be42-ccdc82a253e2] received 2024-05-09T20:18:01.278821636Z [2024-05-09 20:18:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70dc3f09-ab9b-49bf-9268-59751fcdbe91] received 2024-05-09T20:18:01.279645149Z [2024-05-09 20:18:01,279: INFO/ForkPoolWorker-15] [0eeb5c0f-9586-437e-be42-ccdc82a253e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:18:01.294603066Z [2024-05-09 20:18:01,285: INFO/ForkPoolWorker-16] [70dc3f09-ab9b-49bf-9268-59751fcdbe91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:18:01.294622410Z [2024-05-09 20:18:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[971b74d2-1db4-43e4-9509-cb736ffb58b0] received 2024-05-09T20:18:01.303529633Z [2024-05-09 20:18:01,303: INFO/ForkPoolWorker-1] [971b74d2-1db4-43e4-9509-cb736ffb58b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:18:01.795151236Z [2024-05-09 20:18:01,791: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:18:01.811900656Z [2024-05-09 20:18:01,808: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:18:01.920211531Z [2024-05-09 20:18:01,911: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:18:02.128552055Z [2024-05-09 20:18:02,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:18:02.908381460Z [2024-05-09 20:18:02,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0eeb5c0f-9586-437e-be42-ccdc82a253e2] succeeded in 1.636849821000169s: None 2024-05-09T20:18:03.437672543Z [2024-05-09 20:18:03,437: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:18:03.442298274Z [2024-05-09 20:18:03,441: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:18:03.492409496Z [2024-05-09 20:18:03,492: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:18:03.500021155Z [2024-05-09 20:18:03,499: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:18:03.500534168Z [2024-05-09 20:18:03,499: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:18:03.502089784Z [2024-05-09 20:18:03,501: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:18:03.502911974Z [2024-05-09 20:18:03,502: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:18:03.504854925Z [2024-05-09 20:18:03,504: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:18:03.506685276Z [2024-05-09 20:18:03,506: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:18:03.609371224Z [2024-05-09 20:18:03,609: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:18:03.666531610Z [2024-05-09 20:18:03,666: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:18:03.670841854Z [2024-05-09 20:18:03,670: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:18:03.749179140Z [2024-05-09 20:18:03,748: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:18:03.751649289Z [2024-05-09 20:18:03,751: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:18:03.751939142Z [2024-05-09 20:18:03,751: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:18:03.752092362Z [2024-05-09 20:18:03,751: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:18:03.752310847Z [2024-05-09 20:18:03,752: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:18:03.752603424Z [2024-05-09 20:18:03,752: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:18:03.752696216Z [2024-05-09 20:18:03,752: INFO/ForkPoolWorker-1] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:18:03.850027416Z [2024-05-09 20:18:03,842: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:18:05.435047882Z [2024-05-09 20:18:05,434: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[971b74d2-1db4-43e4-9509-cb736ffb58b0] succeeded in 4.141835270999991s: None 2024-05-09T20:18:05.607463418Z [2024-05-09 20:18:05,607: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70dc3f09-ab9b-49bf-9268-59751fcdbe91] succeeded in 4.331344172999934s: None 2024-05-09T20:19:00.970553701Z [2024-05-09 20:19:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83546d82-06e2-44d9-b386-3b6c25356e49] received 2024-05-09T20:19:00.979251392Z [2024-05-09 20:19:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b36045f4-905d-4f7d-8b00-60dab45ede0d] received 2024-05-09T20:19:00.981903622Z [2024-05-09 20:19:00,981: INFO/ForkPoolWorker-15] [83546d82-06e2-44d9-b386-3b6c25356e49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:19:00.995978848Z [2024-05-09 20:19:00,995: INFO/ForkPoolWorker-16] [b36045f4-905d-4f7d-8b00-60dab45ede0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:19:01.373237856Z [2024-05-09 20:19:01,369: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:19:01.408586066Z [2024-05-09 20:19:01,405: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:19:02.824459068Z [2024-05-09 20:19:02,824: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:19:02.828088728Z [2024-05-09 20:19:02,827: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:19:02.872123664Z [2024-05-09 20:19:02,871: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:19:02.873563946Z [2024-05-09 20:19:02,873: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:19:02.873787731Z [2024-05-09 20:19:02,873: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:19:02.874091209Z [2024-05-09 20:19:02,873: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:19:02.874307180Z [2024-05-09 20:19:02,874: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:19:02.874846313Z [2024-05-09 20:19:02,874: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:19:02.875024138Z [2024-05-09 20:19:02,874: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:19:02.914648396Z [2024-05-09 20:19:02,914: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:19:02.918610509Z [2024-05-09 20:19:02,918: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:19:02.948494443Z [2024-05-09 20:19:02,948: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:19:02.949506698Z [2024-05-09 20:19:02,949: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:19:02.949528540Z [2024-05-09 20:19:02,949: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:19:02.949720543Z [2024-05-09 20:19:02,949: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:19:02.949758147Z [2024-05-09 20:19:02,949: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:19:02.950015287Z [2024-05-09 20:19:02,949: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:19:02.950140972Z [2024-05-09 20:19:02,949: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:19:02.970111751Z [2024-05-09 20:19:02,969: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:19:03.048622590Z [2024-05-09 20:19:03,047: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:19:04.749829023Z [2024-05-09 20:19:04,749: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b36045f4-905d-4f7d-8b00-60dab45ede0d] succeeded in 3.763448015999984s: None 2024-05-09T20:19:05.012032265Z [2024-05-09 20:19:05,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83546d82-06e2-44d9-b386-3b6c25356e49] succeeded in 4.0386574439999094s: None 2024-05-09T20:20:01.098400175Z [2024-05-09 20:20:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7731615e-37bf-49d5-896e-a803dfb06b88] received 2024-05-09T20:20:01.100269881Z [2024-05-09 20:20:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3df772e5-1814-4938-a468-a06641d7066c] received 2024-05-09T20:20:01.103732473Z [2024-05-09 20:20:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e92e286-d686-4a4c-8195-cacf72ed0048] received 2024-05-09T20:20:01.105750982Z [2024-05-09 20:20:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42a5d986-a249-4c95-80bf-0741991e0184] received 2024-05-09T20:20:01.109174747Z [2024-05-09 20:20:01,108: INFO/ForkPoolWorker-16] [3df772e5-1814-4938-a468-a06641d7066c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-09T20:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:20:01.119355431Z [2024-05-09 20:20:01,119: INFO/ForkPoolWorker-1] [4e92e286-d686-4a4c-8195-cacf72ed0048] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:20:01.127572055Z [2024-05-09 20:20:01,127: INFO/ForkPoolWorker-15] [7731615e-37bf-49d5-896e-a803dfb06b88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:20:01.149917986Z [2024-05-09 20:20:01,149: INFO/ForkPoolWorker-2] [42a5d986-a249-4c95-80bf-0741991e0184] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:20:01.580712536Z [2024-05-09 20:20:01,568: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:20:01.659109282Z [2024-05-09 20:20:01,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:20:01.665709313Z [2024-05-09 20:20:01,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:20:01.724021571Z [2024-05-09 20:20:01,717: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:20:02.012769343Z [2024-05-09 20:20:02,012: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:20:03.069744549Z [2024-05-09 20:20:03,069: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[42a5d986-a249-4c95-80bf-0741991e0184] succeeded in 1.9462942750001275s: None 2024-05-09T20:20:03.417636116Z [2024-05-09 20:20:03,417: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:20:03.421688906Z [2024-05-09 20:20:03,420: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:20:03.453362191Z [2024-05-09 20:20:03,453: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:20:03.459350851Z [2024-05-09 20:20:03,459: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:20:03.459601674Z [2024-05-09 20:20:03,459: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:20:03.459843828Z [2024-05-09 20:20:03,459: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:20:03.459919234Z [2024-05-09 20:20:03,459: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:20:03.461310885Z [2024-05-09 20:20:03,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:20:03.461372039Z [2024-05-09 20:20:03,461: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:20:03.568845625Z [2024-05-09 20:20:03,568: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:20:03.672619796Z [2024-05-09 20:20:03,672: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:20:03.677989246Z [2024-05-09 20:20:03,677: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:20:03.745683437Z [2024-05-09 20:20:03,745: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:20:03.749983780Z [2024-05-09 20:20:03,749: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:20:03.750076585Z [2024-05-09 20:20:03,749: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:20:03.750349016Z [2024-05-09 20:20:03,750: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:20:03.750357464Z [2024-05-09 20:20:03,750: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:20:03.750806447Z [2024-05-09 20:20:03,750: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:20:03.750825268Z [2024-05-09 20:20:03,750: INFO/ForkPoolWorker-1] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:20:03.858107617Z [2024-05-09 20:20:03,857: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:20:04.163801251Z [2024-05-09 20:20:04,163: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:20:04.170193423Z [2024-05-09 20:20:04,169: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:20:04.260287417Z [2024-05-09 20:20:04,260: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:20:04.262578402Z [2024-05-09 20:20:04,262: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:20:04.262888725Z [2024-05-09 20:20:04,262: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:20:04.263183891Z [2024-05-09 20:20:04,262: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:20:04.263366322Z [2024-05-09 20:20:04,263: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:20:04.263893551Z [2024-05-09 20:20:04,263: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:20:04.264052251Z [2024-05-09 20:20:04,263: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:20:04.424313930Z [2024-05-09 20:20:04,424: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:20:05.211902520Z [2024-05-09 20:20:05,211: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3df772e5-1814-4938-a468-a06641d7066c] succeeded in 4.109918007000033s: None 2024-05-09T20:20:05.514120350Z [2024-05-09 20:20:05,513: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e92e286-d686-4a4c-8195-cacf72ed0048] succeeded in 4.407318249999889s: None 2024-05-09T20:20:05.872948630Z [2024-05-09 20:20:05,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7731615e-37bf-49d5-896e-a803dfb06b88] succeeded in 4.766535708999982s: None 2024-05-09T20:20:06.124067666Z [2024-05-09 20:20:06,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b8f9fbf-f382-49af-9130-c30e1383652a] received 2024-05-09T20:20:06.137271812Z [2024-05-09 20:20:06,136: INFO/ForkPoolWorker-15] [2b8f9fbf-f382-49af-9130-c30e1383652a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'split_metrics', 'scheduled__2024-05-09T20:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:20:06.597802696Z [2024-05-09 20:20:06,593: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:20:08.166387674Z [2024-05-09 20:20:08,165: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:20:08.169848932Z [2024-05-09 20:20:08,169: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:20:08.193344563Z [2024-05-09 20:20:08,193: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:20:08.194416082Z [2024-05-09 20:20:08,194: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:20:08.194434834Z [2024-05-09 20:20:08,194: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:20:08.194564632Z [2024-05-09 20:20:08,194: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:20:08.194588594Z [2024-05-09 20:20:08,194: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:20:08.195230083Z [2024-05-09 20:20:08,195: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:20:08.195245732Z [2024-05-09 20:20:08,195: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:20:08.273891442Z [2024-05-09 20:20:08,273: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:20:08.938948022Z [2024-05-09 20:20:08,938: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b8f9fbf-f382-49af-9130-c30e1383652a] succeeded in 2.8118662809999933s: None 2024-05-09T20:20:09.870216480Z [2024-05-09 20:20:09,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b74b1935-90ea-4190-bca2-230c99998c97] received 2024-05-09T20:20:09.878434504Z [2024-05-09 20:20:09,878: INFO/ForkPoolWorker-15] [b74b1935-90ea-4190-bca2-230c99998c97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'collect_metrics', 'scheduled__2024-05-09T20:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-09T20:20:10.219578481Z [2024-05-09 20:20:10,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:20:11.531868886Z [2024-05-09 20:20:11,531: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:20:11.535494178Z [2024-05-09 20:20:11,535: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:20:11.563550700Z [2024-05-09 20:20:11,563: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:20:11.565679821Z [2024-05-09 20:20:11,565: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:20:11.566848486Z [2024-05-09 20:20:11,566: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:20:11.567707612Z [2024-05-09 20:20:11,567: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:20:11.568028257Z [2024-05-09 20:20:11,567: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:20:11.568798238Z [2024-05-09 20:20:11,568: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:20:11.569900644Z [2024-05-09 20:20:11,569: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:20:11.686065922Z [2024-05-09 20:20:11,685: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:20:13.135198930Z [2024-05-09 20:20:13,134: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b74b1935-90ea-4190-bca2-230c99998c97] succeeded in 3.2635055580001335s: None 2024-05-09T20:20:13.908115310Z [2024-05-09 20:20:13,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[230bbc13-2582-4183-a492-4f8ab294ab14] received 2024-05-09T20:20:13.919746756Z [2024-05-09 20:20:13,919: INFO/ForkPoolWorker-15] [230bbc13-2582-4183-a492-4f8ab294ab14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'send_prometheus', 'scheduled__2024-05-09T20:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:20:14.281927264Z [2024-05-09 20:20:14,278: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:20:15.740349311Z [2024-05-09 20:20:15,739: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:20:15.744842382Z [2024-05-09 20:20:15,744: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:20:15.779252323Z [2024-05-09 20:20:15,779: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:20:15.780386742Z [2024-05-09 20:20:15,780: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:20:15.780423207Z [2024-05-09 20:20:15,780: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:20:15.780588320Z [2024-05-09 20:20:15,780: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:20:15.780630059Z [2024-05-09 20:20:15,780: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:20:15.780942136Z [2024-05-09 20:20:15,780: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:20:15.780951326Z [2024-05-09 20:20:15,780: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:20:15.877874199Z [2024-05-09 20:20:15,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:20:16.467658997Z [2024-05-09 20:20:16,467: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[230bbc13-2582-4183-a492-4f8ab294ab14] succeeded in 2.5567829379999694s: None 2024-05-09T20:21:00.167830106Z [2024-05-09 20:21:00,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[134341ff-5c43-46a7-ae8a-2c018de16438] received 2024-05-09T20:21:00.172193196Z [2024-05-09 20:21:00,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7624cd9c-9cfa-4286-b173-5481947763f0] received 2024-05-09T20:21:00.175698279Z [2024-05-09 20:21:00,175: INFO/ForkPoolWorker-15] [134341ff-5c43-46a7-ae8a-2c018de16438] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:21:00.185421219Z [2024-05-09 20:21:00,185: INFO/ForkPoolWorker-16] [7624cd9c-9cfa-4286-b173-5481947763f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:21:00.547963603Z [2024-05-09 20:21:00,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:21:00.576819898Z [2024-05-09 20:21:00,573: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:21:02.024622329Z [2024-05-09 20:21:02,024: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:21:02.028645453Z [2024-05-09 20:21:02,028: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:21:02.063435762Z [2024-05-09 20:21:02,063: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:21:02.065362330Z [2024-05-09 20:21:02,065: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:21:02.065379473Z [2024-05-09 20:21:02,065: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:21:02.065559059Z [2024-05-09 20:21:02,065: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:21:02.065626738Z [2024-05-09 20:21:02,065: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:21:02.065830181Z [2024-05-09 20:21:02,065: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:21:02.065840633Z [2024-05-09 20:21:02,065: INFO/ForkPoolWorker-15] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:21:02.151215356Z [2024-05-09 20:21:02,150: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:21:02.154749573Z [2024-05-09 20:21:02,154: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:21:02.163970881Z [2024-05-09 20:21:02,163: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:21:02.192635045Z [2024-05-09 20:21:02,192: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:21:02.193783607Z [2024-05-09 20:21:02,193: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:21:02.193824396Z [2024-05-09 20:21:02,193: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:21:02.193975353Z [2024-05-09 20:21:02,193: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:21:02.194102293Z [2024-05-09 20:21:02,193: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:21:02.195058410Z [2024-05-09 20:21:02,194: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:21:02.195293271Z [2024-05-09 20:21:02,195: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:21:02.323037431Z [2024-05-09 20:21:02,322: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:21:03.984057458Z [2024-05-09 20:21:03,983: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[134341ff-5c43-46a7-ae8a-2c018de16438] succeeded in 3.8148507509999945s: None 2024-05-09T20:21:04.827589579Z [2024-05-09 20:21:04,827: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7624cd9c-9cfa-4286-b173-5481947763f0] succeeded in 4.652613384999995s: None 2024-05-09T20:22:00.282633840Z [2024-05-09 20:22:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf557ef1-878c-455c-a9a6-55b55e9c6eb5] received 2024-05-09T20:22:00.284443904Z [2024-05-09 20:22:00,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[940d6615-6241-4a1a-a08c-a1aa3b94112b] received 2024-05-09T20:22:00.293884137Z [2024-05-09 20:22:00,293: INFO/ForkPoolWorker-16] [940d6615-6241-4a1a-a08c-a1aa3b94112b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:22:00.298614439Z [2024-05-09 20:22:00,298: INFO/ForkPoolWorker-15] [bf557ef1-878c-455c-a9a6-55b55e9c6eb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:22:00.341105268Z [2024-05-09 20:22:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b096bb67-7b7d-4008-8829-8d63faaf3f7b] received 2024-05-09T20:22:00.351375848Z [2024-05-09 20:22:00,351: INFO/ForkPoolWorker-1] [b096bb67-7b7d-4008-8829-8d63faaf3f7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:22:00.719871420Z [2024-05-09 20:22:00,714: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:22:00.746428306Z [2024-05-09 20:22:00,743: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:22:00.783569746Z [2024-05-09 20:22:00,780: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:22:01.081290150Z [2024-05-09 20:22:01,081: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:22:01.801462215Z [2024-05-09 20:22:01,801: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf557ef1-878c-455c-a9a6-55b55e9c6eb5] succeeded in 1.515954732000182s: None 2024-05-09T20:22:02.326604998Z [2024-05-09 20:22:02,325: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:22:02.328234444Z [2024-05-09 20:22:02,327: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:22:02.330116091Z [2024-05-09 20:22:02,329: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:22:02.332001512Z [2024-05-09 20:22:02,331: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:22:02.376930020Z [2024-05-09 20:22:02,376: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:22:02.382964768Z [2024-05-09 20:22:02,380: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:22:02.382982453Z [2024-05-09 20:22:02,380: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:22:02.383010064Z [2024-05-09 20:22:02,380: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:22:02.383014184Z [2024-05-09 20:22:02,381: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:22:02.383017162Z [2024-05-09 20:22:02,381: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:22:02.383020278Z [2024-05-09 20:22:02,381: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:22:02.397551646Z [2024-05-09 20:22:02,397: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:22:02.399208359Z [2024-05-09 20:22:02,398: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:22:02.399224282Z [2024-05-09 20:22:02,399: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:22:02.406878499Z [2024-05-09 20:22:02,399: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:22:02.406888654Z [2024-05-09 20:22:02,399: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:22:02.406893026Z [2024-05-09 20:22:02,399: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:22:02.406896300Z [2024-05-09 20:22:02,399: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:22:02.542927635Z [2024-05-09 20:22:02,542: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:22:02.583413064Z [2024-05-09 20:22:02,583: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:22:04.158833095Z [2024-05-09 20:22:04,158: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[940d6615-6241-4a1a-a08c-a1aa3b94112b] succeeded in 3.871652076000146s: None 2024-05-09T20:22:04.858292427Z [2024-05-09 20:22:04,857: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b096bb67-7b7d-4008-8829-8d63faaf3f7b] succeeded in 4.514121315000011s: None 2024-05-09T20:23:00.573082008Z [2024-05-09 20:23:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[995194cf-78ca-4902-adb8-0cd2ca5f5bbb] received 2024-05-09T20:23:00.574908722Z [2024-05-09 20:23:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14b066b9-12d4-40d2-97d9-d908709b32a4] received 2024-05-09T20:23:00.583660342Z [2024-05-09 20:23:00,583: INFO/ForkPoolWorker-16] [14b066b9-12d4-40d2-97d9-d908709b32a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:23:00.584691008Z [2024-05-09 20:23:00,583: INFO/ForkPoolWorker-15] [995194cf-78ca-4902-adb8-0cd2ca5f5bbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:23:00.993254793Z [2024-05-09 20:23:00,984: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:23:01.051634296Z [2024-05-09 20:23:01,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:23:02.629602243Z [2024-05-09 20:23:02,629: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:23:02.634240990Z [2024-05-09 20:23:02,632: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:23:02.691454036Z [2024-05-09 20:23:02,691: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:23:02.708520205Z [2024-05-09 20:23:02,696: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:23:02.708559648Z [2024-05-09 20:23:02,696: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:23:02.708565391Z [2024-05-09 20:23:02,696: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:23:02.708570122Z [2024-05-09 20:23:02,696: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:23:02.708573445Z [2024-05-09 20:23:02,696: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:23:02.708576592Z [2024-05-09 20:23:02,697: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:23:02.717305606Z [2024-05-09 20:23:02,716: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:23:02.720702419Z [2024-05-09 20:23:02,720: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:23:02.776052713Z [2024-05-09 20:23:02,775: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:23:02.777308296Z [2024-05-09 20:23:02,777: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:23:02.777321124Z [2024-05-09 20:23:02,777: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:23:02.777400428Z [2024-05-09 20:23:02,777: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:23:02.777442285Z [2024-05-09 20:23:02,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:23:02.777794855Z [2024-05-09 20:23:02,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:23:02.777813044Z [2024-05-09 20:23:02,777: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:23:02.842929176Z [2024-05-09 20:23:02,842: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:23:02.904513836Z [2024-05-09 20:23:02,904: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:23:04.542956531Z [2024-05-09 20:23:04,542: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[14b066b9-12d4-40d2-97d9-d908709b32a4] succeeded in 3.9662569690003693s: None 2024-05-09T20:23:05.376363262Z [2024-05-09 20:23:05,375: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[995194cf-78ca-4902-adb8-0cd2ca5f5bbb] succeeded in 4.800597943999946s: None 2024-05-09T20:24:00.459033957Z [2024-05-09 20:24:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d8bd294-44ec-48f1-b17f-3a0c80f92ac6] received 2024-05-09T20:24:00.461113103Z [2024-05-09 20:24:00,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a3ad948-65b8-4a5c-8b40-b9717b63006b] received 2024-05-09T20:24:00.463675956Z [2024-05-09 20:24:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6124d16-1849-4fe5-a91e-5bcbfc082b89] received 2024-05-09T20:24:00.474600081Z [2024-05-09 20:24:00,474: INFO/ForkPoolWorker-15] [4d8bd294-44ec-48f1-b17f-3a0c80f92ac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:24:00.478009377Z [2024-05-09 20:24:00,477: INFO/ForkPoolWorker-1] [d6124d16-1849-4fe5-a91e-5bcbfc082b89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:24:00.480364747Z [2024-05-09 20:24:00,480: INFO/ForkPoolWorker-16] [4a3ad948-65b8-4a5c-8b40-b9717b63006b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:24:00.825885420Z [2024-05-09 20:24:00,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:24:00.885292357Z [2024-05-09 20:24:00,879: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:24:00.950172848Z [2024-05-09 20:24:00,947: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:24:01.169846847Z [2024-05-09 20:24:01,169: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:24:01.920952043Z [2024-05-09 20:24:01,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d8bd294-44ec-48f1-b17f-3a0c80f92ac6] succeeded in 1.4559065839998766s: None 2024-05-09T20:24:02.534773349Z [2024-05-09 20:24:02,534: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:24:02.542821804Z [2024-05-09 20:24:02,540: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:24:02.618315167Z [2024-05-09 20:24:02,618: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:24:02.619855457Z [2024-05-09 20:24:02,619: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:24:02.619868493Z [2024-05-09 20:24:02,619: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:24:02.620866685Z [2024-05-09 20:24:02,619: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:24:02.622217073Z [2024-05-09 20:24:02,620: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:24:02.627785574Z [2024-05-09 20:24:02,627: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:24:02.627844262Z [2024-05-09 20:24:02,627: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:24:02.745723618Z [2024-05-09 20:24:02,745: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:24:02.784614473Z [2024-05-09 20:24:02,784: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:24:02.789054388Z [2024-05-09 20:24:02,788: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:24:02.817867976Z [2024-05-09 20:24:02,817: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:24:02.819451667Z [2024-05-09 20:24:02,819: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:24:02.819486184Z [2024-05-09 20:24:02,819: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:24:02.819616822Z [2024-05-09 20:24:02,819: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:24:02.819652932Z [2024-05-09 20:24:02,819: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:24:02.819867063Z [2024-05-09 20:24:02,819: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:24:02.819929106Z [2024-05-09 20:24:02,819: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:24:02.941702944Z [2024-05-09 20:24:02,941: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:24:04.746130315Z [2024-05-09 20:24:04,745: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a3ad948-65b8-4a5c-8b40-b9717b63006b] succeeded in 4.28381542399984s: None 2024-05-09T20:24:05.217663507Z [2024-05-09 20:24:05,217: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6124d16-1849-4fe5-a91e-5bcbfc082b89] succeeded in 4.750348331000168s: None 2024-05-09T20:25:00.721842518Z [2024-05-09 20:25:00,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c288a983-2ec6-40fd-b6ed-0102f8577c70] received 2024-05-09T20:25:00.725474577Z [2024-05-09 20:25:00,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87609fe7-938f-4824-ad0b-435fcad2e04a] received 2024-05-09T20:25:00.740004184Z [2024-05-09 20:25:00,739: INFO/ForkPoolWorker-15] [c288a983-2ec6-40fd-b6ed-0102f8577c70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-09T20:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:25:00.743839958Z [2024-05-09 20:25:00,739: INFO/ForkPoolWorker-16] [87609fe7-938f-4824-ad0b-435fcad2e04a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:25:00.744398312Z [2024-05-09 20:25:00,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23ab4f60-a19f-47cb-a43c-fee288595172] received 2024-05-09T20:25:00.760892650Z [2024-05-09 20:25:00,760: INFO/ForkPoolWorker-1] [23ab4f60-a19f-47cb-a43c-fee288595172] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:25:01.112870818Z [2024-05-09 20:25:01,109: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:25:01.145459695Z [2024-05-09 20:25:01,142: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:25:01.255081606Z [2024-05-09 20:25:01,250: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:25:02.673497515Z [2024-05-09 20:25:02,673: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:25:02.677938997Z [2024-05-09 20:25:02,677: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:25:02.747910547Z [2024-05-09 20:25:02,747: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:25:02.748973061Z [2024-05-09 20:25:02,748: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:25:02.748986349Z [2024-05-09 20:25:02,748: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:25:02.748991179Z [2024-05-09 20:25:02,748: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:25:02.749528108Z [2024-05-09 20:25:02,748: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:25:02.749535140Z [2024-05-09 20:25:02,749: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:25:02.751057253Z [2024-05-09 20:25:02,749: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:25:02.906714219Z [2024-05-09 20:25:02,906: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:25:03.097486178Z [2024-05-09 20:25:03,097: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:25:03.105992307Z [2024-05-09 20:25:03,105: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:25:03.137852355Z [2024-05-09 20:25:03,137: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:25:03.138936410Z [2024-05-09 20:25:03,138: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:25:03.139160345Z [2024-05-09 20:25:03,139: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:25:03.139354394Z [2024-05-09 20:25:03,139: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:25:03.139483279Z [2024-05-09 20:25:03,139: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:25:03.139770145Z [2024-05-09 20:25:03,139: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:25:03.139900014Z [2024-05-09 20:25:03,139: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:25:03.173263767Z [2024-05-09 20:25:03,172: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:25:03.177287673Z [2024-05-09 20:25:03,176: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:25:03.232299681Z [2024-05-09 20:25:03,232: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:25:03.243277728Z [2024-05-09 20:25:03,243: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:25:03.247624570Z [2024-05-09 20:25:03,247: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:25:03.248043048Z [2024-05-09 20:25:03,247: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:25:03.248273087Z [2024-05-09 20:25:03,248: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:25:03.248386433Z [2024-05-09 20:25:03,248: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:25:03.248677508Z [2024-05-09 20:25:03,248: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:25:03.248790574Z [2024-05-09 20:25:03,248: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:25:03.373660047Z [2024-05-09 20:25:03,373: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:25:04.034167966Z [2024-05-09 20:25:04,033: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c288a983-2ec6-40fd-b6ed-0102f8577c70] succeeded in 3.3066997370001445s: None 2024-05-09T20:25:04.515104340Z [2024-05-09 20:25:04,514: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[87609fe7-938f-4824-ad0b-435fcad2e04a] succeeded in 3.7863867299997764s: None 2024-05-09T20:25:05.142033103Z [2024-05-09 20:25:05,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[608b9c91-0f31-42f1-a5cb-6f46ba1fd13d] received 2024-05-09T20:25:05.156900209Z [2024-05-09 20:25:05,156: INFO/ForkPoolWorker-15] [608b9c91-0f31-42f1-a5cb-6f46ba1fd13d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'split_metrics', 'scheduled__2024-05-09T20:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:25:05.475108558Z [2024-05-09 20:25:05,474: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23ab4f60-a19f-47cb-a43c-fee288595172] succeeded in 4.721322410000084s: None 2024-05-09T20:25:05.733512098Z [2024-05-09 20:25:05,729: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:25:07.050517967Z [2024-05-09 20:25:07,050: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:25:07.055482916Z [2024-05-09 20:25:07,054: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:25:07.089532593Z [2024-05-09 20:25:07,089: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:25:07.094851185Z [2024-05-09 20:25:07,094: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:25:07.095092597Z [2024-05-09 20:25:07,094: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:25:07.095410753Z [2024-05-09 20:25:07,095: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:25:07.095683270Z [2024-05-09 20:25:07,095: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:25:07.096084363Z [2024-05-09 20:25:07,095: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:25:07.096350270Z [2024-05-09 20:25:07,096: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:25:07.203573049Z [2024-05-09 20:25:07,203: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:25:07.991293744Z [2024-05-09 20:25:07,990: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[608b9c91-0f31-42f1-a5cb-6f46ba1fd13d] succeeded in 2.8477209500001663s: None 2024-05-09T20:25:09.008827286Z [2024-05-09 20:25:09,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f59be9e7-ce44-44f5-9d5d-390abd224f4b] received 2024-05-09T20:25:09.029399923Z [2024-05-09 20:25:09,027: INFO/ForkPoolWorker-15] [f59be9e7-ce44-44f5-9d5d-390abd224f4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'collect_metrics', 'scheduled__2024-05-09T20:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-09T20:25:09.378245366Z [2024-05-09 20:25:09,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:25:10.785002223Z [2024-05-09 20:25:10,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:25:10.788592299Z [2024-05-09 20:25:10,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:25:10.824029084Z [2024-05-09 20:25:10,823: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:25:10.825006524Z [2024-05-09 20:25:10,824: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:25:10.825022795Z [2024-05-09 20:25:10,824: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:25:10.825155126Z [2024-05-09 20:25:10,824: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:25:10.825162566Z [2024-05-09 20:25:10,825: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:25:10.825374564Z [2024-05-09 20:25:10,825: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:25:10.825387140Z [2024-05-09 20:25:10,825: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:25:10.921572379Z [2024-05-09 20:25:10,921: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:25:12.659639856Z [2024-05-09 20:25:12,658: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f59be9e7-ce44-44f5-9d5d-390abd224f4b] succeeded in 3.6354754139997567s: None 2024-05-09T20:25:12.985261934Z [2024-05-09 20:25:12,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[def21cf4-1390-4f88-bbf3-3472a0ccc35e] received 2024-05-09T20:25:13.000756620Z [2024-05-09 20:25:13,000: INFO/ForkPoolWorker-15] [def21cf4-1390-4f88-bbf3-3472a0ccc35e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'send_prometheus', 'scheduled__2024-05-09T20:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:25:13.309576841Z [2024-05-09 20:25:13,306: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:25:14.722273800Z [2024-05-09 20:25:14,721: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:25:14.725826078Z [2024-05-09 20:25:14,725: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:25:14.782444855Z [2024-05-09 20:25:14,782: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:25:14.783845426Z [2024-05-09 20:25:14,783: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:25:14.784032134Z [2024-05-09 20:25:14,783: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:25:14.784337876Z [2024-05-09 20:25:14,784: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:25:14.784813625Z [2024-05-09 20:25:14,784: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:25:14.785654273Z [2024-05-09 20:25:14,785: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:25:14.785996420Z [2024-05-09 20:25:14,785: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:25:14.867423877Z [2024-05-09 20:25:14,867: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:25:15.539431446Z [2024-05-09 20:25:15,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[def21cf4-1390-4f88-bbf3-3472a0ccc35e] succeeded in 2.5512510150001617s: None 2024-05-09T20:26:01.205930096Z [2024-05-09 20:26:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e89607d7-07c8-4579-bdda-274dbdb04cce] received 2024-05-09T20:26:01.207985925Z [2024-05-09 20:26:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0586408-2b29-4013-9d44-8536db8848b1] received 2024-05-09T20:26:01.210354788Z [2024-05-09 20:26:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1e97d4d-acd6-4197-8b77-c84081a1a550] received 2024-05-09T20:26:01.219714199Z [2024-05-09 20:26:01,219: INFO/ForkPoolWorker-1] [f1e97d4d-acd6-4197-8b77-c84081a1a550] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:26:01.220245488Z [2024-05-09 20:26:01,220: INFO/ForkPoolWorker-16] [a0586408-2b29-4013-9d44-8536db8848b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:26:01.221749108Z [2024-05-09 20:26:01,221: INFO/ForkPoolWorker-15] [e89607d7-07c8-4579-bdda-274dbdb04cce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:26:01.661998516Z [2024-05-09 20:26:01,658: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:26:01.711520100Z [2024-05-09 20:26:01,707: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:26:01.720282893Z [2024-05-09 20:26:01,717: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:26:02.013076590Z [2024-05-09 20:26:02,012: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:26:02.889646663Z [2024-05-09 20:26:02,889: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0586408-2b29-4013-9d44-8536db8848b1] succeeded in 1.6796114300000227s: None 2024-05-09T20:26:03.358952583Z [2024-05-09 20:26:03,358: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:26:03.362392588Z [2024-05-09 20:26:03,361: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:26:03.398803504Z [2024-05-09 20:26:03,398: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:26:03.404476111Z [2024-05-09 20:26:03,404: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:26:03.404604028Z [2024-05-09 20:26:03,404: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:26:03.404809165Z [2024-05-09 20:26:03,404: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:26:03.404948758Z [2024-05-09 20:26:03,404: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:26:03.405277594Z [2024-05-09 20:26:03,405: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:26:03.405397741Z [2024-05-09 20:26:03,405: INFO/ForkPoolWorker-1] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:26:03.463242721Z [2024-05-09 20:26:03,462: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:26:03.467923543Z [2024-05-09 20:26:03,467: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:26:03.503876241Z [2024-05-09 20:26:03,503: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:26:03.506883492Z [2024-05-09 20:26:03,506: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:26:03.506894538Z [2024-05-09 20:26:03,506: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:26:03.507043489Z [2024-05-09 20:26:03,506: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:26:03.507162241Z [2024-05-09 20:26:03,507: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:26:03.507556136Z [2024-05-09 20:26:03,507: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:26:03.508422555Z [2024-05-09 20:26:03,507: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:26:03.525339931Z [2024-05-09 20:26:03,525: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:26:03.615261458Z [2024-05-09 20:26:03,615: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:26:05.410272303Z [2024-05-09 20:26:05,409: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1e97d4d-acd6-4197-8b77-c84081a1a550] succeeded in 4.198097104000226s: None 2024-05-09T20:26:05.823205001Z [2024-05-09 20:26:05,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e89607d7-07c8-4579-bdda-274dbdb04cce] succeeded in 4.615401588000168s: None 2024-05-09T20:26:37.598890351Z [2024-05-09 20:26:37,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3dd1c3d-5373-4580-a38a-7e33e701cbf5] received 2024-05-09T20:26:37.606936495Z [2024-05-09 20:26:37,606: INFO/ForkPoolWorker-15] [a3dd1c3d-5373-4580-a38a-7e33e701cbf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240509202636_644180', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-09T20:26:37.933354139Z [2024-05-09 20:26:37,929: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-09T20:26:38.362863406Z [2024-05-09 20:26:38,362: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:26:39.051014125Z [2024-05-09 20:26:39,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3dd1c3d-5373-4580-a38a-7e33e701cbf5] succeeded in 1.4506379969998306s: None 2024-05-09T20:27:00.507236830Z [2024-05-09 20:27:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38e8b657-1b58-4ed8-91e3-eda9723bf121] received 2024-05-09T20:27:00.510366022Z [2024-05-09 20:27:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[816b37af-0c3f-450e-8e2c-2bdb2953311e] received 2024-05-09T20:27:00.516992127Z [2024-05-09 20:27:00,516: INFO/ForkPoolWorker-16] [816b37af-0c3f-450e-8e2c-2bdb2953311e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:27:00.525942914Z [2024-05-09 20:27:00,524: INFO/ForkPoolWorker-15] [38e8b657-1b58-4ed8-91e3-eda9723bf121] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:27:00.874526167Z [2024-05-09 20:27:00,871: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:27:00.912003404Z [2024-05-09 20:27:00,909: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:27:02.291453030Z [2024-05-09 20:27:02,291: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:27:02.295460187Z [2024-05-09 20:27:02,295: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:27:02.324212857Z [2024-05-09 20:27:02,324: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:27:02.327013056Z [2024-05-09 20:27:02,326: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:27:02.327048620Z [2024-05-09 20:27:02,326: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:27:02.327994805Z [2024-05-09 20:27:02,327: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:27:02.328192787Z [2024-05-09 20:27:02,327: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:27:02.332591337Z [2024-05-09 20:27:02,332: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:27:02.333076506Z [2024-05-09 20:27:02,332: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:27:02.452209550Z [2024-05-09 20:27:02,451: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:27:02.485940496Z [2024-05-09 20:27:02,485: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:27:02.493589588Z [2024-05-09 20:27:02,492: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:27:02.526021760Z [2024-05-09 20:27:02,525: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:27:02.527338262Z [2024-05-09 20:27:02,527: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:27:02.527461550Z [2024-05-09 20:27:02,527: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:27:02.527702216Z [2024-05-09 20:27:02,527: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:27:02.527882562Z [2024-05-09 20:27:02,527: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:27:02.528175813Z [2024-05-09 20:27:02,528: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:27:02.528275836Z [2024-05-09 20:27:02,528: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:27:02.614019965Z [2024-05-09 20:27:02,613: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:27:04.983669784Z [2024-05-09 20:27:04,983: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[816b37af-0c3f-450e-8e2c-2bdb2953311e] succeeded in 4.471553937000408s: None 2024-05-09T20:27:05.527278727Z [2024-05-09 20:27:05,526: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38e8b657-1b58-4ed8-91e3-eda9723bf121] succeeded in 5.01419116299985s: None 2024-05-09T20:28:00.880533827Z [2024-05-09 20:28:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d1238bd-6061-4729-bd95-cbde51f17e9b] received 2024-05-09T20:28:00.884575886Z [2024-05-09 20:28:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b32653a-fd2c-4413-bbf3-78d4ce5838e0] received 2024-05-09T20:28:00.891250817Z [2024-05-09 20:28:00,890: INFO/ForkPoolWorker-15] [6d1238bd-6061-4729-bd95-cbde51f17e9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:28:00.898021553Z [2024-05-09 20:28:00,897: INFO/ForkPoolWorker-16] [4b32653a-fd2c-4413-bbf3-78d4ce5838e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:28:00.906396962Z [2024-05-09 20:28:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30ece2e5-718a-4505-a093-d47d0b3769f1] received 2024-05-09T20:28:00.917748041Z [2024-05-09 20:28:00,917: INFO/ForkPoolWorker-1] [30ece2e5-718a-4505-a093-d47d0b3769f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:28:01.378825196Z [2024-05-09 20:28:01,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:28:01.451546053Z [2024-05-09 20:28:01,447: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:28:01.459580791Z [2024-05-09 20:28:01,452: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:28:01.828487820Z [2024-05-09 20:28:01,828: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:28:02.592646489Z [2024-05-09 20:28:02,592: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b32653a-fd2c-4413-bbf3-78d4ce5838e0] succeeded in 1.7040507890001209s: None 2024-05-09T20:28:03.088190625Z [2024-05-09 20:28:03,087: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:28:03.091606080Z [2024-05-09 20:28:03,091: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:28:03.119162503Z [2024-05-09 20:28:03,118: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:28:03.123829427Z [2024-05-09 20:28:03,122: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:28:03.123975550Z [2024-05-09 20:28:03,123: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:28:03.124231464Z [2024-05-09 20:28:03,123: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:28:03.124569357Z [2024-05-09 20:28:03,124: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:28:03.125072066Z [2024-05-09 20:28:03,124: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:28:03.131045303Z [2024-05-09 20:28:03,130: INFO/ForkPoolWorker-1] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:28:03.218161699Z [2024-05-09 20:28:03,217: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:28:03.223634573Z [2024-05-09 20:28:03,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:28:03.242747898Z [2024-05-09 20:28:03,242: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:28:03.265698575Z [2024-05-09 20:28:03,265: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:28:03.268523840Z [2024-05-09 20:28:03,268: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:28:03.269135386Z [2024-05-09 20:28:03,268: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:28:03.269576497Z [2024-05-09 20:28:03,269: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:28:03.269717008Z [2024-05-09 20:28:03,269: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:28:03.270008230Z [2024-05-09 20:28:03,269: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:28:03.270023612Z [2024-05-09 20:28:03,269: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:28:03.363301663Z [2024-05-09 20:28:03,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:28:05.537103860Z [2024-05-09 20:28:05,535: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[30ece2e5-718a-4505-a093-d47d0b3769f1] succeeded in 4.628001372000199s: None 2024-05-09T20:28:05.895638876Z [2024-05-09 20:28:05,895: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d1238bd-6061-4729-bd95-cbde51f17e9b] succeeded in 5.012956332000158s: None 2024-05-09T20:29:00.485878763Z [2024-05-09 20:29:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6a890a7-a95a-46b4-bcf1-c70d4b4d4ca5] received 2024-05-09T20:29:00.491526631Z [2024-05-09 20:29:00,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66f18411-b268-4fb0-8d5e-8ccd33568d8b] received 2024-05-09T20:29:00.499456864Z [2024-05-09 20:29:00,498: INFO/ForkPoolWorker-15] [f6a890a7-a95a-46b4-bcf1-c70d4b4d4ca5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:29:00.509762903Z [2024-05-09 20:29:00,509: INFO/ForkPoolWorker-16] [66f18411-b268-4fb0-8d5e-8ccd33568d8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:29:00.891179436Z [2024-05-09 20:29:00,886: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:29:00.934221998Z [2024-05-09 20:29:00,931: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:29:02.482785510Z [2024-05-09 20:29:02,477: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:29:02.486827304Z [2024-05-09 20:29:02,482: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:29:02.493556563Z [2024-05-09 20:29:02,491: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:29:02.501791968Z [2024-05-09 20:29:02,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:29:02.530490927Z [2024-05-09 20:29:02,529: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:29:02.534421998Z [2024-05-09 20:29:02,534: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:29:02.534436596Z [2024-05-09 20:29:02,534: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:29:02.534580830Z [2024-05-09 20:29:02,534: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:29:02.535171191Z [2024-05-09 20:29:02,535: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:29:02.536505588Z [2024-05-09 20:29:02,536: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:29:02.536516956Z [2024-05-09 20:29:02,536: INFO/ForkPoolWorker-16] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:29:02.578771462Z [2024-05-09 20:29:02,575: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:29:02.578792332Z [2024-05-09 20:29:02,577: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:29:02.578796468Z [2024-05-09 20:29:02,577: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:29:02.578800299Z [2024-05-09 20:29:02,577: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:29:02.578804212Z [2024-05-09 20:29:02,577: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:29:02.578807272Z [2024-05-09 20:29:02,577: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:29:02.578810300Z [2024-05-09 20:29:02,577: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:29:02.710258973Z [2024-05-09 20:29:02,707: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:29:02.720405815Z [2024-05-09 20:29:02,717: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:29:04.616053640Z [2024-05-09 20:29:04,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[66f18411-b268-4fb0-8d5e-8ccd33568d8b] succeeded in 4.120112785999936s: None 2024-05-09T20:29:04.958834498Z [2024-05-09 20:29:04,958: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6a890a7-a95a-46b4-bcf1-c70d4b4d4ca5] succeeded in 4.47090674600031s: None 2024-05-09T20:30:00.774033603Z [2024-05-09 20:30:00,773: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fff3a7bb-e0bc-406e-bb3c-4aefc7e314d8] received 2024-05-09T20:30:00.778221517Z [2024-05-09 20:30:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[301a6071-c025-4dd4-891f-661d86c8be0f] received 2024-05-09T20:30:00.791687957Z [2024-05-09 20:30:00,791: INFO/ForkPoolWorker-15] [fff3a7bb-e0bc-406e-bb3c-4aefc7e314d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-09T20:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:30:00.791741164Z [2024-05-09 20:30:00,791: INFO/ForkPoolWorker-16] [301a6071-c025-4dd4-891f-661d86c8be0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-09T20:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-09T20:30:00.805532959Z [2024-05-09 20:30:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32148692-09fd-418d-8ca3-6915048ec8e1] received 2024-05-09T20:30:00.808659306Z [2024-05-09 20:30:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[457129df-b97b-4946-a657-1d88b70af4c6] received 2024-05-09T20:30:00.825240474Z [2024-05-09 20:30:00,824: INFO/ForkPoolWorker-1] [32148692-09fd-418d-8ca3-6915048ec8e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-09T20:30:00.835892008Z [2024-05-09 20:30:00,835: INFO/ForkPoolWorker-2] [457129df-b97b-4946-a657-1d88b70af4c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-09T20:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-09T20:30:01.220631663Z [2024-05-09 20:30:01,210: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:30:01.346341379Z [2024-05-09 20:30:01,333: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-09T20:30:01.454332548Z [2024-05-09 20:30:01,450: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-09T20:30:01.609414769Z [2024-05-09 20:30:01,593: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-09T20:30:01.811918972Z [2024-05-09 20:30:01,811: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:30:02.833204842Z [2024-05-09 20:30:02,832: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[301a6071-c025-4dd4-891f-661d86c8be0f] succeeded in 2.0491718649996074s: None 2024-05-09T20:30:03.570744062Z [2024-05-09 20:30:03,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:30:03.577501034Z [2024-05-09 20:30:03,576: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:30:03.679827693Z [2024-05-09 20:30:03,679: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:30:03.681653576Z [2024-05-09 20:30:03,681: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:30:03.681775283Z [2024-05-09 20:30:03,681: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:30:03.682016416Z [2024-05-09 20:30:03,681: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:30:03.682128214Z [2024-05-09 20:30:03,682: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:30:03.682414970Z [2024-05-09 20:30:03,682: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:30:03.682533102Z [2024-05-09 20:30:03,682: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:30:03.801799986Z [2024-05-09 20:30:03,801: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:30:04.025218959Z [2024-05-09 20:30:04,024: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-09T20:30:04.029141686Z [2024-05-09 20:30:04,028: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:30:04.109934839Z [2024-05-09 20:30:04,109: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-09T20:30:04.115194853Z [2024-05-09 20:30:04,114: INFO/ForkPoolWorker-1] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:30:04.115208555Z [2024-05-09 20:30:04,115: INFO/ForkPoolWorker-1] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:30:04.115307358Z [2024-05-09 20:30:04,115: INFO/ForkPoolWorker-1] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:30:04.115326495Z [2024-05-09 20:30:04,115: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-09T20:30:04.115599384Z [2024-05-09 20:30:04,115: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-09T20:30:04.115621183Z [2024-05-09 20:30:04,115: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:30:04.247423629Z [2024-05-09 20:30:04,244: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-09T20:30:04.261846409Z [2024-05-09 20:30:04,255: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:30:04.298951993Z [2024-05-09 20:30:04,298: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:30:04.374949609Z [2024-05-09 20:30:04,374: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-09T20:30:04.379857480Z [2024-05-09 20:30:04,379: INFO/ForkPoolWorker-2] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:30:04.379885455Z [2024-05-09 20:30:04,379: INFO/ForkPoolWorker-2] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:30:04.380116785Z [2024-05-09 20:30:04,379: INFO/ForkPoolWorker-2] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:30:04.380220729Z [2024-05-09 20:30:04,380: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-09T20:30:04.380540397Z [2024-05-09 20:30:04,380: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-09T20:30:04.380635230Z [2024-05-09 20:30:04,380: INFO/ForkPoolWorker-2] Creating DAG vim_status_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:30:04.550559231Z [2024-05-09 20:30:04,548: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:30:04.842435343Z [2024-05-09 20:30:04,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[400c2831-20df-4221-a5a6-97a959232d9b] received 2024-05-09T20:30:04.851143341Z [2024-05-09 20:30:04,850: INFO/ForkPoolWorker-16] [400c2831-20df-4221-a5a6-97a959232d9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'split_metrics', 'scheduled__2024-05-09T20:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:30:05.146884607Z [2024-05-09 20:30:05,146: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fff3a7bb-e0bc-406e-bb3c-4aefc7e314d8] succeeded in 4.367069951999838s: None 2024-05-09T20:30:05.300555724Z [2024-05-09 20:30:05,297: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:30:06.582851308Z [2024-05-09 20:30:06,580: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32148692-09fd-418d-8ca3-6915048ec8e1] succeeded in 5.767277040999943s: None 2024-05-09T20:30:06.703913332Z [2024-05-09 20:30:06,703: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[457129df-b97b-4946-a657-1d88b70af4c6] succeeded in 5.8908981929998845s: None 2024-05-09T20:30:07.188120732Z [2024-05-09 20:30:07,187: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-09T20:30:07.192743436Z [2024-05-09 20:30:07,192: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:30:07.269995040Z [2024-05-09 20:30:07,269: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-09T20:30:07.274944045Z [2024-05-09 20:30:07,274: INFO/ForkPoolWorker-16] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:30:07.275174338Z [2024-05-09 20:30:07,274: INFO/ForkPoolWorker-16] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:30:07.276555930Z [2024-05-09 20:30:07,275: INFO/ForkPoolWorker-16] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:30:07.276816265Z [2024-05-09 20:30:07,276: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-09T20:30:07.277344640Z [2024-05-09 20:30:07,277: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:30:07.277547161Z [2024-05-09 20:30:07,277: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:30:07.395030584Z [2024-05-09 20:30:07,394: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:30:08.304309560Z [2024-05-09 20:30:08,303: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[400c2831-20df-4221-a5a6-97a959232d9b] succeeded in 3.460068190999664s: None 2024-05-09T20:30:08.542263467Z [2024-05-09 20:30:08,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c93b111-2cce-44f0-a539-99c6c9bee7e6] received 2024-05-09T20:30:08.558052431Z [2024-05-09 20:30:08,557: INFO/ForkPoolWorker-15] [7c93b111-2cce-44f0-a539-99c6c9bee7e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'collect_metrics', 'scheduled__2024-05-09T20:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-09T20:30:08.933576277Z [2024-05-09 20:30:08,928: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:30:10.583660191Z [2024-05-09 20:30:10,583: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:30:10.587641510Z [2024-05-09 20:30:10,587: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:30:10.629549268Z [2024-05-09 20:30:10,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:30:10.630669612Z [2024-05-09 20:30:10,630: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:30:10.630778698Z [2024-05-09 20:30:10,630: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:30:10.631016386Z [2024-05-09 20:30:10,630: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:30:10.631106237Z [2024-05-09 20:30:10,630: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:30:10.631449899Z [2024-05-09 20:30:10,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:30:10.631747157Z [2024-05-09 20:30:10,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:30:10.738534551Z [2024-05-09 20:30:10,738: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:30:11.528376158Z [2024-05-09 20:30:11,528: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c93b111-2cce-44f0-a539-99c6c9bee7e6] succeeded in 2.984643969999979s: None 2024-05-09T20:30:12.026181165Z [2024-05-09 20:30:12,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ba9e98b-eb0f-4521-837d-82ae561d0236] received 2024-05-09T20:30:12.042413774Z [2024-05-09 20:30:12,042: INFO/ForkPoolWorker-15] [9ba9e98b-eb0f-4521-837d-82ae561d0236] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'send_prometheus', 'scheduled__2024-05-09T20:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-09T20:30:12.499303903Z [2024-05-09 20:30:12,488: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-09T20:30:13.995727247Z [2024-05-09 20:30:13,995: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-09T20:30:13.999522480Z [2024-05-09 20:30:13,998: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'ayxHObq4EAdw0Apg0BDiHGEBxcuVi4o9'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-09T20:30:14.048718993Z [2024-05-09 20:30:14,048: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-09T20:30:14.050790997Z [2024-05-09 20:30:14,050: INFO/ForkPoolWorker-15] Read VIM 505e5490-9984-429e-a031-c0f8575e94cb (_system-osm-vim) 2024-05-09T20:30:14.050814186Z [2024-05-09 20:30:14,050: INFO/ForkPoolWorker-15] Read VIM c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 (osm) 2024-05-09T20:30:14.050939100Z [2024-05-09 20:30:14,050: INFO/ForkPoolWorker-15] [{'_id': '505e5490-9984-429e-a031-c0f8575e94cb', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'c5b4db07-fe57-4cbb-bcf9-62f2cd919d83', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-09T20:30:14.050956770Z [2024-05-09 20:30:14,050: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-09T20:30:14.051268680Z [2024-05-09 20:30:14,051: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-09T20:30:14.051280269Z [2024-05-09 20:30:14,051: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c5b4db07-fe57-4cbb-bcf9-62f2cd919d83 2024-05-09T20:30:14.148823783Z [2024-05-09 20:30:14,148: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-09T20:30:15.025402875Z [2024-05-09 20:30:15,024: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ba9e98b-eb0f-4521-837d-82ae561d0236] succeeded in 2.989395112999773s: None