2024-04-05T01:25:31.978291654Z .. 2024-04-05T01:25:33.038852323Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-05T01:25:34.211974235Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-05T01:25:44.375812707Z [2024-04-05T01:25:44.374+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-05T01:25:45.388055389Z [2024-04-05T01:25:45.386+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-05T01:25:46.391911117Z [2024-04-05T01:25:46.391+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-04-05T01:25:47.398129140Z [2024-04-05T01:25:47.396+0000] {db.py:755} INFO - Waiting for migrations... 3 second(s) 2024-04-05T01:25:48.409560453Z [2024-04-05T01:25:48.403+0000] {db.py:755} INFO - Waiting for migrations... 4 second(s) 2024-04-05T01:25:49.409843157Z [2024-04-05T01:25:49.408+0000] {db.py:755} INFO - Waiting for migrations... 5 second(s) 2024-04-05T01:25:50.422518103Z [2024-04-05T01:25:50.420+0000] {db.py:755} INFO - Waiting for migrations... 6 second(s) 2024-04-05T01:26:22.045082131Z 2024-04-05T01:26:25.572581434Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-05T01:26:28.329633077Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-05T01:26:40.381225579Z ____________ _____________ 2024-04-05T01:26:40.381245584Z ____ |__( )_________ __/__ /________ __ 2024-04-05T01:26:40.381250000Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-04-05T01:26:40.381253237Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-04-05T01:26:40.381256310Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-04-05T01:26:40.381260024Z [2024-04-05T01:26:40.380+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-04-05T01:26:40.387021843Z [2024-04-05T01:26:40.381+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-04-05T01:26:41.586277754Z [2024-04-05T01:26:41.577+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-04-05T01:26:41.696336796Z [2024-04-05T01:26:41.616+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 25 2024-04-05T01:26:41.707795320Z [2024-04-05T01:26:41.696+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:26:41.789231156Z [2024-04-05T01:26:41.725+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-04-05T01:26:41.813512909Z [2024-04-05T01:26:41.811+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-04-05T01:27:05.473592600Z [2024-04-05T01:27:05.473+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:27:06.205067956Z [2024-04-05T01:27:06.203+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:27:06.205094634Z 2024-04-05T01:27:06.210421018Z [2024-04-05T01:27:06.206+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:27:06.216565011Z [2024-04-05T01:27:06.216+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:27:06.216589276Z 2024-04-05T01:27:06.304769543Z [2024-04-05T01:27:06.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:27:06.309244869Z [2024-04-05T01:27:06.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:27:07.116644934Z [2024-04-05T01:27:07.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status queued for try_number 1 2024-04-05T01:27:07.126972038Z [2024-04-05T01:27:07.126+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14d93a2f-1c92-4df5-be1c-9440cab132eb 2024-04-05T01:27:13.680289674Z [2024-04-05T01:27:13.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status success for try_number 1 2024-04-05T01:27:13.696431763Z [2024-04-05T01:27:13.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:24:00+00:00, map_index=-1, run_start_date=2024-04-05 01:27:09.569851+00:00, run_end_date=2024-04-05 01:27:11.431279+00:00, run_duration=1.861428, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:27:06.216987+00:00, queued_by_job_id=1, pid=47 2024-04-05T01:27:22.162890162Z [2024-04-05T01:27:22.162+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:27:22.162909834Z 2024-04-05T01:27:22.165568222Z [2024-04-05T01:27:22.162+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:27:22.167560375Z [2024-04-05T01:27:22.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:27:22.167573999Z 2024-04-05T01:27:22.172766860Z [2024-04-05T01:27:22.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:24:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:27:22.173033267Z [2024-04-05T01:27:22.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:27:22.257781557Z [2024-04-05T01:27:22.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status queued for try_number 2 2024-04-05T01:27:22.276674379Z [2024-04-05T01:27:22.274+0000] {scheduler_job.py:635} INFO - Setting external_id for to db73f706-70ae-47aa-9919-5f0f08143c77 2024-04-05T01:27:25.931632220Z [2024-04-05T01:27:25.930+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:27:25.932192699Z [2024-04-05T01:27:25.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:24:00+00:00, run_id=scheduled__2024-04-05T01:24:00+00:00, run_start_date=2024-04-05 01:27:05.526662+00:00, run_end_date=2024-04-05 01:27:25.931579+00:00, run_duration=20.404917, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:24:00+00:00, data_interval_end=2024-04-05 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:27:25.952010277Z [2024-04-05T01:27:25.951+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:26:00+00:00, run_after=2024-04-05T01:28:00+00:00 2024-04-05T01:27:26.047612562Z [2024-04-05T01:27:26.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status success for try_number 2 2024-04-05T01:27:26.059664003Z [2024-04-05T01:27:26.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:24:00+00:00, map_index=-1, run_start_date=2024-04-05 01:27:24.089527+00:00, run_end_date=2024-04-05 01:27:24.942570+00:00, run_duration=0.853043, state=failed, executor_state=success, try_number=2, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:27:22.168070+00:00, queued_by_job_id=1, pid=68 2024-04-05T01:28:00.565910531Z [2024-04-05T01:28:00.565+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:28:00.689876829Z [2024-04-05T01:28:00.689+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:28:00.689903723Z 2024-04-05T01:28:00.690027120Z [2024-04-05T01:28:00.689+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:28:00.692505715Z [2024-04-05T01:28:00.691+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:28:00.692519794Z 2024-04-05T01:28:00.704873297Z [2024-04-05T01:28:00.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:28:00.705039141Z [2024-04-05T01:28:00.704+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:28:00.900270364Z [2024-04-05T01:28:00.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status queued for try_number 1 2024-04-05T01:28:00.916052101Z [2024-04-05T01:28:00.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9688150c-486d-4ef8-a714-9b658d00836d 2024-04-05T01:28:04.499703479Z [2024-04-05T01:28:04.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:28:04.507914948Z [2024-04-05T01:28:04.507+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:26:00+00:00, run_id=scheduled__2024-04-05T01:26:00+00:00, run_start_date=2024-04-05 01:28:00.601045+00:00, run_end_date=2024-04-05 01:28:04.502708+00:00, run_duration=3.901663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:26:00+00:00, data_interval_end=2024-04-05 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:28:04.543105254Z [2024-04-05T01:28:04.542+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:28:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:28:04.690174252Z [2024-04-05T01:28:04.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status success for try_number 1 2024-04-05T01:28:04.710236307Z [2024-04-05T01:28:04.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:26:00+00:00, map_index=-1, run_start_date=2024-04-05 01:28:03.009831+00:00, run_end_date=2024-04-05 01:28:03.875532+00:00, run_duration=0.865701, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:28:00.697093+00:00, queued_by_job_id=1, pid=77 2024-04-05T01:30:00.622495982Z [2024-04-05T01:30:00.621+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:30:00.726312600Z [2024-04-05T01:30:00.722+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:30:00.726339465Z 2024-04-05T01:30:00.726343707Z [2024-04-05T01:30:00.723+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:30:00.729089096Z [2024-04-05T01:30:00.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:30:00.729097362Z 2024-04-05T01:30:00.737335794Z [2024-04-05T01:30:00.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:30:00.737551454Z [2024-04-05T01:30:00.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:30:00.865090610Z [2024-04-05T01:30:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:00.879677320Z [2024-04-05T01:30:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca243cd9-1edd-433a-8539-e76435d90906 2024-04-05T01:30:03.211792983Z [2024-04-05T01:30:03.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:30:03.211833632Z [2024-04-05T01:30:03.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:28:00+00:00, run_id=scheduled__2024-04-05T01:28:00+00:00, run_start_date=2024-04-05 01:30:00.644660+00:00, run_end_date=2024-04-05 01:30:03.210503+00:00, run_duration=2.565843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:28:00+00:00, data_interval_end=2024-04-05 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:30:03.230306754Z [2024-04-05T01:30:03.228+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:32:00+00:00 2024-04-05T01:30:03.307151873Z [2024-04-05T01:30:03.296+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:03.343316153Z [2024-04-05T01:30:03.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:28:00+00:00, map_index=-1, run_start_date=2024-04-05 01:30:01.825350+00:00, run_end_date=2024-04-05 01:30:02.756604+00:00, run_duration=0.931254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:00.731003+00:00, queued_by_job_id=1, pid=112 2024-04-05T01:31:42.732484366Z [2024-04-05T01:31:42.730+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:32:00.151481711Z [2024-04-05T01:32:00.151+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:32:00.221170398Z [2024-04-05T01:32:00.220+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:32:00.221193088Z 2024-04-05T01:32:00.221202308Z [2024-04-05T01:32:00.221+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:32:00.222067783Z [2024-04-05T01:32:00.221+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:32:00.222081062Z 2024-04-05T01:32:00.225806359Z [2024-04-05T01:32:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:32:00.226282082Z [2024-04-05T01:32:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:32:00.313370482Z [2024-04-05T01:32:00.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:32:00.319444198Z [2024-04-05T01:32:00.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88b50ae2-696e-46d0-a23c-2915715b34b8 2024-04-05T01:32:02.656993812Z [2024-04-05T01:32:02.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:32:02.658848430Z [2024-04-05T01:32:02.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:32:00.170492+00:00, run_end_date=2024-04-05 01:32:02.657698+00:00, run_duration=2.487206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:32:02.675344762Z [2024-04-05T01:32:02.675+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:32:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:32:02.740821457Z [2024-04-05T01:32:02.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:32:02.763007166Z [2024-04-05T01:32:02.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:32:01.311833+00:00, run_end_date=2024-04-05 01:32:01.844368+00:00, run_duration=0.532535, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:32:00.222863+00:00, queued_by_job_id=1, pid=148 2024-04-05T01:33:58.443731716Z [2024-04-05T01:33:58.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:33:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:33:58.486413874Z [2024-04-05T01:33:58.486+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:33:58.486443418Z 2024-04-05T01:33:58.486556727Z [2024-04-05T01:33:58.486+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:33:58.487622930Z [2024-04-05T01:33:58.487+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:33:58.487634608Z 2024-04-05T01:33:58.491074575Z [2024-04-05T01:33:58.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:33:58.491669701Z [2024-04-05T01:33:58.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:33:58.552605490Z [2024-04-05T01:33:58.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status queued for try_number 1 2024-04-05T01:33:58.558598387Z [2024-04-05T01:33:58.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to daf48d0d-02bb-4e45-8451-7635355802a4 2024-04-05T01:33:59.697848953Z [2024-04-05T01:33:59.697+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:33:59.772542191Z [2024-04-05T01:33:59.772+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:33:59.772558523Z 2024-04-05T01:33:59.772587002Z [2024-04-05T01:33:59.772+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:33:59.773695031Z [2024-04-05T01:33:59.773+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:33:59.773704473Z 2024-04-05T01:33:59.777265217Z [2024-04-05T01:33:59.776+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:33:59.777403741Z [2024-04-05T01:33:59.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:33:59.858198103Z [2024-04-05T01:33:59.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status queued for try_number 1 2024-04-05T01:33:59.868673733Z [2024-04-05T01:33:59.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5af9401-1ce1-4d45-b139-d7b7729337cc 2024-04-05T01:34:00.926917907Z [2024-04-05T01:34:00.926+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:34:00.948767302Z [2024-04-05T01:34:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:01.077078079Z [2024-04-05T01:34:01.076+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:34:01.077099368Z 2024-04-05T01:34:01.077103708Z 2024-04-05T01:34:01.077107571Z [2024-04-05T01:34:01.076+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:34:01.077327615Z [2024-04-05T01:34:01.077+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 1/16 running and queued tasks 2024-04-05T01:34:01.078072986Z [2024-04-05T01:34:01.077+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:01.078087488Z 2024-04-05T01:34:01.078091571Z 2024-04-05T01:34:01.086948344Z [2024-04-05T01:34:01.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:01.087101773Z [2024-04-05T01:34:01.086+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:34:01.087393729Z [2024-04-05T01:34:01.087+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:01.087503392Z [2024-04-05T01:34:01.087+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:34:01.373572930Z [2024-04-05T01:34:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:01.374059675Z [2024-04-05T01:34:01.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:01.400159592Z [2024-04-05T01:34:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc576fa9-d593-4fbe-b627-ada135883cf6 2024-04-05T01:34:01.401331852Z [2024-04-05T01:34:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e267157-417e-43a0-9838-cf3f54eb9627 2024-04-05T01:34:04.779254423Z [2024-04-05T01:34:04.778+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:04.780267528Z [2024-04-05T01:34:04.779+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:32:00+00:00, run_id=scheduled__2024-04-05T01:32:00+00:00, run_start_date=2024-04-05 01:33:58.460303+00:00, run_end_date=2024-04-05 01:34:04.779820+00:00, run_duration=6.319517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:32:00+00:00, data_interval_end=2024-04-05 01:33:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:34:04.833397031Z [2024-04-05T01:34:04.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:33:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:34:06.451380361Z [2024-04-05T01:34:06.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:07.031419455Z [2024-04-05T01:34:07.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:07.047793920Z [2024-04-05T01:34:07.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:32:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:00.971752+00:00, run_end_date=2024-04-05 01:34:04.660208+00:00, run_duration=3.688456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:33:58.488375+00:00, queued_by_job_id=1, pid=196 2024-04-05T01:34:07.618510156Z [2024-04-05T01:34:07.618+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:07.623996967Z [2024-04-05T01:34:07.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:32:00+00:00, run_id=scheduled__2024-04-05T01:32:00+00:00, run_start_date=2024-04-05 01:34:00.964562+00:00, run_end_date=2024-04-05 01:34:07.618455+00:00, run_duration=6.653893, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:32:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:34:07.709409099Z [2024-04-05T01:34:07.709+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:34:07.913699100Z [2024-04-05T01:34:07.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:07.931603824Z [2024-04-05T01:34:07.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:32:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:04.860167+00:00, run_end_date=2024-04-05 01:34:07.212931+00:00, run_duration=2.352764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:01.078742+00:00, queued_by_job_id=1, pid=218 2024-04-05T01:34:09.680119288Z [2024-04-05T01:34:09.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:09.781615223Z [2024-04-05T01:34:09.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:09.781888176Z [2024-04-05T01:34:09.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:32:00+00:00, run_id=scheduled__2024-04-05T01:32:00+00:00, run_start_date=2024-04-05 01:33:59.719329+00:00, run_end_date=2024-04-05 01:34:09.781551+00:00, run_duration=10.062222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:32:00+00:00, data_interval_end=2024-04-05 01:33:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:34:09.802409319Z [2024-04-05T01:34:09.802+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:33:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:34:09.868081027Z [2024-04-05T01:34:09.867+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:09.868099016Z 2024-04-05T01:34:09.868144058Z [2024-04-05T01:34:09.868+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:34:09.868663636Z [2024-04-05T01:34:09.868+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:09.868675499Z 2024-04-05T01:34:09.871394297Z [2024-04-05T01:34:09.871+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:34:09.871488050Z [2024-04-05T01:34:09.871+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:34:09.930913119Z [2024-04-05T01:34:09.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:09.930924924Z [2024-04-05T01:34:09.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:09.937677652Z [2024-04-05T01:34:09.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8f92351-3ed3-4dcf-bda6-861fdb0dfe24 2024-04-05T01:34:09.937816988Z [2024-04-05T01:34:09.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:32:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:05.667657+00:00, run_end_date=2024-04-05 01:34:09.142612+00:00, run_duration=3.474955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:33:59.774202+00:00, queued_by_job_id=1, pid=219 2024-04-05T01:34:09.971127175Z [2024-04-05T01:34:09.970+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:34:10.077997672Z [2024-04-05T01:34:10.077+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:10.078018856Z 2024-04-05T01:34:10.078022525Z [2024-04-05T01:34:10.077+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:34:10.080027168Z [2024-04-05T01:34:10.079+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:10.080043680Z 2024-04-05T01:34:10.082109355Z [2024-04-05T01:34:10.081+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:10.082195979Z [2024-04-05T01:34:10.082+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:34:10.134841113Z [2024-04-05T01:34:10.134+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:10.152814160Z [2024-04-05T01:34:10.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to d485e5bc-6361-440f-9260-f94654212377 2024-04-05T01:34:11.381041300Z [2024-04-05T01:34:11.380+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:11.381562605Z [2024-04-05T01:34:11.381+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:33:00+00:00, run_id=scheduled__2024-04-05T01:33:00+00:00, run_start_date=2024-04-05 01:34:00.965171+00:00, run_end_date=2024-04-05 01:34:11.380951+00:00, run_duration=10.41578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:33:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:34:11.418596426Z [2024-04-05T01:34:11.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:11.499466701Z [2024-04-05T01:34:11.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:11.505313469Z [2024-04-05T01:34:11.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:33:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:09.137193+00:00, run_end_date=2024-04-05 01:34:11.054198+00:00, run_duration=1.917005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:01.078742+00:00, queued_by_job_id=1, pid=248 2024-04-05T01:34:14.912315986Z [2024-04-05T01:34:14.912+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:14.912332688Z 2024-04-05T01:34:14.912374565Z [2024-04-05T01:34:14.912+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:34:14.912926005Z [2024-04-05T01:34:14.912+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:14.912937663Z 2024-04-05T01:34:14.915798950Z [2024-04-05T01:34:14.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:34:14.915914154Z [2024-04-05T01:34:14.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:34:14.972468251Z [2024-04-05T01:34:14.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:14.972788365Z [2024-04-05T01:34:14.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:14.985615396Z [2024-04-05T01:34:14.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95dbc3aa-e449-4849-9852-23c484b283db 2024-04-05T01:34:14.994891681Z [2024-04-05T01:34:14.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:12.777800+00:00, run_end_date=2024-04-05 01:34:13.631865+00:00, run_duration=0.854065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:09.868915+00:00, queued_by_job_id=1, pid=281 2024-04-05T01:34:16.149055117Z [2024-04-05T01:34:16.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:16.149644870Z [2024-04-05T01:34:16.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:33:00+00:00, run_id=scheduled__2024-04-05T01:33:00+00:00, run_start_date=2024-04-05 01:34:09.990292+00:00, run_end_date=2024-04-05 01:34:16.149211+00:00, run_duration=6.158919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:33:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:34:16.163975461Z [2024-04-05T01:34:16.163+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:16.216458146Z [2024-04-05T01:34:16.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:16.222952299Z [2024-04-05T01:34:16.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:33:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:13.272910+00:00, run_end_date=2024-04-05 01:34:15.503402+00:00, run_duration=2.230492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:10.080272+00:00, queued_by_job_id=1, pid=291 2024-04-05T01:34:18.035529826Z [2024-04-05T01:34:18.035+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:18.035548718Z 2024-04-05T01:34:18.040656387Z [2024-04-05T01:34:18.038+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:34:18.042649082Z [2024-04-05T01:34:18.041+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:18.042661490Z 2024-04-05T01:34:18.053539174Z [2024-04-05T01:34:18.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:34:18.057252480Z [2024-04-05T01:34:18.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:34:18.132510553Z [2024-04-05T01:34:18.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:18.132728260Z [2024-04-05T01:34:18.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:18.142578988Z [2024-04-05T01:34:18.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdba4a40-1a0f-41cf-a1a1-62aed4e4a290 2024-04-05T01:34:18.142764259Z [2024-04-05T01:34:18.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:17.269508+00:00, run_end_date=2024-04-05 01:34:17.625368+00:00, run_duration=0.35586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:14.913184+00:00, queued_by_job_id=1, pid=324 2024-04-05T01:34:21.091046989Z [2024-04-05T01:34:21.090+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:21.091077434Z 2024-04-05T01:34:21.091703457Z [2024-04-05T01:34:21.091+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:34:21.093447762Z [2024-04-05T01:34:21.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:21.093466488Z 2024-04-05T01:34:21.097079477Z [2024-04-05T01:34:21.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:21.097172138Z [2024-04-05T01:34:21.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:34:21.149543797Z [2024-04-05T01:34:21.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:21.149749307Z [2024-04-05T01:34:21.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:21.158660045Z [2024-04-05T01:34:21.158+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0d69766-fb74-44df-aa23-9d3dba5a38b3 2024-04-05T01:34:21.158827416Z [2024-04-05T01:34:21.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=0, run_start_date=2024-04-05 01:34:20.074111+00:00, run_end_date=2024-04-05 01:34:20.434110+00:00, run_duration=0.359999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:18.045412+00:00, queued_by_job_id=1, pid=336 2024-04-05T01:34:23.984439357Z [2024-04-05T01:34:23.983+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:23.984826968Z [2024-04-05T01:34:23.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:25:00+00:00, run_id=scheduled__2024-04-05T01:25:00+00:00, run_start_date=2024-04-05 01:34:09.699700+00:00, run_end_date=2024-04-05 01:34:23.984395+00:00, run_duration=14.284695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:25:00+00:00, data_interval_end=2024-04-05 01:30:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T01:34:23.993884278Z [2024-04-05T01:34:23.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:25.214079498Z [2024-04-05T01:34:25.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:25.220994365Z [2024-04-05T01:34:25.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:23.398771+00:00, run_end_date=2024-04-05 01:34:23.924167+00:00, run_duration=0.525396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:21.094426+00:00, queued_by_job_id=1, pid=348 2024-04-05T01:34:30.256945611Z [2024-04-05T01:34:30.256+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:30.314768064Z [2024-04-05T01:34:30.314+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:30.314789894Z 2024-04-05T01:34:30.314858432Z [2024-04-05T01:34:30.314+0000] {scheduler_job.py:425} INFO - DAG vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:34:30.315598967Z [2024-04-05T01:34:30.315+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:30.315611091Z 2024-04-05T01:34:30.318271462Z [2024-04-05T01:34:30.318+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:30.318490645Z [2024-04-05T01:34:30.318+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:34:30.395218589Z [2024-04-05T01:34:30.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:30.402069055Z [2024-04-05T01:34:30.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to e32a9aca-a317-4c33-b0bc-4e325211031f 2024-04-05T01:34:32.637598993Z [2024-04-05T01:34:32.637+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:34:32.725743437Z [2024-04-05T01:34:32.725+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:32.725785071Z 2024-04-05T01:34:32.728212278Z [2024-04-05T01:34:32.727+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:34:32.729643414Z [2024-04-05T01:34:32.728+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:32.729658927Z 2024-04-05T01:34:32.733349801Z [2024-04-05T01:34:32.733+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:32.733579193Z [2024-04-05T01:34:32.733+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:34:32.850750180Z [2024-04-05T01:34:32.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:32.860624723Z [2024-04-05T01:34:32.860+0000] {scheduler_job.py:635} INFO - Setting external_id for to 628ce939-1a6c-4c43-952e-c851768a297d 2024-04-05T01:34:35.309311600Z [2024-04-05T01:34:35.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:35.309991310Z [2024-04-05T01:34:35.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, execution_date=2024-04-05 01:33:00+00:00, run_id=scheduled__2024-04-05T01:33:00+00:00, run_start_date=2024-04-05 01:34:30.275005+00:00, run_end_date=2024-04-05 01:34:35.309214+00:00, run_duration=5.034209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:33:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=1889d36080681093fe178b7503d6a7b1 2024-04-05T01:34:35.320908205Z [2024-04-05T01:34:35.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:35.365205532Z [2024-04-05T01:34:35.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:35.375036866Z [2024-04-05T01:34:35.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:33:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:32.676390+00:00, run_end_date=2024-04-05 01:34:34.392677+00:00, run_duration=1.716287, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:30.316257+00:00, queued_by_job_id=1, pid=360 2024-04-05T01:34:37.511073502Z [2024-04-05T01:34:37.509+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:37.511672363Z [2024-04-05T01:34:37.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, execution_date=2024-04-05 01:33:00+00:00, run_id=scheduled__2024-04-05T01:33:00+00:00, run_start_date=2024-04-05 01:34:32.676192+00:00, run_end_date=2024-04-05 01:34:37.510898+00:00, run_duration=4.834706, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:33:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=569a57d6b43dc47657487dae4372bbce 2024-04-05T01:34:37.532239583Z [2024-04-05T01:34:37.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:37.572093685Z [2024-04-05T01:34:37.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:37.585847383Z [2024-04-05T01:34:37.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:33:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:35.348249+00:00, run_end_date=2024-04-05 01:34:37.097073+00:00, run_duration=1.748824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:32.730508+00:00, queued_by_job_id=1, pid=381 2024-04-05T01:34:41.453287181Z [2024-04-05T01:34:41.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:41.516943361Z [2024-04-05T01:34:41.516+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:41.516967888Z 2024-04-05T01:34:41.517000753Z [2024-04-05T01:34:41.516+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:34:41.517730141Z [2024-04-05T01:34:41.517+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:41.517744550Z 2024-04-05T01:34:41.520124552Z [2024-04-05T01:34:41.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:34:41.520246478Z [2024-04-05T01:34:41.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:34:41.572149001Z [2024-04-05T01:34:41.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:41.579066190Z [2024-04-05T01:34:41.578+0000] {scheduler_job.py:635} INFO - Setting external_id for to a714004f-dc65-40da-b7c2-ce5b3b0d5d8e 2024-04-05T01:34:45.555189719Z [2024-04-05T01:34:45.554+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:45.555211870Z 2024-04-05T01:34:45.555270632Z [2024-04-05T01:34:45.555+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:34:45.556026614Z [2024-04-05T01:34:45.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:45.556038331Z 2024-04-05T01:34:45.563918013Z [2024-04-05T01:34:45.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='split_metrics', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:34:45.564070212Z [2024-04-05T01:34:45.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'split_metrics', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:34:45.633071974Z [2024-04-05T01:34:45.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.split_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:45.633397901Z [2024-04-05T01:34:45.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:45.640877714Z [2024-04-05T01:34:45.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:44.040674+00:00, run_end_date=2024-04-05 01:34:44.542690+00:00, run_duration=0.502016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:41.518177+00:00, queued_by_job_id=1, pid=402 2024-04-05T01:34:45.641170752Z [2024-04-05T01:34:45.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84830e7f-173d-44cf-b84d-b299c849c020 2024-04-05T01:34:49.481966283Z [2024-04-05T01:34:49.481+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:49.482144920Z 2024-04-05T01:34:49.482148691Z [2024-04-05T01:34:49.481+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:34:49.482730784Z [2024-04-05T01:34:49.482+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:49.482760446Z 2024-04-05T01:34:49.486511327Z [2024-04-05T01:34:49.485+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:34:49.486535631Z [2024-04-05T01:34:49.486+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'collect_metrics', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:34:49.631767614Z [2024-04-05T01:34:49.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.collect_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:49.633155389Z [2024-04-05T01:34:49.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.split_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:49.642790600Z [2024-04-05T01:34:49.642+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=split_metrics, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:47.857947+00:00, run_end_date=2024-04-05 01:34:48.367547+00:00, run_duration=0.5096, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:45.556673+00:00, queued_by_job_id=1, pid=423 2024-04-05T01:34:49.643156575Z [2024-04-05T01:34:49.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 010a62ff-7e44-4534-9bbe-472a89edca90 2024-04-05T01:34:53.111993328Z [2024-04-05T01:34:53.111+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:34:53.112014833Z 2024-04-05T01:34:53.112199110Z [2024-04-05T01:34:53.112+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:34:53.112759109Z [2024-04-05T01:34:53.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:53.112771868Z 2024-04-05T01:34:53.115157600Z [2024-04-05T01:34:53.114+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:53.115388088Z [2024-04-05T01:34:53.115+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'send_prometheus', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:34:53.214775985Z [2024-04-05T01:34:53.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.send_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:53.216323791Z [2024-04-05T01:34:53.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.collect_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:53.230745831Z [2024-04-05T01:34:53.229+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=0, run_start_date=2024-04-05 01:34:51.708019+00:00, run_end_date=2024-04-05 01:34:52.081483+00:00, run_duration=0.373464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:49.483090+00:00, queued_by_job_id=1, pid=435 2024-04-05T01:34:53.230766652Z [2024-04-05T01:34:53.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84609848-3f92-4f7f-82e8-cf28d15380d9 2024-04-05T01:34:57.091456799Z [2024-04-05T01:34:57.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:57.091731236Z [2024-04-05T01:34:57.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, execution_date=2024-04-05 01:25:00+00:00, run_id=scheduled__2024-04-05T01:25:00+00:00, run_start_date=2024-04-05 01:34:41.465694+00:00, run_end_date=2024-04-05 01:34:57.091356+00:00, run_duration=15.625662, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:25:00+00:00, data_interval_end=2024-04-05 01:30:00+00:00, dag_hash=9fe0f8ba47ae3b8b4501f4f057d4242f 2024-04-05T01:34:57.097108390Z [2024-04-05T01:34:57.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:57.120871602Z [2024-04-05T01:34:57.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.send_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:57.126643593Z [2024-04-05T01:34:57.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:55.932869+00:00, run_end_date=2024-04-05 01:34:56.376900+00:00, run_duration=0.444031, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:53.113122+00:00, queued_by_job_id=1, pid=447 2024-04-05T01:35:01.017373401Z [2024-04-05T01:35:01.016+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:35:01.026957830Z [2024-04-05T01:35:01.026+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:35:01.058977781Z [2024-04-05T01:35:01.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:01.082548182Z [2024-04-05T01:35:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:35:01.096063077Z [2024-04-05T01:35:01.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:35:01.112780566Z [2024-04-05T01:35:01.112+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:01.261818284Z [2024-04-05T01:35:01.256+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-05T01:35:01.261855430Z 2024-04-05T01:35:01.261860760Z 2024-04-05T01:35:01.261867516Z 2024-04-05T01:35:01.261872651Z 2024-04-05T01:35:01.261877522Z 2024-04-05T01:35:01.261882235Z 2024-04-05T01:35:01.262490961Z [2024-04-05T01:35:01.262+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:35:01.262891015Z [2024-04-05T01:35:01.262+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:35:01.263198844Z [2024-04-05T01:35:01.262+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:35:01.263484763Z [2024-04-05T01:35:01.263+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:35:01.263729757Z [2024-04-05T01:35:01.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:35:01.264000547Z [2024-04-05T01:35:01.263+0000] {scheduler_job.py:425} INFO - DAG vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:35:01.265291886Z [2024-04-05T01:35:01.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:01.265328419Z 2024-04-05T01:35:01.265333470Z 2024-04-05T01:35:01.265338282Z 2024-04-05T01:35:01.265373363Z 2024-04-05T01:35:01.265377936Z 2024-04-05T01:35:01.265393800Z 2024-04-05T01:35:01.274334009Z [2024-04-05T01:35:01.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:35:01.274690596Z [2024-04-05T01:35:01.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:35:01.275200038Z [2024-04-05T01:35:01.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:35:01.275672653Z [2024-04-05T01:35:01.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:35:01.276222011Z [2024-04-05T01:35:01.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:01.276908777Z [2024-04-05T01:35:01.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:35:01.277423875Z [2024-04-05T01:35:01.277+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:01.277660473Z [2024-04-05T01:35:01.277+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:35:01.278783989Z [2024-04-05T01:35:01.278+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:01.279263412Z [2024-04-05T01:35:01.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:35:01.279769091Z [2024-04-05T01:35:01.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:01.280125144Z [2024-04-05T01:35:01.279+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:35:02.023626526Z [2024-04-05T01:35:02.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:02.024192563Z [2024-04-05T01:35:02.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:02.024419041Z [2024-04-05T01:35:02.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:02.024750435Z [2024-04-05T01:35:02.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:02.025094526Z [2024-04-05T01:35:02.024+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:02.025391623Z [2024-04-05T01:35:02.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:02.053237780Z [2024-04-05T01:35:02.051+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9acb5a57-e9d1-405c-bcc5-38e76a8de156 2024-04-05T01:35:02.054520623Z [2024-04-05T01:35:02.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2396d7f9-4da8-498f-9bb7-49649f1e1889 2024-04-05T01:35:02.056038070Z [2024-04-05T01:35:02.055+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76420231-91e4-4939-a3cc-4bc4f411415d 2024-04-05T01:35:02.056657810Z [2024-04-05T01:35:02.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to e547f16d-9506-431e-b4f3-cb6cd3484dd6 2024-04-05T01:35:02.057049352Z [2024-04-05T01:35:02.056+0000] {scheduler_job.py:635} INFO - Setting external_id for to 249ce4ff-c796-4c95-9722-409da3f95be0 2024-04-05T01:35:02.057450765Z [2024-04-05T01:35:02.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80622a70-d3bd-4bf5-b3b3-f834070c254a 2024-04-05T01:35:11.249595250Z [2024-04-05T01:35:11.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status failed for try_number 1 2024-04-05T01:35:11.268908213Z [2024-04-05T01:35:11.268+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:01.267354+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:35:11.270276739Z [2024-04-05T01:35:11.269+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:11.281019695Z [2024-04-05T01:35:11.280+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:11.348746598Z [2024-04-05T01:35:11.348+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T013400, start_date=, end_date=20240405T013511 2024-04-05T01:35:13.419522904Z [2024-04-05T01:35:13.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status failed for try_number 1 2024-04-05T01:35:13.433005669Z [2024-04-05T01:35:13.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:01.267354+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:35:13.434721811Z [2024-04-05T01:35:13.434+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:13.447195620Z [2024-04-05T01:35:13.446+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:13.500590604Z [2024-04-05T01:35:13.486+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=extract_metrics_from_vnfrs, execution_date=20240405T013000, start_date=, end_date=20240405T013513 2024-04-05T01:35:15.105460268Z [2024-04-05T01:35:15.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status failed for try_number 1 2024-04-05T01:35:15.117638798Z [2024-04-05T01:35:15.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:01.267354+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:35:15.121030292Z [2024-04-05T01:35:15.120+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:15.146754280Z [2024-04-05T01:35:15.146+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:15.307494293Z [2024-04-05T01:35:15.307+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T013400, start_date=, end_date=20240405T013515 2024-04-05T01:35:16.544488620Z [2024-04-05T01:35:16.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:35:16.549018649Z [2024-04-05T01:35:16.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:35:01.141960+00:00, run_end_date=2024-04-05 01:35:16.544356+00:00, run_duration=15.402396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:35:16.570135326Z [2024-04-05T01:35:16.569+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:16.816633915Z [2024-04-05T01:35:16.816+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:35:16.816653865Z 2024-04-05T01:35:16.816793909Z [2024-04-05T01:35:16.816+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:35:16.817521802Z [2024-04-05T01:35:16.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:16.817534426Z 2024-04-05T01:35:16.823734132Z [2024-04-05T01:35:16.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:35:16.824367155Z [2024-04-05T01:35:16.823+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:35:16.928347244Z [2024-04-05T01:35:16.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:16.931308986Z [2024-04-05T01:35:16.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:16.931558014Z [2024-04-05T01:35:16.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:16.952045039Z [2024-04-05T01:35:16.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:10.044838+00:00, run_end_date=2024-04-05 01:35:14.991295+00:00, run_duration=4.946457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:01.267354+00:00, queued_by_job_id=1, pid=478 2024-04-05T01:35:16.952282234Z [2024-04-05T01:35:16.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:13.348724+00:00, run_end_date=2024-04-05 01:35:14.676195+00:00, run_duration=1.327471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:01.267354+00:00, queued_by_job_id=1, pid=551 2024-04-05T01:35:16.954385415Z [2024-04-05T01:35:16.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to bcf5ab08-3064-4338-bc2e-a79d3227ebce 2024-04-05T01:35:18.324060665Z [2024-04-05T01:35:18.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:35:18.324332565Z [2024-04-05T01:35:18.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:35:01.139370+00:00, run_end_date=2024-04-05 01:35:18.323926+00:00, run_duration=17.184556, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:35:18.346798523Z [2024-04-05T01:35:18.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:18.533100793Z [2024-04-05T01:35:18.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:18.547477714Z [2024-04-05T01:35:18.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:14.360624+00:00, run_end_date=2024-04-05 01:35:17.713038+00:00, run_duration=3.352414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:01.267354+00:00, queued_by_job_id=1, pid=569 2024-04-05T01:35:20.691008465Z [2024-04-05T01:35:20.690+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:35:20.691039764Z 2024-04-05T01:35:20.691183432Z [2024-04-05T01:35:20.691+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:35:20.693491299Z [2024-04-05T01:35:20.692+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:20.693509977Z 2024-04-05T01:35:20.696289905Z [2024-04-05T01:35:20.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:35:20.696416185Z [2024-04-05T01:35:20.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:35:20.857755609Z [2024-04-05T01:35:20.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:20.857934955Z [2024-04-05T01:35:20.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:20.875426404Z [2024-04-05T01:35:20.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to fca92801-b1e6-4a4d-9a61-bc999b3ff029 2024-04-05T01:35:20.875573411Z [2024-04-05T01:35:20.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:19.794755+00:00, run_end_date=2024-04-05 01:35:20.182518+00:00, run_duration=0.387763, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:16.818437+00:00, queued_by_job_id=1, pid=594 2024-04-05T01:35:22.097652792Z [2024-04-05T01:35:22.097+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:35:22.097697653Z 2024-04-05T01:35:22.097864684Z [2024-04-05T01:35:22.097+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:35:22.098538165Z [2024-04-05T01:35:22.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:22.098553235Z 2024-04-05T01:35:22.100880829Z [2024-04-05T01:35:22.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:22.101184760Z [2024-04-05T01:35:22.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:35:22.195721218Z [2024-04-05T01:35:22.195+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 2 2024-04-05T01:35:22.204674054Z [2024-04-05T01:35:22.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45cc6782-7f64-4f64-8430-2eb71aed12ec 2024-04-05T01:35:23.694763364Z [2024-04-05T01:35:23.694+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:35:23.694786044Z 2024-04-05T01:35:23.694944137Z [2024-04-05T01:35:23.694+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:35:23.696308641Z [2024-04-05T01:35:23.696+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:23.696323258Z 2024-04-05T01:35:23.699358817Z [2024-04-05T01:35:23.699+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:35:23.699521814Z [2024-04-05T01:35:23.699+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:35:23.786700034Z [2024-04-05T01:35:23.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 2 2024-04-05T01:35:23.798809537Z [2024-04-05T01:35:23.798+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c401ff7-27a1-4150-a944-a4253bf14e6b 2024-04-05T01:35:25.244726233Z [2024-04-05T01:35:25.244+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:35:25.244746978Z 2024-04-05T01:35:25.244754241Z 2024-04-05T01:35:25.246617912Z [2024-04-05T01:35:25.246+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:35:25.249843115Z [2024-04-05T01:35:25.249+0000] {scheduler_job.py:425} INFO - DAG vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:35:25.250699001Z [2024-04-05T01:35:25.250+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:25.250713012Z 2024-04-05T01:35:25.250717299Z 2024-04-05T01:35:25.265524467Z [2024-04-05T01:35:25.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:25.267115658Z [2024-04-05T01:35:25.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:35:25.268067021Z [2024-04-05T01:35:25.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:25.268816950Z [2024-04-05T01:35:25.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:35:25.675522898Z [2024-04-05T01:35:25.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:25.675548236Z [2024-04-05T01:35:25.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 2 2024-04-05T01:35:25.675664430Z [2024-04-05T01:35:25.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:25.734422998Z [2024-04-05T01:35:25.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccf7fb9f-017a-4348-b5c8-0635837a6318 2024-04-05T01:35:25.734489097Z [2024-04-05T01:35:25.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=0, run_start_date=2024-04-05 01:35:23.725415+00:00, run_end_date=2024-04-05 01:35:24.796054+00:00, run_duration=1.070639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:20.692981+00:00, queued_by_job_id=1, pid=609 2024-04-05T01:35:25.734494538Z [2024-04-05T01:35:25.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to c553d5ac-bddc-43c0-bc23-5f45d2b8a4cf 2024-04-05T01:35:26.078785117Z [2024-04-05T01:35:26.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status failed for try_number 2 2024-04-05T01:35:26.085391211Z [2024-04-05T01:35:26.085+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:35:11.296031+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:22.098928+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:35:26.085767834Z [2024-04-05T01:35:26.085+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:26.090733272Z [2024-04-05T01:35:26.090+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:26.108580137Z [2024-04-05T01:35:26.108+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T013400, start_date=, end_date=20240405T013526 2024-04-05T01:35:27.266485764Z [2024-04-05T01:35:27.263+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:35:27.266920492Z [2024-04-05T01:35:27.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:35:01.136611+00:00, run_end_date=2024-04-05 01:35:27.266457+00:00, run_duration=26.129846, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=569a57d6b43dc47657487dae4372bbce 2024-04-05T01:35:27.281180117Z [2024-04-05T01:35:27.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:27.392582563Z [2024-04-05T01:35:27.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status failed for try_number 2 2024-04-05T01:35:27.404645111Z [2024-04-05T01:35:27.404+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:35:13.461407+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:23.696794+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:35:27.405686733Z [2024-04-05T01:35:27.405+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:27.409184095Z [2024-04-05T01:35:27.408+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:27.426241435Z [2024-04-05T01:35:27.425+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=extract_metrics_from_vnfrs, execution_date=20240405T013000, start_date=, end_date=20240405T013527 2024-04-05T01:35:29.537544236Z [2024-04-05T01:35:29.537+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:35:29.538496617Z [2024-04-05T01:35:29.538+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:35:01.133698+00:00, run_end_date=2024-04-05 01:35:29.537480+00:00, run_duration=28.403782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T01:35:29.545618271Z [2024-04-05T01:35:29.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:35:29.623928935Z [2024-04-05T01:35:29.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:29.624115566Z [2024-04-05T01:35:29.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status failed for try_number 2 2024-04-05T01:35:29.638042605Z [2024-04-05T01:35:29.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:28.964549+00:00, run_end_date=2024-04-05 01:35:29.324513+00:00, run_duration=0.359964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:25.253421+00:00, queued_by_job_id=1, pid=678 2024-04-05T01:35:29.638512827Z [2024-04-05T01:35:29.638+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:35:15.166877+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:25.253421+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:35:29.639242575Z [2024-04-05T01:35:29.639+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:29.645526684Z [2024-04-05T01:35:29.645+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:35:29.659750831Z [2024-04-05T01:35:29.659+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T013400, start_date=, end_date=20240405T013529 2024-04-05T01:35:30.732823934Z [2024-04-05T01:35:30.732+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:35:30.733005743Z [2024-04-05T01:35:30.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:35:01.145267+00:00, run_end_date=2024-04-05 01:35:30.732762+00:00, run_duration=29.587495, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=1889d36080681093fe178b7503d6a7b1 2024-04-05T01:35:30.745486788Z [2024-04-05T01:35:30.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:31.807522002Z [2024-04-05T01:35:31.806+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:35:31.808212690Z [2024-04-05T01:35:31.807+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:35:01.131863+00:00, run_end_date=2024-04-05 01:35:31.807676+00:00, run_duration=30.675813, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=9fe0f8ba47ae3b8b4501f4f057d4242f 2024-04-05T01:35:31.817771730Z [2024-04-05T01:35:31.817+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:36:00.938048953Z [2024-04-05T01:36:00.937+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:00.961093185Z [2024-04-05T01:36:00.959+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:36:00.973840853Z [2024-04-05T01:36:00.973+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:36:00.996816751Z [2024-04-05T01:36:00.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:01.155273656Z [2024-04-05T01:36:01.154+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:36:01.155297207Z 2024-04-05T01:36:01.155303722Z 2024-04-05T01:36:01.155308710Z 2024-04-05T01:36:01.155313875Z 2024-04-05T01:36:01.155721019Z [2024-04-05T01:36:01.155+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:36:01.155987439Z [2024-04-05T01:36:01.155+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:36:01.156347583Z [2024-04-05T01:36:01.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:36:01.156568239Z [2024-04-05T01:36:01.156+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:36:01.158360108Z [2024-04-05T01:36:01.157+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:36:01.158382091Z 2024-04-05T01:36:01.158405526Z 2024-04-05T01:36:01.158410029Z 2024-04-05T01:36:01.158428649Z 2024-04-05T01:36:01.168565930Z [2024-04-05T01:36:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:01.169245759Z [2024-04-05T01:36:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:36:01.169843077Z [2024-04-05T01:36:01.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:01.170176741Z [2024-04-05T01:36:01.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:36:01.170849025Z [2024-04-05T01:36:01.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:01.171200042Z [2024-04-05T01:36:01.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:36:01.171863053Z [2024-04-05T01:36:01.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:01.172541299Z [2024-04-05T01:36:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:36:01.757253120Z [2024-04-05T01:36:01.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:36:01.757412124Z [2024-04-05T01:36:01.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:36:01.757621519Z [2024-04-05T01:36:01.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:36:01.757736104Z [2024-04-05T01:36:01.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:36:01.820495573Z [2024-04-05T01:36:01.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 277aec4b-c82c-45c9-8ca7-ab312f1977f9 2024-04-05T01:36:01.820607013Z [2024-04-05T01:36:01.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5817b8f2-f73e-42b3-9081-72c2696c66e6 2024-04-05T01:36:01.820823145Z [2024-04-05T01:36:01.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61fbd0ad-97ac-4585-aef4-714e89216f8e 2024-04-05T01:36:01.821059515Z [2024-04-05T01:36:01.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b952956-17ca-43a3-bb9d-d61e10218978 2024-04-05T01:36:05.926083013Z [2024-04-05T01:36:05.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:36:05.932410511Z [2024-04-05T01:36:05.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:36:01.018381+00:00, run_end_date=2024-04-05 01:36:05.931883+00:00, run_duration=4.913502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:36:05.999755139Z [2024-04-05T01:36:05.999+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:36:06.741749149Z [2024-04-05T01:36:06.741+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status success for try_number 1 2024-04-05T01:36:06.805563769Z [2024-04-05T01:36:06.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=2024-04-05 01:36:03.487124+00:00, run_end_date=2024-04-05 01:36:04.781380+00:00, run_duration=1.294256, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:01.161766+00:00, queued_by_job_id=1, pid=683 2024-04-05T01:36:08.115526636Z [2024-04-05T01:36:08.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status failed for try_number 1 2024-04-05T01:36:08.125689805Z [2024-04-05T01:36:08.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:01.161766+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:36:08.126483932Z [2024-04-05T01:36:08.126+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:36:08.130663797Z [2024-04-05T01:36:08.130+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:36:08.159603919Z [2024-04-05T01:36:08.159+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T013500, start_date=, end_date=20240405T013608 2024-04-05T01:36:09.773558410Z [2024-04-05T01:36:09.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:36:09.773924693Z [2024-04-05T01:36:09.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:36:01.020867+00:00, run_end_date=2024-04-05 01:36:09.773491+00:00, run_duration=8.752624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:36:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:36:09.792264859Z [2024-04-05T01:36:09.791+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:09.827990737Z [2024-04-05T01:36:09.827+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:36:09.828513747Z [2024-04-05T01:36:09.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:36:01.027043+00:00, run_end_date=2024-04-05 01:36:09.828142+00:00, run_duration=8.801099, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:36:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:36:09.841446006Z [2024-04-05T01:36:09.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:09.917649872Z [2024-04-05T01:36:09.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:36:09.961807893Z [2024-04-05T01:36:09.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:36:07.134538+00:00, run_end_date=2024-04-05 01:36:09.226740+00:00, run_duration=2.092202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:01.161766+00:00, queued_by_job_id=1, pid=722 2024-04-05T01:36:11.085382988Z [2024-04-05T01:36:11.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:36:11.093798972Z [2024-04-05T01:36:11.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:36:07.926808+00:00, run_end_date=2024-04-05 01:36:09.645208+00:00, run_duration=1.7184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:01.161766+00:00, queued_by_job_id=1, pid=741 2024-04-05T01:36:18.845269699Z [2024-04-05T01:36:18.844+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:36:18.845301404Z 2024-04-05T01:36:18.845448601Z [2024-04-05T01:36:18.845+0000] {scheduler_job.py:425} INFO - DAG vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 has 0/16 running and queued tasks 2024-04-05T01:36:18.846441796Z [2024-04-05T01:36:18.846+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:36:18.846456698Z 2024-04-05T01:36:18.850409933Z [2024-04-05T01:36:18.850+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:18.850707546Z [2024-04-05T01:36:18.850+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:36:18.928817417Z [2024-04-05T01:36:18.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 2 2024-04-05T01:36:18.936729603Z [2024-04-05T01:36:18.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to c829a1e3-c1ed-40e4-ac5f-7143546fc00e 2024-04-05T01:36:21.226902656Z [2024-04-05T01:36:21.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status failed for try_number 2 2024-04-05T01:36:21.236466406Z [2024-04-05T01:36:21.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:36:08.142244+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:18.847701+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:36:21.236797315Z [2024-04-05T01:36:21.236+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:36:21.244347831Z [2024-04-05T01:36:21.243+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:36:21.269088860Z [2024-04-05T01:36:21.268+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T013500, start_date=, end_date=20240405T013621 2024-04-05T01:36:22.357143928Z [2024-04-05T01:36:22.355+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:36:22.357193984Z [2024-04-05T01:36:22.356+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:36:01.024141+00:00, run_end_date=2024-04-05 01:36:22.355919+00:00, run_duration=21.331778, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:36:00+00:00, dag_hash=1889d36080681093fe178b7503d6a7b1 2024-04-05T01:36:22.388701035Z [2024-04-05T01:36:22.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_8beee11b-dc1d-4e0e-961c-3802ca7f8d22 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:42.813415521Z [2024-04-05T01:36:42.812+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:37:00.337282622Z [2024-04-05T01:37:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:00.345254433Z [2024-04-05T01:37:00.344+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:37:00.400490503Z [2024-04-05T01:37:00.400+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:37:00.400546141Z 2024-04-05T01:37:00.400553405Z 2024-04-05T01:37:00.400666008Z [2024-04-05T01:37:00.400+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:37:00.401195719Z [2024-04-05T01:37:00.400+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:37:00.401993982Z [2024-04-05T01:37:00.401+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:37:00.402010392Z 2024-04-05T01:37:00.402015697Z 2024-04-05T01:37:00.405641583Z [2024-04-05T01:37:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:37:00.405953306Z [2024-04-05T01:37:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:37:00.406668967Z [2024-04-05T01:37:00.406+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:37:00.406856262Z [2024-04-05T01:37:00.406+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:37:00.627548812Z [2024-04-05T01:37:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:37:00.628392033Z [2024-04-05T01:37:00.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:37:00.650107631Z [2024-04-05T01:37:00.649+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac454af3-33c6-46ab-a424-0a473219154e 2024-04-05T01:37:00.650618174Z [2024-04-05T01:37:00.650+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3a3b239-a9b4-409b-a70b-db8f3e6df7af 2024-04-05T01:37:08.065297168Z [2024-04-05T01:37:08.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:37:08.065694261Z [2024-04-05T01:37:08.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:37:00.355319+00:00, run_end_date=2024-04-05 01:37:08.065280+00:00, run_duration=7.709961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:37:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:37:08.079843551Z [2024-04-05T01:37:08.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:08.137246483Z [2024-04-05T01:37:08.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:37:08.161066629Z [2024-04-05T01:37:08.160+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:37:04.590079+00:00, run_end_date=2024-04-05 01:37:07.690247+00:00, run_duration=3.100168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:37:00.402689+00:00, queued_by_job_id=1, pid=806 2024-04-05T01:37:09.209914677Z [2024-04-05T01:37:09.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:37:09.210856123Z [2024-04-05T01:37:09.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:37:00.356705+00:00, run_end_date=2024-04-05 01:37:09.210233+00:00, run_duration=8.853528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:37:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:37:09.226689703Z [2024-04-05T01:37:09.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:09.267084403Z [2024-04-05T01:37:09.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:37:09.273199779Z [2024-04-05T01:37:09.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:37:04.698333+00:00, run_end_date=2024-04-05 01:37:08.047575+00:00, run_duration=3.349242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:37:00.402689+00:00, queued_by_job_id=1, pid=807 2024-04-05T01:37:47.305394849Z [2024-04-05T01:37:47.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:47.345701352Z [2024-04-05T01:37:47.345+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:37:47.345722655Z 2024-04-05T01:37:47.345958524Z [2024-04-05T01:37:47.345+0000] {scheduler_job.py:425} INFO - DAG vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:37:47.347225580Z [2024-04-05T01:37:47.346+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:37:47.347243609Z 2024-04-05T01:37:47.350095046Z [2024-04-05T01:37:47.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:37:47.350592607Z [2024-04-05T01:37:47.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:37:47.415486540Z [2024-04-05T01:37:47.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:37:47.422914194Z [2024-04-05T01:37:47.422+0000] {scheduler_job.py:635} INFO - Setting external_id for to 085c42ce-5b22-4c01-b8f6-efa8e7fec9a6 2024-04-05T01:37:50.219736050Z [2024-04-05T01:37:50.219+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:37:50.295176907Z [2024-04-05T01:37:50.294+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:37:50.295189635Z 2024-04-05T01:37:50.295405221Z [2024-04-05T01:37:50.295+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:37:50.295957442Z [2024-04-05T01:37:50.295+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:37:50.295981964Z 2024-04-05T01:37:50.298848740Z [2024-04-05T01:37:50.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:37:50.299015094Z [2024-04-05T01:37:50.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:37:50.363916826Z [2024-04-05T01:37:50.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:37:50.372132277Z [2024-04-05T01:37:50.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23411aba-1c44-46a2-8ada-c0e4497ed42b 2024-04-05T01:37:51.044260251Z [2024-04-05T01:37:51.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:37:51.044689644Z [2024-04-05T01:37:51.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:37:47.316432+00:00, run_end_date=2024-04-05 01:37:51.044347+00:00, run_duration=3.727915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:37:00+00:00, dag_hash=f15db48f5bf2fbe2775c35858c798a3a 2024-04-05T01:37:51.056036566Z [2024-04-05T01:37:51.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:51.110262330Z [2024-04-05T01:37:51.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:37:51.121859984Z [2024-04-05T01:37:51.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:37:49.333788+00:00, run_end_date=2024-04-05 01:37:50.634305+00:00, run_duration=1.300517, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:37:47.347735+00:00, queued_by_job_id=1, pid=850 2024-04-05T01:37:55.460022910Z [2024-04-05T01:37:55.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:37:55.460130046Z [2024-04-05T01:37:55.459+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:37:50.235672+00:00, run_end_date=2024-04-05 01:37:55.459872+00:00, run_duration=5.2242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:37:00+00:00, dag_hash=8ffdadb56d8b76e58956f56c714bd249 2024-04-05T01:37:55.472822801Z [2024-04-05T01:37:55.472+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:55.507068443Z [2024-04-05T01:37:55.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:37:55.520026564Z [2024-04-05T01:37:55.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:37:52.522642+00:00, run_end_date=2024-04-05 01:37:54.449064+00:00, run_duration=1.926422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:37:50.296397+00:00, queued_by_job_id=1, pid=871 2024-04-05T01:37:58.672869920Z [2024-04-05T01:37:58.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:37:58.715697621Z [2024-04-05T01:37:58.715+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:37:58.715714178Z 2024-04-05T01:37:58.716081999Z [2024-04-05T01:37:58.715+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:37:58.716783256Z [2024-04-05T01:37:58.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:37:58.716805832Z 2024-04-05T01:37:58.719021901Z [2024-04-05T01:37:58.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:37:58.719285998Z [2024-04-05T01:37:58.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:37:58.765884733Z [2024-04-05T01:37:58.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:37:58.779355044Z [2024-04-05T01:37:58.778+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54609e00-38fe-4efc-b94c-fee786ba5fdd 2024-04-05T01:38:00.604663587Z [2024-04-05T01:38:00.604+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:38:00.634124019Z [2024-04-05T01:38:00.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:00.651239441Z [2024-04-05T01:38:00.650+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:38:00.710090338Z [2024-04-05T01:38:00.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:00.800607230Z [2024-04-05T01:38:00.800+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:38:01.025732821Z [2024-04-05T01:38:01.025+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T01:38:01.025752929Z 2024-04-05T01:38:01.025757199Z 2024-04-05T01:38:01.025760522Z 2024-04-05T01:38:01.025763864Z 2024-04-05T01:38:01.025767109Z 2024-04-05T01:38:01.026400596Z [2024-04-05T01:38:01.026+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:38:01.026549095Z [2024-04-05T01:38:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:38:01.026676245Z [2024-04-05T01:38:01.026+0000] {scheduler_job.py:425} INFO - DAG vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:38:01.026818294Z [2024-04-05T01:38:01.026+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:38:01.026983715Z [2024-04-05T01:38:01.026+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:38:01.028109725Z [2024-04-05T01:38:01.027+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:38:01.028121505Z 2024-04-05T01:38:01.028141104Z 2024-04-05T01:38:01.028161885Z 2024-04-05T01:38:01.028165686Z 2024-04-05T01:38:01.028169141Z 2024-04-05T01:38:01.033896097Z [2024-04-05T01:38:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.034118379Z [2024-04-05T01:38:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:38:01.034457714Z [2024-04-05T01:38:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.034615677Z [2024-04-05T01:38:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:38:01.034837254Z [2024-04-05T01:38:01.034+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.035650956Z [2024-04-05T01:38:01.035+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:38:01.036072764Z [2024-04-05T01:38:01.035+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.036214686Z [2024-04-05T01:38:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:38:01.036426958Z [2024-04-05T01:38:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.036605544Z [2024-04-05T01:38:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:38:01.809502469Z [2024-04-05T01:38:01.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.809763294Z [2024-04-05T01:38:01.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.809955219Z [2024-04-05T01:38:01.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.810261742Z [2024-04-05T01:38:01.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.810376840Z [2024-04-05T01:38:01.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.810483391Z [2024-04-05T01:38:01.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:01.831888837Z [2024-04-05T01:38:01.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:00.602709+00:00, run_end_date=2024-04-05 01:38:01.196611+00:00, run_duration=0.593902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:37:58.717219+00:00, queued_by_job_id=1, pid=892 2024-04-05T01:38:01.832437279Z [2024-04-05T01:38:01.832+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dcd6810-0462-4cf2-87b1-136134103a86 2024-04-05T01:38:01.833434967Z [2024-04-05T01:38:01.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb36073f-c7cc-48e7-9bce-94393119d6a6 2024-04-05T01:38:01.833739192Z [2024-04-05T01:38:01.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1869590f-33af-47e4-86cb-dfaf306f8e3c 2024-04-05T01:38:01.834644489Z [2024-04-05T01:38:01.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c935a06-b5c4-4b85-b378-d771b4ab69fa 2024-04-05T01:38:01.835627764Z [2024-04-05T01:38:01.835+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20146035-25a9-41de-b6ef-7874186bf3d4 2024-04-05T01:38:02.131598291Z [2024-04-05T01:38:02.131+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:38:02.131644525Z 2024-04-05T01:38:02.132095928Z [2024-04-05T01:38:02.131+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:38:02.132941401Z [2024-04-05T01:38:02.132+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:38:02.132955829Z 2024-04-05T01:38:02.136632699Z [2024-04-05T01:38:02.136+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='split_metrics', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:38:02.136847234Z [2024-04-05T01:38:02.136+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'split_metrics', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:38:02.265464271Z [2024-04-05T01:38:02.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.split_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:02.283006579Z [2024-04-05T01:38:02.279+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99329613-fbe5-4b6b-8240-a0cb68ad98ef 2024-04-05T01:38:06.673211132Z [2024-04-05T01:38:06.672+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:06.675185237Z [2024-04-05T01:38:06.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:38:00.842721+00:00, run_end_date=2024-04-05 01:38:06.674587+00:00, run_duration=5.831866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:38:06.690511036Z [2024-04-05T01:38:06.690+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:38:07.093057669Z [2024-04-05T01:38:07.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:07.099823028Z [2024-04-05T01:38:07.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:03.528769+00:00, run_end_date=2024-04-05 01:38:06.594462+00:00, run_duration=3.065693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.029687+00:00, queued_by_job_id=1, pid=908 2024-04-05T01:38:11.970193794Z [2024-04-05T01:38:11.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:11.971808371Z [2024-04-05T01:38:11.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:37:00+00:00, run_id=scheduled__2024-04-05T01:37:00+00:00, run_start_date=2024-04-05 01:38:00.848400+00:00, run_end_date=2024-04-05 01:38:11.971382+00:00, run_duration=11.122982, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:37:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=f15db48f5bf2fbe2775c35858c798a3a 2024-04-05T01:38:11.992396609Z [2024-04-05T01:38:11.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:12.005804957Z [2024-04-05T01:38:12.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:12.006142000Z [2024-04-05T01:38:12.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:37:00+00:00, run_id=scheduled__2024-04-05T01:37:00+00:00, run_start_date=2024-04-05 01:38:00.844901+00:00, run_end_date=2024-04-05 01:38:12.005791+00:00, run_duration=11.16089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:37:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:38:12.016345383Z [2024-04-05T01:38:12.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:12.167836658Z [2024-04-05T01:38:12.167+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:38:12.167856296Z 2024-04-05T01:38:12.168043833Z [2024-04-05T01:38:12.167+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:38:12.169093875Z [2024-04-05T01:38:12.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:38:12.169145289Z 2024-04-05T01:38:12.178414969Z [2024-04-05T01:38:12.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:38:12.178676983Z [2024-04-05T01:38:12.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'collect_metrics', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:38:12.300931865Z [2024-04-05T01:38:12.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.collect_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:12.300953304Z [2024-04-05T01:38:12.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:12.329918334Z [2024-04-05T01:38:12.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f7fc436-f96e-44f1-ae8d-41acf75555c1 2024-04-05T01:38:12.330338134Z [2024-04-05T01:38:12.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:37:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:08.685047+00:00, run_end_date=2024-04-05 01:38:11.532381+00:00, run_duration=2.847334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.029687+00:00, queued_by_job_id=1, pid=941 2024-04-05T01:38:12.478633072Z [2024-04-05T01:38:12.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:12.478642343Z [2024-04-05T01:38:12.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:37:00+00:00, run_id=scheduled__2024-04-05T01:37:00+00:00, run_start_date=2024-04-05 01:38:00.852996+00:00, run_end_date=2024-04-05 01:38:12.472783+00:00, run_duration=11.619787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:37:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:38:12.499928224Z [2024-04-05T01:38:12.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:12.584263362Z [2024-04-05T01:38:12.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:12.584620845Z [2024-04-05T01:38:12.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.split_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:12.610074211Z [2024-04-05T01:38:12.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=split_metrics, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:11.250816+00:00, run_end_date=2024-04-05 01:38:11.948765+00:00, run_duration=0.697949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:02.133705+00:00, queued_by_job_id=1, pid=1017 2024-04-05T01:38:12.610839648Z [2024-04-05T01:38:12.610+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:37:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:09.246901+00:00, run_end_date=2024-04-05 01:38:11.930490+00:00, run_duration=2.683589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.029687+00:00, queued_by_job_id=1, pid=942 2024-04-05T01:38:13.735240941Z [2024-04-05T01:38:13.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:13.735563746Z [2024-04-05T01:38:13.735+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:37:00+00:00, run_id=scheduled__2024-04-05T01:37:00+00:00, run_start_date=2024-04-05 01:38:00.866658+00:00, run_end_date=2024-04-05 01:38:13.735222+00:00, run_duration=12.868564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:37:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=8ffdadb56d8b76e58956f56c714bd249 2024-04-05T01:38:13.749261010Z [2024-04-05T01:38:13.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:13.821800779Z [2024-04-05T01:38:13.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:13.822488169Z [2024-04-05T01:38:13.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:13.832404543Z [2024-04-05T01:38:13.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:37:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:10.533407+00:00, run_end_date=2024-04-05 01:38:12.405216+00:00, run_duration=1.871809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.029687+00:00, queued_by_job_id=1, pid=998 2024-04-05T01:38:13.834336963Z [2024-04-05T01:38:13.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:37:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:10.229769+00:00, run_end_date=2024-04-05 01:38:12.762179+00:00, run_duration=2.53241, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.029687+00:00, queued_by_job_id=1, pid=990 2024-04-05T01:38:16.091310698Z [2024-04-05T01:38:16.090+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:38:16.091344403Z 2024-04-05T01:38:16.092122044Z [2024-04-05T01:38:16.091+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:38:16.093930762Z [2024-04-05T01:38:16.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:38:16.093944093Z 2024-04-05T01:38:16.098490222Z [2024-04-05T01:38:16.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:16.098636180Z [2024-04-05T01:38:16.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'send_prometheus', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:38:16.196770401Z [2024-04-05T01:38:16.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.send_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:16.197505686Z [2024-04-05T01:38:16.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.collect_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:16.213157965Z [2024-04-05T01:38:16.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=0, run_start_date=2024-04-05 01:38:15.078882+00:00, run_end_date=2024-04-05 01:38:15.524296+00:00, run_duration=0.445414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:12.174552+00:00, queued_by_job_id=1, pid=1032 2024-04-05T01:38:16.213465389Z [2024-04-05T01:38:16.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b4772bd-7789-495e-959f-4724217471cb 2024-04-05T01:38:19.323266849Z [2024-04-05T01:38:19.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:19.324976276Z [2024-04-05T01:38:19.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:37:58.681509+00:00, run_end_date=2024-04-05 01:38:19.323183+00:00, run_duration=20.641674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=a79ee3445e43d67c4c5d622c3c43b1ed 2024-04-05T01:38:19.332725015Z [2024-04-05T01:38:19.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:38:19.358957170Z [2024-04-05T01:38:19.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.send_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:19.366180074Z [2024-04-05T01:38:19.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:18.152822+00:00, run_end_date=2024-04-05 01:38:18.557410+00:00, run_duration=0.404588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:16.094783+00:00, queued_by_job_id=1, pid=1044 2024-04-05T01:39:00.213212048Z [2024-04-05T01:39:00.212+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:39:00.236507956Z [2024-04-05T01:39:00.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:00.255002321Z [2024-04-05T01:39:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:00.266641491Z [2024-04-05T01:39:00.266+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:39:00.416501107Z [2024-04-05T01:39:00.416+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:39:00.416526663Z 2024-04-05T01:39:00.416533318Z 2024-04-05T01:39:00.416538836Z 2024-04-05T01:39:00.416544575Z 2024-04-05T01:39:00.416814692Z [2024-04-05T01:39:00.416+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:39:00.417164749Z [2024-04-05T01:39:00.416+0000] {scheduler_job.py:425} INFO - DAG vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:39:00.417505804Z [2024-04-05T01:39:00.417+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:39:00.417776314Z [2024-04-05T01:39:00.417+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:39:00.418948451Z [2024-04-05T01:39:00.418+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:39:00.418962156Z 2024-04-05T01:39:00.418965852Z 2024-04-05T01:39:00.418969135Z 2024-04-05T01:39:00.418972370Z 2024-04-05T01:39:00.423413030Z [2024-04-05T01:39:00.423+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:39:00.423893435Z [2024-04-05T01:39:00.423+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:39:00.424996952Z [2024-04-05T01:39:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:39:00.425388229Z [2024-04-05T01:39:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:39:00.425922069Z [2024-04-05T01:39:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:39:00.426238818Z [2024-04-05T01:39:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:39:00.426749746Z [2024-04-05T01:39:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:39:00.427127594Z [2024-04-05T01:39:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:39:01.056212420Z [2024-04-05T01:39:01.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:39:01.056352840Z [2024-04-05T01:39:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:39:01.056751137Z [2024-04-05T01:39:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:39:01.056912046Z [2024-04-05T01:39:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:39:01.092610952Z [2024-04-05T01:39:01.089+0000] {scheduler_job.py:635} INFO - Setting external_id for to 883b30c6-84db-4873-8756-8c3b7c304d75 2024-04-05T01:39:01.094034338Z [2024-04-05T01:39:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9861eb53-7734-46ac-a77c-ffeaeaf3af99 2024-04-05T01:39:01.094925998Z [2024-04-05T01:39:01.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb44b342-c361-4db2-8360-55cc55df6e5c 2024-04-05T01:39:01.095169030Z [2024-04-05T01:39:01.095+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65bfa653-ccc1-4639-b83d-c748d0a9d4d7 2024-04-05T01:39:09.774664418Z [2024-04-05T01:39:09.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:39:09.775859051Z [2024-04-05T01:39:09.775+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:39:00.285964+00:00, run_end_date=2024-04-05 01:39:09.775417+00:00, run_duration=9.489453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:39:00+00:00, dag_hash=8ffdadb56d8b76e58956f56c714bd249 2024-04-05T01:39:09.801627431Z [2024-04-05T01:39:09.801+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:11.015742812Z [2024-04-05T01:39:11.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:39:11.016150921Z [2024-04-05T01:39:11.015+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:39:00.280478+00:00, run_end_date=2024-04-05 01:39:11.015782+00:00, run_duration=10.735304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:39:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:39:11.026282379Z [2024-04-05T01:39:11.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:11.145794884Z [2024-04-05T01:39:11.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:39:11.146019445Z [2024-04-05T01:39:11.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:39:11.154969120Z [2024-04-05T01:39:11.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:39:06.631725+00:00, run_end_date=2024-04-05 01:39:09.558513+00:00, run_duration=2.926788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:39:00.419948+00:00, queued_by_job_id=1, pid=1061 2024-04-05T01:39:11.155471846Z [2024-04-05T01:39:11.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:39:08.166683+00:00, run_end_date=2024-04-05 01:39:10.077948+00:00, run_duration=1.911265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:39:00.419948+00:00, queued_by_job_id=1, pid=1089 2024-04-05T01:39:12.225599383Z [2024-04-05T01:39:12.225+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:39:12.226491669Z [2024-04-05T01:39:12.226+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:39:00.282245+00:00, run_end_date=2024-04-05 01:39:12.225945+00:00, run_duration=11.9437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:39:00+00:00, dag_hash=f15db48f5bf2fbe2775c35858c798a3a 2024-04-05T01:39:12.243297582Z [2024-04-05T01:39:12.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:12.252244176Z [2024-04-05T01:39:12.251+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:39:12.252409043Z [2024-04-05T01:39:12.252+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:39:00.283665+00:00, run_end_date=2024-04-05 01:39:12.252125+00:00, run_duration=11.96846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:39:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:39:12.262745218Z [2024-04-05T01:39:12.262+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:12.300767826Z [2024-04-05T01:39:12.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:39:12.300797567Z [2024-04-05T01:39:12.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:39:12.312400573Z [2024-04-05T01:39:12.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:39:08.546198+00:00, run_end_date=2024-04-05 01:39:11.059513+00:00, run_duration=2.513315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:39:00.419948+00:00, queued_by_job_id=1, pid=1099 2024-04-05T01:39:12.312423465Z [2024-04-05T01:39:12.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:39:09.384012+00:00, run_end_date=2024-04-05 01:39:12.051626+00:00, run_duration=2.667614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:39:00.419948+00:00, queued_by_job_id=1, pid=1109 2024-04-05T01:40:00.422768195Z [2024-04-05T01:40:00.421+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:40:00.442108903Z [2024-04-05T01:40:00.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:40:00.463841166Z [2024-04-05T01:40:00.463+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:00.474902239Z [2024-04-05T01:40:00.474+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:40:00.488268523Z [2024-04-05T01:40:00.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:00.502780987Z [2024-04-05T01:40:00.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:40:00.510595640Z [2024-04-05T01:40:00.510+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:40:00.669588020Z [2024-04-05T01:40:00.669+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-04-05T01:40:00.669643461Z 2024-04-05T01:40:00.669647503Z 2024-04-05T01:40:00.669650891Z 2024-04-05T01:40:00.669655034Z 2024-04-05T01:40:00.669658177Z 2024-04-05T01:40:00.669661482Z 2024-04-05T01:40:00.669664561Z 2024-04-05T01:40:00.669695383Z [2024-04-05T01:40:00.669+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:40:00.669699225Z [2024-04-05T01:40:00.669+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:40:00.669792127Z [2024-04-05T01:40:00.669+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:40:00.669866268Z [2024-04-05T01:40:00.669+0000] {scheduler_job.py:425} INFO - DAG vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:40:00.669927460Z [2024-04-05T01:40:00.669+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:40:00.670064030Z [2024-04-05T01:40:00.669+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:40:00.670184666Z [2024-04-05T01:40:00.670+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:40:00.670796150Z [2024-04-05T01:40:00.670+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:00.670803932Z 2024-04-05T01:40:00.670807137Z 2024-04-05T01:40:00.670817423Z 2024-04-05T01:40:00.670821067Z 2024-04-05T01:40:00.670824225Z 2024-04-05T01:40:00.670827447Z 2024-04-05T01:40:00.670830576Z 2024-04-05T01:40:00.676347418Z [2024-04-05T01:40:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:40:00.676414676Z [2024-04-05T01:40:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:00.676601396Z [2024-04-05T01:40:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:40:00.676688620Z [2024-04-05T01:40:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:00.676873888Z [2024-04-05T01:40:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:00.676946852Z [2024-04-05T01:40:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:40:00.677103231Z [2024-04-05T01:40:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:00.677203644Z [2024-04-05T01:40:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:40:00.677355873Z [2024-04-05T01:40:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:00.677462491Z [2024-04-05T01:40:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:40:00.677620230Z [2024-04-05T01:40:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:00.677699596Z [2024-04-05T01:40:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:40:00.677848414Z [2024-04-05T01:40:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:00.677928052Z [2024-04-05T01:40:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:40:01.688827047Z [2024-04-05T01:40:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.689002434Z [2024-04-05T01:40:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.689118837Z [2024-04-05T01:40:01.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.689225131Z [2024-04-05T01:40:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.689352248Z [2024-04-05T01:40:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.689540762Z [2024-04-05T01:40:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.689640464Z [2024-04-05T01:40:01.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.729177192Z [2024-04-05T01:40:01.728+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88a3e032-db0f-405c-8cef-366da27b345a 2024-04-05T01:40:01.729608293Z [2024-04-05T01:40:01.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cd4dd2a-924d-470f-99c5-1795c61a6d17 2024-04-05T01:40:01.729924464Z [2024-04-05T01:40:01.729+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7199215e-3549-4b5d-a4c9-061430bbf142 2024-04-05T01:40:01.730553525Z [2024-04-05T01:40:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24ad7a9c-0063-4913-b763-09a45f663fea 2024-04-05T01:40:01.730887620Z [2024-04-05T01:40:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 652f17f8-2023-406b-b7d4-2aa9a314575a 2024-04-05T01:40:01.731181806Z [2024-04-05T01:40:01.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4ba2447-f938-4056-b591-8d7be8cf6c6a 2024-04-05T01:40:01.731475835Z [2024-04-05T01:40:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ba41c3f-2b8f-47df-8c79-33eb7fa5929e 2024-04-05T01:40:07.592338942Z [2024-04-05T01:40:07.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:07.600268595Z [2024-04-05T01:40:07.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:05.936392+00:00, run_end_date=2024-04-05 01:40:07.298379+00:00, run_duration=1.361987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:00.671986+00:00, queued_by_job_id=1, pid=1151 2024-04-05T01:40:08.950919874Z [2024-04-05T01:40:08.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:08.956152890Z [2024-04-05T01:40:08.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:40:00.526874+00:00, run_end_date=2024-04-05 01:40:08.955370+00:00, run_duration=8.428496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:40:09.063031885Z [2024-04-05T01:40:09.062+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:40:13.921904184Z [2024-04-05T01:40:13.877+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:13.921958157Z 2024-04-05T01:40:13.930490659Z [2024-04-05T01:40:13.921+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:40:13.956460223Z [2024-04-05T01:40:13.955+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:13.956494822Z 2024-04-05T01:40:13.986993067Z [2024-04-05T01:40:13.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:40:13.988560399Z [2024-04-05T01:40:13.988+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:14.422136159Z [2024-04-05T01:40:14.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:14.422543724Z [2024-04-05T01:40:14.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:14.436710452Z [2024-04-05T01:40:14.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c489db8-2d4f-4494-947f-ee804f8b243d 2024-04-05T01:40:14.437071286Z [2024-04-05T01:40:14.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:09.784591+00:00, run_end_date=2024-04-05 01:40:13.603178+00:00, run_duration=3.818587, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:00.671986+00:00, queued_by_job_id=1, pid=1198 2024-04-05T01:40:14.538858370Z [2024-04-05T01:40:14.538+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:14.539307784Z [2024-04-05T01:40:14.539+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:39:00+00:00, run_id=scheduled__2024-04-05T01:39:00+00:00, run_start_date=2024-04-05 01:40:00.530170+00:00, run_end_date=2024-04-05 01:40:14.538896+00:00, run_duration=14.008726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:39:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=8ffdadb56d8b76e58956f56c714bd249 2024-04-05T01:40:14.725220170Z [2024-04-05T01:40:14.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:14.783468971Z [2024-04-05T01:40:14.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:14.786825096Z [2024-04-05T01:40:14.786+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:39:00+00:00, run_id=scheduled__2024-04-05T01:39:00+00:00, run_start_date=2024-04-05 01:40:00.531159+00:00, run_end_date=2024-04-05 01:40:14.785089+00:00, run_duration=14.25393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:39:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:40:14.862121059Z [2024-04-05T01:40:14.861+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:15.395250256Z [2024-04-05T01:40:15.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:15.444090495Z [2024-04-05T01:40:15.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:39:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:09.483293+00:00, run_end_date=2024-04-05 01:40:13.774472+00:00, run_duration=4.291179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:00.671986+00:00, queued_by_job_id=1, pid=1189 2024-04-05T01:40:17.092507175Z [2024-04-05T01:40:17.078+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:17.092526764Z 2024-04-05T01:40:17.093024501Z [2024-04-05T01:40:17.092+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:40:17.093799210Z [2024-04-05T01:40:17.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:17.093811424Z 2024-04-05T01:40:17.109277589Z [2024-04-05T01:40:17.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='split_metrics', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:40:17.135569114Z [2024-04-05T01:40:17.135+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'split_metrics', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:17.399107543Z [2024-04-05T01:40:17.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.split_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:17.406513982Z [2024-04-05T01:40:17.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:17.406591164Z [2024-04-05T01:40:17.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:17.406754686Z [2024-04-05T01:40:17.406+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:17.539329273Z [2024-04-05T01:40:17.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:39:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:09.559186+00:00, run_end_date=2024-04-05 01:40:14.310106+00:00, run_duration=4.75092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:00.671986+00:00, queued_by_job_id=1, pid=1190 2024-04-05T01:40:17.539456107Z [2024-04-05T01:40:17.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:14.472081+00:00, run_end_date=2024-04-05 01:40:16.361106+00:00, run_duration=1.889025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:00.671986+00:00, queued_by_job_id=1, pid=1259 2024-04-05T01:40:17.539656407Z [2024-04-05T01:40:17.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fc9bb33-0a2a-4eae-84c4-4edb5cfc80a9 2024-04-05T01:40:17.539786602Z [2024-04-05T01:40:17.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:39:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:14.140900+00:00, run_end_date=2024-04-05 01:40:16.066580+00:00, run_duration=1.92568, state=up_for_retry, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:00.671986+00:00, queued_by_job_id=1, pid=1254 2024-04-05T01:40:19.336004102Z [2024-04-05T01:40:19.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:19.336415056Z [2024-04-05T01:40:19.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:39:00+00:00, run_id=scheduled__2024-04-05T01:39:00+00:00, run_start_date=2024-04-05 01:40:00.532105+00:00, run_end_date=2024-04-05 01:40:19.336042+00:00, run_duration=18.803937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:39:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:40:19.353424948Z [2024-04-05T01:40:19.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:19.516036081Z [2024-04-05T01:40:19.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:19.539436392Z [2024-04-05T01:40:19.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:39:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:15.802598+00:00, run_end_date=2024-04-05 01:40:18.833685+00:00, run_duration=3.031087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:00.671986+00:00, queued_by_job_id=1, pid=1278 2024-04-05T01:40:20.855527869Z [2024-04-05T01:40:20.855+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:20.855544024Z 2024-04-05T01:40:20.855593203Z [2024-04-05T01:40:20.855+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:40:20.856165840Z [2024-04-05T01:40:20.855+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:20.856181691Z 2024-04-05T01:40:20.863852500Z [2024-04-05T01:40:20.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:40:20.864003563Z [2024-04-05T01:40:20.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:40:20.935020782Z [2024-04-05T01:40:20.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:20.935126280Z [2024-04-05T01:40:20.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:20.935188507Z [2024-04-05T01:40:20.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.split_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status failed for try_number 1 2024-04-05T01:40:20.945899452Z [2024-04-05T01:40:20.945+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7c9f04e-0519-4f7f-89a9-314099695fd9 2024-04-05T01:40:20.946005600Z [2024-04-05T01:40:20.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=split_metrics, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:17.094588+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:40:20.946625142Z [2024-04-05T01:40:20.946+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:40:20.951735487Z [2024-04-05T01:40:20.951+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:40:20.967971136Z [2024-04-05T01:40:20.967+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=split_metrics, execution_date=20240405T013500, start_date=, end_date=20240405T014020 2024-04-05T01:40:20.979498206Z [2024-04-05T01:40:20.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:19.723163+00:00, run_end_date=2024-04-05 01:40:20.269444+00:00, run_duration=0.546281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:13.956511+00:00, queued_by_job_id=1, pid=1303 2024-04-05T01:40:24.563655257Z [2024-04-05T01:40:24.563+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:24.563679735Z 2024-04-05T01:40:24.563778745Z [2024-04-05T01:40:24.563+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:40:24.565171080Z [2024-04-05T01:40:24.564+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:24.565188398Z 2024-04-05T01:40:24.567733104Z [2024-04-05T01:40:24.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:24.567760405Z [2024-04-05T01:40:24.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:24.691081544Z [2024-04-05T01:40:24.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:24.691100328Z [2024-04-05T01:40:24.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:24.696964579Z [2024-04-05T01:40:24.696+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=0, run_start_date=2024-04-05 01:40:23.669682+00:00, run_end_date=2024-04-05 01:40:24.089402+00:00, run_duration=0.41972, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:20.856450+00:00, queued_by_job_id=1, pid=1333 2024-04-05T01:40:24.697118320Z [2024-04-05T01:40:24.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb6da627-1786-4616-bb5f-15d210d1c381 2024-04-05T01:40:27.148920262Z [2024-04-05T01:40:27.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:27.149096407Z [2024-04-05T01:40:27.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:40:00.523528+00:00, run_end_date=2024-04-05 01:40:27.148846+00:00, run_duration=26.625318, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T01:40:27.161255309Z [2024-04-05T01:40:27.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:40:27.281289290Z [2024-04-05T01:40:27.277+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:27.281309060Z 2024-04-05T01:40:27.281469088Z [2024-04-05T01:40:27.281+0000] {scheduler_job.py:425} INFO - DAG vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:40:27.282058318Z [2024-04-05T01:40:27.281+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:27.282069665Z 2024-04-05T01:40:27.284357905Z [2024-04-05T01:40:27.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:39:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:27.284483356Z [2024-04-05T01:40:27.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:40:27.370248020Z [2024-04-05T01:40:27.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status queued for try_number 2 2024-04-05T01:40:27.370731250Z [2024-04-05T01:40:27.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:27.377774780Z [2024-04-05T01:40:27.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:26.712960+00:00, run_end_date=2024-04-05 01:40:27.104877+00:00, run_duration=0.391917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:24.565457+00:00, queued_by_job_id=1, pid=1345 2024-04-05T01:40:27.378049861Z [2024-04-05T01:40:27.377+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b61b1d9-23b5-45d0-88b9-da1e61e1e648 2024-04-05T01:40:29.800414936Z [2024-04-05T01:40:29.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status failed for try_number 2 2024-04-05T01:40:29.813830791Z [2024-04-05T01:40:29.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:39:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:14.140900+00:00, run_end_date=2024-04-05 01:40:16.066580+00:00, run_duration=1.92568, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:27.282372+00:00, queued_by_job_id=1, pid=1254 2024-04-05T01:40:29.814740397Z [2024-04-05T01:40:29.814+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:40:29.818752879Z [2024-04-05T01:40:29.818+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:40:29.841246986Z [2024-04-05T01:40:29.839+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T013900, start_date=20240405T014014, end_date=20240405T014029 2024-04-05T01:40:30.924123755Z [2024-04-05T01:40:30.923+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:40:30.924576026Z [2024-04-05T01:40:30.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:39:00+00:00, run_id=scheduled__2024-04-05T01:39:00+00:00, run_start_date=2024-04-05 01:40:00.528326+00:00, run_end_date=2024-04-05 01:40:30.924205+00:00, run_duration=30.395879, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:39:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=f15db48f5bf2fbe2775c35858c798a3a 2024-04-05T01:40:30.950568678Z [2024-04-05T01:40:30.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:31.173870597Z [2024-04-05T01:40:31.173+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:31.173902567Z 2024-04-05T01:40:31.173977055Z [2024-04-05T01:40:31.173+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:40:31.175404165Z [2024-04-05T01:40:31.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:31.175431108Z 2024-04-05T01:40:31.179224932Z [2024-04-05T01:40:31.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='split_metrics', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=2, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:40:31.179468426Z [2024-04-05T01:40:31.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'split_metrics', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:31.256073420Z [2024-04-05T01:40:31.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.split_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 2 2024-04-05T01:40:31.265287339Z [2024-04-05T01:40:31.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dbb9fb8-a05c-4f21-8c6d-8058f9c50661 2024-04-05T01:40:33.672494447Z [2024-04-05T01:40:33.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.split_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status failed for try_number 2 2024-04-05T01:40:33.687647528Z [2024-04-05T01:40:33.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=split_metrics, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:40:20.954416+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:31.176374+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:40:33.688102338Z [2024-04-05T01:40:33.687+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:40:33.697795692Z [2024-04-05T01:40:33.697+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:40:33.722902365Z [2024-04-05T01:40:33.722+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=split_metrics, execution_date=20240405T013500, start_date=, end_date=20240405T014033 2024-04-05T01:40:36.339334289Z [2024-04-05T01:40:36.338+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:40:36.340623447Z [2024-04-05T01:40:36.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:40:00.525606+00:00, run_end_date=2024-04-05 01:40:36.339251+00:00, run_duration=35.813645, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=a79ee3445e43d67c4c5d622c3c43b1ed 2024-04-05T01:40:36.346830024Z [2024-04-05T01:40:36.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:41:00.834237670Z [2024-04-05T01:41:00.829+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:41:00.854097824Z [2024-04-05T01:41:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:00.879301570Z [2024-04-05T01:41:00.877+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:41:00.904286605Z [2024-04-05T01:41:00.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:01.094648595Z [2024-04-05T01:41:01.094+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:41:01.094672969Z 2024-04-05T01:41:01.094677011Z 2024-04-05T01:41:01.094680500Z 2024-04-05T01:41:01.094684109Z 2024-04-05T01:41:01.095662668Z [2024-04-05T01:41:01.094+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:41:01.095948127Z [2024-04-05T01:41:01.095+0000] {scheduler_job.py:425} INFO - DAG vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:41:01.096158898Z [2024-04-05T01:41:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:41:01.096343902Z [2024-04-05T01:41:01.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:41:01.097593317Z [2024-04-05T01:41:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:41:01.097673123Z 2024-04-05T01:41:01.097680385Z 2024-04-05T01:41:01.097719981Z 2024-04-05T01:41:01.097724646Z 2024-04-05T01:41:01.106682290Z [2024-04-05T01:41:01.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:01.106931629Z [2024-04-05T01:41:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:41:01.107730553Z [2024-04-05T01:41:01.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:01.107939138Z [2024-04-05T01:41:01.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:41:01.108235963Z [2024-04-05T01:41:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:01.108458581Z [2024-04-05T01:41:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:41:01.108781001Z [2024-04-05T01:41:01.108+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:01.109043595Z [2024-04-05T01:41:01.108+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:41:01.640187758Z [2024-04-05T01:41:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:41:01.640219803Z [2024-04-05T01:41:01.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:41:01.640276292Z [2024-04-05T01:41:01.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:41:01.640330987Z [2024-04-05T01:41:01.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:41:01.661561347Z [2024-04-05T01:41:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to be735e90-5924-40bc-83ee-82971a0d35e8 2024-04-05T01:41:01.661665969Z [2024-04-05T01:41:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e896e93-7929-4293-9824-0126bd0bf025 2024-04-05T01:41:01.661783814Z [2024-04-05T01:41:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94a564f0-8817-4027-8e3e-820138db0da4 2024-04-05T01:41:01.661919408Z [2024-04-05T01:41:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27e8a119-2e73-47d8-b41e-20b36bf696e3 2024-04-05T01:41:07.036155757Z [2024-04-05T01:41:07.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status failed for try_number 1 2024-04-05T01:41:07.092488023Z [2024-04-05T01:41:07.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:01.101497+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:41:07.113538444Z [2024-04-05T01:41:07.113+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:41:07.129186472Z [2024-04-05T01:41:07.125+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:41:07.215366616Z [2024-04-05T01:41:07.215+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T014000, start_date=, end_date=20240405T014107 2024-04-05T01:41:08.701297116Z [2024-04-05T01:41:08.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status failed for try_number 1 2024-04-05T01:41:08.716791318Z [2024-04-05T01:41:08.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:01.101497+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:41:08.718737951Z [2024-04-05T01:41:08.718+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:41:08.734975438Z [2024-04-05T01:41:08.733+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:41:08.769324966Z [2024-04-05T01:41:08.769+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T014000, start_date=, end_date=20240405T014108 2024-04-05T01:41:09.845312108Z [2024-04-05T01:41:09.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:41:09.845755937Z [2024-04-05T01:41:09.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:41:00.943491+00:00, run_end_date=2024-04-05 01:41:09.845224+00:00, run_duration=8.901733, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:41:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:41:09.857361283Z [2024-04-05T01:41:09.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:10.987419379Z [2024-04-05T01:41:10.987+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:41:10.987604638Z [2024-04-05T01:41:10.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:41:00.936351+00:00, run_end_date=2024-04-05 01:41:10.987317+00:00, run_duration=10.050966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:41:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:41:11.013876280Z [2024-04-05T01:41:11.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:11.122233144Z [2024-04-05T01:41:11.110+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:41:11.122297049Z [2024-04-05T01:41:11.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:41:11.122302041Z [2024-04-05T01:41:11.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:41:07.403061+00:00, run_end_date=2024-04-05 01:41:09.752594+00:00, run_duration=2.349533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:01.101497+00:00, queued_by_job_id=1, pid=1431 2024-04-05T01:41:11.122305496Z [2024-04-05T01:41:11.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:41:07.206508+00:00, run_end_date=2024-04-05 01:41:10.372178+00:00, run_duration=3.16567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:01.101497+00:00, queued_by_job_id=1, pid=1430 2024-04-05T01:41:17.573252098Z [2024-04-05T01:41:17.572+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:41:17.573350495Z 2024-04-05T01:41:17.573454757Z [2024-04-05T01:41:17.573+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:41:17.574344059Z [2024-04-05T01:41:17.574+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:41:17.574361175Z 2024-04-05T01:41:17.579027545Z [2024-04-05T01:41:17.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:17.588428984Z [2024-04-05T01:41:17.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:41:17.646726366Z [2024-04-05T01:41:17.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 2 2024-04-05T01:41:17.653903412Z [2024-04-05T01:41:17.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27771107-e775-4d17-abdd-24434373b6da 2024-04-05T01:41:18.851997361Z [2024-04-05T01:41:18.851+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:41:18.852018982Z 2024-04-05T01:41:18.852207676Z [2024-04-05T01:41:18.851+0000] {scheduler_job.py:425} INFO - DAG vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f has 0/16 running and queued tasks 2024-04-05T01:41:18.852997511Z [2024-04-05T01:41:18.852+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:41:18.853011624Z 2024-04-05T01:41:18.855725778Z [2024-04-05T01:41:18.855+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:18.855922923Z [2024-04-05T01:41:18.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:41:18.957959042Z [2024-04-05T01:41:18.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 2 2024-04-05T01:41:18.970146017Z [2024-04-05T01:41:18.969+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7adb4df-683c-4298-909d-37ff3bb5e86a 2024-04-05T01:41:20.158803513Z [2024-04-05T01:41:20.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status failed for try_number 2 2024-04-05T01:41:20.167571963Z [2024-04-05T01:41:20.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:41:07.140968+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:17.576428+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:41:20.168239964Z [2024-04-05T01:41:20.168+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:41:20.171565369Z [2024-04-05T01:41:20.171+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:41:20.192514419Z [2024-04-05T01:41:20.192+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T014000, start_date=, end_date=20240405T014120 2024-04-05T01:41:20.889880059Z [2024-04-05T01:41:20.889+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:41:20.890467133Z [2024-04-05T01:41:20.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:41:00.941107+00:00, run_end_date=2024-04-05 01:41:20.889953+00:00, run_duration=19.948846, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:41:00+00:00, dag_hash=8ffdadb56d8b76e58956f56c714bd249 2024-04-05T01:41:20.903836125Z [2024-04-05T01:41:20.903+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:22.031237468Z [2024-04-05T01:41:22.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status failed for try_number 2 2024-04-05T01:41:22.037688502Z [2024-04-05T01:41:22.037+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:41:08.746715+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:18.853372+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:41:22.038234848Z [2024-04-05T01:41:22.037+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:41:22.040533346Z [2024-04-05T01:41:22.040+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:41:22.053247317Z [2024-04-05T01:41:22.052+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T014000, start_date=, end_date=20240405T014122 2024-04-05T01:41:22.821371251Z [2024-04-05T01:41:22.821+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:41:22.821848491Z [2024-04-05T01:41:22.821+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:41:00.938810+00:00, run_end_date=2024-04-05 01:41:22.821486+00:00, run_duration=21.882676, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:41:00+00:00, dag_hash=f15db48f5bf2fbe2775c35858c798a3a 2024-04-05T01:41:22.852124624Z [2024-04-05T01:41:22.851+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_6b2ef9dc-50c2-4aa4-850c-b852e17d353f to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:42.876508992Z [2024-04-05T01:41:42.876+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:42:00.828515825Z [2024-04-05T01:42:00.828+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:42:00.843967611Z [2024-04-05T01:42:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:43:00+00:00 2024-04-05T01:42:00.853720768Z [2024-04-05T01:42:00.853+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:42:00.951658281Z [2024-04-05T01:42:00.951+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:42:00.951694853Z 2024-04-05T01:42:00.951702479Z 2024-04-05T01:42:00.951705821Z 2024-04-05T01:42:00.951860733Z [2024-04-05T01:42:00.951+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:42:00.952022778Z [2024-04-05T01:42:00.951+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:42:00.952260231Z [2024-04-05T01:42:00.952+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:42:00.953036795Z [2024-04-05T01:42:00.952+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:42:00.953050910Z 2024-04-05T01:42:00.953054710Z 2024-04-05T01:42:00.953057893Z 2024-04-05T01:42:00.959188746Z [2024-04-05T01:42:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:42:00.959474857Z [2024-04-05T01:42:00.959+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:42:00.959882578Z [2024-04-05T01:42:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:42:00.960227449Z [2024-04-05T01:42:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:42:00.960571268Z [2024-04-05T01:42:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:42:00.960876738Z [2024-04-05T01:42:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:42:01.411705734Z [2024-04-05T01:42:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:42:01.417749514Z [2024-04-05T01:42:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status queued for try_number 1 2024-04-05T01:42:01.418318015Z [2024-04-05T01:42:01.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status queued for try_number 1 2024-04-05T01:42:01.432613635Z [2024-04-05T01:42:01.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22863b4a-8ed0-4a53-85fc-abb269fc3161 2024-04-05T01:42:01.435237792Z [2024-04-05T01:42:01.432+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee181f7f-a907-41bb-a96b-3e9febadd1e0 2024-04-05T01:42:01.435644923Z [2024-04-05T01:42:01.435+0000] {scheduler_job.py:635} INFO - Setting external_id for to 226e666b-c39b-4518-b29f-7dbb9dec673b 2024-04-05T01:42:05.139707363Z [2024-04-05T01:42:05.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:42:05.145109779Z [2024-04-05T01:42:05.144+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:42:00.870481+00:00, run_end_date=2024-04-05 01:42:05.142176+00:00, run_duration=4.271695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:42:05.222021650Z [2024-04-05T01:42:05.210+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:42:05.457481001Z [2024-04-05T01:42:05.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:42:05.468314510Z [2024-04-05T01:42:05.467+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:42:03.323705+00:00, run_end_date=2024-04-05 01:42:04.354403+00:00, run_duration=1.030698, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:42:00.954209+00:00, queued_by_job_id=1, pid=1523 2024-04-05T01:42:08.961956661Z [2024-04-05T01:42:08.961+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:42:08.962410003Z [2024-04-05T01:42:08.962+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:41:00+00:00, run_id=scheduled__2024-04-05T01:41:00+00:00, run_start_date=2024-04-05 01:42:00.876958+00:00, run_end_date=2024-04-05 01:42:08.961871+00:00, run_duration=8.084913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:41:00+00:00, data_interval_end=2024-04-05 01:42:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:42:08.972404770Z [2024-04-05T01:42:08.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:43:00+00:00 2024-04-05T01:42:09.015060341Z [2024-04-05T01:42:09.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status success for try_number 1 2024-04-05T01:42:09.023553573Z [2024-04-05T01:42:09.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:41:00+00:00, map_index=-1, run_start_date=2024-04-05 01:42:06.596337+00:00, run_end_date=2024-04-05 01:42:08.681746+00:00, run_duration=2.085409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:42:00.954209+00:00, queued_by_job_id=1, pid=1544 2024-04-05T01:42:10.113858731Z [2024-04-05T01:42:10.113+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:42:10.114678481Z [2024-04-05T01:42:10.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:41:00+00:00, run_id=scheduled__2024-04-05T01:41:00+00:00, run_start_date=2024-04-05 01:42:00.873911+00:00, run_end_date=2024-04-05 01:42:10.113778+00:00, run_duration=9.239867, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:41:00+00:00, data_interval_end=2024-04-05 01:42:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:42:10.129952856Z [2024-04-05T01:42:10.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:43:00+00:00 2024-04-05T01:42:10.171076554Z [2024-04-05T01:42:10.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status success for try_number 1 2024-04-05T01:42:10.177248141Z [2024-04-05T01:42:10.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:41:00+00:00, map_index=-1, run_start_date=2024-04-05 01:42:07.991266+00:00, run_end_date=2024-04-05 01:42:09.794177+00:00, run_duration=1.802911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:42:00.954209+00:00, queued_by_job_id=1, pid=1563 2024-04-05T01:43:00.883179634Z [2024-04-05T01:43:00.882+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:43:00.898467348Z [2024-04-05T01:43:00.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:43:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:43:00.956956803Z [2024-04-05T01:43:00.956+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:43:00.957012857Z 2024-04-05T01:43:00.957020842Z 2024-04-05T01:43:00.957167197Z [2024-04-05T01:43:00.956+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:43:00.957321184Z [2024-04-05T01:43:00.957+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:43:00.958123919Z [2024-04-05T01:43:00.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:43:00.958139097Z 2024-04-05T01:43:00.958143031Z 2024-04-05T01:43:00.961921885Z [2024-04-05T01:43:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:43:00.962276591Z [2024-04-05T01:43:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:43:00.962742144Z [2024-04-05T01:43:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:43:00.962955376Z [2024-04-05T01:43:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:43:01.243637874Z [2024-04-05T01:43:01.242+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status queued for try_number 1 2024-04-05T01:43:01.243790463Z [2024-04-05T01:43:01.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status queued for try_number 1 2024-04-05T01:43:01.256151811Z [2024-04-05T01:43:01.255+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fa711a8-21a3-4dfa-b0e6-3f8bced64796 2024-04-05T01:43:01.256428041Z [2024-04-05T01:43:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0b944ee-6858-4aaf-ae8c-e2b4ce60de47 2024-04-05T01:43:07.771194940Z [2024-04-05T01:43:07.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:43:07.771730394Z [2024-04-05T01:43:07.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:42:00+00:00, run_id=scheduled__2024-04-05T01:42:00+00:00, run_start_date=2024-04-05 01:43:00.913781+00:00, run_end_date=2024-04-05 01:43:07.771309+00:00, run_duration=6.857528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:42:00+00:00, data_interval_end=2024-04-05 01:43:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:43:07.789229946Z [2024-04-05T01:43:07.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:43:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:43:07.870219699Z [2024-04-05T01:43:07.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status success for try_number 1 2024-04-05T01:43:07.880836194Z [2024-04-05T01:43:07.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:42:00+00:00, map_index=-1, run_start_date=2024-04-05 01:43:04.424720+00:00, run_end_date=2024-04-05 01:43:07.537758+00:00, run_duration=3.113038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:43:00.958745+00:00, queued_by_job_id=1, pid=1599 2024-04-05T01:43:08.945652440Z [2024-04-05T01:43:08.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:43:08.946223746Z [2024-04-05T01:43:08.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:42:00+00:00, run_id=scheduled__2024-04-05T01:42:00+00:00, run_start_date=2024-04-05 01:43:00.912123+00:00, run_end_date=2024-04-05 01:43:08.945552+00:00, run_duration=8.033429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:42:00+00:00, data_interval_end=2024-04-05 01:43:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:43:08.958924926Z [2024-04-05T01:43:08.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:43:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:43:09.012823123Z [2024-04-05T01:43:09.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status success for try_number 1 2024-04-05T01:43:09.025068379Z [2024-04-05T01:43:09.023+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:42:00+00:00, map_index=-1, run_start_date=2024-04-05 01:43:05.159044+00:00, run_end_date=2024-04-05 01:43:08.560914+00:00, run_duration=3.40187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:43:00.958745+00:00, queued_by_job_id=1, pid=1618 2024-04-05T01:44:00.904847471Z [2024-04-05T01:44:00.904+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:44:00.926893694Z [2024-04-05T01:44:00.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:44:00.936214671Z [2024-04-05T01:44:00.935+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:44:01.015625179Z [2024-04-05T01:44:01.015+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:44:01.015665396Z 2024-04-05T01:44:01.015670224Z 2024-04-05T01:44:01.015674828Z 2024-04-05T01:44:01.016064088Z [2024-04-05T01:44:01.015+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:44:01.016428173Z [2024-04-05T01:44:01.016+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:44:01.016630573Z [2024-04-05T01:44:01.016+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:44:01.017248775Z [2024-04-05T01:44:01.017+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:44:01.017260865Z 2024-04-05T01:44:01.017266463Z 2024-04-05T01:44:01.017271265Z 2024-04-05T01:44:01.020803050Z [2024-04-05T01:44:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:44:01.020994412Z [2024-04-05T01:44:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:44:01.021622659Z [2024-04-05T01:44:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:44:01.021875224Z [2024-04-05T01:44:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:44:01.022357831Z [2024-04-05T01:44:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:44:01.023266872Z [2024-04-05T01:44:01.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:44:01.395177854Z [2024-04-05T01:44:01.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status queued for try_number 1 2024-04-05T01:44:01.396759891Z [2024-04-05T01:44:01.395+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status queued for try_number 1 2024-04-05T01:44:01.397111034Z [2024-04-05T01:44:01.396+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status queued for try_number 1 2024-04-05T01:44:01.410092553Z [2024-04-05T01:44:01.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf28b7d2-9c63-4833-8a97-6e12c2c00c32 2024-04-05T01:44:01.410366227Z [2024-04-05T01:44:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b6d92ac-a804-4467-a530-970566e8e99d 2024-04-05T01:44:01.410890427Z [2024-04-05T01:44:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to e209cb22-05f7-4ef2-9316-620cb463316e 2024-04-05T01:44:03.981797279Z [2024-04-05T01:44:03.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:44:03.982789795Z [2024-04-05T01:44:03.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:42:00+00:00, run_id=scheduled__2024-04-05T01:42:00+00:00, run_start_date=2024-04-05 01:44:00.952664+00:00, run_end_date=2024-04-05 01:44:03.981958+00:00, run_duration=3.029294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:42:00+00:00, data_interval_end=2024-04-05 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:44:04.004024916Z [2024-04-05T01:44:03.996+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:44:04.144061552Z [2024-04-05T01:44:04.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status success for try_number 1 2024-04-05T01:44:04.216084230Z [2024-04-05T01:44:04.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:42:00+00:00, map_index=-1, run_start_date=2024-04-05 01:44:02.228465+00:00, run_end_date=2024-04-05 01:44:03.473570+00:00, run_duration=1.245105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:44:01.017995+00:00, queued_by_job_id=1, pid=1644 2024-04-05T01:44:09.063814848Z [2024-04-05T01:44:09.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:44:09.065031442Z [2024-04-05T01:44:09.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:43:00+00:00, run_id=scheduled__2024-04-05T01:43:00+00:00, run_start_date=2024-04-05 01:44:00.954130+00:00, run_end_date=2024-04-05 01:44:09.064017+00:00, run_duration=8.109887, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:43:00+00:00, data_interval_end=2024-04-05 01:44:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:44:09.079456579Z [2024-04-05T01:44:09.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:44:09.088667902Z [2024-04-05T01:44:09.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:44:09.089636482Z [2024-04-05T01:44:09.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:43:00+00:00, run_id=scheduled__2024-04-05T01:43:00+00:00, run_start_date=2024-04-05 01:44:00.955288+00:00, run_end_date=2024-04-05 01:44:09.088767+00:00, run_duration=8.133479, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:43:00+00:00, data_interval_end=2024-04-05 01:44:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:44:09.110176136Z [2024-04-05T01:44:09.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:44:09.158838245Z [2024-04-05T01:44:09.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status success for try_number 1 2024-04-05T01:44:09.159051331Z [2024-04-05T01:44:09.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status success for try_number 1 2024-04-05T01:44:09.172427607Z [2024-04-05T01:44:09.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:43:00+00:00, map_index=-1, run_start_date=2024-04-05 01:44:06.583391+00:00, run_end_date=2024-04-05 01:44:08.699730+00:00, run_duration=2.116339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:44:01.017995+00:00, queued_by_job_id=1, pid=1675 2024-04-05T01:44:09.172876118Z [2024-04-05T01:44:09.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:43:00+00:00, map_index=-1, run_start_date=2024-04-05 01:44:06.412107+00:00, run_end_date=2024-04-05 01:44:08.248989+00:00, run_duration=1.836882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:44:01.017995+00:00, queued_by_job_id=1, pid=1674 2024-04-05T01:45:00.614964168Z [2024-04-05T01:45:00.614+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:45:00.634806837Z [2024-04-05T01:45:00.634+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:45:00.651838804Z [2024-04-05T01:45:00.651+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:45:00.788816233Z [2024-04-05T01:45:00.785+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:45:00.788851295Z 2024-04-05T01:45:00.788856324Z 2024-04-05T01:45:00.788859987Z 2024-04-05T01:45:00.788863388Z [2024-04-05T01:45:00.785+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:45:00.788866705Z [2024-04-05T01:45:00.786+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:45:00.788870076Z [2024-04-05T01:45:00.786+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:45:00.788874195Z [2024-04-05T01:45:00.786+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:45:00.788877414Z 2024-04-05T01:45:00.788880910Z 2024-04-05T01:45:00.788883977Z 2024-04-05T01:45:00.792547683Z [2024-04-05T01:45:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:45:00.792568158Z [2024-04-05T01:45:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:45:00.792572091Z [2024-04-05T01:45:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:45:00.792615454Z [2024-04-05T01:45:00.791+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:45:00.794060774Z [2024-04-05T01:45:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:45:00.794079295Z [2024-04-05T01:45:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:45:01.138384717Z [2024-04-05T01:45:01.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:01.138478697Z [2024-04-05T01:45:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:01.138534008Z [2024-04-05T01:45:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:01.153862862Z [2024-04-05T01:45:01.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to f48f3ad5-9066-40aa-9803-537db95fea6e 2024-04-05T01:45:01.154156583Z [2024-04-05T01:45:01.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to abdaf94d-a36b-470f-883f-a0f0795c869d 2024-04-05T01:45:01.154358574Z [2024-04-05T01:45:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cdba2b6-2fb9-4f8d-b3c6-1631e5be4c2f 2024-04-05T01:45:06.793518828Z [2024-04-05T01:45:06.792+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:45:06.793558521Z 2024-04-05T01:45:06.793565252Z [2024-04-05T01:45:06.793+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:45:06.806077465Z [2024-04-05T01:45:06.802+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:45:06.806115221Z 2024-04-05T01:45:06.823654823Z [2024-04-05T01:45:06.823+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:45:06.824789239Z [2024-04-05T01:45:06.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:45:07.128748283Z [2024-04-05T01:45:07.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:07.135007539Z [2024-04-05T01:45:07.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:07.214055660Z [2024-04-05T01:45:07.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:04.849462+00:00, run_end_date=2024-04-05 01:45:06.465851+00:00, run_duration=1.616389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:00.787632+00:00, queued_by_job_id=1, pid=1731 2024-04-05T01:45:07.214614159Z [2024-04-05T01:45:07.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to aca20cbd-906f-4896-bb42-da30bfc7214d 2024-04-05T01:45:09.297089616Z [2024-04-05T01:45:09.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:45:09.306866612Z [2024-04-05T01:45:09.306+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:44:00+00:00, run_id=scheduled__2024-04-05T01:44:00+00:00, run_start_date=2024-04-05 01:45:00.676020+00:00, run_end_date=2024-04-05 01:45:09.306121+00:00, run_duration=8.630101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:44:00+00:00, data_interval_end=2024-04-05 01:45:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:45:09.481007887Z [2024-04-05T01:45:09.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:45:09.527122707Z [2024-04-05T01:45:09.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:45:09.528452645Z [2024-04-05T01:45:09.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:44:00+00:00, run_id=scheduled__2024-04-05T01:44:00+00:00, run_start_date=2024-04-05 01:45:00.677297+00:00, run_end_date=2024-04-05 01:45:09.527081+00:00, run_duration=8.849784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:44:00+00:00, data_interval_end=2024-04-05 01:45:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:45:09.557168034Z [2024-04-05T01:45:09.556+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:45:09.639111663Z [2024-04-05T01:45:09.637+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:09.639876849Z [2024-04-05T01:45:09.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:09.657849235Z [2024-04-05T01:45:09.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:44:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:05.610225+00:00, run_end_date=2024-04-05 01:45:08.340338+00:00, run_duration=2.730113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:00.787632+00:00, queued_by_job_id=1, pid=1741 2024-04-05T01:45:09.658607463Z [2024-04-05T01:45:09.658+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:44:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:05.978527+00:00, run_end_date=2024-04-05 01:45:08.922374+00:00, run_duration=2.943847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:00.787632+00:00, queued_by_job_id=1, pid=1742 2024-04-05T01:45:14.479462878Z [2024-04-05T01:45:14.479+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:45:14.479503130Z 2024-04-05T01:45:14.479561954Z [2024-04-05T01:45:14.479+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:45:14.480325423Z [2024-04-05T01:45:14.480+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:45:14.480340833Z 2024-04-05T01:45:14.484809175Z [2024-04-05T01:45:14.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:45:14.484917047Z [2024-04-05T01:45:14.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:45:14.663529870Z [2024-04-05T01:45:14.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:14.663563274Z [2024-04-05T01:45:14.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:14.687415630Z [2024-04-05T01:45:14.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:12.272889+00:00, run_end_date=2024-04-05 01:45:13.239897+00:00, run_duration=0.967008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:06.813849+00:00, queued_by_job_id=1, pid=1790 2024-04-05T01:45:14.688310870Z [2024-04-05T01:45:14.687+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d646c7e-df46-4051-aac7-c71db7adfb56 2024-04-05T01:45:20.744865588Z [2024-04-05T01:45:20.723+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:45:20.744876232Z 2024-04-05T01:45:20.744880156Z [2024-04-05T01:45:20.730+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:45:20.744883893Z [2024-04-05T01:45:20.731+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:45:20.744886962Z 2024-04-05T01:45:20.766049467Z [2024-04-05T01:45:20.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:45:20.766061354Z [2024-04-05T01:45:20.749+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:45:20.861797274Z [2024-04-05T01:45:20.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:20.863595953Z [2024-04-05T01:45:20.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:20.873799844Z [2024-04-05T01:45:20.873+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=0, run_start_date=2024-04-05 01:45:17.319450+00:00, run_end_date=2024-04-05 01:45:19.945694+00:00, run_duration=2.626244, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:14.480740+00:00, queued_by_job_id=1, pid=1805 2024-04-05T01:45:20.874047545Z [2024-04-05T01:45:20.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38243a92-54a7-480d-b118-34d76bdee8bc 2024-04-05T01:45:24.719778577Z [2024-04-05T01:45:24.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:45:24.720302412Z [2024-04-05T01:45:24.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:45:00.674362+00:00, run_end_date=2024-04-05 01:45:24.719896+00:00, run_duration=24.045534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:45:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T01:45:24.728770315Z [2024-04-05T01:45:24.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:45:24.774338465Z [2024-04-05T01:45:24.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:24.781357051Z [2024-04-05T01:45:24.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:23.209633+00:00, run_end_date=2024-04-05 01:45:23.738484+00:00, run_duration=0.528851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:20.731778+00:00, queued_by_job_id=1, pid=1826 2024-04-05T01:46:00.245233022Z [2024-04-05T01:46:00.244+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:46:00.259946356Z [2024-04-05T01:46:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:47:00+00:00 2024-04-05T01:46:00.269186223Z [2024-04-05T01:46:00.268+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:46:00.359171330Z [2024-04-05T01:46:00.358+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:46:00.359187825Z 2024-04-05T01:46:00.359192128Z 2024-04-05T01:46:00.359212238Z 2024-04-05T01:46:00.359639040Z [2024-04-05T01:46:00.359+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:46:00.359882456Z [2024-04-05T01:46:00.359+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:46:00.360096149Z [2024-04-05T01:46:00.359+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:46:00.361754901Z [2024-04-05T01:46:00.361+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:46:00.361765796Z 2024-04-05T01:46:00.361769487Z 2024-04-05T01:46:00.361773073Z 2024-04-05T01:46:00.367570898Z [2024-04-05T01:46:00.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:46:00.368129407Z [2024-04-05T01:46:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:46:00.368556063Z [2024-04-05T01:46:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:46:00.368783506Z [2024-04-05T01:46:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:46:00.370069395Z [2024-04-05T01:46:00.368+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:46:00.370081827Z [2024-04-05T01:46:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:46:00.758161175Z [2024-04-05T01:46:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status queued for try_number 1 2024-04-05T01:46:00.758182105Z [2024-04-05T01:46:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:46:00.758185723Z [2024-04-05T01:46:00.752+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:46:00.774304633Z [2024-04-05T01:46:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to b771279e-57ba-48e4-a1e5-9dbcd378e8fb 2024-04-05T01:46:00.774327460Z [2024-04-05T01:46:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6962f53f-f0b6-4d09-a7f3-ce8bbaf6c899 2024-04-05T01:46:00.774331690Z [2024-04-05T01:46:00.771+0000] {scheduler_job.py:635} INFO - Setting external_id for to 548136f5-03af-4b12-aca3-0ad273fd35e3 2024-04-05T01:46:03.230794640Z [2024-04-05T01:46:03.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:46:03.231647396Z [2024-04-05T01:46:03.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:44:00+00:00, run_id=scheduled__2024-04-05T01:44:00+00:00, run_start_date=2024-04-05 01:46:00.287751+00:00, run_end_date=2024-04-05 01:46:03.230130+00:00, run_duration=2.942379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:44:00+00:00, data_interval_end=2024-04-05 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:46:03.243420439Z [2024-04-05T01:46:03.243+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:46:03.357368575Z [2024-04-05T01:46:03.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status success for try_number 1 2024-04-05T01:46:03.376820502Z [2024-04-05T01:46:03.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:44:00+00:00, map_index=-1, run_start_date=2024-04-05 01:46:01.539098+00:00, run_end_date=2024-04-05 01:46:02.097037+00:00, run_duration=0.557939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:46:00.363173+00:00, queued_by_job_id=1, pid=1830 2024-04-05T01:46:06.726479757Z [2024-04-05T01:46:06.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:46:06.726664862Z [2024-04-05T01:46:06.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:45:00+00:00, run_id=scheduled__2024-04-05T01:45:00+00:00, run_start_date=2024-04-05 01:46:00.291676+00:00, run_end_date=2024-04-05 01:46:06.726372+00:00, run_duration=6.434696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:45:00+00:00, data_interval_end=2024-04-05 01:46:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:46:06.745839010Z [2024-04-05T01:46:06.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:47:00+00:00 2024-04-05T01:46:06.876558766Z [2024-04-05T01:46:06.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:46:06.883186653Z [2024-04-05T01:46:06.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:46:03.753726+00:00, run_end_date=2024-04-05 01:46:05.876108+00:00, run_duration=2.122382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:46:00.363173+00:00, queued_by_job_id=1, pid=1860 2024-04-05T01:46:07.674353248Z [2024-04-05T01:46:07.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:46:07.675215551Z [2024-04-05T01:46:07.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:45:00+00:00, run_id=scheduled__2024-04-05T01:45:00+00:00, run_start_date=2024-04-05 01:46:00.290497+00:00, run_end_date=2024-04-05 01:46:07.674277+00:00, run_duration=7.38378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:45:00+00:00, data_interval_end=2024-04-05 01:46:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:46:07.688768726Z [2024-04-05T01:46:07.688+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:47:00+00:00 2024-04-05T01:46:08.815970607Z [2024-04-05T01:46:08.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:46:08.821121451Z [2024-04-05T01:46:08.820+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:46:04.133547+00:00, run_end_date=2024-04-05 01:46:07.521996+00:00, run_duration=3.388449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:46:00.363173+00:00, queued_by_job_id=1, pid=1861 2024-04-05T01:46:42.977789659Z [2024-04-05T01:46:42.977+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:47:00.035084979Z [2024-04-05T01:47:00.034+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:47:00.049497952Z [2024-04-05T01:47:00.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:47:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:47:00.114337932Z [2024-04-05T01:47:00.113+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:47:00.114380904Z 2024-04-05T01:47:00.114422015Z 2024-04-05T01:47:00.114431411Z [2024-04-05T01:47:00.114+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:47:00.114440181Z [2024-04-05T01:47:00.114+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:47:00.114960280Z [2024-04-05T01:47:00.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:47:00.114977212Z 2024-04-05T01:47:00.114981460Z 2024-04-05T01:47:00.119673280Z [2024-04-05T01:47:00.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:47:00.119983854Z [2024-04-05T01:47:00.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:47:00.120364499Z [2024-04-05T01:47:00.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:47:00.120635231Z [2024-04-05T01:47:00.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:47:00.317112643Z [2024-04-05T01:47:00.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status queued for try_number 1 2024-04-05T01:47:00.317511968Z [2024-04-05T01:47:00.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status queued for try_number 1 2024-04-05T01:47:00.331071807Z [2024-04-05T01:47:00.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5426cc96-14aa-45e2-a71c-c37e6a01c564 2024-04-05T01:47:00.331171001Z [2024-04-05T01:47:00.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 996cb856-030d-4e3a-8008-c83a2a822215 2024-04-05T01:47:05.394043003Z [2024-04-05T01:47:05.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:47:05.394456251Z [2024-04-05T01:47:05.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:46:00+00:00, run_id=scheduled__2024-04-05T01:46:00+00:00, run_start_date=2024-04-05 01:47:00.066180+00:00, run_end_date=2024-04-05 01:47:05.393829+00:00, run_duration=5.327649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:46:00+00:00, data_interval_end=2024-04-05 01:47:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:47:05.408573323Z [2024-04-05T01:47:05.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:47:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:47:06.609031841Z [2024-04-05T01:47:06.608+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:47:06.610065164Z [2024-04-05T01:47:06.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:46:00+00:00, run_id=scheduled__2024-04-05T01:46:00+00:00, run_start_date=2024-04-05 01:47:00.064310+00:00, run_end_date=2024-04-05 01:47:06.608945+00:00, run_duration=6.544635, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:46:00+00:00, data_interval_end=2024-04-05 01:47:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:47:06.621555698Z [2024-04-05T01:47:06.621+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:47:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:47:06.673437543Z [2024-04-05T01:47:06.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status success for try_number 1 2024-04-05T01:47:06.673623158Z [2024-04-05T01:47:06.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status success for try_number 1 2024-04-05T01:47:06.689751454Z [2024-04-05T01:47:06.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:46:00+00:00, map_index=-1, run_start_date=2024-04-05 01:47:03.330008+00:00, run_end_date=2024-04-05 01:47:05.352865+00:00, run_duration=2.022857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:47:00.115607+00:00, queued_by_job_id=1, pid=1916 2024-04-05T01:47:06.690161165Z [2024-04-05T01:47:06.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:46:00+00:00, map_index=-1, run_start_date=2024-04-05 01:47:03.264274+00:00, run_end_date=2024-04-05 01:47:05.849355+00:00, run_duration=2.585081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:47:00.115607+00:00, queued_by_job_id=1, pid=1915 2024-04-05T01:48:00.427503479Z [2024-04-05T01:48:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:49:00+00:00 2024-04-05T01:48:00.435718205Z [2024-04-05T01:48:00.435+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:48:00.444161038Z [2024-04-05T01:48:00.443+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:48:00.540930739Z [2024-04-05T01:48:00.540+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:48:00.540961270Z 2024-04-05T01:48:00.540968957Z 2024-04-05T01:48:00.540975894Z 2024-04-05T01:48:00.541630843Z [2024-04-05T01:48:00.541+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:48:00.541885364Z [2024-04-05T01:48:00.541+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:48:00.542147721Z [2024-04-05T01:48:00.541+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:48:00.542878593Z [2024-04-05T01:48:00.542+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:48:00.542885934Z 2024-04-05T01:48:00.542889188Z 2024-04-05T01:48:00.542903376Z 2024-04-05T01:48:00.546414143Z [2024-04-05T01:48:00.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:48:00.546702118Z [2024-04-05T01:48:00.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:48:00.547340669Z [2024-04-05T01:48:00.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:48:00.547530921Z [2024-04-05T01:48:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:48:00.547816255Z [2024-04-05T01:48:00.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:48:00.547993041Z [2024-04-05T01:48:00.547+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:48:01.057348281Z [2024-04-05T01:48:01.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status queued for try_number 1 2024-04-05T01:48:01.057667916Z [2024-04-05T01:48:01.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status queued for try_number 1 2024-04-05T01:48:01.058522394Z [2024-04-05T01:48:01.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status queued for try_number 1 2024-04-05T01:48:01.083281401Z [2024-04-05T01:48:01.082+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8708a466-1231-45ed-83b5-d7299ebba438 2024-04-05T01:48:01.083573098Z [2024-04-05T01:48:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to f49b02b9-45b8-4897-a1ed-db50ac47863f 2024-04-05T01:48:01.083841612Z [2024-04-05T01:48:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4612d165-0bff-43a8-bdab-60c0333673d4 2024-04-05T01:48:03.968695121Z [2024-04-05T01:48:03.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:48:03.969336406Z [2024-04-05T01:48:03.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:46:00+00:00, run_id=scheduled__2024-04-05T01:46:00+00:00, run_start_date=2024-04-05 01:48:00.460880+00:00, run_end_date=2024-04-05 01:48:03.968715+00:00, run_duration=3.507835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:46:00+00:00, data_interval_end=2024-04-05 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:48:03.984868017Z [2024-04-05T01:48:03.984+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:48:04.154424362Z [2024-04-05T01:48:04.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status success for try_number 1 2024-04-05T01:48:04.165735951Z [2024-04-05T01:48:04.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:46:00+00:00, map_index=-1, run_start_date=2024-04-05 01:48:01.971336+00:00, run_end_date=2024-04-05 01:48:03.067066+00:00, run_duration=1.09573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:48:00.543781+00:00, queued_by_job_id=1, pid=1951 2024-04-05T01:48:08.290819384Z [2024-04-05T01:48:08.288+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:48:08.291089379Z [2024-04-05T01:48:08.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:47:00+00:00, run_id=scheduled__2024-04-05T01:47:00+00:00, run_start_date=2024-04-05 01:48:00.466020+00:00, run_end_date=2024-04-05 01:48:08.290781+00:00, run_duration=7.824761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:47:00+00:00, data_interval_end=2024-04-05 01:48:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:48:08.308083834Z [2024-04-05T01:48:08.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:49:00+00:00 2024-04-05T01:48:09.456477464Z [2024-04-05T01:48:09.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:48:09.457431211Z [2024-04-05T01:48:09.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:47:00+00:00, run_id=scheduled__2024-04-05T01:47:00+00:00, run_start_date=2024-04-05 01:48:00.467909+00:00, run_end_date=2024-04-05 01:48:09.456532+00:00, run_duration=8.988623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:47:00+00:00, data_interval_end=2024-04-05 01:48:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:48:09.469066894Z [2024-04-05T01:48:09.468+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:49:00+00:00 2024-04-05T01:48:09.506679774Z [2024-04-05T01:48:09.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status success for try_number 1 2024-04-05T01:48:09.506899635Z [2024-04-05T01:48:09.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status success for try_number 1 2024-04-05T01:48:09.513878436Z [2024-04-05T01:48:09.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:47:00+00:00, map_index=-1, run_start_date=2024-04-05 01:48:05.930734+00:00, run_end_date=2024-04-05 01:48:08.224544+00:00, run_duration=2.29381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:48:00.543781+00:00, queued_by_job_id=1, pid=1982 2024-04-05T01:48:09.514436028Z [2024-04-05T01:48:09.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:47:00+00:00, map_index=-1, run_start_date=2024-04-05 01:48:05.728556+00:00, run_end_date=2024-04-05 01:48:08.386240+00:00, run_duration=2.657684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:48:00.543781+00:00, queued_by_job_id=1, pid=1981 2024-04-05T01:49:00.853937062Z [2024-04-05T01:49:00.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:49:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:49:00.868045815Z [2024-04-05T01:49:00.867+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:49:00.942639461Z [2024-04-05T01:49:00.941+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:49:00.942680268Z 2024-04-05T01:49:00.942684658Z 2024-04-05T01:49:00.943920716Z [2024-04-05T01:49:00.943+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:49:00.944246546Z [2024-04-05T01:49:00.944+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:49:00.945202204Z [2024-04-05T01:49:00.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:49:00.945218365Z 2024-04-05T01:49:00.945222203Z 2024-04-05T01:49:00.948746561Z [2024-04-05T01:49:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:49:00.949009173Z [2024-04-05T01:49:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:49:00.949395125Z [2024-04-05T01:49:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:49:00.949615335Z [2024-04-05T01:49:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:49:01.181576586Z [2024-04-05T01:49:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status queued for try_number 1 2024-04-05T01:49:01.182373446Z [2024-04-05T01:49:01.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status queued for try_number 1 2024-04-05T01:49:01.194623349Z [2024-04-05T01:49:01.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86edab05-7c17-49a8-865b-10b76c29112c 2024-04-05T01:49:01.195068896Z [2024-04-05T01:49:01.194+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69797ce5-9cf5-43fd-b53c-3bfc20d3bb37 2024-04-05T01:49:07.065937978Z [2024-04-05T01:49:07.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:49:07.066398041Z [2024-04-05T01:49:07.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:48:00+00:00, run_id=scheduled__2024-04-05T01:48:00+00:00, run_start_date=2024-04-05 01:49:00.880384+00:00, run_end_date=2024-04-05 01:49:07.065869+00:00, run_duration=6.185485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:48:00+00:00, data_interval_end=2024-04-05 01:49:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:49:07.078447873Z [2024-04-05T01:49:07.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:49:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:49:07.197588373Z [2024-04-05T01:49:07.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status success for try_number 1 2024-04-05T01:49:07.205220608Z [2024-04-05T01:49:07.204+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:48:00+00:00, map_index=-1, run_start_date=2024-04-05 01:49:04.171223+00:00, run_end_date=2024-04-05 01:49:06.816246+00:00, run_duration=2.645023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:49:00.946175+00:00, queued_by_job_id=1, pid=2036 2024-04-05T01:49:08.611901226Z [2024-04-05T01:49:08.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:49:08.614015448Z [2024-04-05T01:49:08.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:48:00+00:00, run_id=scheduled__2024-04-05T01:48:00+00:00, run_start_date=2024-04-05 01:49:00.882271+00:00, run_end_date=2024-04-05 01:49:08.612619+00:00, run_duration=7.730348, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:48:00+00:00, data_interval_end=2024-04-05 01:49:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:49:08.624450006Z [2024-04-05T01:49:08.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:49:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:49:08.684740562Z [2024-04-05T01:49:08.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status success for try_number 1 2024-04-05T01:49:08.701437466Z [2024-04-05T01:49:08.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:48:00+00:00, map_index=-1, run_start_date=2024-04-05 01:49:04.472434+00:00, run_end_date=2024-04-05 01:49:07.595998+00:00, run_duration=3.123564, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:49:00.946175+00:00, queued_by_job_id=1, pid=2037 2024-04-05T01:50:00.178873742Z [2024-04-05T01:50:00.178+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:50:00.189837488Z [2024-04-05T01:50:00.189+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:50:00.202944198Z [2024-04-05T01:50:00.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:50:00.217129865Z [2024-04-05T01:50:00.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:51:00+00:00 2024-04-05T01:50:00.305864904Z [2024-04-05T01:50:00.305+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:50:00.305882590Z 2024-04-05T01:50:00.305886253Z 2024-04-05T01:50:00.305890175Z 2024-04-05T01:50:00.305907734Z 2024-04-05T01:50:00.306449520Z [2024-04-05T01:50:00.306+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:50:00.306709926Z [2024-04-05T01:50:00.306+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:50:00.306934527Z [2024-04-05T01:50:00.306+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:50:00.307119138Z [2024-04-05T01:50:00.306+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:50:00.307752633Z [2024-04-05T01:50:00.307+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:50:00.307764172Z 2024-04-05T01:50:00.307780032Z 2024-04-05T01:50:00.307783505Z 2024-04-05T01:50:00.307786479Z 2024-04-05T01:50:00.313152180Z [2024-04-05T01:50:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:50:00.313514239Z [2024-04-05T01:50:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:50:00.313898220Z [2024-04-05T01:50:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:00.314172625Z [2024-04-05T01:50:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:50:00.314768271Z [2024-04-05T01:50:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:00.315028620Z [2024-04-05T01:50:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:50:00.315372645Z [2024-04-05T01:50:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:00.315902248Z [2024-04-05T01:50:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:50:00.750107275Z [2024-04-05T01:50:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:00.750125425Z [2024-04-05T01:50:00.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:00.750129720Z [2024-04-05T01:50:00.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:00.750133074Z [2024-04-05T01:50:00.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:00.808158531Z [2024-04-05T01:50:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0229063-44f0-4843-b922-5df6e24d4544 2024-04-05T01:50:00.808252334Z [2024-04-05T01:50:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b215c1-6389-49c2-b48e-1e2a2a30cb0a 2024-04-05T01:50:00.808375060Z [2024-04-05T01:50:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02f738ca-17a5-4599-a544-115ffae5301e 2024-04-05T01:50:00.808477414Z [2024-04-05T01:50:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcc3d265-7d28-47d6-972f-ea22e46a9281 2024-04-05T01:50:05.077892841Z [2024-04-05T01:50:05.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:05.079103396Z [2024-04-05T01:50:05.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:48:00+00:00, run_id=scheduled__2024-04-05T01:48:00+00:00, run_start_date=2024-04-05 01:50:00.238127+00:00, run_end_date=2024-04-05 01:50:05.077788+00:00, run_duration=4.839661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:48:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:50:05.099262644Z [2024-04-05T01:50:05.098+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:50:05.343980441Z [2024-04-05T01:50:05.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:05.351028113Z [2024-04-05T01:50:05.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:48:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:02.368916+00:00, run_end_date=2024-04-05 01:50:03.842609+00:00, run_duration=1.473693, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.308677+00:00, queued_by_job_id=1, pid=2074 2024-04-05T01:50:08.949862115Z [2024-04-05T01:50:08.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:08.950407277Z [2024-04-05T01:50:08.950+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:49:00+00:00, run_id=scheduled__2024-04-05T01:49:00+00:00, run_start_date=2024-04-05 01:50:00.239265+00:00, run_end_date=2024-04-05 01:50:08.949778+00:00, run_duration=8.710513, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:49:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:50:08.964343530Z [2024-04-05T01:50:08.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:51:00+00:00 2024-04-05T01:50:09.021597495Z [2024-04-05T01:50:09.021+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:50:09.021622901Z 2024-04-05T01:50:09.023134180Z [2024-04-05T01:50:09.022+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:50:09.024397192Z [2024-04-05T01:50:09.024+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:50:09.024415866Z 2024-04-05T01:50:09.036695458Z [2024-04-05T01:50:09.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:50:09.038661708Z [2024-04-05T01:50:09.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:50:09.163589526Z [2024-04-05T01:50:09.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:09.163771373Z [2024-04-05T01:50:09.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:09.163996793Z [2024-04-05T01:50:09.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:09.183465110Z [2024-04-05T01:50:09.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:49:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:05.032733+00:00, run_end_date=2024-04-05 01:50:08.268484+00:00, run_duration=3.235751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.308677+00:00, queued_by_job_id=1, pid=2095 2024-04-05T01:50:09.183991779Z [2024-04-05T01:50:09.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b5e730a-198c-4410-9f67-b99c35d0bb3f 2024-04-05T01:50:09.184694785Z [2024-04-05T01:50:09.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:07.546943+00:00, run_end_date=2024-04-05 01:50:08.539455+00:00, run_duration=0.992512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.308677+00:00, queued_by_job_id=1, pid=2133 2024-04-05T01:50:09.379276335Z [2024-04-05T01:50:09.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:09.379436837Z [2024-04-05T01:50:09.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:49:00+00:00, run_id=scheduled__2024-04-05T01:49:00+00:00, run_start_date=2024-04-05 01:50:00.240806+00:00, run_end_date=2024-04-05 01:50:09.379148+00:00, run_duration=9.138342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:49:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:50:09.393829500Z [2024-04-05T01:50:09.393+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:51:00+00:00 2024-04-05T01:50:10.644408255Z [2024-04-05T01:50:10.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:10.663793522Z [2024-04-05T01:50:10.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:49:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:05.858189+00:00, run_end_date=2024-04-05 01:50:09.301667+00:00, run_duration=3.443478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.308677+00:00, queued_by_job_id=1, pid=2105 2024-04-05T01:50:15.563375683Z [2024-04-05T01:50:15.562+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:50:15.563398801Z 2024-04-05T01:50:15.563408258Z [2024-04-05T01:50:15.563+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:50:15.564463399Z [2024-04-05T01:50:15.564+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:50:15.564472203Z 2024-04-05T01:50:15.571104655Z [2024-04-05T01:50:15.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:50:15.571206109Z [2024-04-05T01:50:15.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:50:15.691325330Z [2024-04-05T01:50:15.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:15.691627079Z [2024-04-05T01:50:15.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:15.726635796Z [2024-04-05T01:50:15.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to f891a736-b46c-4be8-9919-fa3edb26fa48 2024-04-05T01:50:15.728777536Z [2024-04-05T01:50:15.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:13.631548+00:00, run_end_date=2024-04-05 01:50:14.334192+00:00, run_duration=0.702644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:09.026548+00:00, queued_by_job_id=1, pid=2164 2024-04-05T01:50:19.359034648Z [2024-04-05T01:50:19.358+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:50:19.359062198Z 2024-04-05T01:50:19.359244554Z [2024-04-05T01:50:19.359+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:50:19.359932538Z [2024-04-05T01:50:19.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:50:19.359943224Z 2024-04-05T01:50:19.363794384Z [2024-04-05T01:50:19.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:19.364585370Z [2024-04-05T01:50:19.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:50:19.423157019Z [2024-04-05T01:50:19.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:19.423750723Z [2024-04-05T01:50:19.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:19.443911354Z [2024-04-05T01:50:19.443+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9dd59414-cb95-4590-8fb9-9a0c234e974c 2024-04-05T01:50:19.445682177Z [2024-04-05T01:50:19.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=0, run_start_date=2024-04-05 01:50:18.539785+00:00, run_end_date=2024-04-05 01:50:18.978575+00:00, run_duration=0.43879, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:15.565354+00:00, queued_by_job_id=1, pid=2179 2024-04-05T01:50:22.967336985Z [2024-04-05T01:50:22.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:22.967544893Z [2024-04-05T01:50:22.967+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:45:00+00:00, run_id=scheduled__2024-04-05T01:45:00+00:00, run_start_date=2024-04-05 01:50:00.236624+00:00, run_end_date=2024-04-05 01:50:22.967267+00:00, run_duration=22.730643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:45:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T01:50:22.977181516Z [2024-04-05T01:50:22.976+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:50:23.057029287Z [2024-04-05T01:50:23.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:23.072947853Z [2024-04-05T01:50:23.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:21.532661+00:00, run_end_date=2024-04-05 01:50:21.921650+00:00, run_duration=0.388989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:19.360946+00:00, queued_by_job_id=1, pid=2191 2024-04-05T01:51:00.035838741Z [2024-04-05T01:51:00.035+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:51:00.049145298Z [2024-04-05T01:51:00.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:51:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:51:00.103714758Z [2024-04-05T01:51:00.103+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:51:00.103751074Z 2024-04-05T01:51:00.103786273Z 2024-04-05T01:51:00.103795057Z [2024-04-05T01:51:00.103+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:51:00.103878696Z [2024-04-05T01:51:00.103+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:51:00.104492919Z [2024-04-05T01:51:00.104+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:51:00.104543673Z 2024-04-05T01:51:00.104553260Z 2024-04-05T01:51:00.107334372Z [2024-04-05T01:51:00.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:51:00.107372148Z [2024-04-05T01:51:00.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:51:00.107787408Z [2024-04-05T01:51:00.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:51:00.107805564Z [2024-04-05T01:51:00.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:51:00.304468437Z [2024-04-05T01:51:00.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:51:00.304522535Z [2024-04-05T01:51:00.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:51:00.311495283Z [2024-04-05T01:51:00.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0b2322f-ab7c-4c67-b50f-31fc8a2368ad 2024-04-05T01:51:00.311612883Z [2024-04-05T01:51:00.311+0000] {scheduler_job.py:635} INFO - Setting external_id for to 04d4ad4c-d50a-489e-801e-3e257e47ebaf 2024-04-05T01:51:05.278768425Z [2024-04-05T01:51:05.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:51:05.279047589Z [2024-04-05T01:51:05.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:51:00.060807+00:00, run_end_date=2024-04-05 01:51:05.278693+00:00, run_duration=5.217886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:51:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:51:05.297637420Z [2024-04-05T01:51:05.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:51:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:51:06.550790095Z [2024-04-05T01:51:06.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:51:06.550983725Z [2024-04-05T01:51:06.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:51:00.062186+00:00, run_end_date=2024-04-05 01:51:06.550731+00:00, run_duration=6.488545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:51:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:51:06.568522325Z [2024-04-05T01:51:06.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:51:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:51:06.598678761Z [2024-04-05T01:51:06.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:51:06.598708201Z [2024-04-05T01:51:06.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:51:06.605898598Z [2024-04-05T01:51:06.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:51:02.838852+00:00, run_end_date=2024-04-05 01:51:05.220583+00:00, run_duration=2.381731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:51:00.105072+00:00, queued_by_job_id=1, pid=2205 2024-04-05T01:51:06.608509626Z [2024-04-05T01:51:06.608+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:51:04.024394+00:00, run_end_date=2024-04-05 01:51:05.826058+00:00, run_duration=1.801664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:51:00.105072+00:00, queued_by_job_id=1, pid=2224 2024-04-05T01:51:43.058948926Z [2024-04-05T01:51:43.056+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:52:00.109106344Z [2024-04-05T01:52:00.108+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:52:00.126889230Z [2024-04-05T01:52:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:53:00+00:00 2024-04-05T01:52:00.135167709Z [2024-04-05T01:52:00.134+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:52:00.235795117Z [2024-04-05T01:52:00.235+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:52:00.235839157Z 2024-04-05T01:52:00.235850674Z 2024-04-05T01:52:00.235860605Z 2024-04-05T01:52:00.240844864Z [2024-04-05T01:52:00.240+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:52:00.242464837Z [2024-04-05T01:52:00.241+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:52:00.243770941Z [2024-04-05T01:52:00.243+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:52:00.244506326Z [2024-04-05T01:52:00.244+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:52:00.244533720Z 2024-04-05T01:52:00.244543203Z 2024-04-05T01:52:00.244550706Z 2024-04-05T01:52:00.255512837Z [2024-04-05T01:52:00.255+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:52:00.255856243Z [2024-04-05T01:52:00.255+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:52:00.256391930Z [2024-04-05T01:52:00.256+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:52:00.256679892Z [2024-04-05T01:52:00.256+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:52:00.257685400Z [2024-04-05T01:52:00.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:52:00.257958903Z [2024-04-05T01:52:00.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:52:00.555902242Z [2024-04-05T01:52:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:52:00.556143832Z [2024-04-05T01:52:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status queued for try_number 1 2024-04-05T01:52:00.556327526Z [2024-04-05T01:52:00.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status queued for try_number 1 2024-04-05T01:52:00.571420449Z [2024-04-05T01:52:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9ab7283-6260-4a27-8ba7-88612518fe41 2024-04-05T01:52:00.571657385Z [2024-04-05T01:52:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4fc4154-131b-49df-b48a-92c1f06de41e 2024-04-05T01:52:00.571824662Z [2024-04-05T01:52:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to c792c502-6538-4839-95f9-cc49ecdd1058 2024-04-05T01:52:02.661275570Z [2024-04-05T01:52:02.660+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:52:02.661741589Z [2024-04-05T01:52:02.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:52:00.162477+00:00, run_end_date=2024-04-05 01:52:02.661264+00:00, run_duration=2.498787, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:52:02.709197331Z [2024-04-05T01:52:02.708+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:52:02.849212990Z [2024-04-05T01:52:02.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:52:02.864198782Z [2024-04-05T01:52:02.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:52:01.470276+00:00, run_end_date=2024-04-05 01:52:02.285326+00:00, run_duration=0.81505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:52:00.250268+00:00, queued_by_job_id=1, pid=2250 2024-04-05T01:52:06.468891239Z [2024-04-05T01:52:06.468+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:52:06.471516251Z [2024-04-05T01:52:06.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:51:00+00:00, run_id=scheduled__2024-04-05T01:51:00+00:00, run_start_date=2024-04-05 01:52:00.170549+00:00, run_end_date=2024-04-05 01:52:06.471076+00:00, run_duration=6.300527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:51:00+00:00, data_interval_end=2024-04-05 01:52:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:52:06.486080082Z [2024-04-05T01:52:06.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:53:00+00:00 2024-04-05T01:52:06.593621783Z [2024-04-05T01:52:06.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status success for try_number 1 2024-04-05T01:52:06.603047993Z [2024-04-05T01:52:06.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:51:00+00:00, map_index=-1, run_start_date=2024-04-05 01:52:03.984352+00:00, run_end_date=2024-04-05 01:52:06.258144+00:00, run_duration=2.273792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:52:00.250268+00:00, queued_by_job_id=1, pid=2271 2024-04-05T01:52:07.713171724Z [2024-04-05T01:52:07.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:52:07.713394801Z [2024-04-05T01:52:07.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:51:00+00:00, run_id=scheduled__2024-04-05T01:51:00+00:00, run_start_date=2024-04-05 01:52:00.167893+00:00, run_end_date=2024-04-05 01:52:07.713112+00:00, run_duration=7.545219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:51:00+00:00, data_interval_end=2024-04-05 01:52:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:52:07.727460916Z [2024-04-05T01:52:07.727+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:53:00+00:00 2024-04-05T01:52:07.768052346Z [2024-04-05T01:52:07.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status success for try_number 1 2024-04-05T01:52:07.786621167Z [2024-04-05T01:52:07.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:51:00+00:00, map_index=-1, run_start_date=2024-04-05 01:52:04.845255+00:00, run_end_date=2024-04-05 01:52:07.354631+00:00, run_duration=2.509376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:52:00.250268+00:00, queued_by_job_id=1, pid=2290 2024-04-05T01:53:00.521725412Z [2024-04-05T01:53:00.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:53:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:53:00.538087852Z [2024-04-05T01:53:00.537+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:53:00.616842432Z [2024-04-05T01:53:00.616+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:53:00.616871788Z 2024-04-05T01:53:00.616877309Z 2024-04-05T01:53:00.616882786Z [2024-04-05T01:53:00.616+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:53:00.617135933Z [2024-04-05T01:53:00.616+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:53:00.617854863Z [2024-04-05T01:53:00.617+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:53:00.617869551Z 2024-04-05T01:53:00.617873476Z 2024-04-05T01:53:00.621251214Z [2024-04-05T01:53:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:53:00.621506890Z [2024-04-05T01:53:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:53:00.621789085Z [2024-04-05T01:53:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:53:00.621893863Z [2024-04-05T01:53:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:53:00.915713670Z [2024-04-05T01:53:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status queued for try_number 1 2024-04-05T01:53:00.915938681Z [2024-04-05T01:53:00.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status queued for try_number 1 2024-04-05T01:53:00.925911745Z [2024-04-05T01:53:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83adb6b9-150d-4aed-a75a-7f6338b9f588 2024-04-05T01:53:00.927184419Z [2024-04-05T01:53:00.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 316373e7-e9a6-4996-b378-20c11ee4c560 2024-04-05T01:53:07.394493960Z [2024-04-05T01:53:07.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:53:07.395529405Z [2024-04-05T01:53:07.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:52:00+00:00, run_id=scheduled__2024-04-05T01:52:00+00:00, run_start_date=2024-04-05 01:53:00.563434+00:00, run_end_date=2024-04-05 01:53:07.395077+00:00, run_duration=6.831643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:52:00+00:00, data_interval_end=2024-04-05 01:53:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:53:07.410617010Z [2024-04-05T01:53:07.410+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:53:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:53:07.466868853Z [2024-04-05T01:53:07.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status success for try_number 1 2024-04-05T01:53:07.472236682Z [2024-04-05T01:53:07.471+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:52:00+00:00, map_index=-1, run_start_date=2024-04-05 01:53:04.524097+00:00, run_end_date=2024-04-05 01:53:07.227256+00:00, run_duration=2.703159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:53:00.618578+00:00, queued_by_job_id=1, pid=2335 2024-04-05T01:53:08.777422730Z [2024-04-05T01:53:08.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:53:08.777798851Z [2024-04-05T01:53:08.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:52:00+00:00, run_id=scheduled__2024-04-05T01:52:00+00:00, run_start_date=2024-04-05 01:53:00.564918+00:00, run_end_date=2024-04-05 01:53:08.777355+00:00, run_duration=8.212437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:52:00+00:00, data_interval_end=2024-04-05 01:53:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:53:08.790387706Z [2024-04-05T01:53:08.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:53:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:53:08.850934130Z [2024-04-05T01:53:08.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status success for try_number 1 2024-04-05T01:53:08.859844085Z [2024-04-05T01:53:08.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:52:00+00:00, map_index=-1, run_start_date=2024-04-05 01:53:04.528669+00:00, run_end_date=2024-04-05 01:53:08.000727+00:00, run_duration=3.472058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:53:00.618578+00:00, queued_by_job_id=1, pid=2336 2024-04-05T01:54:00.689065585Z [2024-04-05T01:54:00.688+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:54:00.730069427Z [2024-04-05T01:54:00.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:54:00.730091062Z [2024-04-05T01:54:00.725+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:54:00.826854649Z [2024-04-05T01:54:00.826+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:54:00.826875931Z 2024-04-05T01:54:00.826880528Z 2024-04-05T01:54:00.826883902Z 2024-04-05T01:54:00.827153694Z [2024-04-05T01:54:00.826+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:54:00.827498343Z [2024-04-05T01:54:00.827+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:54:00.827747230Z [2024-04-05T01:54:00.827+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:54:00.828889227Z [2024-04-05T01:54:00.828+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:54:00.828904411Z 2024-04-05T01:54:00.828910636Z 2024-04-05T01:54:00.828915655Z 2024-04-05T01:54:00.836642734Z [2024-04-05T01:54:00.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:54:00.839649599Z [2024-04-05T01:54:00.838+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:54:00.840525008Z [2024-04-05T01:54:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:54:00.841181479Z [2024-04-05T01:54:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:54:00.841595731Z [2024-04-05T01:54:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:54:00.841749732Z [2024-04-05T01:54:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:54:01.366527187Z [2024-04-05T01:54:01.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status queued for try_number 1 2024-04-05T01:54:01.366724671Z [2024-04-05T01:54:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status queued for try_number 1 2024-04-05T01:54:01.366909838Z [2024-04-05T01:54:01.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status queued for try_number 1 2024-04-05T01:54:01.382289284Z [2024-04-05T01:54:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to e90491b2-50e8-44f8-bf38-3b8c851cc891 2024-04-05T01:54:01.382333907Z [2024-04-05T01:54:01.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0df4306-30c0-40a0-9b16-5814cc7d86d8 2024-04-05T01:54:01.382344597Z [2024-04-05T01:54:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to aeda2f0b-ea6f-4b1f-bdb9-6a46c10ec083 2024-04-05T01:54:05.271449663Z [2024-04-05T01:54:05.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:54:05.277355887Z [2024-04-05T01:54:05.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:52:00+00:00, run_id=scheduled__2024-04-05T01:52:00+00:00, run_start_date=2024-04-05 01:54:00.735772+00:00, run_end_date=2024-04-05 01:54:05.274857+00:00, run_duration=4.539085, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:52:00+00:00, data_interval_end=2024-04-05 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:54:05.345005481Z [2024-04-05T01:54:05.344+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:54:05.606215079Z [2024-04-05T01:54:05.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status success for try_number 1 2024-04-05T01:54:05.620765358Z [2024-04-05T01:54:05.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:52:00+00:00, map_index=-1, run_start_date=2024-04-05 01:54:03.074501+00:00, run_end_date=2024-04-05 01:54:04.461212+00:00, run_duration=1.386711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:54:00.830704+00:00, queued_by_job_id=1, pid=2371 2024-04-05T01:54:09.001240862Z [2024-04-05T01:54:09.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:54:09.003412959Z [2024-04-05T01:54:09.003+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:53:00+00:00, run_id=scheduled__2024-04-05T01:53:00+00:00, run_start_date=2024-04-05 01:54:00.737068+00:00, run_end_date=2024-04-05 01:54:09.002972+00:00, run_duration=8.265904, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:53:00+00:00, data_interval_end=2024-04-05 01:54:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:54:09.016098233Z [2024-04-05T01:54:09.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:54:09.028300376Z [2024-04-05T01:54:09.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:54:09.029321354Z [2024-04-05T01:54:09.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:53:00+00:00, run_id=scheduled__2024-04-05T01:53:00+00:00, run_start_date=2024-04-05 01:54:00.738371+00:00, run_end_date=2024-04-05 01:54:09.028595+00:00, run_duration=8.290224, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:53:00+00:00, data_interval_end=2024-04-05 01:54:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:54:09.040238280Z [2024-04-05T01:54:09.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:54:09.082201069Z [2024-04-05T01:54:09.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status success for try_number 1 2024-04-05T01:54:09.082553609Z [2024-04-05T01:54:09.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status success for try_number 1 2024-04-05T01:54:09.092909471Z [2024-04-05T01:54:09.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:53:00+00:00, map_index=-1, run_start_date=2024-04-05 01:54:06.315453+00:00, run_end_date=2024-04-05 01:54:08.116103+00:00, run_duration=1.80065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:54:00.830704+00:00, queued_by_job_id=1, pid=2401 2024-04-05T01:54:09.093255530Z [2024-04-05T01:54:09.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:53:00+00:00, map_index=-1, run_start_date=2024-04-05 01:54:06.462604+00:00, run_end_date=2024-04-05 01:54:08.786420+00:00, run_duration=2.323816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:54:00.830704+00:00, queued_by_job_id=1, pid=2402 2024-04-05T01:55:01.021200072Z [2024-04-05T01:55:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:55:01.032940858Z [2024-04-05T01:55:01.032+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:55:01.045968098Z [2024-04-05T01:55:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:55:01.157133388Z [2024-04-05T01:55:01.156+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:55:01.157170964Z 2024-04-05T01:55:01.157275884Z 2024-04-05T01:55:01.157313483Z 2024-04-05T01:55:01.157339265Z [2024-04-05T01:55:01.157+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:55:01.157557056Z [2024-04-05T01:55:01.157+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:55:01.157801946Z [2024-04-05T01:55:01.157+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:55:01.158648682Z [2024-04-05T01:55:01.158+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:55:01.158678208Z 2024-04-05T01:55:01.158688226Z 2024-04-05T01:55:01.158696799Z 2024-04-05T01:55:01.162839330Z [2024-04-05T01:55:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:55:01.163355067Z [2024-04-05T01:55:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:55:01.163545308Z [2024-04-05T01:55:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:55:01.163740457Z [2024-04-05T01:55:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:55:01.164095059Z [2024-04-05T01:55:01.163+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:55:01.164281087Z [2024-04-05T01:55:01.163+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:55:01.586656288Z [2024-04-05T01:55:01.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:01.586771838Z [2024-04-05T01:55:01.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:01.586899038Z [2024-04-05T01:55:01.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:01.598348143Z [2024-04-05T01:55:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34fe9b08-c02a-4a72-b5d7-328890f98762 2024-04-05T01:55:01.598588613Z [2024-04-05T01:55:01.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed8d2929-2f58-452d-9a35-910ab83761e2 2024-04-05T01:55:01.598789008Z [2024-04-05T01:55:01.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4c816cd-cb65-4b36-ad21-cd7f7eacdf4f 2024-04-05T01:55:10.175733200Z [2024-04-05T01:55:10.175+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:55:10.175751667Z 2024-04-05T01:55:10.175800541Z [2024-04-05T01:55:10.175+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:55:10.182120533Z [2024-04-05T01:55:10.181+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:55:10.182139653Z 2024-04-05T01:55:10.200573756Z [2024-04-05T01:55:10.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:55:10.200674257Z [2024-04-05T01:55:10.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:55:10.506731089Z [2024-04-05T01:55:10.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:10.506899535Z [2024-04-05T01:55:10.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:10.533028567Z [2024-04-05T01:55:10.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to e03338bf-43d8-494a-836d-6327a4b06511 2024-04-05T01:55:10.533162607Z [2024-04-05T01:55:10.532+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:07.475444+00:00, run_end_date=2024-04-05 01:55:08.749076+00:00, run_duration=1.273632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:01.159380+00:00, queued_by_job_id=1, pid=2449 2024-04-05T01:55:11.943533167Z [2024-04-05T01:55:11.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:55:11.943823817Z [2024-04-05T01:55:11.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:54:00+00:00, run_id=scheduled__2024-04-05T01:54:00+00:00, run_start_date=2024-04-05 01:55:01.061775+00:00, run_end_date=2024-04-05 01:55:11.943478+00:00, run_duration=10.881703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:54:00+00:00, data_interval_end=2024-04-05 01:55:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:55:12.029319536Z [2024-04-05T01:55:12.028+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:55:12.052370279Z [2024-04-05T01:55:12.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:55:12.052816267Z [2024-04-05T01:55:12.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:54:00+00:00, run_id=scheduled__2024-04-05T01:54:00+00:00, run_start_date=2024-04-05 01:55:01.063264+00:00, run_end_date=2024-04-05 01:55:12.052259+00:00, run_duration=10.988995, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:54:00+00:00, data_interval_end=2024-04-05 01:55:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:55:12.078632043Z [2024-04-05T01:55:12.078+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:55:12.314345438Z [2024-04-05T01:55:12.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:12.318047825Z [2024-04-05T01:55:12.314+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:12.336925190Z [2024-04-05T01:55:12.336+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:54:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:08.616934+00:00, run_end_date=2024-04-05 01:55:11.067300+00:00, run_duration=2.450366, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:01.159380+00:00, queued_by_job_id=1, pid=2478 2024-04-05T01:55:12.339061097Z [2024-04-05T01:55:12.337+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:54:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:08.129702+00:00, run_end_date=2024-04-05 01:55:11.329555+00:00, run_duration=3.199853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:01.159380+00:00, queued_by_job_id=1, pid=2468 2024-04-05T01:55:15.718228946Z [2024-04-05T01:55:15.717+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:55:15.718260481Z 2024-04-05T01:55:15.718542890Z [2024-04-05T01:55:15.718+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:55:15.719351796Z [2024-04-05T01:55:15.719+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:55:15.719363452Z 2024-04-05T01:55:15.726081347Z [2024-04-05T01:55:15.725+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:55:15.726341582Z [2024-04-05T01:55:15.726+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:55:15.808232713Z [2024-04-05T01:55:15.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:15.809833149Z [2024-04-05T01:55:15.809+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:15.834127031Z [2024-04-05T01:55:15.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f4102d8-11db-41d2-b3a1-8981d62b1d73 2024-04-05T01:55:15.836317104Z [2024-04-05T01:55:15.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:14.204195+00:00, run_end_date=2024-04-05 01:55:14.815589+00:00, run_duration=0.611394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:10.187392+00:00, queued_by_job_id=1, pid=2518 2024-04-05T01:55:19.230796166Z [2024-04-05T01:55:19.230+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:55:19.230833803Z 2024-04-05T01:55:19.230857147Z [2024-04-05T01:55:19.230+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:55:19.231604203Z [2024-04-05T01:55:19.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:55:19.231625252Z 2024-04-05T01:55:19.235946850Z [2024-04-05T01:55:19.235+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:55:19.236225715Z [2024-04-05T01:55:19.235+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:55:19.317488025Z [2024-04-05T01:55:19.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:19.318927534Z [2024-04-05T01:55:19.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:19.330000758Z [2024-04-05T01:55:19.329+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38b33a62-a33d-40c5-8cb6-5819bc5dfd06 2024-04-05T01:55:19.330584121Z [2024-04-05T01:55:19.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=0, run_start_date=2024-04-05 01:55:18.171195+00:00, run_end_date=2024-04-05 01:55:18.538922+00:00, run_duration=0.367727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:15.720324+00:00, queued_by_job_id=1, pid=2533 2024-04-05T01:55:22.060110700Z [2024-04-05T01:55:22.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:55:22.060647806Z [2024-04-05T01:55:22.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:55:01.060359+00:00, run_end_date=2024-04-05 01:55:22.060237+00:00, run_duration=20.999878, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:55:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T01:55:22.070041953Z [2024-04-05T01:55:22.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:55:22.098221239Z [2024-04-05T01:55:22.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:22.103789712Z [2024-04-05T01:55:22.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:21.284567+00:00, run_end_date=2024-04-05 01:55:21.721087+00:00, run_duration=0.43652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:19.232014+00:00, queued_by_job_id=1, pid=2545 2024-04-05T01:56:00.771921085Z [2024-04-05T01:56:00.766+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:56:00.800084686Z [2024-04-05T01:56:00.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:57:00+00:00 2024-04-05T01:56:00.820948672Z [2024-04-05T01:56:00.820+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:56:00.927454793Z [2024-04-05T01:56:00.926+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:56:00.927546336Z 2024-04-05T01:56:00.927671392Z 2024-04-05T01:56:00.927682181Z 2024-04-05T01:56:00.927716769Z [2024-04-05T01:56:00.927+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:56:00.928140855Z [2024-04-05T01:56:00.927+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:56:00.928422434Z [2024-04-05T01:56:00.928+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:56:00.933628892Z [2024-04-05T01:56:00.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:56:00.933662896Z 2024-04-05T01:56:00.933672937Z 2024-04-05T01:56:00.933678662Z 2024-04-05T01:56:00.939615255Z [2024-04-05T01:56:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:56:00.939733375Z [2024-04-05T01:56:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:56:00.940103161Z [2024-04-05T01:56:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:56:00.940253164Z [2024-04-05T01:56:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:56:00.940610400Z [2024-04-05T01:56:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:56:00.940772289Z [2024-04-05T01:56:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:56:01.338910233Z [2024-04-05T01:56:01.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status queued for try_number 1 2024-04-05T01:56:01.339200252Z [2024-04-05T01:56:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:56:01.339299967Z [2024-04-05T01:56:01.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:56:01.355935957Z [2024-04-05T01:56:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41552a91-87d7-43f0-8ae7-dfe706159351 2024-04-05T01:56:01.356111831Z [2024-04-05T01:56:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 49d29ba6-66d6-4747-bf71-916265ff33b3 2024-04-05T01:56:01.356293711Z [2024-04-05T01:56:01.356+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12efb9de-5cce-4400-a5ff-21cc23ade02e 2024-04-05T01:56:03.939889783Z [2024-04-05T01:56:03.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:56:03.947045674Z [2024-04-05T01:56:03.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:54:00+00:00, run_id=scheduled__2024-04-05T01:54:00+00:00, run_start_date=2024-04-05 01:56:00.838536+00:00, run_end_date=2024-04-05 01:56:03.944989+00:00, run_duration=3.106453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:54:00+00:00, data_interval_end=2024-04-05 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:56:03.969429269Z [2024-04-05T01:56:03.969+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:56:05.385621049Z [2024-04-05T01:56:05.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status success for try_number 1 2024-04-05T01:56:05.395049668Z [2024-04-05T01:56:05.394+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:54:00+00:00, map_index=-1, run_start_date=2024-04-05 01:56:02.395235+00:00, run_end_date=2024-04-05 01:56:03.852019+00:00, run_duration=1.456784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:56:00.935655+00:00, queued_by_job_id=1, pid=2549 2024-04-05T01:56:08.776760560Z [2024-04-05T01:56:08.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:56:08.776908737Z [2024-04-05T01:56:08.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:55:00+00:00, run_id=scheduled__2024-04-05T01:55:00+00:00, run_start_date=2024-04-05 01:56:00.843131+00:00, run_end_date=2024-04-05 01:56:08.776654+00:00, run_duration=7.933523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:55:00+00:00, data_interval_end=2024-04-05 01:56:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:56:08.792815179Z [2024-04-05T01:56:08.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:57:00+00:00 2024-04-05T01:56:08.836335553Z [2024-04-05T01:56:08.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:56:08.844520561Z [2024-04-05T01:56:08.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 01:56:05.576627+00:00, run_end_date=2024-04-05 01:56:08.185909+00:00, run_duration=2.609282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:56:00.935655+00:00, queued_by_job_id=1, pid=2579 2024-04-05T01:56:09.895612606Z [2024-04-05T01:56:09.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:56:09.896262599Z [2024-04-05T01:56:09.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:55:00+00:00, run_id=scheduled__2024-04-05T01:55:00+00:00, run_start_date=2024-04-05 01:56:00.841047+00:00, run_end_date=2024-04-05 01:56:09.895766+00:00, run_duration=9.054719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:55:00+00:00, data_interval_end=2024-04-05 01:56:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:56:09.909521769Z [2024-04-05T01:56:09.909+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:57:00+00:00 2024-04-05T01:56:09.955117881Z [2024-04-05T01:56:09.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:56:09.961377862Z [2024-04-05T01:56:09.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 01:56:06.184343+00:00, run_end_date=2024-04-05 01:56:08.855053+00:00, run_duration=2.67071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:56:00.935655+00:00, queued_by_job_id=1, pid=2580 2024-04-05T01:56:43.118420366Z [2024-04-05T01:56:43.117+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:57:00.404797317Z [2024-04-05T01:57:00.404+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:57:00.417349325Z [2024-04-05T01:57:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:57:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:57:00.500274542Z [2024-04-05T01:57:00.499+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:57:00.500305390Z 2024-04-05T01:57:00.500309366Z 2024-04-05T01:57:00.500547527Z [2024-04-05T01:57:00.500+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:57:00.500849778Z [2024-04-05T01:57:00.500+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:57:00.501826856Z [2024-04-05T01:57:00.501+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:57:00.501843825Z 2024-04-05T01:57:00.501851027Z 2024-04-05T01:57:00.506917324Z [2024-04-05T01:57:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:57:00.507416829Z [2024-04-05T01:57:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:57:00.508450358Z [2024-04-05T01:57:00.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:57:00.509094971Z [2024-04-05T01:57:00.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:57:00.881271815Z [2024-04-05T01:57:00.880+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status queued for try_number 1 2024-04-05T01:57:00.883110619Z [2024-04-05T01:57:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status queued for try_number 1 2024-04-05T01:57:00.902436949Z [2024-04-05T01:57:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to c144f7f9-8cdc-40e5-b761-5b2f72b544d5 2024-04-05T01:57:00.902846971Z [2024-04-05T01:57:00.902+0000] {scheduler_job.py:635} INFO - Setting external_id for to c49bc243-fdeb-4260-8073-28db9a1ab769 2024-04-05T01:57:08.956463316Z [2024-04-05T01:57:08.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:57:08.956501184Z [2024-04-05T01:57:08.956+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:56:00+00:00, run_id=scheduled__2024-04-05T01:56:00+00:00, run_start_date=2024-04-05 01:57:00.441431+00:00, run_end_date=2024-04-05 01:57:08.956010+00:00, run_duration=8.514579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:56:00+00:00, data_interval_end=2024-04-05 01:57:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:57:08.968982015Z [2024-04-05T01:57:08.968+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:57:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:57:10.386655223Z [2024-04-05T01:57:10.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:57:10.386844170Z [2024-04-05T01:57:10.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:56:00+00:00, run_id=scheduled__2024-04-05T01:56:00+00:00, run_start_date=2024-04-05 01:57:00.438459+00:00, run_end_date=2024-04-05 01:57:10.386564+00:00, run_duration=9.948105, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:56:00+00:00, data_interval_end=2024-04-05 01:57:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:57:10.397069912Z [2024-04-05T01:57:10.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:57:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:57:10.441265218Z [2024-04-05T01:57:10.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status success for try_number 1 2024-04-05T01:57:10.441509620Z [2024-04-05T01:57:10.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status success for try_number 1 2024-04-05T01:57:10.455173109Z [2024-04-05T01:57:10.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:56:00+00:00, map_index=-1, run_start_date=2024-04-05 01:57:06.446958+00:00, run_end_date=2024-04-05 01:57:09.985198+00:00, run_duration=3.53824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:57:00.502948+00:00, queued_by_job_id=1, pid=2635 2024-04-05T01:57:10.455336029Z [2024-04-05T01:57:10.455+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:56:00+00:00, map_index=-1, run_start_date=2024-04-05 01:57:05.779117+00:00, run_end_date=2024-04-05 01:57:08.839538+00:00, run_duration=3.060421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:57:00.502948+00:00, queued_by_job_id=1, pid=2633 2024-04-05T01:58:00.905022123Z [2024-04-05T01:58:00.904+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T01:59:00+00:00 2024-04-05T01:58:00.917858166Z [2024-04-05T01:58:00.917+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:58:00.933790097Z [2024-04-05T01:58:00.933+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:58:01.031758603Z [2024-04-05T01:58:01.030+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:58:01.031779588Z 2024-04-05T01:58:01.031783872Z 2024-04-05T01:58:01.031787435Z 2024-04-05T01:58:01.032010412Z [2024-04-05T01:58:01.031+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:58:01.032180512Z [2024-04-05T01:58:01.032+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:58:01.032316766Z [2024-04-05T01:58:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:58:01.033467567Z [2024-04-05T01:58:01.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:58:01.033478001Z 2024-04-05T01:58:01.033482186Z 2024-04-05T01:58:01.033485357Z 2024-04-05T01:58:01.039990017Z [2024-04-05T01:58:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:58:01.041225420Z [2024-04-05T01:58:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:58:01.043523262Z [2024-04-05T01:58:01.043+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:58:01.043842721Z [2024-04-05T01:58:01.043+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:58:01.044629444Z [2024-04-05T01:58:01.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:58:01.045127700Z [2024-04-05T01:58:01.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:58:01.346021671Z [2024-04-05T01:58:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status queued for try_number 1 2024-04-05T01:58:01.346341545Z [2024-04-05T01:58:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status queued for try_number 1 2024-04-05T01:58:01.346512887Z [2024-04-05T01:58:01.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status queued for try_number 1 2024-04-05T01:58:01.359064603Z [2024-04-05T01:58:01.358+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9765f43b-6ab4-41a9-8579-f73098d6ca4d 2024-04-05T01:58:01.359327017Z [2024-04-05T01:58:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to d85793cd-bc52-469e-8864-d1abf664f75b 2024-04-05T01:58:01.359603611Z [2024-04-05T01:58:01.359+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfe79cd8-f38f-493c-87a1-cc3370d2b323 2024-04-05T01:58:05.518323364Z [2024-04-05T01:58:05.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:58:05.520558247Z [2024-04-05T01:58:05.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:56:00+00:00, run_id=scheduled__2024-04-05T01:56:00+00:00, run_start_date=2024-04-05 01:58:00.954942+00:00, run_end_date=2024-04-05 01:58:05.518593+00:00, run_duration=4.563651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:56:00+00:00, data_interval_end=2024-04-05 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:58:05.545622020Z [2024-04-05T01:58:05.545+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:58:05.744364926Z [2024-04-05T01:58:05.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status success for try_number 1 2024-04-05T01:58:05.773615564Z [2024-04-05T01:58:05.773+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:56:00+00:00, map_index=-1, run_start_date=2024-04-05 01:58:03.427965+00:00, run_end_date=2024-04-05 01:58:04.749696+00:00, run_duration=1.321731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:58:01.034809+00:00, queued_by_job_id=1, pid=2670 2024-04-05T01:58:09.180694041Z [2024-04-05T01:58:09.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:58:09.180928876Z [2024-04-05T01:58:09.180+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:57:00+00:00, run_id=scheduled__2024-04-05T01:57:00+00:00, run_start_date=2024-04-05 01:58:00.957340+00:00, run_end_date=2024-04-05 01:58:09.180632+00:00, run_duration=8.223292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:57:00+00:00, data_interval_end=2024-04-05 01:58:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:58:09.198236185Z [2024-04-05T01:58:09.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T01:59:00+00:00 2024-04-05T01:58:09.206275596Z [2024-04-05T01:58:09.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:58:09.206429659Z [2024-04-05T01:58:09.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:57:00+00:00, run_id=scheduled__2024-04-05T01:57:00+00:00, run_start_date=2024-04-05 01:58:00.959874+00:00, run_end_date=2024-04-05 01:58:09.206185+00:00, run_duration=8.246311, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:57:00+00:00, data_interval_end=2024-04-05 01:58:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:58:09.216237082Z [2024-04-05T01:58:09.215+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T01:59:00+00:00 2024-04-05T01:58:09.268265642Z [2024-04-05T01:58:09.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status success for try_number 1 2024-04-05T01:58:09.268766515Z [2024-04-05T01:58:09.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status success for try_number 1 2024-04-05T01:58:09.279633132Z [2024-04-05T01:58:09.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:57:00+00:00, map_index=-1, run_start_date=2024-04-05 01:58:06.153062+00:00, run_end_date=2024-04-05 01:58:08.559107+00:00, run_duration=2.406045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:58:01.034809+00:00, queued_by_job_id=1, pid=2700 2024-04-05T01:58:09.280218279Z [2024-04-05T01:58:09.279+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:57:00+00:00, map_index=-1, run_start_date=2024-04-05 01:58:06.484900+00:00, run_end_date=2024-04-05 01:58:08.585540+00:00, run_duration=2.10064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:58:01.034809+00:00, queued_by_job_id=1, pid=2701 2024-04-05T01:59:00.148905951Z [2024-04-05T01:59:00.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:59:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:59:00.159836905Z [2024-04-05T01:59:00.159+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:59:00.234427728Z [2024-04-05T01:59:00.234+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:59:00.234463766Z 2024-04-05T01:59:00.234469953Z 2024-04-05T01:59:00.234687626Z [2024-04-05T01:59:00.234+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:59:00.234922293Z [2024-04-05T01:59:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T01:59:00.235535064Z [2024-04-05T01:59:00.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:59:00.235558665Z 2024-04-05T01:59:00.235567958Z 2024-04-05T01:59:00.244492192Z [2024-04-05T01:59:00.244+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:59:00.244853542Z [2024-04-05T01:59:00.244+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:59:00.245286307Z [2024-04-05T01:59:00.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:59:00.245569109Z [2024-04-05T01:59:00.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:59:00.528251528Z [2024-04-05T01:59:00.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status queued for try_number 1 2024-04-05T01:59:00.528330101Z [2024-04-05T01:59:00.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status queued for try_number 1 2024-04-05T01:59:00.545201189Z [2024-04-05T01:59:00.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e2a8eef-692e-4dff-96ce-0c08061e0ac9 2024-04-05T01:59:00.546194896Z [2024-04-05T01:59:00.545+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55f84c9c-2497-4c4e-a437-7fbc81a60cbd 2024-04-05T01:59:06.864655668Z [2024-04-05T01:59:06.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:59:06.865266718Z [2024-04-05T01:59:06.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:58:00+00:00, run_id=scheduled__2024-04-05T01:58:00+00:00, run_start_date=2024-04-05 01:59:00.183117+00:00, run_end_date=2024-04-05 01:59:06.864870+00:00, run_duration=6.681753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:58:00+00:00, data_interval_end=2024-04-05 01:59:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T01:59:06.875608276Z [2024-04-05T01:59:06.875+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:59:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:59:06.882657821Z [2024-04-05T01:59:06.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:59:06.883180497Z [2024-04-05T01:59:06.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:58:00+00:00, run_id=scheduled__2024-04-05T01:58:00+00:00, run_start_date=2024-04-05 01:59:00.180612+00:00, run_end_date=2024-04-05 01:59:06.882568+00:00, run_duration=6.701956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:58:00+00:00, data_interval_end=2024-04-05 01:59:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T01:59:06.896163953Z [2024-04-05T01:59:06.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T01:59:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:59:06.940136808Z [2024-04-05T01:59:06.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status success for try_number 1 2024-04-05T01:59:06.946249846Z [2024-04-05T01:59:06.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:58:00+00:00, map_index=-1, run_start_date=2024-04-05 01:59:03.829358+00:00, run_end_date=2024-04-05 01:59:06.275000+00:00, run_duration=2.445642, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:59:00.239304+00:00, queued_by_job_id=1, pid=2756 2024-04-05T01:59:08.074634848Z [2024-04-05T01:59:08.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status success for try_number 1 2024-04-05T01:59:08.080157640Z [2024-04-05T01:59:08.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:58:00+00:00, map_index=-1, run_start_date=2024-04-05 01:59:03.182325+00:00, run_end_date=2024-04-05 01:59:06.687774+00:00, run_duration=3.505449, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:59:00.239304+00:00, queued_by_job_id=1, pid=2755 2024-04-05T02:00:00.298367826Z [2024-04-05T02:00:00.297+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:00:00.312257452Z [2024-04-05T02:00:00.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:00:00.330021282Z [2024-04-05T02:00:00.329+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:01:00+00:00 2024-04-05T02:00:00.344603955Z [2024-04-05T02:00:00.344+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:00:00.464010735Z [2024-04-05T02:00:00.463+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:00:00.464038184Z 2024-04-05T02:00:00.464042690Z 2024-04-05T02:00:00.464047308Z 2024-04-05T02:00:00.464067889Z 2024-04-05T02:00:00.464495318Z [2024-04-05T02:00:00.464+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:00:00.464805825Z [2024-04-05T02:00:00.464+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:00:00.465088439Z [2024-04-05T02:00:00.464+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:00:00.465551859Z [2024-04-05T02:00:00.465+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:00:00.466616573Z [2024-04-05T02:00:00.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:00:00.466631044Z 2024-04-05T02:00:00.466635479Z 2024-04-05T02:00:00.466639439Z 2024-04-05T02:00:00.466642778Z 2024-04-05T02:00:00.472365534Z [2024-04-05T02:00:00.471+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:00:00.473019331Z [2024-04-05T02:00:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:00:00.474014874Z [2024-04-05T02:00:00.473+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:00.474290731Z [2024-04-05T02:00:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:00:00.474641574Z [2024-04-05T02:00:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:00.474956370Z [2024-04-05T02:00:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:00:00.475419222Z [2024-04-05T02:00:00.475+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:00.475671526Z [2024-04-05T02:00:00.475+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:00:01.142402152Z [2024-04-05T02:00:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:01.142514746Z [2024-04-05T02:00:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:01.142698541Z [2024-04-05T02:00:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:01.142836454Z [2024-04-05T02:00:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:01.171539146Z [2024-04-05T02:00:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8dd6215c-a888-4891-a5a3-2041ff0eebd6 2024-04-05T02:00:01.171624360Z [2024-04-05T02:00:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a246c06-b302-4b57-97a6-ed9ff8cf5822 2024-04-05T02:00:01.171847728Z [2024-04-05T02:00:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to c190ec8b-327c-40bb-af6d-f3cb20966855 2024-04-05T02:00:01.171964456Z [2024-04-05T02:00:01.171+0000] {scheduler_job.py:635} INFO - Setting external_id for to eac96fd5-ba51-4901-a36c-7db5dd28edca 2024-04-05T02:00:04.523619445Z [2024-04-05T02:00:04.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:04.524229428Z [2024-04-05T02:00:04.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:58:00+00:00, run_id=scheduled__2024-04-05T01:58:00+00:00, run_start_date=2024-04-05 02:00:00.368254+00:00, run_end_date=2024-04-05 02:00:04.523609+00:00, run_duration=4.155355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:58:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:00:04.555330566Z [2024-04-05T02:00:04.554+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:00:04.907703760Z [2024-04-05T02:00:04.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:04.956013160Z [2024-04-05T02:00:04.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:58:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:01.737242+00:00, run_end_date=2024-04-05 02:00:03.835169+00:00, run_duration=2.097927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:00.467776+00:00, queued_by_job_id=1, pid=2792 2024-04-05T02:00:09.994266611Z [2024-04-05T02:00:09.992+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:09.996704916Z [2024-04-05T02:00:09.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:59:00+00:00, run_id=scheduled__2024-04-05T01:59:00+00:00, run_start_date=2024-04-05 02:00:00.371449+00:00, run_end_date=2024-04-05 02:00:09.992667+00:00, run_duration=9.621218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:59:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:00:10.041153833Z [2024-04-05T02:00:10.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:01:00+00:00 2024-04-05T02:00:11.371757575Z [2024-04-05T02:00:11.371+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:00:11.371806287Z 2024-04-05T02:00:11.375128109Z [2024-04-05T02:00:11.374+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:00:11.375884929Z [2024-04-05T02:00:11.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:00:11.375894365Z 2024-04-05T02:00:11.382361649Z [2024-04-05T02:00:11.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:00:11.382774904Z [2024-04-05T02:00:11.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:00:11.488961515Z [2024-04-05T02:00:11.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:11.489281134Z [2024-04-05T02:00:11.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:11.489565397Z [2024-04-05T02:00:11.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:11.501834682Z [2024-04-05T02:00:11.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:59:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:07.391655+00:00, run_end_date=2024-04-05 02:00:09.786512+00:00, run_duration=2.394857, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:00.467776+00:00, queued_by_job_id=1, pid=2814 2024-04-05T02:00:11.502364746Z [2024-04-05T02:00:11.502+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14105f75-0506-49f5-926c-b8e5b6d4c171 2024-04-05T02:00:11.503684777Z [2024-04-05T02:00:11.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:08.586170+00:00, run_end_date=2024-04-05 02:00:09.588026+00:00, run_duration=1.001856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:00.467776+00:00, queued_by_job_id=1, pid=2843 2024-04-05T02:00:12.194618176Z [2024-04-05T02:00:12.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:12.195400661Z [2024-04-05T02:00:12.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:59:00+00:00, run_id=scheduled__2024-04-05T01:59:00+00:00, run_start_date=2024-04-05 02:00:00.369521+00:00, run_end_date=2024-04-05 02:00:12.194560+00:00, run_duration=11.825039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:59:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:00:12.207363574Z [2024-04-05T02:00:12.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:01:00+00:00 2024-04-05T02:00:12.285032918Z [2024-04-05T02:00:12.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:12.339218453Z [2024-04-05T02:00:12.338+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:59:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:08.663051+00:00, run_end_date=2024-04-05 02:00:11.592250+00:00, run_duration=2.929199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:00.467776+00:00, queued_by_job_id=1, pid=2842 2024-04-05T02:00:18.414769341Z [2024-04-05T02:00:18.414+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:00:18.414786194Z 2024-04-05T02:00:18.415847933Z [2024-04-05T02:00:18.415+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:00:18.417483772Z [2024-04-05T02:00:18.417+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:00:18.417500382Z 2024-04-05T02:00:18.424870437Z [2024-04-05T02:00:18.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:00:18.425298217Z [2024-04-05T02:00:18.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:00:18.514662101Z [2024-04-05T02:00:18.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:18.514710347Z [2024-04-05T02:00:18.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:18.524652986Z [2024-04-05T02:00:18.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4224fa3-b155-4956-a78a-e1bc507f6a45 2024-04-05T02:00:18.524743965Z [2024-04-05T02:00:18.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:16.544060+00:00, run_end_date=2024-04-05 02:00:17.244914+00:00, run_duration=0.700854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:11.378795+00:00, queued_by_job_id=1, pid=2886 2024-04-05T02:00:22.045948138Z [2024-04-05T02:00:22.045+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:00:22.046034975Z 2024-04-05T02:00:22.046560412Z [2024-04-05T02:00:22.046+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:00:22.047527313Z [2024-04-05T02:00:22.047+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:00:22.047540506Z 2024-04-05T02:00:22.051344581Z [2024-04-05T02:00:22.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:22.051707135Z [2024-04-05T02:00:22.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:00:22.121033746Z [2024-04-05T02:00:22.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:22.121077365Z [2024-04-05T02:00:22.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:22.128773365Z [2024-04-05T02:00:22.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2066b53b-a2da-487d-a85e-f4b5db1d164c 2024-04-05T02:00:22.128934168Z [2024-04-05T02:00:22.128+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=0, run_start_date=2024-04-05 02:00:21.045827+00:00, run_end_date=2024-04-05 02:00:21.452166+00:00, run_duration=0.406339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:18.418687+00:00, queued_by_job_id=1, pid=2897 2024-04-05T02:00:25.975081990Z [2024-04-05T02:00:25.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:25.975516908Z [2024-04-05T02:00:25.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 01:55:00+00:00, run_id=scheduled__2024-04-05T01:55:00+00:00, run_start_date=2024-04-05 02:00:00.366696+00:00, run_end_date=2024-04-05 02:00:25.975136+00:00, run_duration=25.60844, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:55:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:00:25.983747148Z [2024-04-05T02:00:25.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:00:26.027883382Z [2024-04-05T02:00:26.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:26.033197803Z [2024-04-05T02:00:26.032+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:25.203611+00:00, run_end_date=2024-04-05 02:00:25.657904+00:00, run_duration=0.454293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:22.048225+00:00, queued_by_job_id=1, pid=2909 2024-04-05T02:01:00.375229414Z [2024-04-05T02:01:00.374+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:01:00.395312494Z [2024-04-05T02:01:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:01:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:01:00.471166961Z [2024-04-05T02:01:00.469+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:01:00.471208580Z 2024-04-05T02:01:00.471426215Z 2024-04-05T02:01:00.471502949Z [2024-04-05T02:01:00.471+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:01:00.472034432Z [2024-04-05T02:01:00.471+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:01:00.472646281Z [2024-04-05T02:01:00.472+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:01:00.472665366Z 2024-04-05T02:01:00.472696156Z 2024-04-05T02:01:00.476964089Z [2024-04-05T02:01:00.476+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:01:00.477014890Z [2024-04-05T02:01:00.476+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:01:00.477215727Z [2024-04-05T02:01:00.477+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:01:00.477287272Z [2024-04-05T02:01:00.477+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:01:00.707181114Z [2024-04-05T02:01:00.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:01:00.707203930Z [2024-04-05T02:01:00.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:01:00.721053808Z [2024-04-05T02:01:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2e6a04b-a66f-4bd8-9a47-7131f4abc274 2024-04-05T02:01:00.721075895Z [2024-04-05T02:01:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 925e6d70-183b-4b80-a894-59748a881187 2024-04-05T02:01:09.007536444Z [2024-04-05T02:01:09.007+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:01:09.011568759Z [2024-04-05T02:01:09.011+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:01:00.412090+00:00, run_end_date=2024-04-05 02:01:09.011081+00:00, run_duration=8.598991, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:01:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:01:09.030746336Z [2024-04-05T02:01:09.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:01:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:01:09.041133197Z [2024-04-05T02:01:09.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:01:09.041322297Z [2024-04-05T02:01:09.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:01:00.414085+00:00, run_end_date=2024-04-05 02:01:09.041034+00:00, run_duration=8.626949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:01:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:01:09.055656399Z [2024-04-05T02:01:09.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:01:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:01:09.119774779Z [2024-04-05T02:01:09.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:01:09.126554521Z [2024-04-05T02:01:09.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:01:09.152135520Z [2024-04-05T02:01:09.151+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:01:04.823405+00:00, run_end_date=2024-04-05 02:01:08.388391+00:00, run_duration=3.564986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:01:00.473216+00:00, queued_by_job_id=1, pid=2932 2024-04-05T02:01:09.162176082Z [2024-04-05T02:01:09.161+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:01:05.342392+00:00, run_end_date=2024-04-05 02:01:08.041930+00:00, run_duration=2.699538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:01:00.473216+00:00, queued_by_job_id=1, pid=2933 2024-04-05T02:01:43.188643623Z [2024-04-05T02:01:43.187+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:02:00.391680697Z [2024-04-05T02:02:00.391+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:03:00+00:00 2024-04-05T02:02:00.411785897Z [2024-04-05T02:02:00.411+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:02:00.431633390Z [2024-04-05T02:02:00.431+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:02:00.558979677Z [2024-04-05T02:02:00.558+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:02:00.559017326Z 2024-04-05T02:02:00.559035290Z 2024-04-05T02:02:00.559041722Z 2024-04-05T02:02:00.559378651Z [2024-04-05T02:02:00.559+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:02:00.559671869Z [2024-04-05T02:02:00.559+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:02:00.559921437Z [2024-04-05T02:02:00.559+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:02:00.563022131Z [2024-04-05T02:02:00.562+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:02:00.563037330Z 2024-04-05T02:02:00.563041713Z 2024-04-05T02:02:00.563045045Z 2024-04-05T02:02:00.572034397Z [2024-04-05T02:02:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:02:00.572534209Z [2024-04-05T02:02:00.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:02:00.573175988Z [2024-04-05T02:02:00.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:02:00.573655412Z [2024-04-05T02:02:00.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:02:00.574268145Z [2024-04-05T02:02:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:02:00.574726384Z [2024-04-05T02:02:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:02:01.174695785Z [2024-04-05T02:02:01.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:02:01.174848655Z [2024-04-05T02:02:01.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status queued for try_number 1 2024-04-05T02:02:01.174858363Z [2024-04-05T02:02:01.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status queued for try_number 1 2024-04-05T02:02:01.201259158Z [2024-04-05T02:02:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0fa09b1-fd99-4700-be89-f09f6005234b 2024-04-05T02:02:01.201441103Z [2024-04-05T02:02:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to d899905a-8c96-4e72-a0b2-d92b7a95d448 2024-04-05T02:02:01.201503769Z [2024-04-05T02:02:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73e71352-947e-4dfa-a1ae-81a622680b1d 2024-04-05T02:02:03.781245932Z [2024-04-05T02:02:03.780+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:02:03.781626990Z [2024-04-05T02:02:03.781+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:02:00.457270+00:00, run_end_date=2024-04-05 02:02:03.781208+00:00, run_duration=3.323938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:02:03.799333548Z [2024-04-05T02:02:03.798+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:02:03.929718861Z [2024-04-05T02:02:03.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:02:03.935329198Z [2024-04-05T02:02:03.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:02:02.058172+00:00, run_end_date=2024-04-05 02:02:02.927469+00:00, run_duration=0.869297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:02:00.564271+00:00, queued_by_job_id=1, pid=2968 2024-04-05T02:02:07.234374979Z [2024-04-05T02:02:07.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:02:07.235023723Z [2024-04-05T02:02:07.234+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:01:00+00:00, run_id=scheduled__2024-04-05T02:01:00+00:00, run_start_date=2024-04-05 02:02:00.459515+00:00, run_end_date=2024-04-05 02:02:07.234386+00:00, run_duration=6.774871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:01:00+00:00, data_interval_end=2024-04-05 02:02:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:02:07.261265911Z [2024-04-05T02:02:07.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:03:00+00:00 2024-04-05T02:02:07.342774508Z [2024-04-05T02:02:07.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status success for try_number 1 2024-04-05T02:02:07.352454099Z [2024-04-05T02:02:07.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:01:00+00:00, map_index=-1, run_start_date=2024-04-05 02:02:05.116226+00:00, run_end_date=2024-04-05 02:02:06.946572+00:00, run_duration=1.830346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:02:00.564271+00:00, queued_by_job_id=1, pid=2999 2024-04-05T02:02:08.405684615Z [2024-04-05T02:02:08.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:02:08.405875566Z [2024-04-05T02:02:08.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:01:00+00:00, run_id=scheduled__2024-04-05T02:01:00+00:00, run_start_date=2024-04-05 02:02:00.461615+00:00, run_end_date=2024-04-05 02:02:08.405554+00:00, run_duration=7.943939, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:01:00+00:00, data_interval_end=2024-04-05 02:02:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:02:08.423149288Z [2024-04-05T02:02:08.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:03:00+00:00 2024-04-05T02:02:08.507273866Z [2024-04-05T02:02:08.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status success for try_number 1 2024-04-05T02:02:08.517575812Z [2024-04-05T02:02:08.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:01:00+00:00, map_index=-1, run_start_date=2024-04-05 02:02:05.049020+00:00, run_end_date=2024-04-05 02:02:07.685833+00:00, run_duration=2.636813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:02:00.564271+00:00, queued_by_job_id=1, pid=2998 2024-04-05T02:03:00.294478789Z [2024-04-05T02:03:00.293+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:03:00.308351058Z [2024-04-05T02:03:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:03:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:03:00.376361530Z [2024-04-05T02:03:00.376+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:03:00.376376835Z 2024-04-05T02:03:00.376380320Z 2024-04-05T02:03:00.376669206Z [2024-04-05T02:03:00.376+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:03:00.376812590Z [2024-04-05T02:03:00.376+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:03:00.377479272Z [2024-04-05T02:03:00.377+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:03:00.377488321Z 2024-04-05T02:03:00.377491691Z 2024-04-05T02:03:00.381319309Z [2024-04-05T02:03:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:03:00.381888641Z [2024-04-05T02:03:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:03:00.382223520Z [2024-04-05T02:03:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:03:00.382421139Z [2024-04-05T02:03:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:03:00.576938252Z [2024-04-05T02:03:00.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status queued for try_number 1 2024-04-05T02:03:00.577452449Z [2024-04-05T02:03:00.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status queued for try_number 1 2024-04-05T02:03:00.586469890Z [2024-04-05T02:03:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fc3fb67-b9e7-463a-94d9-a2d22d1b2ef0 2024-04-05T02:03:00.586965766Z [2024-04-05T02:03:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8c4cf1d-c0ae-4fee-8477-371914608e4b 2024-04-05T02:03:07.747061568Z [2024-04-05T02:03:07.746+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:03:07.747887730Z [2024-04-05T02:03:07.747+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:02:00+00:00, run_id=scheduled__2024-04-05T02:02:00+00:00, run_start_date=2024-04-05 02:03:00.324638+00:00, run_end_date=2024-04-05 02:03:07.747105+00:00, run_duration=7.422467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:02:00+00:00, data_interval_end=2024-04-05 02:03:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:03:07.763192909Z [2024-04-05T02:03:07.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:03:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:03:07.807443505Z [2024-04-05T02:03:07.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status success for try_number 1 2024-04-05T02:03:07.814814978Z [2024-04-05T02:03:07.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:02:00+00:00, map_index=-1, run_start_date=2024-04-05 02:03:03.740019+00:00, run_end_date=2024-04-05 02:03:07.388855+00:00, run_duration=3.648836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:03:00.378595+00:00, queued_by_job_id=1, pid=3053 2024-04-05T02:03:08.862470562Z [2024-04-05T02:03:08.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:03:08.863416868Z [2024-04-05T02:03:08.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:02:00+00:00, run_id=scheduled__2024-04-05T02:02:00+00:00, run_start_date=2024-04-05 02:03:00.322794+00:00, run_end_date=2024-04-05 02:03:08.863030+00:00, run_duration=8.540236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:02:00+00:00, data_interval_end=2024-04-05 02:03:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:03:08.873878752Z [2024-04-05T02:03:08.873+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:03:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:03:08.911028565Z [2024-04-05T02:03:08.910+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status success for try_number 1 2024-04-05T02:03:08.917468622Z [2024-04-05T02:03:08.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:02:00+00:00, map_index=-1, run_start_date=2024-04-05 02:03:03.817191+00:00, run_end_date=2024-04-05 02:03:07.935405+00:00, run_duration=4.118214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:03:00.378595+00:00, queued_by_job_id=1, pid=3054 2024-04-05T02:04:00.638088475Z [2024-04-05T02:04:00.637+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:04:00.653492506Z [2024-04-05T02:04:00.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:04:00.664390255Z [2024-04-05T02:04:00.664+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:04:00.813534416Z [2024-04-05T02:04:00.812+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:04:00.813559430Z 2024-04-05T02:04:00.813564520Z 2024-04-05T02:04:00.813568793Z 2024-04-05T02:04:00.813692408Z [2024-04-05T02:04:00.813+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:04:00.813879260Z [2024-04-05T02:04:00.813+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:04:00.814058769Z [2024-04-05T02:04:00.813+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:04:00.815700775Z [2024-04-05T02:04:00.814+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:04:00.815713041Z 2024-04-05T02:04:00.815717483Z 2024-04-05T02:04:00.815721170Z 2024-04-05T02:04:00.820050283Z [2024-04-05T02:04:00.819+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:04:00.820258338Z [2024-04-05T02:04:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:04:00.820535199Z [2024-04-05T02:04:00.820+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:04:00.821259738Z [2024-04-05T02:04:00.820+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:04:00.821553175Z [2024-04-05T02:04:00.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:04:00.821749665Z [2024-04-05T02:04:00.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:04:01.197454351Z [2024-04-05T02:04:01.196+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status queued for try_number 1 2024-04-05T02:04:01.202768955Z [2024-04-05T02:04:01.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status queued for try_number 1 2024-04-05T02:04:01.203013153Z [2024-04-05T02:04:01.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status queued for try_number 1 2024-04-05T02:04:01.246806038Z [2024-04-05T02:04:01.245+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4948fcd8-2b2d-4f75-9c34-2ac89bf42ff0 2024-04-05T02:04:01.247316383Z [2024-04-05T02:04:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94742ce8-501b-4f70-9466-2358ef51b28d 2024-04-05T02:04:01.253833386Z [2024-04-05T02:04:01.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to fde67f29-fb15-4bf8-8b9d-5b42b1b65a66 2024-04-05T02:04:03.559663400Z [2024-04-05T02:04:03.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status success for try_number 1 2024-04-05T02:04:03.598095372Z [2024-04-05T02:04:03.597+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:02:00+00:00, map_index=-1, run_start_date=2024-04-05 02:04:02.238849+00:00, run_end_date=2024-04-05 02:04:03.155109+00:00, run_duration=0.91626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:04:00.817217+00:00, queued_by_job_id=1, pid=3090 2024-04-05T02:04:04.835626115Z [2024-04-05T02:04:04.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:04:04.845136624Z [2024-04-05T02:04:04.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:02:00+00:00, run_id=scheduled__2024-04-05T02:02:00+00:00, run_start_date=2024-04-05 02:04:00.679379+00:00, run_end_date=2024-04-05 02:04:04.844524+00:00, run_duration=4.165145, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:02:00+00:00, data_interval_end=2024-04-05 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:04:04.887870239Z [2024-04-05T02:04:04.887+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:04:08.211411617Z [2024-04-05T02:04:08.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:04:08.212556703Z [2024-04-05T02:04:08.211+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:03:00+00:00, run_id=scheduled__2024-04-05T02:03:00+00:00, run_start_date=2024-04-05 02:04:00.681029+00:00, run_end_date=2024-04-05 02:04:08.211351+00:00, run_duration=7.530322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:03:00+00:00, data_interval_end=2024-04-05 02:04:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:04:08.243655237Z [2024-04-05T02:04:08.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:04:08.261564181Z [2024-04-05T02:04:08.261+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:04:08.262143664Z [2024-04-05T02:04:08.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:03:00+00:00, run_id=scheduled__2024-04-05T02:03:00+00:00, run_start_date=2024-04-05 02:04:00.682562+00:00, run_end_date=2024-04-05 02:04:08.261538+00:00, run_duration=7.578976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:03:00+00:00, data_interval_end=2024-04-05 02:04:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:04:08.285142254Z [2024-04-05T02:04:08.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:04:08.344390540Z [2024-04-05T02:04:08.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status success for try_number 1 2024-04-05T02:04:08.344729294Z [2024-04-05T02:04:08.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status success for try_number 1 2024-04-05T02:04:08.351550267Z [2024-04-05T02:04:08.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:03:00+00:00, map_index=-1, run_start_date=2024-04-05 02:04:05.098127+00:00, run_end_date=2024-04-05 02:04:07.847542+00:00, run_duration=2.749415, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:04:00.817217+00:00, queued_by_job_id=1, pid=3120 2024-04-05T02:04:08.351919862Z [2024-04-05T02:04:08.351+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:03:00+00:00, map_index=-1, run_start_date=2024-04-05 02:04:05.177692+00:00, run_end_date=2024-04-05 02:04:07.839432+00:00, run_duration=2.66174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:04:00.817217+00:00, queued_by_job_id=1, pid=3121 2024-04-05T02:05:00.603542842Z [2024-04-05T02:05:00.603+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:05:00.618995600Z [2024-04-05T02:05:00.618+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:05:00.634865999Z [2024-04-05T02:05:00.633+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:05:00.787367998Z [2024-04-05T02:05:00.779+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:05:00.787399466Z 2024-04-05T02:05:00.787406324Z 2024-04-05T02:05:00.787411581Z 2024-04-05T02:05:00.787416714Z [2024-04-05T02:05:00.780+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:05:00.787421962Z [2024-04-05T02:05:00.780+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:05:00.787445703Z [2024-04-05T02:05:00.780+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:05:00.787451244Z [2024-04-05T02:05:00.781+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:05:00.787455992Z 2024-04-05T02:05:00.787461167Z 2024-04-05T02:05:00.787466323Z 2024-04-05T02:05:00.804979789Z [2024-04-05T02:05:00.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:05:00.805001834Z [2024-04-05T02:05:00.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:05:00.805018472Z [2024-04-05T02:05:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:05:00.805024395Z [2024-04-05T02:05:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:05:00.805053506Z [2024-04-05T02:05:00.804+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:05:00.805058557Z [2024-04-05T02:05:00.804+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:05:01.145169327Z [2024-04-05T02:05:01.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:01.145610642Z [2024-04-05T02:05:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:01.145852444Z [2024-04-05T02:05:01.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:01.169548638Z [2024-04-05T02:05:01.168+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ef63137-95d8-48de-b2dc-4652295bba7d 2024-04-05T02:05:01.170599226Z [2024-04-05T02:05:01.169+0000] {scheduler_job.py:635} INFO - Setting external_id for to f54a879d-a1cb-4b5d-bbfe-c5f3ce4f1e22 2024-04-05T02:05:01.171015939Z [2024-04-05T02:05:01.170+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1520c39-abed-4168-9acb-dbb0e9efd3de 2024-04-05T02:05:08.055459464Z [2024-04-05T02:05:08.055+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:05:08.055484136Z 2024-04-05T02:05:08.055832832Z [2024-04-05T02:05:08.055+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:05:08.057058762Z [2024-04-05T02:05:08.056+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:05:08.057075335Z 2024-04-05T02:05:08.062068295Z [2024-04-05T02:05:08.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:05:08.062388921Z [2024-04-05T02:05:08.062+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:05:08.208871666Z [2024-04-05T02:05:08.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:08.209390315Z [2024-04-05T02:05:08.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:08.220582713Z [2024-04-05T02:05:08.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to 962d2960-7c8b-4f9c-90a4-ed05725a0096 2024-04-05T02:05:08.220982709Z [2024-04-05T02:05:08.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:06.358983+00:00, run_end_date=2024-04-05 02:05:07.418379+00:00, run_duration=1.059396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:00.796143+00:00, queued_by_job_id=1, pid=3179 2024-04-05T02:05:08.689496075Z [2024-04-05T02:05:08.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:05:08.690427317Z [2024-04-05T02:05:08.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:04:00+00:00, run_id=scheduled__2024-04-05T02:04:00+00:00, run_start_date=2024-04-05 02:05:00.647637+00:00, run_end_date=2024-04-05 02:05:08.689932+00:00, run_duration=8.042295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:04:00+00:00, data_interval_end=2024-04-05 02:05:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:05:08.716118875Z [2024-04-05T02:05:08.715+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:05:08.967029556Z [2024-04-05T02:05:08.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:08.998552459Z [2024-04-05T02:05:08.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:04:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:05.820017+00:00, run_end_date=2024-04-05 02:05:08.546139+00:00, run_duration=2.726122, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:00.796143+00:00, queued_by_job_id=1, pid=3178 2024-04-05T02:05:11.577512193Z [2024-04-05T02:05:11.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:05:11.577723681Z [2024-04-05T02:05:11.577+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:04:00+00:00, run_id=scheduled__2024-04-05T02:04:00+00:00, run_start_date=2024-04-05 02:05:00.646516+00:00, run_end_date=2024-04-05 02:05:11.577457+00:00, run_duration=10.930941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:04:00+00:00, data_interval_end=2024-04-05 02:05:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:05:11.597520414Z [2024-04-05T02:05:11.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:05:11.790950769Z [2024-04-05T02:05:11.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:11.815089743Z [2024-04-05T02:05:11.814+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:04:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:08.348622+00:00, run_end_date=2024-04-05 02:05:10.904574+00:00, run_duration=2.555952, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:00.796143+00:00, queued_by_job_id=1, pid=3208 2024-04-05T02:05:15.038168409Z [2024-04-05T02:05:15.037+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:05:15.038189109Z 2024-04-05T02:05:15.039126366Z [2024-04-05T02:05:15.038+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:05:15.039862529Z [2024-04-05T02:05:15.039+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:05:15.039875513Z 2024-04-05T02:05:15.044558240Z [2024-04-05T02:05:15.044+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:05:15.044814249Z [2024-04-05T02:05:15.044+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:05:15.104540192Z [2024-04-05T02:05:15.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:15.104572331Z [2024-04-05T02:05:15.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:15.120524063Z [2024-04-05T02:05:15.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 033cb7f5-18a9-4dd1-a77e-3ef855607c51 2024-04-05T02:05:15.120703830Z [2024-04-05T02:05:15.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:13.393817+00:00, run_end_date=2024-04-05 02:05:14.142153+00:00, run_duration=0.748336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:08.057857+00:00, queued_by_job_id=1, pid=3238 2024-04-05T02:05:19.066077547Z [2024-04-05T02:05:19.065+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:05:19.066104721Z 2024-04-05T02:05:19.066574208Z [2024-04-05T02:05:19.066+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:05:19.067637807Z [2024-04-05T02:05:19.067+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:05:19.067652092Z 2024-04-05T02:05:19.071166203Z [2024-04-05T02:05:19.070+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:05:19.071665298Z [2024-04-05T02:05:19.071+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:05:19.131810848Z [2024-04-05T02:05:19.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:19.131866802Z [2024-04-05T02:05:19.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:19.139430259Z [2024-04-05T02:05:19.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6ace5aa-e4c8-4673-aa6c-0b27ec328996 2024-04-05T02:05:19.139642121Z [2024-04-05T02:05:19.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=0, run_start_date=2024-04-05 02:05:18.118297+00:00, run_end_date=2024-04-05 02:05:18.461799+00:00, run_duration=0.343502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:15.040647+00:00, queued_by_job_id=1, pid=3253 2024-04-05T02:05:21.913162752Z [2024-04-05T02:05:21.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:05:21.913649988Z [2024-04-05T02:05:21.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:05:00.645131+00:00, run_end_date=2024-04-05 02:05:21.913239+00:00, run_duration=21.268108, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:05:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:05:21.919927719Z [2024-04-05T02:05:21.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:05:21.961640412Z [2024-04-05T02:05:21.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:21.967847943Z [2024-04-05T02:05:21.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:21.266385+00:00, run_end_date=2024-04-05 02:05:21.620219+00:00, run_duration=0.353834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:19.068315+00:00, queued_by_job_id=1, pid=3265 2024-04-05T02:06:00.425210905Z [2024-04-05T02:06:00.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:07:00+00:00 2024-04-05T02:06:00.442173835Z [2024-04-05T02:06:00.441+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:06:00.456057127Z [2024-04-05T02:06:00.455+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:06:00.545139146Z [2024-04-05T02:06:00.544+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:06:00.545166003Z 2024-04-05T02:06:00.545177721Z 2024-04-05T02:06:00.545183633Z 2024-04-05T02:06:00.545205129Z [2024-04-05T02:06:00.545+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:06:00.545318222Z [2024-04-05T02:06:00.545+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:06:00.545400729Z [2024-04-05T02:06:00.545+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:06:00.546782538Z [2024-04-05T02:06:00.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:06:00.546800362Z 2024-04-05T02:06:00.546807275Z 2024-04-05T02:06:00.546813494Z 2024-04-05T02:06:00.550508291Z [2024-04-05T02:06:00.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:06:00.550761565Z [2024-04-05T02:06:00.550+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:06:00.551065202Z [2024-04-05T02:06:00.550+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:06:00.551245986Z [2024-04-05T02:06:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:06:00.551509892Z [2024-04-05T02:06:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:06:00.551546125Z [2024-04-05T02:06:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:06:00.962029824Z [2024-04-05T02:06:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status queued for try_number 1 2024-04-05T02:06:00.962096441Z [2024-04-05T02:06:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:06:00.962257675Z [2024-04-05T02:06:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:06:00.977606006Z [2024-04-05T02:06:00.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17956dbd-07d5-4915-8c46-fcd7ef906cd9 2024-04-05T02:06:00.978845642Z [2024-04-05T02:06:00.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 078163e7-4688-4f47-a868-8cbc9f4c443b 2024-04-05T02:06:00.979114225Z [2024-04-05T02:06:00.978+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7637fdbf-73f1-461b-ae62-036eda2b9032 2024-04-05T02:06:03.915177564Z [2024-04-05T02:06:03.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:06:03.915498462Z [2024-04-05T02:06:03.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:04:00+00:00, run_id=scheduled__2024-04-05T02:04:00+00:00, run_start_date=2024-04-05 02:06:00.471757+00:00, run_end_date=2024-04-05 02:06:03.915023+00:00, run_duration=3.443266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:04:00+00:00, data_interval_end=2024-04-05 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:06:03.932858331Z [2024-04-05T02:06:03.931+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:06:04.061346436Z [2024-04-05T02:06:04.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status success for try_number 1 2024-04-05T02:06:04.075352277Z [2024-04-05T02:06:04.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:04:00+00:00, map_index=-1, run_start_date=2024-04-05 02:06:01.867848+00:00, run_end_date=2024-04-05 02:06:02.885231+00:00, run_duration=1.017383, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:06:00.547441+00:00, queued_by_job_id=1, pid=3269 2024-04-05T02:06:07.796483785Z [2024-04-05T02:06:07.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:06:07.797079880Z [2024-04-05T02:06:07.796+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:05:00+00:00, run_id=scheduled__2024-04-05T02:05:00+00:00, run_start_date=2024-04-05 02:06:00.474098+00:00, run_end_date=2024-04-05 02:06:07.796552+00:00, run_duration=7.322454, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:05:00+00:00, data_interval_end=2024-04-05 02:06:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:06:07.840336098Z [2024-04-05T02:06:07.839+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:07:00+00:00 2024-04-05T02:06:07.888031083Z [2024-04-05T02:06:07.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:06:07.899537260Z [2024-04-05T02:06:07.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:06:05.010625+00:00, run_end_date=2024-04-05 02:06:07.448195+00:00, run_duration=2.43757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:06:00.547441+00:00, queued_by_job_id=1, pid=3298 2024-04-05T02:06:08.995732919Z [2024-04-05T02:06:08.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:06:08.996263735Z [2024-04-05T02:06:08.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:05:00+00:00, run_id=scheduled__2024-04-05T02:05:00+00:00, run_start_date=2024-04-05 02:06:00.475648+00:00, run_end_date=2024-04-05 02:06:08.995870+00:00, run_duration=8.520222, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:05:00+00:00, data_interval_end=2024-04-05 02:06:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:06:09.010391915Z [2024-04-05T02:06:09.009+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:07:00+00:00 2024-04-05T02:06:09.062009192Z [2024-04-05T02:06:09.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:06:09.072447715Z [2024-04-05T02:06:09.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:06:05.063106+00:00, run_end_date=2024-04-05 02:06:08.058736+00:00, run_duration=2.99563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:06:00.547441+00:00, queued_by_job_id=1, pid=3299 2024-04-05T02:06:43.293518872Z [2024-04-05T02:06:43.293+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:07:00.793128398Z [2024-04-05T02:07:00.792+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:07:00.815243614Z [2024-04-05T02:07:00.814+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:07:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:07:00.909935795Z [2024-04-05T02:07:00.908+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:07:00.909966668Z 2024-04-05T02:07:00.910012768Z 2024-04-05T02:07:00.910466560Z [2024-04-05T02:07:00.909+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:07:00.910706943Z [2024-04-05T02:07:00.910+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:07:00.911389784Z [2024-04-05T02:07:00.911+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:07:00.911402156Z 2024-04-05T02:07:00.911406054Z 2024-04-05T02:07:00.916494124Z [2024-04-05T02:07:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:07:00.917606005Z [2024-04-05T02:07:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:07:00.917959124Z [2024-04-05T02:07:00.917+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:07:00.918162778Z [2024-04-05T02:07:00.917+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:07:01.187135750Z [2024-04-05T02:07:01.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status queued for try_number 1 2024-04-05T02:07:01.187311323Z [2024-04-05T02:07:01.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status queued for try_number 1 2024-04-05T02:07:01.196054829Z [2024-04-05T02:07:01.195+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c02a7e6-bf71-4621-a30d-a3b2978f742f 2024-04-05T02:07:01.196213588Z [2024-04-05T02:07:01.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to f23eb9a0-2b65-4b5b-98d9-30204e92e3d7 2024-04-05T02:07:09.041374713Z [2024-04-05T02:07:09.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:07:09.041707199Z [2024-04-05T02:07:09.041+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:06:00+00:00, run_id=scheduled__2024-04-05T02:06:00+00:00, run_start_date=2024-04-05 02:07:00.837073+00:00, run_end_date=2024-04-05 02:07:09.041347+00:00, run_duration=8.204274, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:06:00+00:00, data_interval_end=2024-04-05 02:07:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:07:09.056708666Z [2024-04-05T02:07:09.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:07:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:07:09.143503519Z [2024-04-05T02:07:09.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status success for try_number 1 2024-04-05T02:07:09.163036774Z [2024-04-05T02:07:09.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:06:00+00:00, map_index=-1, run_start_date=2024-04-05 02:07:05.605719+00:00, run_end_date=2024-04-05 02:07:07.966992+00:00, run_duration=2.361273, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:07:00.912031+00:00, queued_by_job_id=1, pid=3343 2024-04-05T02:07:09.804672001Z [2024-04-05T02:07:09.804+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:07:09.805147738Z [2024-04-05T02:07:09.804+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:06:00+00:00, run_id=scheduled__2024-04-05T02:06:00+00:00, run_start_date=2024-04-05 02:07:00.839603+00:00, run_end_date=2024-04-05 02:07:09.804766+00:00, run_duration=8.965163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:06:00+00:00, data_interval_end=2024-04-05 02:07:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:07:09.816914439Z [2024-04-05T02:07:09.816+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:07:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:07:09.879356608Z [2024-04-05T02:07:09.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status success for try_number 1 2024-04-05T02:07:09.890617722Z [2024-04-05T02:07:09.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:06:00+00:00, map_index=-1, run_start_date=2024-04-05 02:07:07.034610+00:00, run_end_date=2024-04-05 02:07:09.091335+00:00, run_duration=2.056725, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:07:00.912031+00:00, queued_by_job_id=1, pid=3362 2024-04-05T02:08:00.165271821Z [2024-04-05T02:08:00.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:09:00+00:00 2024-04-05T02:08:00.175598026Z [2024-04-05T02:08:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:08:00.182701694Z [2024-04-05T02:08:00.182+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:08:00.260921603Z [2024-04-05T02:08:00.260+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:08:00.260959490Z 2024-04-05T02:08:00.260964929Z 2024-04-05T02:08:00.260969742Z 2024-04-05T02:08:00.260991890Z [2024-04-05T02:08:00.260+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:08:00.261028386Z [2024-04-05T02:08:00.260+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:08:00.261097683Z [2024-04-05T02:08:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:08:00.262180562Z [2024-04-05T02:08:00.261+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:08:00.262202499Z 2024-04-05T02:08:00.262215106Z 2024-04-05T02:08:00.262239689Z 2024-04-05T02:08:00.266158442Z [2024-04-05T02:08:00.265+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:08:00.266343497Z [2024-04-05T02:08:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:08:00.266564732Z [2024-04-05T02:08:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:08:00.266634649Z [2024-04-05T02:08:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:08:00.266824848Z [2024-04-05T02:08:00.266+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:08:00.266885892Z [2024-04-05T02:08:00.266+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:08:00.546312960Z [2024-04-05T02:08:00.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status queued for try_number 1 2024-04-05T02:08:00.547656265Z [2024-04-05T02:08:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status queued for try_number 1 2024-04-05T02:08:00.548013535Z [2024-04-05T02:08:00.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status queued for try_number 1 2024-04-05T02:08:00.555851973Z [2024-04-05T02:08:00.555+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82cd13b7-366b-4acb-a947-5088f6100e51 2024-04-05T02:08:00.556586319Z [2024-04-05T02:08:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0b96cef-835b-4c90-b19b-0bff229dd180 2024-04-05T02:08:00.557000881Z [2024-04-05T02:08:00.556+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2315d067-d443-4ac5-8b44-02f7e54b752e 2024-04-05T02:08:03.031037592Z [2024-04-05T02:08:03.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:08:03.031362516Z [2024-04-05T02:08:03.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:06:00+00:00, run_id=scheduled__2024-04-05T02:06:00+00:00, run_start_date=2024-04-05 02:08:00.193674+00:00, run_end_date=2024-04-05 02:08:03.030965+00:00, run_duration=2.837291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:06:00+00:00, data_interval_end=2024-04-05 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:08:03.040334649Z [2024-04-05T02:08:03.039+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:08:03.103196129Z [2024-04-05T02:08:03.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status success for try_number 1 2024-04-05T02:08:03.111389000Z [2024-04-05T02:08:03.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:06:00+00:00, map_index=-1, run_start_date=2024-04-05 02:08:01.367600+00:00, run_end_date=2024-04-05 02:08:02.094133+00:00, run_duration=0.726533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:08:00.263163+00:00, queued_by_job_id=1, pid=3388 2024-04-05T02:08:07.701547634Z [2024-04-05T02:08:07.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:08:07.709649899Z [2024-04-05T02:08:07.705+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:07:00+00:00, run_id=scheduled__2024-04-05T02:07:00+00:00, run_start_date=2024-04-05 02:08:00.195543+00:00, run_end_date=2024-04-05 02:08:07.701473+00:00, run_duration=7.50593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:07:00+00:00, data_interval_end=2024-04-05 02:08:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:08:07.751170657Z [2024-04-05T02:08:07.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:09:00+00:00 2024-04-05T02:08:07.770533504Z [2024-04-05T02:08:07.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:08:07.771194005Z [2024-04-05T02:08:07.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:07:00+00:00, run_id=scheduled__2024-04-05T02:07:00+00:00, run_start_date=2024-04-05 02:08:00.197601+00:00, run_end_date=2024-04-05 02:08:07.770447+00:00, run_duration=7.572846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:07:00+00:00, data_interval_end=2024-04-05 02:08:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:08:07.798419628Z [2024-04-05T02:08:07.797+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:09:00+00:00 2024-04-05T02:08:07.873267175Z [2024-04-05T02:08:07.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status success for try_number 1 2024-04-05T02:08:07.873337946Z [2024-04-05T02:08:07.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status success for try_number 1 2024-04-05T02:08:07.879463146Z [2024-04-05T02:08:07.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:07:00+00:00, map_index=-1, run_start_date=2024-04-05 02:08:04.563782+00:00, run_end_date=2024-04-05 02:08:07.255637+00:00, run_duration=2.691855, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:08:00.263163+00:00, queued_by_job_id=1, pid=3419 2024-04-05T02:08:07.879552321Z [2024-04-05T02:08:07.879+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:07:00+00:00, map_index=-1, run_start_date=2024-04-05 02:08:04.229485+00:00, run_end_date=2024-04-05 02:08:07.149094+00:00, run_duration=2.919609, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:08:00.263163+00:00, queued_by_job_id=1, pid=3418 2024-04-05T02:09:00.956460185Z [2024-04-05T02:09:00.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:09:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:09:00.975781668Z [2024-04-05T02:09:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:09:01.071392593Z [2024-04-05T02:09:01.070+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:09:01.071426439Z 2024-04-05T02:09:01.071432707Z 2024-04-05T02:09:01.071745537Z [2024-04-05T02:09:01.071+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:09:01.072214031Z [2024-04-05T02:09:01.072+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:09:01.073422402Z [2024-04-05T02:09:01.073+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:09:01.073435903Z 2024-04-05T02:09:01.073439516Z 2024-04-05T02:09:01.077659645Z [2024-04-05T02:09:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:09:01.077889271Z [2024-04-05T02:09:01.077+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:09:01.078275076Z [2024-04-05T02:09:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:09:01.078419581Z [2024-04-05T02:09:01.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:09:01.363583506Z [2024-04-05T02:09:01.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status queued for try_number 1 2024-04-05T02:09:01.363617052Z [2024-04-05T02:09:01.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status queued for try_number 1 2024-04-05T02:09:01.376392282Z [2024-04-05T02:09:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70487c1a-0421-45db-bd49-c5c29dece9e8 2024-04-05T02:09:01.376489666Z [2024-04-05T02:09:01.376+0000] {scheduler_job.py:635} INFO - Setting external_id for to daae33f7-9fdf-43b4-9665-2098805fc8fa 2024-04-05T02:09:08.544470878Z [2024-04-05T02:09:08.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:09:08.551142057Z [2024-04-05T02:09:08.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:08:00+00:00, run_id=scheduled__2024-04-05T02:08:00+00:00, run_start_date=2024-04-05 02:09:00.994751+00:00, run_end_date=2024-04-05 02:09:08.544290+00:00, run_duration=7.549539, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:08:00+00:00, data_interval_end=2024-04-05 02:09:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:09:08.590266431Z [2024-04-05T02:09:08.589+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:09:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:09:08.601224880Z [2024-04-05T02:09:08.600+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:09:08.601413516Z [2024-04-05T02:09:08.601+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:08:00+00:00, run_id=scheduled__2024-04-05T02:08:00+00:00, run_start_date=2024-04-05 02:09:00.997742+00:00, run_end_date=2024-04-05 02:09:08.601139+00:00, run_duration=7.603397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:08:00+00:00, data_interval_end=2024-04-05 02:09:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:09:08.615356484Z [2024-04-05T02:09:08.615+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:09:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:09:08.650903855Z [2024-04-05T02:09:08.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status success for try_number 1 2024-04-05T02:09:08.651812903Z [2024-04-05T02:09:08.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status success for try_number 1 2024-04-05T02:09:08.665346429Z [2024-04-05T02:09:08.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:08:00+00:00, map_index=-1, run_start_date=2024-04-05 02:09:05.138535+00:00, run_end_date=2024-04-05 02:09:07.377849+00:00, run_duration=2.239314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:09:01.074330+00:00, queued_by_job_id=1, pid=3473 2024-04-05T02:09:08.667635217Z [2024-04-05T02:09:08.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:08:00+00:00, map_index=-1, run_start_date=2024-04-05 02:09:05.328396+00:00, run_end_date=2024-04-05 02:09:07.836867+00:00, run_duration=2.508471, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:09:01.074330+00:00, queued_by_job_id=1, pid=3474 2024-04-05T02:10:00.093699715Z [2024-04-05T02:10:00.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:10:00.105118265Z [2024-04-05T02:10:00.104+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:10:00.121292979Z [2024-04-05T02:10:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:11:00+00:00 2024-04-05T02:10:00.131411275Z [2024-04-05T02:10:00.131+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:10:00.238557714Z [2024-04-05T02:10:00.237+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:10:00.238576200Z 2024-04-05T02:10:00.238581118Z 2024-04-05T02:10:00.238586231Z 2024-04-05T02:10:00.238607020Z 2024-04-05T02:10:00.238725285Z [2024-04-05T02:10:00.238+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:10:00.239990146Z [2024-04-05T02:10:00.238+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:10:00.240211664Z [2024-04-05T02:10:00.239+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:10:00.240368881Z [2024-04-05T02:10:00.240+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:10:00.241011587Z [2024-04-05T02:10:00.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:10:00.241021820Z 2024-04-05T02:10:00.241026028Z 2024-04-05T02:10:00.241029563Z 2024-04-05T02:10:00.241032872Z 2024-04-05T02:10:00.246836864Z [2024-04-05T02:10:00.246+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:10:00.247020518Z [2024-04-05T02:10:00.246+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:10:00.247323552Z [2024-04-05T02:10:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:00.247489272Z [2024-04-05T02:10:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:10:00.247751163Z [2024-04-05T02:10:00.247+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:00.247917657Z [2024-04-05T02:10:00.247+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:10:00.248186907Z [2024-04-05T02:10:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:00.248335723Z [2024-04-05T02:10:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:10:00.786231815Z [2024-04-05T02:10:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:00.789389085Z [2024-04-05T02:10:00.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:00.789397226Z [2024-04-05T02:10:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:00.789400630Z [2024-04-05T02:10:00.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:00.801374534Z [2024-04-05T02:10:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to aee6795a-d80e-4f9a-bd16-a24d19719437 2024-04-05T02:10:00.801401880Z [2024-04-05T02:10:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2509cf47-c81c-4275-98c2-05127982ed96 2024-04-05T02:10:00.801405925Z [2024-04-05T02:10:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5774e33-856e-4fa4-9229-14e374d3fb61 2024-04-05T02:10:00.801409413Z [2024-04-05T02:10:00.800+0000] {scheduler_job.py:635} INFO - Setting external_id for to 18208f0e-0b2c-4be1-a720-0d48d6098437 2024-04-05T02:10:04.811556458Z [2024-04-05T02:10:04.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:04.814501190Z [2024-04-05T02:10:04.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:08:00+00:00, run_id=scheduled__2024-04-05T02:08:00+00:00, run_start_date=2024-04-05 02:10:00.145585+00:00, run_end_date=2024-04-05 02:10:04.813578+00:00, run_duration=4.667993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:08:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:10:04.851873305Z [2024-04-05T02:10:04.847+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:10:05.346750898Z [2024-04-05T02:10:05.346+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:05.382911413Z [2024-04-05T02:10:05.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:08:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:02.172841+00:00, run_end_date=2024-04-05 02:10:03.989510+00:00, run_duration=1.816669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.242044+00:00, queued_by_job_id=1, pid=3510 2024-04-05T02:10:07.761758053Z [2024-04-05T02:10:07.761+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:10:07.761817748Z 2024-04-05T02:10:07.761886998Z [2024-04-05T02:10:07.761+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:10:07.762834027Z [2024-04-05T02:10:07.762+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:10:07.762851350Z 2024-04-05T02:10:07.769937902Z [2024-04-05T02:10:07.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:10:07.770228729Z [2024-04-05T02:10:07.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:10:07.957897844Z [2024-04-05T02:10:07.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:07.960823964Z [2024-04-05T02:10:07.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:07.986555105Z [2024-04-05T02:10:07.986+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55364f09-ce87-46ac-852b-94e9994f7bbc 2024-04-05T02:10:07.988945264Z [2024-04-05T02:10:07.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:05.265621+00:00, run_end_date=2024-04-05 02:10:07.080710+00:00, run_duration=1.815089, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.242044+00:00, queued_by_job_id=1, pid=3541 2024-04-05T02:10:09.784033884Z [2024-04-05T02:10:09.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:09.822138336Z [2024-04-05T02:10:09.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:09:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:06.851419+00:00, run_end_date=2024-04-05 02:10:09.223608+00:00, run_duration=2.372189, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.242044+00:00, queued_by_job_id=1, pid=3561 2024-04-05T02:10:10.918421187Z [2024-04-05T02:10:10.918+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:10.919482130Z [2024-04-05T02:10:10.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:09:00+00:00, run_id=scheduled__2024-04-05T02:09:00+00:00, run_start_date=2024-04-05 02:10:00.146855+00:00, run_end_date=2024-04-05 02:10:10.918349+00:00, run_duration=10.771494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:09:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:10:10.951362211Z [2024-04-05T02:10:10.950+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:11:00+00:00 2024-04-05T02:10:10.978188837Z [2024-04-05T02:10:10.977+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:10.978484957Z [2024-04-05T02:10:10.978+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:09:00+00:00, run_id=scheduled__2024-04-05T02:09:00+00:00, run_start_date=2024-04-05 02:10:00.148006+00:00, run_end_date=2024-04-05 02:10:10.978075+00:00, run_duration=10.830069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:09:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:10:11.002354085Z [2024-04-05T02:10:11.002+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:11:00+00:00 2024-04-05T02:10:11.093610753Z [2024-04-05T02:10:11.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:11.102485640Z [2024-04-05T02:10:11.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:09:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:06.037790+00:00, run_end_date=2024-04-05 02:10:09.520808+00:00, run_duration=3.483018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.242044+00:00, queued_by_job_id=1, pid=3551 2024-04-05T02:10:12.109166310Z [2024-04-05T02:10:12.108+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:10:12.109182691Z 2024-04-05T02:10:12.110148468Z [2024-04-05T02:10:12.109+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:10:12.111254030Z [2024-04-05T02:10:12.110+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:10:12.111286116Z 2024-04-05T02:10:12.116494736Z [2024-04-05T02:10:12.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:10:12.116910271Z [2024-04-05T02:10:12.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:10:12.204511044Z [2024-04-05T02:10:12.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:12.204950336Z [2024-04-05T02:10:12.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:12.213635647Z [2024-04-05T02:10:12.213+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fca45d6-6d88-4211-9fc1-a184601c9c28 2024-04-05T02:10:12.214087484Z [2024-04-05T02:10:12.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:10.838683+00:00, run_end_date=2024-04-05 02:10:11.480000+00:00, run_duration=0.641317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:07.766370+00:00, queued_by_job_id=1, pid=3601 2024-04-05T02:10:15.969763667Z [2024-04-05T02:10:15.969+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:10:15.969801351Z 2024-04-05T02:10:15.969818526Z [2024-04-05T02:10:15.969+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:10:15.970458791Z [2024-04-05T02:10:15.970+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:10:15.970472825Z 2024-04-05T02:10:15.973164391Z [2024-04-05T02:10:15.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:15.973286556Z [2024-04-05T02:10:15.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:10:16.099811816Z [2024-04-05T02:10:16.096+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:16.113518079Z [2024-04-05T02:10:16.113+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47514956-3c8e-4d5d-a809-53c182b25167 2024-04-05T02:10:16.236742060Z [2024-04-05T02:10:16.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:16.243210414Z [2024-04-05T02:10:16.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=0, run_start_date=2024-04-05 02:10:15.322150+00:00, run_end_date=2024-04-05 02:10:15.852084+00:00, run_duration=0.529934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:12.111912+00:00, queued_by_job_id=1, pid=3616 2024-04-05T02:10:18.975710747Z [2024-04-05T02:10:18.975+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:18.976550690Z [2024-04-05T02:10:18.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:05:00+00:00, run_id=scheduled__2024-04-05T02:05:00+00:00, run_start_date=2024-04-05 02:10:00.144413+00:00, run_end_date=2024-04-05 02:10:18.976163+00:00, run_duration=18.83175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:05:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:10:18.985027934Z [2024-04-05T02:10:18.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:10:19.020059738Z [2024-04-05T02:10:19.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:19.026103984Z [2024-04-05T02:10:19.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:18.261423+00:00, run_end_date=2024-04-05 02:10:18.609365+00:00, run_duration=0.347942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:15.970864+00:00, queued_by_job_id=1, pid=3628 2024-04-05T02:11:00.528711417Z [2024-04-05T02:11:00.528+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:11:00.570732471Z [2024-04-05T02:11:00.570+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:11:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:11:00.643263532Z [2024-04-05T02:11:00.642+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:11:00.643310781Z 2024-04-05T02:11:00.643331550Z 2024-04-05T02:11:00.643469849Z [2024-04-05T02:11:00.643+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:11:00.643673851Z [2024-04-05T02:11:00.643+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:11:00.644315154Z [2024-04-05T02:11:00.644+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:11:00.644326335Z 2024-04-05T02:11:00.644329806Z 2024-04-05T02:11:00.647384568Z [2024-04-05T02:11:00.647+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:11:00.647608738Z [2024-04-05T02:11:00.647+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:11:00.647938458Z [2024-04-05T02:11:00.647+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:11:00.648228952Z [2024-04-05T02:11:00.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:11:00.883450387Z [2024-04-05T02:11:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:11:00.883631061Z [2024-04-05T02:11:00.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:11:00.897134989Z [2024-04-05T02:11:00.896+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1146eba4-e051-411e-98ef-e096747b7a00 2024-04-05T02:11:00.899217741Z [2024-04-05T02:11:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2091206c-ac17-40b0-940f-51dfdb4a2ef5 2024-04-05T02:11:07.681866445Z [2024-04-05T02:11:07.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:11:07.682418051Z [2024-04-05T02:11:07.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:11:00.588674+00:00, run_end_date=2024-04-05 02:11:07.681783+00:00, run_duration=7.093109, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:11:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:11:07.694369276Z [2024-04-05T02:11:07.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:11:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:11:07.748918257Z [2024-04-05T02:11:07.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:11:07.761991435Z [2024-04-05T02:11:07.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:11:04.196398+00:00, run_end_date=2024-04-05 02:11:06.924681+00:00, run_duration=2.728283, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:11:00.644929+00:00, queued_by_job_id=1, pid=3651 2024-04-05T02:11:08.884840231Z [2024-04-05T02:11:08.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:11:08.885292657Z [2024-04-05T02:11:08.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:11:00.586621+00:00, run_end_date=2024-04-05 02:11:08.884927+00:00, run_duration=8.298306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:11:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:11:08.894799625Z [2024-04-05T02:11:08.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:11:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:11:08.981825777Z [2024-04-05T02:11:08.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:11:08.993162773Z [2024-04-05T02:11:08.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:11:04.401027+00:00, run_end_date=2024-04-05 02:11:08.236784+00:00, run_duration=3.835757, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:11:00.644929+00:00, queued_by_job_id=1, pid=3652 2024-04-05T02:11:43.385068611Z [2024-04-05T02:11:43.384+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:12:00.760363074Z [2024-04-05T02:12:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:13:00+00:00 2024-04-05T02:12:00.767792652Z [2024-04-05T02:12:00.766+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:12:00.777865849Z [2024-04-05T02:12:00.777+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:12:00.885912252Z [2024-04-05T02:12:00.885+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:12:00.885929122Z 2024-04-05T02:12:00.885934001Z 2024-04-05T02:12:00.885952331Z 2024-04-05T02:12:00.886236988Z [2024-04-05T02:12:00.886+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:12:00.886431664Z [2024-04-05T02:12:00.886+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:12:00.886588404Z [2024-04-05T02:12:00.886+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:12:00.887344803Z [2024-04-05T02:12:00.887+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:12:00.887357991Z 2024-04-05T02:12:00.887363423Z 2024-04-05T02:12:00.887369303Z 2024-04-05T02:12:00.894347371Z [2024-04-05T02:12:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:12:00.894494791Z [2024-04-05T02:12:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:12:00.894774284Z [2024-04-05T02:12:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:12:00.894863801Z [2024-04-05T02:12:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:12:00.895037224Z [2024-04-05T02:12:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:12:00.895109671Z [2024-04-05T02:12:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:12:01.207839344Z [2024-04-05T02:12:01.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:12:01.208043935Z [2024-04-05T02:12:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status queued for try_number 1 2024-04-05T02:12:01.208197706Z [2024-04-05T02:12:01.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status queued for try_number 1 2024-04-05T02:12:01.223563540Z [2024-04-05T02:12:01.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfe69973-3d44-45a5-b141-bd9030d514f6 2024-04-05T02:12:01.223984794Z [2024-04-05T02:12:01.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e83e1b6-7cb5-4df0-a0e7-b0f030465780 2024-04-05T02:12:01.224244142Z [2024-04-05T02:12:01.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2d51d87-5212-43e7-8301-24a3b50646e8 2024-04-05T02:12:03.647799062Z [2024-04-05T02:12:03.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:12:03.664885423Z [2024-04-05T02:12:03.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:12:02.171480+00:00, run_end_date=2024-04-05 02:12:03.087944+00:00, run_duration=0.916464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:12:00.889419+00:00, queued_by_job_id=1, pid=3687 2024-04-05T02:12:04.784429913Z [2024-04-05T02:12:04.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:12:04.785288301Z [2024-04-05T02:12:04.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:12:00.800705+00:00, run_end_date=2024-04-05 02:12:04.784400+00:00, run_duration=3.983695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:12:04.802785242Z [2024-04-05T02:12:04.802+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:12:08.392131247Z [2024-04-05T02:12:08.391+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:12:08.392567704Z [2024-04-05T02:12:08.392+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:11:00+00:00, run_id=scheduled__2024-04-05T02:11:00+00:00, run_start_date=2024-04-05 02:12:00.803310+00:00, run_end_date=2024-04-05 02:12:08.392028+00:00, run_duration=7.588718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:11:00+00:00, data_interval_end=2024-04-05 02:12:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:12:08.409897889Z [2024-04-05T02:12:08.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:13:00+00:00 2024-04-05T02:12:08.431614557Z [2024-04-05T02:12:08.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:12:08.432032314Z [2024-04-05T02:12:08.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:11:00+00:00, run_id=scheduled__2024-04-05T02:11:00+00:00, run_start_date=2024-04-05 02:12:00.805116+00:00, run_end_date=2024-04-05 02:12:08.431545+00:00, run_duration=7.626429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:11:00+00:00, data_interval_end=2024-04-05 02:12:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:12:08.471257423Z [2024-04-05T02:12:08.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:13:00+00:00 2024-04-05T02:12:08.510469516Z [2024-04-05T02:12:08.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status success for try_number 1 2024-04-05T02:12:08.510785389Z [2024-04-05T02:12:08.510+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status success for try_number 1 2024-04-05T02:12:08.517707635Z [2024-04-05T02:12:08.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:11:00+00:00, map_index=-1, run_start_date=2024-04-05 02:12:05.778837+00:00, run_end_date=2024-04-05 02:12:07.735293+00:00, run_duration=1.956456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:12:00.889419+00:00, queued_by_job_id=1, pid=3718 2024-04-05T02:12:08.518250963Z [2024-04-05T02:12:08.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:11:00+00:00, map_index=-1, run_start_date=2024-04-05 02:12:05.583734+00:00, run_end_date=2024-04-05 02:12:07.985334+00:00, run_duration=2.4016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:12:00.889419+00:00, queued_by_job_id=1, pid=3717 2024-04-05T02:13:00.566703723Z [2024-04-05T02:13:00.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:13:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:13:00.579188029Z [2024-04-05T02:13:00.578+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:13:00.659440495Z [2024-04-05T02:13:00.659+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:13:00.659467478Z 2024-04-05T02:13:00.659471284Z 2024-04-05T02:13:00.659688298Z [2024-04-05T02:13:00.659+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:13:00.659970945Z [2024-04-05T02:13:00.659+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:13:00.660650923Z [2024-04-05T02:13:00.660+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:13:00.660662828Z 2024-04-05T02:13:00.660666572Z 2024-04-05T02:13:00.667754929Z [2024-04-05T02:13:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:13:00.668007344Z [2024-04-05T02:13:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:13:00.668362581Z [2024-04-05T02:13:00.668+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:13:00.668613361Z [2024-04-05T02:13:00.668+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:13:01.013246362Z [2024-04-05T02:13:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status queued for try_number 1 2024-04-05T02:13:01.013485901Z [2024-04-05T02:13:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status queued for try_number 1 2024-04-05T02:13:01.028496574Z [2024-04-05T02:13:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to a43c8a47-45dd-4859-8180-6314c25e5c38 2024-04-05T02:13:01.028903159Z [2024-04-05T02:13:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to e45f647d-9216-4835-8635-8c726551d997 2024-04-05T02:13:08.282752876Z [2024-04-05T02:13:08.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:13:08.283559287Z [2024-04-05T02:13:08.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:12:00+00:00, run_id=scheduled__2024-04-05T02:12:00+00:00, run_start_date=2024-04-05 02:13:00.602909+00:00, run_end_date=2024-04-05 02:13:08.283074+00:00, run_duration=7.680165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:12:00+00:00, data_interval_end=2024-04-05 02:13:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:13:08.293872747Z [2024-04-05T02:13:08.293+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:13:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:13:08.360161635Z [2024-04-05T02:13:08.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status success for try_number 1 2024-04-05T02:13:08.365042370Z [2024-04-05T02:13:08.364+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:12:00+00:00, map_index=-1, run_start_date=2024-04-05 02:13:05.193835+00:00, run_end_date=2024-04-05 02:13:07.994792+00:00, run_duration=2.800957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:13:00.661290+00:00, queued_by_job_id=1, pid=3771 2024-04-05T02:13:09.404279846Z [2024-04-05T02:13:09.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:13:09.404627395Z [2024-04-05T02:13:09.404+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:12:00+00:00, run_id=scheduled__2024-04-05T02:12:00+00:00, run_start_date=2024-04-05 02:13:00.604376+00:00, run_end_date=2024-04-05 02:13:09.404327+00:00, run_duration=8.799951, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:12:00+00:00, data_interval_end=2024-04-05 02:13:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:13:09.413140236Z [2024-04-05T02:13:09.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:13:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:13:09.458469496Z [2024-04-05T02:13:09.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status success for try_number 1 2024-04-05T02:13:09.463744828Z [2024-04-05T02:13:09.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:12:00+00:00, map_index=-1, run_start_date=2024-04-05 02:13:05.241555+00:00, run_end_date=2024-04-05 02:13:08.426212+00:00, run_duration=3.184657, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:13:00.661290+00:00, queued_by_job_id=1, pid=3772 2024-04-05T02:14:00.622776065Z [2024-04-05T02:14:00.622+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:14:00.633602435Z [2024-04-05T02:14:00.633+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:14:00.647874766Z [2024-04-05T02:14:00.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:14:00.799444979Z [2024-04-05T02:14:00.799+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:14:00.799459187Z 2024-04-05T02:14:00.799464115Z 2024-04-05T02:14:00.799467767Z 2024-04-05T02:14:00.799521532Z [2024-04-05T02:14:00.799+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:14:00.799610729Z [2024-04-05T02:14:00.799+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:14:00.799687405Z [2024-04-05T02:14:00.799+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:14:00.803374364Z [2024-04-05T02:14:00.800+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:14:00.803395146Z 2024-04-05T02:14:00.803399823Z 2024-04-05T02:14:00.803403407Z 2024-04-05T02:14:00.807482052Z [2024-04-05T02:14:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:14:00.807628766Z [2024-04-05T02:14:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:14:00.807854795Z [2024-04-05T02:14:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:14:00.807960259Z [2024-04-05T02:14:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:14:00.808113496Z [2024-04-05T02:14:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:14:00.808214393Z [2024-04-05T02:14:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:14:01.327758768Z [2024-04-05T02:14:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status queued for try_number 1 2024-04-05T02:14:01.327844805Z [2024-04-05T02:14:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status queued for try_number 1 2024-04-05T02:14:01.327959964Z [2024-04-05T02:14:01.327+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status queued for try_number 1 2024-04-05T02:14:01.345338263Z [2024-04-05T02:14:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88cf40bc-c9e5-4740-b8bf-35b82198b09d 2024-04-05T02:14:01.345670090Z [2024-04-05T02:14:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ffbcd1d-c8f3-45bd-8b16-463bd3466907 2024-04-05T02:14:01.345864332Z [2024-04-05T02:14:01.345+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94832a6c-052f-4dfe-8aa6-83643c083394 2024-04-05T02:14:03.768422445Z [2024-04-05T02:14:03.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:14:03.777680872Z [2024-04-05T02:14:03.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:12:00+00:00, run_id=scheduled__2024-04-05T02:12:00+00:00, run_start_date=2024-04-05 02:14:00.664794+00:00, run_end_date=2024-04-05 02:14:03.770809+00:00, run_duration=3.106015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:12:00+00:00, data_interval_end=2024-04-05 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:14:03.808497798Z [2024-04-05T02:14:03.803+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:14:03.995629574Z [2024-04-05T02:14:03.995+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status success for try_number 1 2024-04-05T02:14:04.010522542Z [2024-04-05T02:14:04.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:12:00+00:00, map_index=-1, run_start_date=2024-04-05 02:14:02.252022+00:00, run_end_date=2024-04-05 02:14:03.472999+00:00, run_duration=1.220977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:14:00.801766+00:00, queued_by_job_id=1, pid=3807 2024-04-05T02:14:08.791467428Z [2024-04-05T02:14:08.791+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:14:08.791636061Z [2024-04-05T02:14:08.791+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:13:00+00:00, run_id=scheduled__2024-04-05T02:13:00+00:00, run_start_date=2024-04-05 02:14:00.666724+00:00, run_end_date=2024-04-05 02:14:08.791354+00:00, run_duration=8.12463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:13:00+00:00, data_interval_end=2024-04-05 02:14:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:14:08.804602697Z [2024-04-05T02:14:08.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:14:08.817740844Z [2024-04-05T02:14:08.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:14:08.818162757Z [2024-04-05T02:14:08.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:13:00+00:00, run_id=scheduled__2024-04-05T02:13:00+00:00, run_start_date=2024-04-05 02:14:00.668166+00:00, run_end_date=2024-04-05 02:14:08.817720+00:00, run_duration=8.149554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:13:00+00:00, data_interval_end=2024-04-05 02:14:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:14:08.832225743Z [2024-04-05T02:14:08.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:14:08.899447976Z [2024-04-05T02:14:08.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status success for try_number 1 2024-04-05T02:14:08.906711941Z [2024-04-05T02:14:08.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:13:00+00:00, map_index=-1, run_start_date=2024-04-05 02:14:05.314678+00:00, run_end_date=2024-04-05 02:14:08.166126+00:00, run_duration=2.851448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:14:00.801766+00:00, queued_by_job_id=1, pid=3836 2024-04-05T02:14:09.994485763Z [2024-04-05T02:14:09.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status success for try_number 1 2024-04-05T02:14:10.000305763Z [2024-04-05T02:14:09.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:13:00+00:00, map_index=-1, run_start_date=2024-04-05 02:14:05.393537+00:00, run_end_date=2024-04-05 02:14:08.721483+00:00, run_duration=3.327946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:14:00.801766+00:00, queued_by_job_id=1, pid=3837 2024-04-05T02:15:00.597465304Z [2024-04-05T02:15:00.596+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:15:00.620006126Z [2024-04-05T02:15:00.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:15:00.640035421Z [2024-04-05T02:15:00.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:15:00.754065752Z [2024-04-05T02:15:00.753+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:15:00.754098718Z 2024-04-05T02:15:00.754107496Z 2024-04-05T02:15:00.754111802Z 2024-04-05T02:15:00.754195279Z [2024-04-05T02:15:00.753+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:15:00.754322166Z [2024-04-05T02:15:00.754+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:15:00.754427798Z [2024-04-05T02:15:00.754+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:15:00.755129244Z [2024-04-05T02:15:00.754+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:15:00.755138623Z 2024-04-05T02:15:00.755143379Z 2024-04-05T02:15:00.755147595Z 2024-04-05T02:15:00.763723155Z [2024-04-05T02:15:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:15:00.763841701Z [2024-04-05T02:15:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:15:00.764438220Z [2024-04-05T02:15:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:15:00.764466885Z [2024-04-05T02:15:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:15:00.764486783Z [2024-04-05T02:15:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:15:00.764491489Z [2024-04-05T02:15:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:15:01.142335128Z [2024-04-05T02:15:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:01.142503090Z [2024-04-05T02:15:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:01.142551898Z [2024-04-05T02:15:01.142+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:01.154977869Z [2024-04-05T02:15:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7014ac4c-88fd-41fd-8ca7-36f0cf682eb9 2024-04-05T02:15:01.155078077Z [2024-04-05T02:15:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58e2575f-ebdc-4dca-8040-169ec0c3b772 2024-04-05T02:15:01.155133438Z [2024-04-05T02:15:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to abff66f3-8b83-4145-9856-6fdbb18ff74e 2024-04-05T02:15:07.989942553Z [2024-04-05T02:15:07.989+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:15:07.989988508Z 2024-04-05T02:15:07.990572784Z [2024-04-05T02:15:07.990+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:15:07.992573954Z [2024-04-05T02:15:07.992+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:15:07.992591078Z 2024-04-05T02:15:08.004064053Z [2024-04-05T02:15:08.003+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:15:08.004668732Z [2024-04-05T02:15:08.004+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:15:08.086608007Z [2024-04-05T02:15:08.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:08.086893665Z [2024-04-05T02:15:08.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:08.103374209Z [2024-04-05T02:15:08.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdf489b3-1ed0-454d-9012-9fcc14803f22 2024-04-05T02:15:08.105106396Z [2024-04-05T02:15:08.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:06.864468+00:00, run_end_date=2024-04-05 02:15:07.534627+00:00, run_duration=0.670159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:00.755994+00:00, queued_by_job_id=1, pid=3922 2024-04-05T02:15:09.522080564Z [2024-04-05T02:15:09.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:15:09.524126752Z [2024-04-05T02:15:09.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:14:00+00:00, run_id=scheduled__2024-04-05T02:14:00+00:00, run_start_date=2024-04-05 02:15:00.658653+00:00, run_end_date=2024-04-05 02:15:09.523464+00:00, run_duration=8.864811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:14:00+00:00, data_interval_end=2024-04-05 02:15:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:15:09.562116342Z [2024-04-05T02:15:09.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:15:09.570697489Z [2024-04-05T02:15:09.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:15:09.570919074Z [2024-04-05T02:15:09.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:14:00+00:00, run_id=scheduled__2024-04-05T02:14:00+00:00, run_start_date=2024-04-05 02:15:00.660379+00:00, run_end_date=2024-04-05 02:15:09.570602+00:00, run_duration=8.910223, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:14:00+00:00, data_interval_end=2024-04-05 02:15:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:15:09.603141195Z [2024-04-05T02:15:09.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:15:09.769790105Z [2024-04-05T02:15:09.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:09.770026325Z [2024-04-05T02:15:09.769+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:09.792716958Z [2024-04-05T02:15:09.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:14:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:05.857374+00:00, run_end_date=2024-04-05 02:15:08.446285+00:00, run_duration=2.588911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:00.755994+00:00, queued_by_job_id=1, pid=3900 2024-04-05T02:15:09.795071817Z [2024-04-05T02:15:09.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:14:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:05.404316+00:00, run_end_date=2024-04-05 02:15:08.905385+00:00, run_duration=3.501069, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:00.755994+00:00, queued_by_job_id=1, pid=3893 2024-04-05T02:15:13.384275293Z [2024-04-05T02:15:13.383+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:15:13.384310901Z 2024-04-05T02:15:13.384695345Z [2024-04-05T02:15:13.384+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:15:13.397738572Z [2024-04-05T02:15:13.397+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:15:13.397780822Z 2024-04-05T02:15:13.410270588Z [2024-04-05T02:15:13.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:15:13.412652525Z [2024-04-05T02:15:13.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:15:13.670532851Z [2024-04-05T02:15:13.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:13.670952915Z [2024-04-05T02:15:13.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:13.683604507Z [2024-04-05T02:15:13.683+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7ce3187-8837-4d94-9646-6e81395381a7 2024-04-05T02:15:13.683934677Z [2024-04-05T02:15:13.683+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:11.861271+00:00, run_end_date=2024-04-05 02:15:12.531473+00:00, run_duration=0.670202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:07.998663+00:00, queued_by_job_id=1, pid=3953 2024-04-05T02:15:18.208034429Z [2024-04-05T02:15:18.207+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:15:18.208069516Z 2024-04-05T02:15:18.208351432Z [2024-04-05T02:15:18.208+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:15:18.210188407Z [2024-04-05T02:15:18.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:15:18.210206449Z 2024-04-05T02:15:18.216447879Z [2024-04-05T02:15:18.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:15:18.217195580Z [2024-04-05T02:15:18.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:15:18.303385483Z [2024-04-05T02:15:18.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:18.303591943Z [2024-04-05T02:15:18.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:18.320963960Z [2024-04-05T02:15:18.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39330d6c-7f1e-4aef-bdab-217413917973 2024-04-05T02:15:18.321103780Z [2024-04-05T02:15:18.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=0, run_start_date=2024-04-05 02:15:17.330554+00:00, run_end_date=2024-04-05 02:15:17.738343+00:00, run_duration=0.407789, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:13.402626+00:00, queued_by_job_id=1, pid=3968 2024-04-05T02:15:20.922826523Z [2024-04-05T02:15:20.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:15:20.923261787Z [2024-04-05T02:15:20.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:15:00.656373+00:00, run_end_date=2024-04-05 02:15:20.922853+00:00, run_duration=20.26648, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:15:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:15:20.930956340Z [2024-04-05T02:15:20.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:15:20.958957967Z [2024-04-05T02:15:20.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:20.966705927Z [2024-04-05T02:15:20.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:20.302223+00:00, run_end_date=2024-04-05 02:15:20.663435+00:00, run_duration=0.361212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:18.211458+00:00, queued_by_job_id=1, pid=3980 2024-04-05T02:16:00.519517315Z [2024-04-05T02:16:00.518+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:16:00.534443168Z [2024-04-05T02:16:00.533+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:16:00.551261222Z [2024-04-05T02:16:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:17:00+00:00 2024-04-05T02:16:00.648316881Z [2024-04-05T02:16:00.647+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:16:00.648345942Z 2024-04-05T02:16:00.648355847Z 2024-04-05T02:16:00.648361643Z 2024-04-05T02:16:00.648501617Z [2024-04-05T02:16:00.648+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:16:00.648737902Z [2024-04-05T02:16:00.648+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:16:00.649455609Z [2024-04-05T02:16:00.648+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:16:00.649660458Z [2024-04-05T02:16:00.649+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:16:00.649704860Z 2024-04-05T02:16:00.649711912Z 2024-04-05T02:16:00.649717697Z 2024-04-05T02:16:00.656706363Z [2024-04-05T02:16:00.656+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:16:00.657005869Z [2024-04-05T02:16:00.656+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:16:00.657427632Z [2024-04-05T02:16:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:16:00.657560980Z [2024-04-05T02:16:00.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:16:00.657880937Z [2024-04-05T02:16:00.657+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:16:00.658164662Z [2024-04-05T02:16:00.657+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:16:01.201852024Z [2024-04-05T02:16:01.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status queued for try_number 1 2024-04-05T02:16:01.202307009Z [2024-04-05T02:16:01.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:16:01.202756946Z [2024-04-05T02:16:01.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:16:01.215965366Z [2024-04-05T02:16:01.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9243a37-3d8a-464a-9fb8-5ba8f1d6a823 2024-04-05T02:16:01.216436400Z [2024-04-05T02:16:01.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e63ddb2-5557-4d52-b1c8-7700833e311c 2024-04-05T02:16:01.216869141Z [2024-04-05T02:16:01.216+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfd15bd5-e6ef-4b5f-b063-51ddb7ec2a08 2024-04-05T02:16:03.569670001Z [2024-04-05T02:16:03.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:16:03.569686848Z [2024-04-05T02:16:03.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:14:00+00:00, run_id=scheduled__2024-04-05T02:14:00+00:00, run_start_date=2024-04-05 02:16:00.565802+00:00, run_end_date=2024-04-05 02:16:03.563701+00:00, run_duration=2.997899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:14:00+00:00, data_interval_end=2024-04-05 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:16:03.590404541Z [2024-04-05T02:16:03.589+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:16:03.753994887Z [2024-04-05T02:16:03.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status success for try_number 1 2024-04-05T02:16:03.768534857Z [2024-04-05T02:16:03.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:14:00+00:00, map_index=-1, run_start_date=2024-04-05 02:16:02.170375+00:00, run_end_date=2024-04-05 02:16:02.986584+00:00, run_duration=0.816209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:16:00.650549+00:00, queued_by_job_id=1, pid=3984 2024-04-05T02:16:08.733732705Z [2024-04-05T02:16:08.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:16:08.734096938Z [2024-04-05T02:16:08.733+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:15:00+00:00, run_id=scheduled__2024-04-05T02:15:00+00:00, run_start_date=2024-04-05 02:16:00.567571+00:00, run_end_date=2024-04-05 02:16:08.733736+00:00, run_duration=8.166165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:15:00+00:00, data_interval_end=2024-04-05 02:16:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:16:08.745652344Z [2024-04-05T02:16:08.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:17:00+00:00 2024-04-05T02:16:08.783503152Z [2024-04-05T02:16:08.783+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:16:08.791356698Z [2024-04-05T02:16:08.791+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:16:04.785035+00:00, run_end_date=2024-04-05 02:16:08.435843+00:00, run_duration=3.650808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:16:00.650549+00:00, queued_by_job_id=1, pid=4013 2024-04-05T02:16:09.812374440Z [2024-04-05T02:16:09.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:16:09.813844973Z [2024-04-05T02:16:09.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:15:00+00:00, run_id=scheduled__2024-04-05T02:15:00+00:00, run_start_date=2024-04-05 02:16:00.569734+00:00, run_end_date=2024-04-05 02:16:09.812309+00:00, run_duration=9.242575, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:15:00+00:00, data_interval_end=2024-04-05 02:16:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:16:09.823198646Z [2024-04-05T02:16:09.822+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:17:00+00:00 2024-04-05T02:16:09.908076682Z [2024-04-05T02:16:09.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:16:09.920791566Z [2024-04-05T02:16:09.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:16:04.798014+00:00, run_end_date=2024-04-05 02:16:09.013316+00:00, run_duration=4.215302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:16:00.650549+00:00, queued_by_job_id=1, pid=4014 2024-04-05T02:16:43.459263887Z [2024-04-05T02:16:43.458+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:17:00.042474716Z [2024-04-05T02:17:00.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:17:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:17:00.049412527Z [2024-04-05T02:17:00.049+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:17:00.109023651Z [2024-04-05T02:17:00.108+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:17:00.109044889Z 2024-04-05T02:17:00.109050534Z 2024-04-05T02:17:00.109555521Z [2024-04-05T02:17:00.108+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:17:00.110246498Z [2024-04-05T02:17:00.109+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:17:00.112093852Z [2024-04-05T02:17:00.111+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:17:00.112107793Z 2024-04-05T02:17:00.112111481Z 2024-04-05T02:17:00.116840633Z [2024-04-05T02:17:00.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:17:00.116855402Z [2024-04-05T02:17:00.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:17:00.117329455Z [2024-04-05T02:17:00.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:17:00.117380901Z [2024-04-05T02:17:00.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:17:00.319262221Z [2024-04-05T02:17:00.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status queued for try_number 1 2024-04-05T02:17:00.319567424Z [2024-04-05T02:17:00.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status queued for try_number 1 2024-04-05T02:17:00.331625053Z [2024-04-05T02:17:00.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6bafcce-6c50-4a22-a413-b87014d8a4ef 2024-04-05T02:17:00.332769641Z [2024-04-05T02:17:00.332+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0067db07-dd79-4151-bd5c-2e08fbe855c6 2024-04-05T02:17:06.967396728Z [2024-04-05T02:17:06.966+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:17:06.969047579Z [2024-04-05T02:17:06.968+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:16:00+00:00, run_id=scheduled__2024-04-05T02:16:00+00:00, run_start_date=2024-04-05 02:17:00.061349+00:00, run_end_date=2024-04-05 02:17:06.967314+00:00, run_duration=6.905965, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:16:00+00:00, data_interval_end=2024-04-05 02:17:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:17:07.001855322Z [2024-04-05T02:17:07.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:17:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:17:07.023330487Z [2024-04-05T02:17:07.022+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:17:07.023664037Z [2024-04-05T02:17:07.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:16:00+00:00, run_id=scheduled__2024-04-05T02:16:00+00:00, run_start_date=2024-04-05 02:17:00.062978+00:00, run_end_date=2024-04-05 02:17:07.023235+00:00, run_duration=6.960257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:16:00+00:00, data_interval_end=2024-04-05 02:17:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:17:07.044295765Z [2024-04-05T02:17:07.044+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:17:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:17:07.094193065Z [2024-04-05T02:17:07.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status success for try_number 1 2024-04-05T02:17:07.094270545Z [2024-04-05T02:17:07.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status success for try_number 1 2024-04-05T02:17:07.100456266Z [2024-04-05T02:17:07.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:16:00+00:00, map_index=-1, run_start_date=2024-04-05 02:17:03.511714+00:00, run_end_date=2024-04-05 02:17:05.982491+00:00, run_duration=2.470777, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:17:00.113758+00:00, queued_by_job_id=1, pid=4069 2024-04-05T02:17:07.100931097Z [2024-04-05T02:17:07.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:16:00+00:00, map_index=-1, run_start_date=2024-04-05 02:17:03.708214+00:00, run_end_date=2024-04-05 02:17:06.485340+00:00, run_duration=2.777126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:17:00.113758+00:00, queued_by_job_id=1, pid=4070 2024-04-05T02:18:00.592399694Z [2024-04-05T02:18:00.591+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:18:00.602903525Z [2024-04-05T02:18:00.602+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:18:00.629049825Z [2024-04-05T02:18:00.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:00.755861477Z [2024-04-05T02:18:00.752+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:18:00.755870835Z 2024-04-05T02:18:00.755875096Z 2024-04-05T02:18:00.755878327Z 2024-04-05T02:18:00.755882191Z [2024-04-05T02:18:00.752+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:18:00.755885261Z [2024-04-05T02:18:00.752+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:18:00.755888297Z [2024-04-05T02:18:00.753+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:18:00.755904372Z [2024-04-05T02:18:00.753+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:18:00.755907918Z 2024-04-05T02:18:00.755916141Z 2024-04-05T02:18:00.755919519Z 2024-04-05T02:18:00.761337366Z [2024-04-05T02:18:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:18:00.761380922Z [2024-04-05T02:18:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:18:00.761387765Z [2024-04-05T02:18:00.760+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:18:00.761392901Z [2024-04-05T02:18:00.760+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:18:00.761398243Z [2024-04-05T02:18:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:18:00.761404451Z [2024-04-05T02:18:00.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:18:01.136823476Z [2024-04-05T02:18:01.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status queued for try_number 1 2024-04-05T02:18:01.137018532Z [2024-04-05T02:18:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status queued for try_number 1 2024-04-05T02:18:01.137124924Z [2024-04-05T02:18:01.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status queued for try_number 1 2024-04-05T02:18:01.159635934Z [2024-04-05T02:18:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 138ec35f-4696-4f07-88bc-482e6f0fefd4 2024-04-05T02:18:01.162451918Z [2024-04-05T02:18:01.159+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2216da3b-c177-47f4-9c09-ea46ab05b1ab 2024-04-05T02:18:01.162794748Z [2024-04-05T02:18:01.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5d79c90-df4c-46e1-a9e1-3b9db23760db 2024-04-05T02:18:04.590774008Z [2024-04-05T02:18:04.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:18:04.591131839Z [2024-04-05T02:18:04.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:16:00+00:00, run_id=scheduled__2024-04-05T02:16:00+00:00, run_start_date=2024-04-05 02:18:00.655970+00:00, run_end_date=2024-04-05 02:18:04.590645+00:00, run_duration=3.934675, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:16:00+00:00, data_interval_end=2024-04-05 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:18:04.687060951Z [2024-04-05T02:18:04.667+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:18:05.091063387Z [2024-04-05T02:18:05.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status success for try_number 1 2024-04-05T02:18:05.148982891Z [2024-04-05T02:18:05.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:16:00+00:00, map_index=-1, run_start_date=2024-04-05 02:18:02.377512+00:00, run_end_date=2024-04-05 02:18:04.140780+00:00, run_duration=1.763268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:18:00.754753+00:00, queued_by_job_id=1, pid=4104 2024-04-05T02:18:09.777229425Z [2024-04-05T02:18:09.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:18:09.777667228Z [2024-04-05T02:18:09.777+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:17:00+00:00, run_id=scheduled__2024-04-05T02:17:00+00:00, run_start_date=2024-04-05 02:18:00.658690+00:00, run_end_date=2024-04-05 02:18:09.777320+00:00, run_duration=9.11863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:17:00+00:00, data_interval_end=2024-04-05 02:18:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:18:09.789362167Z [2024-04-05T02:18:09.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:09.842487503Z [2024-04-05T02:18:09.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status success for try_number 1 2024-04-05T02:18:09.849095918Z [2024-04-05T02:18:09.848+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:17:00+00:00, map_index=-1, run_start_date=2024-04-05 02:18:06.631426+00:00, run_end_date=2024-04-05 02:18:09.083889+00:00, run_duration=2.452463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:18:00.754753+00:00, queued_by_job_id=1, pid=4144 2024-04-05T02:18:10.909447162Z [2024-04-05T02:18:10.908+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:18:10.910762441Z [2024-04-05T02:18:10.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:17:00+00:00, run_id=scheduled__2024-04-05T02:17:00+00:00, run_start_date=2024-04-05 02:18:00.660602+00:00, run_end_date=2024-04-05 02:18:10.909633+00:00, run_duration=10.249031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:17:00+00:00, data_interval_end=2024-04-05 02:18:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:18:10.926343260Z [2024-04-05T02:18:10.926+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:10.968829037Z [2024-04-05T02:18:10.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status success for try_number 1 2024-04-05T02:18:10.976416409Z [2024-04-05T02:18:10.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:17:00+00:00, map_index=-1, run_start_date=2024-04-05 02:18:05.552042+00:00, run_end_date=2024-04-05 02:18:09.787250+00:00, run_duration=4.235208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:18:00.754753+00:00, queued_by_job_id=1, pid=4125 2024-04-05T02:18:35.309557509Z [2024-04-05T02:18:35.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:35.360912006Z [2024-04-05T02:18:35.360+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:18:35.360957033Z 2024-04-05T02:18:35.361029260Z [2024-04-05T02:18:35.360+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a has 0/16 running and queued tasks 2024-04-05T02:18:35.361809930Z [2024-04-05T02:18:35.361+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:18:35.361823217Z 2024-04-05T02:18:35.364189754Z [2024-04-05T02:18:35.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:18:35.364409240Z [2024-04-05T02:18:35.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:18:35.429334801Z [2024-04-05T02:18:35.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status queued for try_number 1 2024-04-05T02:18:35.442349847Z [2024-04-05T02:18:35.442+0000] {scheduler_job.py:635} INFO - Setting external_id for to 42e53125-a523-4fa5-a5a4-01a05dd2eea1 2024-04-05T02:18:37.632303732Z [2024-04-05T02:18:37.631+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:18:37.632843536Z [2024-04-05T02:18:37.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, execution_date=2024-04-05 02:17:00+00:00, run_id=scheduled__2024-04-05T02:17:00+00:00, run_start_date=2024-04-05 02:18:35.326532+00:00, run_end_date=2024-04-05 02:18:37.632438+00:00, run_duration=2.305906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:17:00+00:00, data_interval_end=2024-04-05 02:18:00+00:00, dag_hash=449122a2e7ac0eceac2f783316a8ce5f 2024-04-05T02:18:37.648833089Z [2024-04-05T02:18:37.648+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:37.689557373Z [2024-04-05T02:18:37.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status success for try_number 1 2024-04-05T02:18:37.695341633Z [2024-04-05T02:18:37.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:17:00+00:00, map_index=-1, run_start_date=2024-04-05 02:18:36.250537+00:00, run_end_date=2024-04-05 02:18:36.619977+00:00, run_duration=0.36944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:18:35.362289+00:00, queued_by_job_id=1, pid=4176 2024-04-05T02:19:00.210295042Z [2024-04-05T02:19:00.209+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:19:00.225278856Z [2024-04-05T02:19:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:00.248410174Z [2024-04-05T02:19:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:00.337490517Z [2024-04-05T02:19:00.337+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:19:00.337502574Z 2024-04-05T02:19:00.337506063Z 2024-04-05T02:19:00.337509626Z 2024-04-05T02:19:00.337923579Z [2024-04-05T02:19:00.337+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:19:00.338329561Z [2024-04-05T02:19:00.338+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:19:00.339055575Z [2024-04-05T02:19:00.338+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a has 0/16 running and queued tasks 2024-04-05T02:19:00.339903746Z [2024-04-05T02:19:00.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:19:00.339915762Z 2024-04-05T02:19:00.339919383Z 2024-04-05T02:19:00.339922612Z 2024-04-05T02:19:00.344727347Z [2024-04-05T02:19:00.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:19:00.345038126Z [2024-04-05T02:19:00.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:19:00.345452677Z [2024-04-05T02:19:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:19:00.345634849Z [2024-04-05T02:19:00.345+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:19:00.345936413Z [2024-04-05T02:19:00.345+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:19:00.346416272Z [2024-04-05T02:19:00.346+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:19:00.620668553Z [2024-04-05T02:19:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status queued for try_number 1 2024-04-05T02:19:00.625947964Z [2024-04-05T02:19:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status queued for try_number 1 2024-04-05T02:19:00.626606065Z [2024-04-05T02:19:00.626+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status queued for try_number 1 2024-04-05T02:19:00.669013648Z [2024-04-05T02:19:00.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae17f377-60b7-43a9-92bb-29da2da4abf8 2024-04-05T02:19:00.669190010Z [2024-04-05T02:19:00.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d806ce8-e93d-49ec-833f-32b801ab1f45 2024-04-05T02:19:00.669336983Z [2024-04-05T02:19:00.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2900609b-2045-4457-871f-995f3cce26f1 2024-04-05T02:19:03.166088202Z [2024-04-05T02:19:03.156+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:19:03.166103370Z [2024-04-05T02:19:03.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, execution_date=2024-04-05 02:18:00+00:00, run_id=scheduled__2024-04-05T02:18:00+00:00, run_start_date=2024-04-05 02:19:00.266086+00:00, run_end_date=2024-04-05 02:19:03.156879+00:00, run_duration=2.890793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:18:00+00:00, data_interval_end=2024-04-05 02:19:00+00:00, dag_hash=449122a2e7ac0eceac2f783316a8ce5f 2024-04-05T02:19:03.186113982Z [2024-04-05T02:19:03.183+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:03.250842500Z [2024-04-05T02:19:03.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status success for try_number 1 2024-04-05T02:19:03.257166471Z [2024-04-05T02:19:03.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:18:00+00:00, map_index=-1, run_start_date=2024-04-05 02:19:01.630415+00:00, run_end_date=2024-04-05 02:19:02.349337+00:00, run_duration=0.718922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:19:00.341519+00:00, queued_by_job_id=1, pid=4198 2024-04-05T02:19:07.885729599Z [2024-04-05T02:19:07.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:19:07.886264825Z [2024-04-05T02:19:07.885+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:18:00+00:00, run_id=scheduled__2024-04-05T02:18:00+00:00, run_start_date=2024-04-05 02:19:00.267420+00:00, run_end_date=2024-04-05 02:19:07.885848+00:00, run_duration=7.618428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:18:00+00:00, data_interval_end=2024-04-05 02:19:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:19:07.895373344Z [2024-04-05T02:19:07.895+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:07.948555688Z [2024-04-05T02:19:07.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status success for try_number 1 2024-04-05T02:19:07.959652280Z [2024-04-05T02:19:07.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:18:00+00:00, map_index=-1, run_start_date=2024-04-05 02:19:04.223445+00:00, run_end_date=2024-04-05 02:19:07.000380+00:00, run_duration=2.776935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:19:00.341519+00:00, queued_by_job_id=1, pid=4228 2024-04-05T02:19:08.370271709Z [2024-04-05T02:19:08.367+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:19:08.370305849Z [2024-04-05T02:19:08.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:18:00+00:00, run_id=scheduled__2024-04-05T02:18:00+00:00, run_start_date=2024-04-05 02:19:00.268564+00:00, run_end_date=2024-04-05 02:19:08.367710+00:00, run_duration=8.099146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:18:00+00:00, data_interval_end=2024-04-05 02:19:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:19:08.378233105Z [2024-04-05T02:19:08.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:09.526795170Z [2024-04-05T02:19:09.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status success for try_number 1 2024-04-05T02:19:09.533486809Z [2024-04-05T02:19:09.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:18:00+00:00, map_index=-1, run_start_date=2024-04-05 02:19:04.521891+00:00, run_end_date=2024-04-05 02:19:08.195396+00:00, run_duration=3.673505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:19:00.341519+00:00, queued_by_job_id=1, pid=4229 2024-04-05T02:20:00.247340327Z [2024-04-05T02:20:00.246+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:20:00.269237488Z [2024-04-05T02:20:00.268+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:00.278238692Z [2024-04-05T02:20:00.277+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:20:00.291647822Z [2024-04-05T02:20:00.291+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:00.307203904Z [2024-04-05T02:20:00.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:20:00.430686153Z [2024-04-05T02:20:00.430+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T02:20:00.430715922Z 2024-04-05T02:20:00.430721979Z 2024-04-05T02:20:00.430727863Z 2024-04-05T02:20:00.430732851Z 2024-04-05T02:20:00.430738478Z 2024-04-05T02:20:00.431124755Z [2024-04-05T02:20:00.430+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:20:00.431478127Z [2024-04-05T02:20:00.431+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:20:00.431778269Z [2024-04-05T02:20:00.431+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a has 0/16 running and queued tasks 2024-04-05T02:20:00.432109052Z [2024-04-05T02:20:00.431+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:20:00.432411132Z [2024-04-05T02:20:00.432+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:20:00.433631108Z [2024-04-05T02:20:00.433+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:00.433644729Z 2024-04-05T02:20:00.433650846Z 2024-04-05T02:20:00.433656009Z 2024-04-05T02:20:00.433661348Z 2024-04-05T02:20:00.433666188Z 2024-04-05T02:20:00.441244098Z [2024-04-05T02:20:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:20:00.441886562Z [2024-04-05T02:20:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:20:00.443564578Z [2024-04-05T02:20:00.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:00.444292769Z [2024-04-05T02:20:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:20:00.445188105Z [2024-04-05T02:20:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:00.445560710Z [2024-04-05T02:20:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:20:00.446120087Z [2024-04-05T02:20:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:00.446542723Z [2024-04-05T02:20:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:20:00.447353989Z [2024-04-05T02:20:00.447+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:00.447695933Z [2024-04-05T02:20:00.447+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:20:01.012622313Z [2024-04-05T02:20:01.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.013601730Z [2024-04-05T02:20:01.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.013612344Z [2024-04-05T02:20:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.013742338Z [2024-04-05T02:20:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.016026886Z [2024-04-05T02:20:01.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.048558507Z [2024-04-05T02:20:01.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to b323d078-6276-45f5-aad5-168c69b2024d 2024-04-05T02:20:01.048757414Z [2024-04-05T02:20:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to c77033bb-302b-495a-8ad2-f50e669fde0e 2024-04-05T02:20:01.048991928Z [2024-04-05T02:20:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to f69859a6-9021-4dc6-88ad-c3362d3cc545 2024-04-05T02:20:01.049123588Z [2024-04-05T02:20:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0ee1998-5fc1-4b2e-92c4-d9eb5ba9f267 2024-04-05T02:20:01.049295695Z [2024-04-05T02:20:01.049+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3e74d734-b280-4900-a35d-f8308aa1396b 2024-04-05T02:20:02.985116774Z [2024-04-05T02:20:02.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status failed for try_number 1 2024-04-05T02:20:03.027075513Z [2024-04-05T02:20:03.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:19:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:00.436076+00:00, queued_by_job_id=1, pid=None 2024-04-05T02:20:03.027108418Z [2024-04-05T02:20:03.025+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:20:03.070801791Z [2024-04-05T02:20:03.068+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:20:03.204421015Z [2024-04-05T02:20:03.204+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240405T021900, start_date=, end_date=20240405T022003 2024-04-05T02:20:04.358175572Z [2024-04-05T02:20:04.357+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:04.364609339Z [2024-04-05T02:20:04.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:18:00+00:00, run_id=scheduled__2024-04-05T02:18:00+00:00, run_start_date=2024-04-05 02:20:00.324200+00:00, run_end_date=2024-04-05 02:20:04.357951+00:00, run_duration=4.033751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:18:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:20:04.407905047Z [2024-04-05T02:20:04.407+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:20:04.700580056Z [2024-04-05T02:20:04.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:04.727442020Z [2024-04-05T02:20:04.726+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:18:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:02.535206+00:00, run_end_date=2024-04-05 02:20:04.080809+00:00, run_duration=1.545603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:00.436076+00:00, queued_by_job_id=1, pid=4284 2024-04-05T02:20:09.980362781Z [2024-04-05T02:20:09.979+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:20:09.980383148Z 2024-04-05T02:20:09.980792655Z [2024-04-05T02:20:09.980+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:20:09.983402194Z [2024-04-05T02:20:09.983+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:09.983416798Z 2024-04-05T02:20:09.990286897Z [2024-04-05T02:20:09.989+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:20:09.990609734Z [2024-04-05T02:20:09.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:20:10.133210012Z [2024-04-05T02:20:10.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:10.133694273Z [2024-04-05T02:20:10.133+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:10.153185767Z [2024-04-05T02:20:10.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to e90e1633-d52d-4f62-a3d4-289e585ae6a1 2024-04-05T02:20:10.154539834Z [2024-04-05T02:20:10.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:07.689966+00:00, run_end_date=2024-04-05 02:20:09.021710+00:00, run_duration=1.331744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:00.436076+00:00, queued_by_job_id=1, pid=4326 2024-04-05T02:20:10.409557439Z [2024-04-05T02:20:10.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:10.410036448Z [2024-04-05T02:20:10.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:19:00+00:00, run_id=scheduled__2024-04-05T02:19:00+00:00, run_start_date=2024-04-05 02:20:00.326473+00:00, run_end_date=2024-04-05 02:20:10.409501+00:00, run_duration=10.083028, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:19:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:20:10.476707448Z [2024-04-05T02:20:10.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:10.641104067Z [2024-04-05T02:20:10.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:10.675438411Z [2024-04-05T02:20:10.663+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:19:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:07.254593+00:00, run_end_date=2024-04-05 02:20:09.993601+00:00, run_duration=2.739008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:00.436076+00:00, queued_by_job_id=1, pid=4324 2024-04-05T02:20:11.783140337Z [2024-04-05T02:20:11.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:11.783177299Z [2024-04-05T02:20:11.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:19:00+00:00, run_id=scheduled__2024-04-05T02:19:00+00:00, run_start_date=2024-04-05 02:20:00.327814+00:00, run_end_date=2024-04-05 02:20:11.782369+00:00, run_duration=11.454555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:19:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:20:11.809869002Z [2024-04-05T02:20:11.809+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:12.019512028Z [2024-04-05T02:20:12.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:12.035314842Z [2024-04-05T02:20:12.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:19:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:07.316806+00:00, run_end_date=2024-04-05 02:20:10.289623+00:00, run_duration=2.972817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:00.436076+00:00, queued_by_job_id=1, pid=4325 2024-04-05T02:20:13.244947753Z [2024-04-05T02:20:13.243+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:20:13.244979366Z 2024-04-05T02:20:13.244990491Z [2024-04-05T02:20:13.244+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a has 0/16 running and queued tasks 2024-04-05T02:20:13.246243118Z [2024-04-05T02:20:13.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:13.246271766Z 2024-04-05T02:20:13.251353972Z [2024-04-05T02:20:13.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:19:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:13.251455075Z [2024-04-05T02:20:13.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:20:13.447222301Z [2024-04-05T02:20:13.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status queued for try_number 2 2024-04-05T02:20:13.472896204Z [2024-04-05T02:20:13.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1130f4d9-dfcf-4a11-810f-4f59cfbf29ad 2024-04-05T02:20:15.013389417Z [2024-04-05T02:20:15.012+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:20:15.013409989Z 2024-04-05T02:20:15.014557901Z [2024-04-05T02:20:15.013+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:20:15.015306244Z [2024-04-05T02:20:15.015+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:15.015323477Z 2024-04-05T02:20:15.025807336Z [2024-04-05T02:20:15.025+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:20:15.026043511Z [2024-04-05T02:20:15.025+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:20:15.122536678Z [2024-04-05T02:20:15.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:15.122777548Z [2024-04-05T02:20:15.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status failed for try_number 2 2024-04-05T02:20:15.156760539Z [2024-04-05T02:20:15.154+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:19:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 02:20:03.100733+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:13.248583+00:00, queued_by_job_id=1, pid=None 2024-04-05T02:20:15.157583484Z [2024-04-05T02:20:15.157+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:20:15.167876080Z [2024-04-05T02:20:15.167+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:20:15.209388804Z [2024-04-05T02:20:15.206+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240405T021900, start_date=, end_date=20240405T022015 2024-04-05T02:20:15.254932340Z [2024-04-05T02:20:15.254+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b115160-2a58-46c4-a545-1cc3db6a7f86 2024-04-05T02:20:15.426483051Z [2024-04-05T02:20:15.426+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T02:20:15.426697492Z [2024-04-05T02:20:15.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, execution_date=2024-04-05 02:19:00+00:00, run_id=scheduled__2024-04-05T02:19:00+00:00, run_start_date=2024-04-05 02:20:00.325280+00:00, run_end_date=2024-04-05 02:20:15.426402+00:00, run_duration=15.101122, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:19:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=449122a2e7ac0eceac2f783316a8ce5f 2024-04-05T02:20:15.445629381Z [2024-04-05T02:20:15.445+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:15.509401113Z [2024-04-05T02:20:15.509+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:15.547160264Z [2024-04-05T02:20:15.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:13.850905+00:00, run_end_date=2024-04-05 02:20:14.875215+00:00, run_duration=1.02431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:09.984811+00:00, queued_by_job_id=1, pid=4375 2024-04-05T02:20:18.852481294Z [2024-04-05T02:20:18.851+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:20:18.852513690Z 2024-04-05T02:20:18.853147492Z [2024-04-05T02:20:18.852+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:20:18.855241902Z [2024-04-05T02:20:18.854+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:18.855270650Z 2024-04-05T02:20:18.861118498Z [2024-04-05T02:20:18.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:18.861529091Z [2024-04-05T02:20:18.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:20:18.954411373Z [2024-04-05T02:20:18.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:18.954761815Z [2024-04-05T02:20:18.954+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:18.965806511Z [2024-04-05T02:20:18.965+0000] {scheduler_job.py:635} INFO - Setting external_id for to b39f7c17-8b29-4b5f-bf3b-45fc471107d7 2024-04-05T02:20:18.966143064Z [2024-04-05T02:20:18.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=0, run_start_date=2024-04-05 02:20:17.972728+00:00, run_end_date=2024-04-05 02:20:18.372846+00:00, run_duration=0.400118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:15.016361+00:00, queued_by_job_id=1, pid=4408 2024-04-05T02:20:22.458233350Z [2024-04-05T02:20:22.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:22.461715875Z [2024-04-05T02:20:22.458+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:15:00+00:00, run_id=scheduled__2024-04-05T02:15:00+00:00, run_start_date=2024-04-05 02:20:00.322933+00:00, run_end_date=2024-04-05 02:20:22.458171+00:00, run_duration=22.135238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:15:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:20:22.465760111Z [2024-04-05T02:20:22.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:20:22.500412068Z [2024-04-05T02:20:22.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:22.506923625Z [2024-04-05T02:20:22.506+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:21.208883+00:00, run_end_date=2024-04-05 02:20:21.633802+00:00, run_duration=0.424919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:18.856689+00:00, queued_by_job_id=1, pid=4420 2024-04-05T02:21:00.275899930Z [2024-04-05T02:21:00.275+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:21:00.297845077Z [2024-04-05T02:21:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:00.317729326Z [2024-04-05T02:21:00.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:00.408925377Z [2024-04-05T02:21:00.408+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:21:00.408943380Z 2024-04-05T02:21:00.408948766Z 2024-04-05T02:21:00.408962799Z 2024-04-05T02:21:00.410398098Z [2024-04-05T02:21:00.410+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a has 0/16 running and queued tasks 2024-04-05T02:21:00.410460429Z [2024-04-05T02:21:00.410+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:21:00.410556836Z [2024-04-05T02:21:00.410+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:21:00.411197255Z [2024-04-05T02:21:00.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:21:00.411202481Z 2024-04-05T02:21:00.411206162Z 2024-04-05T02:21:00.411209954Z 2024-04-05T02:21:00.415508906Z [2024-04-05T02:21:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:21:00.415561588Z [2024-04-05T02:21:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:21:00.415775601Z [2024-04-05T02:21:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:21:00.415885311Z [2024-04-05T02:21:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:21:00.416165288Z [2024-04-05T02:21:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:21:00.416242120Z [2024-04-05T02:21:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:21:00.859823799Z [2024-04-05T02:21:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:21:00.860299671Z [2024-04-05T02:21:00.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:21:00.860611090Z [2024-04-05T02:21:00.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:21:00.885232256Z [2024-04-05T02:21:00.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52777c6d-db75-4670-9bac-8012efe4ab5e 2024-04-05T02:21:00.885756670Z [2024-04-05T02:21:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to 547f9755-7a46-4524-937d-5076b58e60c2 2024-04-05T02:21:00.886276215Z [2024-04-05T02:21:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7eb54f59-85c3-48bf-be98-3b3332211fd7 2024-04-05T02:21:02.406130439Z [2024-04-05T02:21:02.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status failed for try_number 1 2024-04-05T02:21:02.415004032Z [2024-04-05T02:21:02.413+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:21:00.411895+00:00, queued_by_job_id=1, pid=None 2024-04-05T02:21:02.443442918Z [2024-04-05T02:21:02.435+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:21:02.447520268Z [2024-04-05T02:21:02.446+0000] {dagbag.py:207} WARNING - Serialized DAG sdnc_status_542ffb88-a4c8-4fe1-835a-7fe765b98c0a no longer exists 2024-04-05T02:21:02.455225828Z [2024-04-05T02:21:02.451+0000] {scheduler_job.py:694} ERROR - Marking task instance as failed 2024-04-05T02:21:02.455264997Z Traceback (most recent call last): 2024-04-05T02:21:02.455269575Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/jobs/scheduler_job.py", line 692, in _process_executor_events 2024-04-05T02:21:02.455272998Z task = dag.get_task(ti.task_id) 2024-04-05T02:21:02.455276947Z AttributeError: 'NoneType' object has no attribute 'get_task' 2024-04-05T02:21:08.898197392Z [2024-04-05T02:21:08.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:21:08.898674830Z [2024-04-05T02:21:08.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:21:00.333680+00:00, run_end_date=2024-04-05 02:21:08.898269+00:00, run_duration=8.564589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:21:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:21:08.912082712Z [2024-04-05T02:21:08.911+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:08.980107751Z [2024-04-05T02:21:08.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:21:08.989027301Z [2024-04-05T02:21:08.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:21:04.616138+00:00, run_end_date=2024-04-05 02:21:08.633153+00:00, run_duration=4.017015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:21:00.411895+00:00, queued_by_job_id=1, pid=4462 2024-04-05T02:21:09.289551465Z [2024-04-05T02:21:09.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:21:09.289947532Z [2024-04-05T02:21:09.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:21:00.335656+00:00, run_end_date=2024-04-05 02:21:09.289625+00:00, run_duration=8.953969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:21:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:21:09.299146381Z [2024-04-05T02:21:09.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:09.335142799Z [2024-04-05T02:21:09.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:21:09.341153196Z [2024-04-05T02:21:09.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:21:04.581814+00:00, run_end_date=2024-04-05 02:21:09.005116+00:00, run_duration=4.423302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:21:00.411895+00:00, queued_by_job_id=1, pid=4461 2024-04-05T02:21:43.568112155Z [2024-04-05T02:21:43.567+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:22:00.791368740Z [2024-04-05T02:22:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:23:00+00:00 2024-04-05T02:22:00.814670822Z [2024-04-05T02:22:00.814+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:22:00.830486633Z [2024-04-05T02:22:00.829+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:22:00.939436927Z [2024-04-05T02:22:00.938+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:22:00.939472557Z 2024-04-05T02:22:00.939481212Z 2024-04-05T02:22:00.939488114Z 2024-04-05T02:22:00.939905654Z [2024-04-05T02:22:00.939+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:22:00.940300470Z [2024-04-05T02:22:00.940+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:22:00.940652978Z [2024-04-05T02:22:00.940+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:22:00.942048719Z [2024-04-05T02:22:00.941+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:22:00.942072789Z 2024-04-05T02:22:00.942080451Z 2024-04-05T02:22:00.942114426Z 2024-04-05T02:22:00.949862319Z [2024-04-05T02:22:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:22:00.951516262Z [2024-04-05T02:22:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:22:00.952917967Z [2024-04-05T02:22:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:22:00.953314452Z [2024-04-05T02:22:00.953+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:22:00.953907376Z [2024-04-05T02:22:00.953+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:22:00.954310334Z [2024-04-05T02:22:00.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:22:01.696403827Z [2024-04-05T02:22:01.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:22:01.696443327Z [2024-04-05T02:22:01.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status queued for try_number 1 2024-04-05T02:22:01.696449572Z [2024-04-05T02:22:01.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status queued for try_number 1 2024-04-05T02:22:01.760040732Z [2024-04-05T02:22:01.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d348c63-a71c-49fa-9808-e514bf1b2a68 2024-04-05T02:22:01.767174224Z [2024-04-05T02:22:01.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to e60d5a0e-7902-43e5-b607-1ef5e18ae31d 2024-04-05T02:22:01.770522651Z [2024-04-05T02:22:01.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to f027ecec-2071-4430-8974-37af42e721b8 2024-04-05T02:22:04.890835257Z [2024-04-05T02:22:04.890+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:22:04.891057318Z [2024-04-05T02:22:04.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:22:00.844881+00:00, run_end_date=2024-04-05 02:22:04.890757+00:00, run_duration=4.045876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:22:04.901903148Z [2024-04-05T02:22:04.901+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:22:06.405728267Z [2024-04-05T02:22:06.405+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:22:06.439883844Z [2024-04-05T02:22:06.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:22:04.103136+00:00, run_end_date=2024-04-05 02:22:04.612887+00:00, run_duration=0.509751, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:22:00.944349+00:00, queued_by_job_id=1, pid=4496 2024-04-05T02:22:09.107334000Z [2024-04-05T02:22:09.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:22:09.108621583Z [2024-04-05T02:22:09.108+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:21:00+00:00, run_id=scheduled__2024-04-05T02:21:00+00:00, run_start_date=2024-04-05 02:22:00.846642+00:00, run_end_date=2024-04-05 02:22:09.107272+00:00, run_duration=8.26063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:21:00+00:00, data_interval_end=2024-04-05 02:22:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:22:09.134258235Z [2024-04-05T02:22:09.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:23:00+00:00 2024-04-05T02:22:09.222957883Z [2024-04-05T02:22:09.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status success for try_number 1 2024-04-05T02:22:09.233682660Z [2024-04-05T02:22:09.233+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:21:00+00:00, map_index=-1, run_start_date=2024-04-05 02:22:06.713339+00:00, run_end_date=2024-04-05 02:22:08.775211+00:00, run_duration=2.061872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:22:00.944349+00:00, queued_by_job_id=1, pid=4517 2024-04-05T02:22:10.901528629Z [2024-04-05T02:22:10.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:22:10.901946837Z [2024-04-05T02:22:10.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:21:00+00:00, run_id=scheduled__2024-04-05T02:21:00+00:00, run_start_date=2024-04-05 02:22:00.848492+00:00, run_end_date=2024-04-05 02:22:10.901440+00:00, run_duration=10.052948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:21:00+00:00, data_interval_end=2024-04-05 02:22:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:22:10.914375415Z [2024-04-05T02:22:10.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:23:00+00:00 2024-04-05T02:22:10.957576112Z [2024-04-05T02:22:10.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status success for try_number 1 2024-04-05T02:22:10.965132600Z [2024-04-05T02:22:10.964+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:21:00+00:00, map_index=-1, run_start_date=2024-04-05 02:22:08.076502+00:00, run_end_date=2024-04-05 02:22:10.147705+00:00, run_duration=2.071203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:22:00.944349+00:00, queued_by_job_id=1, pid=4536 2024-04-05T02:23:00.156340090Z [2024-04-05T02:23:00.155+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:23:00.187368629Z [2024-04-05T02:23:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:23:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:23:00.257678472Z [2024-04-05T02:23:00.257+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:23:00.257704023Z 2024-04-05T02:23:00.257707890Z 2024-04-05T02:23:00.257717258Z [2024-04-05T02:23:00.257+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:23:00.257840215Z [2024-04-05T02:23:00.257+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:23:00.258905789Z [2024-04-05T02:23:00.258+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:23:00.258927771Z 2024-04-05T02:23:00.258934469Z 2024-04-05T02:23:00.268037950Z [2024-04-05T02:23:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:23:00.268091886Z [2024-04-05T02:23:00.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:23:00.268270155Z [2024-04-05T02:23:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:23:00.268343153Z [2024-04-05T02:23:00.268+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:23:00.565246538Z [2024-04-05T02:23:00.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status queued for try_number 1 2024-04-05T02:23:00.565669579Z [2024-04-05T02:23:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status queued for try_number 1 2024-04-05T02:23:00.584449723Z [2024-04-05T02:23:00.583+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10364c06-72ba-4978-a51c-732bd9acfa4d 2024-04-05T02:23:00.586417494Z [2024-04-05T02:23:00.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12255dd0-e209-4e4d-90d7-31b73f5d7481 2024-04-05T02:23:07.535112745Z [2024-04-05T02:23:07.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:23:07.536640634Z [2024-04-05T02:23:07.536+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:22:00+00:00, run_id=scheduled__2024-04-05T02:22:00+00:00, run_start_date=2024-04-05 02:23:00.206856+00:00, run_end_date=2024-04-05 02:23:07.536172+00:00, run_duration=7.329316, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:22:00+00:00, data_interval_end=2024-04-05 02:23:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:23:07.566965715Z [2024-04-05T02:23:07.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:23:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:23:08.686042007Z [2024-04-05T02:23:08.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:23:08.686531899Z [2024-04-05T02:23:08.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:22:00+00:00, run_id=scheduled__2024-04-05T02:22:00+00:00, run_start_date=2024-04-05 02:23:00.208945+00:00, run_end_date=2024-04-05 02:23:08.685968+00:00, run_duration=8.477023, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:22:00+00:00, data_interval_end=2024-04-05 02:23:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:23:08.703231830Z [2024-04-05T02:23:08.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:23:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:23:08.751252139Z [2024-04-05T02:23:08.750+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status success for try_number 1 2024-04-05T02:23:08.751472655Z [2024-04-05T02:23:08.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status success for try_number 1 2024-04-05T02:23:08.761561596Z [2024-04-05T02:23:08.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:22:00+00:00, map_index=-1, run_start_date=2024-04-05 02:23:04.065286+00:00, run_end_date=2024-04-05 02:23:07.480437+00:00, run_duration=3.415151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:23:00.261195+00:00, queued_by_job_id=1, pid=4582 2024-04-05T02:23:08.762281037Z [2024-04-05T02:23:08.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:22:00+00:00, map_index=-1, run_start_date=2024-04-05 02:23:03.665221+00:00, run_end_date=2024-04-05 02:23:08.160736+00:00, run_duration=4.495515, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:23:00.261195+00:00, queued_by_job_id=1, pid=4581 2024-04-05T02:24:01.021224100Z [2024-04-05T02:24:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:24:01.036137610Z [2024-04-05T02:24:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:24:01.059187094Z [2024-04-05T02:24:01.058+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:24:01.187622705Z [2024-04-05T02:24:01.187+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:24:01.187657382Z 2024-04-05T02:24:01.187664980Z 2024-04-05T02:24:01.187676032Z 2024-04-05T02:24:01.187793649Z [2024-04-05T02:24:01.187+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:24:01.188076642Z [2024-04-05T02:24:01.187+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:24:01.188310285Z [2024-04-05T02:24:01.188+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:24:01.189303391Z [2024-04-05T02:24:01.189+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:24:01.189318558Z 2024-04-05T02:24:01.189322632Z 2024-04-05T02:24:01.189326070Z 2024-04-05T02:24:01.195455341Z [2024-04-05T02:24:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:24:01.195882093Z [2024-04-05T02:24:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:24:01.196305713Z [2024-04-05T02:24:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:24:01.196467464Z [2024-04-05T02:24:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:24:01.197026699Z [2024-04-05T02:24:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:24:01.197252267Z [2024-04-05T02:24:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:24:01.779348667Z [2024-04-05T02:24:01.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status queued for try_number 1 2024-04-05T02:24:01.780306150Z [2024-04-05T02:24:01.779+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status queued for try_number 1 2024-04-05T02:24:01.780556789Z [2024-04-05T02:24:01.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status queued for try_number 1 2024-04-05T02:24:01.823772575Z [2024-04-05T02:24:01.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90707824-8636-4c3c-9cf0-fa07d02b12b3 2024-04-05T02:24:01.823817742Z [2024-04-05T02:24:01.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89e9c473-fb6a-48b4-ab49-4f4f88d46c78 2024-04-05T02:24:01.823965786Z [2024-04-05T02:24:01.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 521af675-f799-4083-b9f7-9fc97a9bcb6c 2024-04-05T02:24:04.474351428Z [2024-04-05T02:24:04.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:24:04.475165966Z [2024-04-05T02:24:04.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:22:00+00:00, run_id=scheduled__2024-04-05T02:22:00+00:00, run_start_date=2024-04-05 02:24:01.077874+00:00, run_end_date=2024-04-05 02:24:04.474446+00:00, run_duration=3.396572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:22:00+00:00, data_interval_end=2024-04-05 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:24:04.496782461Z [2024-04-05T02:24:04.496+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:24:04.676728451Z [2024-04-05T02:24:04.674+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status success for try_number 1 2024-04-05T02:24:04.710199709Z [2024-04-05T02:24:04.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:22:00+00:00, map_index=-1, run_start_date=2024-04-05 02:24:02.704414+00:00, run_end_date=2024-04-05 02:24:03.758529+00:00, run_duration=1.054115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:24:01.190945+00:00, queued_by_job_id=1, pid=4617 2024-04-05T02:24:09.107243599Z [2024-04-05T02:24:09.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:24:09.108051952Z [2024-04-05T02:24:09.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:23:00+00:00, run_id=scheduled__2024-04-05T02:23:00+00:00, run_start_date=2024-04-05 02:24:01.085580+00:00, run_end_date=2024-04-05 02:24:09.107687+00:00, run_duration=8.022107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:23:00+00:00, data_interval_end=2024-04-05 02:24:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:24:09.121328355Z [2024-04-05T02:24:09.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:24:09.132830312Z [2024-04-05T02:24:09.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:24:09.134359593Z [2024-04-05T02:24:09.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:23:00+00:00, run_id=scheduled__2024-04-05T02:23:00+00:00, run_start_date=2024-04-05 02:24:01.082103+00:00, run_end_date=2024-04-05 02:24:09.133964+00:00, run_duration=8.051861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:23:00+00:00, data_interval_end=2024-04-05 02:24:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:24:09.147670324Z [2024-04-05T02:24:09.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:24:09.204801240Z [2024-04-05T02:24:09.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status success for try_number 1 2024-04-05T02:24:09.204861106Z [2024-04-05T02:24:09.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status success for try_number 1 2024-04-05T02:24:09.214279142Z [2024-04-05T02:24:09.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:23:00+00:00, map_index=-1, run_start_date=2024-04-05 02:24:05.214441+00:00, run_end_date=2024-04-05 02:24:08.941321+00:00, run_duration=3.72688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:24:01.190945+00:00, queued_by_job_id=1, pid=4639 2024-04-05T02:24:09.218785606Z [2024-04-05T02:24:09.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:23:00+00:00, map_index=-1, run_start_date=2024-04-05 02:24:05.759401+00:00, run_end_date=2024-04-05 02:24:08.430265+00:00, run_duration=2.670864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:24:01.190945+00:00, queued_by_job_id=1, pid=4648 2024-04-05T02:25:00.281304925Z [2024-04-05T02:25:00.280+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:25:00.298438346Z [2024-04-05T02:25:00.298+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:25:00.313323941Z [2024-04-05T02:25:00.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:25:00.394058296Z [2024-04-05T02:25:00.393+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:25:00.394082523Z 2024-04-05T02:25:00.394089410Z 2024-04-05T02:25:00.394095141Z 2024-04-05T02:25:00.394292979Z [2024-04-05T02:25:00.394+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:25:00.394567159Z [2024-04-05T02:25:00.394+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:25:00.394792175Z [2024-04-05T02:25:00.394+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:25:00.395497330Z [2024-04-05T02:25:00.395+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:25:00.395506532Z 2024-04-05T02:25:00.395511058Z 2024-04-05T02:25:00.395514927Z 2024-04-05T02:25:00.398802177Z [2024-04-05T02:25:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:25:00.398922230Z [2024-04-05T02:25:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:25:00.399121303Z [2024-04-05T02:25:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:25:00.399217352Z [2024-04-05T02:25:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:25:00.399422695Z [2024-04-05T02:25:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:25:00.399527057Z [2024-04-05T02:25:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:25:00.660041382Z [2024-04-05T02:25:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:00.663158439Z [2024-04-05T02:25:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:00.663493496Z [2024-04-05T02:25:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:00.677607650Z [2024-04-05T02:25:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55616256-1dff-404d-9a1f-15dacdd4f4e7 2024-04-05T02:25:00.678170441Z [2024-04-05T02:25:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4600482b-9a62-4934-9004-4a8ffbfbfe25 2024-04-05T02:25:00.678545374Z [2024-04-05T02:25:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4da21a6-e08e-412e-b93d-00ea111285bc 2024-04-05T02:25:08.202027291Z [2024-04-05T02:25:08.201+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:25:08.202063617Z 2024-04-05T02:25:08.202959376Z [2024-04-05T02:25:08.201+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:25:08.203632238Z [2024-04-05T02:25:08.203+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:25:08.203638222Z 2024-04-05T02:25:08.206682314Z [2024-04-05T02:25:08.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:25:08.206891785Z [2024-04-05T02:25:08.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:25:08.350370742Z [2024-04-05T02:25:08.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:08.350401005Z [2024-04-05T02:25:08.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:08.380083815Z [2024-04-05T02:25:08.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c93b205-c998-4276-b722-cefcb924d07e 2024-04-05T02:25:08.381494618Z [2024-04-05T02:25:08.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:05.401425+00:00, run_end_date=2024-04-05 02:25:07.182770+00:00, run_duration=1.781345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:00.396345+00:00, queued_by_job_id=1, pid=4714 2024-04-05T02:25:08.589834913Z [2024-04-05T02:25:08.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:25:08.590466072Z [2024-04-05T02:25:08.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:24:00+00:00, run_id=scheduled__2024-04-05T02:24:00+00:00, run_start_date=2024-04-05 02:25:00.332538+00:00, run_end_date=2024-04-05 02:25:08.589807+00:00, run_duration=8.257269, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:24:00+00:00, data_interval_end=2024-04-05 02:25:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:25:08.627145816Z [2024-04-05T02:25:08.626+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:25:08.765934048Z [2024-04-05T02:25:08.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:08.793451018Z [2024-04-05T02:25:08.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:24:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:05.387439+00:00, run_end_date=2024-04-05 02:25:08.321433+00:00, run_duration=2.933994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:00.396345+00:00, queued_by_job_id=1, pid=4713 2024-04-05T02:25:09.912827861Z [2024-04-05T02:25:09.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:25:09.916040770Z [2024-04-05T02:25:09.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:24:00+00:00, run_id=scheduled__2024-04-05T02:24:00+00:00, run_start_date=2024-04-05 02:25:00.331047+00:00, run_end_date=2024-04-05 02:25:09.912745+00:00, run_duration=9.581698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:24:00+00:00, data_interval_end=2024-04-05 02:25:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:25:09.933758378Z [2024-04-05T02:25:09.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:25:10.048946715Z [2024-04-05T02:25:10.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:10.066558887Z [2024-04-05T02:25:10.066+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:24:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:04.738134+00:00, run_end_date=2024-04-05 02:25:08.328318+00:00, run_duration=3.590184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:00.396345+00:00, queued_by_job_id=1, pid=4712 2024-04-05T02:25:12.984657781Z [2024-04-05T02:25:12.981+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:25:12.984687506Z 2024-04-05T02:25:12.984692016Z [2024-04-05T02:25:12.982+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:25:12.984711220Z [2024-04-05T02:25:12.982+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:25:12.984714801Z 2024-04-05T02:25:12.987098393Z [2024-04-05T02:25:12.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:25:12.987257457Z [2024-04-05T02:25:12.987+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:25:13.047190383Z [2024-04-05T02:25:13.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:13.058103386Z [2024-04-05T02:25:13.052+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fc3dea1-f45f-4e72-be31-60374273d4d9 2024-04-05T02:25:13.201474279Z [2024-04-05T02:25:13.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:13.211810490Z [2024-04-05T02:25:13.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:11.703197+00:00, run_end_date=2024-04-05 02:25:12.361227+00:00, run_duration=0.65803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:08.204078+00:00, queued_by_job_id=1, pid=4762 2024-04-05T02:25:18.276343423Z [2024-04-05T02:25:18.276+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:25:18.276364045Z 2024-04-05T02:25:18.276649509Z [2024-04-05T02:25:18.276+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:25:18.277337148Z [2024-04-05T02:25:18.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:25:18.277347896Z 2024-04-05T02:25:18.279995794Z [2024-04-05T02:25:18.279+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:25:18.280324757Z [2024-04-05T02:25:18.280+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:25:18.366704336Z [2024-04-05T02:25:18.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:18.366746632Z [2024-04-05T02:25:18.366+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:18.373255938Z [2024-04-05T02:25:18.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 575bb946-d4ea-443a-9c00-d2477df74218 2024-04-05T02:25:18.373477780Z [2024-04-05T02:25:18.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=0, run_start_date=2024-04-05 02:25:17.025334+00:00, run_end_date=2024-04-05 02:25:17.529407+00:00, run_duration=0.504073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:12.983676+00:00, queued_by_job_id=1, pid=4777 2024-04-05T02:25:21.827416398Z [2024-04-05T02:25:21.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:25:21.827677013Z [2024-04-05T02:25:21.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:25:00.329509+00:00, run_end_date=2024-04-05 02:25:21.827291+00:00, run_duration=21.497782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:25:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:25:21.835987192Z [2024-04-05T02:25:21.835+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:25:21.869431780Z [2024-04-05T02:25:21.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:21.874948545Z [2024-04-05T02:25:21.874+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:20.396939+00:00, run_end_date=2024-04-05 02:25:20.845150+00:00, run_duration=0.448211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:18.277829+00:00, queued_by_job_id=1, pid=4789 2024-04-05T02:26:01.073106258Z [2024-04-05T02:26:01.072+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:26:01.091368629Z [2024-04-05T02:26:01.090+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:26:01.114404944Z [2024-04-05T02:26:01.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:27:00+00:00 2024-04-05T02:26:01.244464929Z [2024-04-05T02:26:01.244+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:26:01.244485515Z 2024-04-05T02:26:01.244490064Z 2024-04-05T02:26:01.244494098Z 2024-04-05T02:26:01.244867346Z [2024-04-05T02:26:01.244+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:26:01.245174740Z [2024-04-05T02:26:01.244+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:26:01.245596009Z [2024-04-05T02:26:01.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:26:01.246653089Z [2024-04-05T02:26:01.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:26:01.246666194Z 2024-04-05T02:26:01.246670651Z 2024-04-05T02:26:01.246674283Z 2024-04-05T02:26:01.251589096Z [2024-04-05T02:26:01.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:26:01.251847123Z [2024-04-05T02:26:01.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:26:01.252191356Z [2024-04-05T02:26:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:26:01.252440475Z [2024-04-05T02:26:01.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:26:01.252913593Z [2024-04-05T02:26:01.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:26:01.253254083Z [2024-04-05T02:26:01.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:26:01.624943363Z [2024-04-05T02:26:01.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status queued for try_number 1 2024-04-05T02:26:01.625127704Z [2024-04-05T02:26:01.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:26:01.625276457Z [2024-04-05T02:26:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:26:01.635658957Z [2024-04-05T02:26:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc94c7de-0fef-4186-8aad-24681dc770af 2024-04-05T02:26:01.635972448Z [2024-04-05T02:26:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13cc2069-8921-4ab5-8e0c-d6588dc1a5bc 2024-04-05T02:26:01.636238615Z [2024-04-05T02:26:01.636+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11e83aea-bafb-4f16-8703-945e205baf68 2024-04-05T02:26:04.739551373Z [2024-04-05T02:26:04.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:26:04.739796821Z [2024-04-05T02:26:04.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:24:00+00:00, run_id=scheduled__2024-04-05T02:24:00+00:00, run_start_date=2024-04-05 02:26:01.137545+00:00, run_end_date=2024-04-05 02:26:04.739457+00:00, run_duration=3.601912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:24:00+00:00, data_interval_end=2024-04-05 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:26:04.755802243Z [2024-04-05T02:26:04.754+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:26:04.883756314Z [2024-04-05T02:26:04.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status success for try_number 1 2024-04-05T02:26:04.898796415Z [2024-04-05T02:26:04.898+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:24:00+00:00, map_index=-1, run_start_date=2024-04-05 02:26:02.599026+00:00, run_end_date=2024-04-05 02:26:03.780924+00:00, run_duration=1.181898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:26:01.247836+00:00, queued_by_job_id=1, pid=4793 2024-04-05T02:26:08.774592250Z [2024-04-05T02:26:08.774+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:26:08.775032016Z [2024-04-05T02:26:08.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:25:00+00:00, run_id=scheduled__2024-04-05T02:25:00+00:00, run_start_date=2024-04-05 02:26:01.140135+00:00, run_end_date=2024-04-05 02:26:08.774492+00:00, run_duration=7.634357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:25:00+00:00, data_interval_end=2024-04-05 02:26:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:26:08.786345129Z [2024-04-05T02:26:08.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:27:00+00:00 2024-04-05T02:26:08.832467024Z [2024-04-05T02:26:08.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:26:08.844165125Z [2024-04-05T02:26:08.843+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:26:06.058415+00:00, run_end_date=2024-04-05 02:26:08.539277+00:00, run_duration=2.480862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:26:01.247836+00:00, queued_by_job_id=1, pid=4832 2024-04-05T02:26:09.900156332Z [2024-04-05T02:26:09.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:26:09.900524402Z [2024-04-05T02:26:09.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:25:00+00:00, run_id=scheduled__2024-04-05T02:25:00+00:00, run_start_date=2024-04-05 02:26:01.142348+00:00, run_end_date=2024-04-05 02:26:09.900091+00:00, run_duration=8.757743, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:25:00+00:00, data_interval_end=2024-04-05 02:26:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:26:09.915836952Z [2024-04-05T02:26:09.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:27:00+00:00 2024-04-05T02:26:09.971948230Z [2024-04-05T02:26:09.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:26:09.980237985Z [2024-04-05T02:26:09.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:26:05.323057+00:00, run_end_date=2024-04-05 02:26:08.897243+00:00, run_duration=3.574186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:26:01.247836+00:00, queued_by_job_id=1, pid=4822 2024-04-05T02:26:43.653770546Z [2024-04-05T02:26:43.653+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:27:00.180889741Z [2024-04-05T02:27:00.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:27:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:27:00.189053080Z [2024-04-05T02:27:00.188+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:27:00.246851293Z [2024-04-05T02:27:00.246+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:27:00.246893690Z 2024-04-05T02:27:00.246897358Z 2024-04-05T02:27:00.247952380Z [2024-04-05T02:27:00.247+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:27:00.248183052Z [2024-04-05T02:27:00.248+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:27:00.248838681Z [2024-04-05T02:27:00.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:27:00.248845216Z 2024-04-05T02:27:00.248848670Z 2024-04-05T02:27:00.252825007Z [2024-04-05T02:27:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:27:00.253237507Z [2024-04-05T02:27:00.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:27:00.253806797Z [2024-04-05T02:27:00.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:27:00.254614061Z [2024-04-05T02:27:00.254+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:27:00.424218649Z [2024-04-05T02:27:00.423+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status queued for try_number 1 2024-04-05T02:27:00.424335482Z [2024-04-05T02:27:00.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status queued for try_number 1 2024-04-05T02:27:00.433680573Z [2024-04-05T02:27:00.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58c9e335-4448-4f44-b628-99f35e5ad17d 2024-04-05T02:27:00.433778674Z [2024-04-05T02:27:00.433+0000] {scheduler_job.py:635} INFO - Setting external_id for to c72c817b-5e2c-4d15-83b0-6d52575baf27 2024-04-05T02:27:08.843917556Z [2024-04-05T02:27:08.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:27:08.844194484Z [2024-04-05T02:27:08.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:26:00+00:00, run_id=scheduled__2024-04-05T02:26:00+00:00, run_start_date=2024-04-05 02:27:00.203690+00:00, run_end_date=2024-04-05 02:27:08.843860+00:00, run_duration=8.64017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:26:00+00:00, data_interval_end=2024-04-05 02:27:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:27:08.866577296Z [2024-04-05T02:27:08.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:27:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:27:08.874564039Z [2024-04-05T02:27:08.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:27:08.874765357Z [2024-04-05T02:27:08.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:26:00+00:00, run_id=scheduled__2024-04-05T02:26:00+00:00, run_start_date=2024-04-05 02:27:00.202222+00:00, run_end_date=2024-04-05 02:27:08.874503+00:00, run_duration=8.672281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:26:00+00:00, data_interval_end=2024-04-05 02:27:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:27:08.884206733Z [2024-04-05T02:27:08.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:27:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:27:08.920139284Z [2024-04-05T02:27:08.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status success for try_number 1 2024-04-05T02:27:08.920161076Z [2024-04-05T02:27:08.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status success for try_number 1 2024-04-05T02:27:08.933055923Z [2024-04-05T02:27:08.932+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:26:00+00:00, map_index=-1, run_start_date=2024-04-05 02:27:04.266557+00:00, run_end_date=2024-04-05 02:27:08.116377+00:00, run_duration=3.84982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:27:00.249453+00:00, queued_by_job_id=1, pid=4887 2024-04-05T02:27:08.933197805Z [2024-04-05T02:27:08.933+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:26:00+00:00, map_index=-1, run_start_date=2024-04-05 02:27:03.328338+00:00, run_end_date=2024-04-05 02:27:07.961832+00:00, run_duration=4.633494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:27:00.249453+00:00, queued_by_job_id=1, pid=4868 2024-04-05T02:28:00.152472504Z [2024-04-05T02:28:00.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:29:00+00:00 2024-04-05T02:28:00.168731379Z [2024-04-05T02:28:00.168+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:28:00.177774302Z [2024-04-05T02:28:00.177+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:28:00.286955171Z [2024-04-05T02:28:00.286+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:28:00.286974166Z 2024-04-05T02:28:00.286978699Z 2024-04-05T02:28:00.286982408Z 2024-04-05T02:28:00.287432276Z [2024-04-05T02:28:00.286+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:28:00.287762929Z [2024-04-05T02:28:00.287+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:28:00.288095211Z [2024-04-05T02:28:00.287+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:28:00.288848812Z [2024-04-05T02:28:00.288+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:28:00.288859617Z 2024-04-05T02:28:00.288863370Z 2024-04-05T02:28:00.288866905Z 2024-04-05T02:28:00.292470783Z [2024-04-05T02:28:00.292+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:28:00.292798911Z [2024-04-05T02:28:00.292+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:28:00.293641416Z [2024-04-05T02:28:00.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:28:00.293858985Z [2024-04-05T02:28:00.293+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:28:00.294860305Z [2024-04-05T02:28:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:28:00.295252219Z [2024-04-05T02:28:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:28:00.605582753Z [2024-04-05T02:28:00.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status queued for try_number 1 2024-04-05T02:28:00.605878157Z [2024-04-05T02:28:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status queued for try_number 1 2024-04-05T02:28:00.606086825Z [2024-04-05T02:28:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status queued for try_number 1 2024-04-05T02:28:00.623337990Z [2024-04-05T02:28:00.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f867fc3-f9f5-48ef-89d6-6f67fe3df2c3 2024-04-05T02:28:00.624567377Z [2024-04-05T02:28:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82425ba0-ba9f-4c0d-b2db-22a2a7fcf177 2024-04-05T02:28:00.625170429Z [2024-04-05T02:28:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2a15a51-6a03-49dd-85d1-5c8ea6b98433 2024-04-05T02:28:01.953465594Z [2024-04-05T02:28:01.952+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:28:01.956830987Z [2024-04-05T02:28:01.953+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:26:00+00:00, run_id=scheduled__2024-04-05T02:26:00+00:00, run_start_date=2024-04-05 02:28:00.190211+00:00, run_end_date=2024-04-05 02:28:01.953378+00:00, run_duration=1.763167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:26:00+00:00, data_interval_end=2024-04-05 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:28:01.963503762Z [2024-04-05T02:28:01.963+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:28:03.373777666Z [2024-04-05T02:28:03.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status success for try_number 1 2024-04-05T02:28:03.388159425Z [2024-04-05T02:28:03.387+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:26:00+00:00, map_index=-1, run_start_date=2024-04-05 02:28:01.310951+00:00, run_end_date=2024-04-05 02:28:01.899007+00:00, run_duration=0.588056, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:28:00.289760+00:00, queued_by_job_id=1, pid=4913 2024-04-05T02:28:08.129235348Z [2024-04-05T02:28:08.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:28:08.129522988Z [2024-04-05T02:28:08.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:27:00+00:00, run_id=scheduled__2024-04-05T02:27:00+00:00, run_start_date=2024-04-05 02:28:00.191620+00:00, run_end_date=2024-04-05 02:28:08.129151+00:00, run_duration=7.937531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:27:00+00:00, data_interval_end=2024-04-05 02:28:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:28:08.144674315Z [2024-04-05T02:28:08.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:29:00+00:00 2024-04-05T02:28:08.153009554Z [2024-04-05T02:28:08.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:28:08.153290553Z [2024-04-05T02:28:08.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:27:00+00:00, run_id=scheduled__2024-04-05T02:27:00+00:00, run_start_date=2024-04-05 02:28:00.192730+00:00, run_end_date=2024-04-05 02:28:08.152927+00:00, run_duration=7.960197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:27:00+00:00, data_interval_end=2024-04-05 02:28:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:28:08.163233726Z [2024-04-05T02:28:08.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:29:00+00:00 2024-04-05T02:28:08.200828766Z [2024-04-05T02:28:08.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status success for try_number 1 2024-04-05T02:28:08.201044751Z [2024-04-05T02:28:08.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status success for try_number 1 2024-04-05T02:28:08.209203496Z [2024-04-05T02:28:08.208+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:27:00+00:00, map_index=-1, run_start_date=2024-04-05 02:28:04.671393+00:00, run_end_date=2024-04-05 02:28:07.311642+00:00, run_duration=2.640249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:28:00.289760+00:00, queued_by_job_id=1, pid=4944 2024-04-05T02:28:08.209520592Z [2024-04-05T02:28:08.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:27:00+00:00, map_index=-1, run_start_date=2024-04-05 02:28:04.283931+00:00, run_end_date=2024-04-05 02:28:07.651474+00:00, run_duration=3.367543, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:28:00.289760+00:00, queued_by_job_id=1, pid=4943 2024-04-05T02:29:00.895130885Z [2024-04-05T02:29:00.894+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:29:00.910639859Z [2024-04-05T02:29:00.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:29:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:29:01.009896905Z [2024-04-05T02:29:01.009+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:29:01.009928402Z 2024-04-05T02:29:01.009933719Z 2024-04-05T02:29:01.010218073Z [2024-04-05T02:29:01.009+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:29:01.010675378Z [2024-04-05T02:29:01.010+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:29:01.013929612Z [2024-04-05T02:29:01.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:29:01.013944630Z 2024-04-05T02:29:01.013949893Z 2024-04-05T02:29:01.020037981Z [2024-04-05T02:29:01.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:29:01.020348401Z [2024-04-05T02:29:01.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:29:01.020786960Z [2024-04-05T02:29:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:29:01.020951571Z [2024-04-05T02:29:01.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:29:01.280087144Z [2024-04-05T02:29:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status queued for try_number 1 2024-04-05T02:29:01.280322295Z [2024-04-05T02:29:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status queued for try_number 1 2024-04-05T02:29:01.304019457Z [2024-04-05T02:29:01.303+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13a175c8-f2bd-43d9-8bff-4190c728ec1f 2024-04-05T02:29:01.304420234Z [2024-04-05T02:29:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to ada30bca-27e6-45b9-ba3f-a15c94d8209b 2024-04-05T02:29:07.928283155Z [2024-04-05T02:29:07.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:29:07.929636916Z [2024-04-05T02:29:07.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:28:00+00:00, run_id=scheduled__2024-04-05T02:28:00+00:00, run_start_date=2024-04-05 02:29:00.929211+00:00, run_end_date=2024-04-05 02:29:07.928540+00:00, run_duration=6.999329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:28:00+00:00, data_interval_end=2024-04-05 02:29:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:29:07.941634664Z [2024-04-05T02:29:07.941+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:29:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:29:07.949967558Z [2024-04-05T02:29:07.948+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:29:07.950027750Z [2024-04-05T02:29:07.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:28:00+00:00, run_id=scheduled__2024-04-05T02:28:00+00:00, run_start_date=2024-04-05 02:29:00.927134+00:00, run_end_date=2024-04-05 02:29:07.949270+00:00, run_duration=7.022136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:28:00+00:00, data_interval_end=2024-04-05 02:29:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:29:07.965988575Z [2024-04-05T02:29:07.965+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:29:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:29:08.023705464Z [2024-04-05T02:29:08.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status success for try_number 1 2024-04-05T02:29:08.023875262Z [2024-04-05T02:29:08.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status success for try_number 1 2024-04-05T02:29:08.033527576Z [2024-04-05T02:29:08.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:28:00+00:00, map_index=-1, run_start_date=2024-04-05 02:29:04.436146+00:00, run_end_date=2024-04-05 02:29:07.359703+00:00, run_duration=2.923557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:29:01.015110+00:00, queued_by_job_id=1, pid=4989 2024-04-05T02:29:08.033659832Z [2024-04-05T02:29:08.033+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:28:00+00:00, map_index=-1, run_start_date=2024-04-05 02:29:05.075848+00:00, run_end_date=2024-04-05 02:29:07.504132+00:00, run_duration=2.428284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:29:01.015110+00:00, queued_by_job_id=1, pid=4999 2024-04-05T02:30:00.855618862Z [2024-04-05T02:30:00.855+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:30:00.883201574Z [2024-04-05T02:30:00.882+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:30:00.906274978Z [2024-04-05T02:30:00.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:31:00+00:00 2024-04-05T02:30:00.915522426Z [2024-04-05T02:30:00.915+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:30:01.033109665Z [2024-04-05T02:30:01.032+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:30:01.033138040Z 2024-04-05T02:30:01.033143605Z 2024-04-05T02:30:01.033149231Z 2024-04-05T02:30:01.033154127Z 2024-04-05T02:30:01.034100536Z [2024-04-05T02:30:01.033+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:30:01.034120308Z [2024-04-05T02:30:01.033+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:30:01.034125518Z [2024-04-05T02:30:01.033+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:30:01.034442780Z [2024-04-05T02:30:01.034+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:30:01.035408953Z [2024-04-05T02:30:01.035+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:01.035424101Z 2024-04-05T02:30:01.035429973Z 2024-04-05T02:30:01.035435125Z 2024-04-05T02:30:01.035439809Z 2024-04-05T02:30:01.046428099Z [2024-04-05T02:30:01.045+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:30:01.046853017Z [2024-04-05T02:30:01.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:30:01.048471650Z [2024-04-05T02:30:01.047+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:01.048831825Z [2024-04-05T02:30:01.048+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:30:01.050326888Z [2024-04-05T02:30:01.049+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:01.050661551Z [2024-04-05T02:30:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:30:01.051212173Z [2024-04-05T02:30:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:01.052064286Z [2024-04-05T02:30:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:30:01.493030177Z [2024-04-05T02:30:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.493760911Z [2024-04-05T02:30:01.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.494073920Z [2024-04-05T02:30:01.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.494973904Z [2024-04-05T02:30:01.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.538880614Z [2024-04-05T02:30:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to a910d428-c21d-48e8-bfae-5ae821beee94 2024-04-05T02:30:01.538919303Z [2024-04-05T02:30:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9fb102b-4307-4afc-958c-f78757b1a1d6 2024-04-05T02:30:01.539071329Z [2024-04-05T02:30:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to b11d9633-493d-47d8-8257-ec77f775eb2b 2024-04-05T02:30:01.539160193Z [2024-04-05T02:30:01.539+0000] {scheduler_job.py:635} INFO - Setting external_id for to 044f23f6-2a8c-4563-87af-7c120f9be7c6 2024-04-05T02:30:05.768554429Z [2024-04-05T02:30:05.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:05.773586904Z [2024-04-05T02:30:05.773+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:28:00+00:00, run_id=scheduled__2024-04-05T02:28:00+00:00, run_start_date=2024-04-05 02:30:00.933544+00:00, run_end_date=2024-04-05 02:30:05.772736+00:00, run_duration=4.839192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:28:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:30:05.856295775Z [2024-04-05T02:30:05.855+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:30:06.068500586Z [2024-04-05T02:30:06.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:06.083861026Z [2024-04-05T02:30:06.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:28:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:03.224404+00:00, run_end_date=2024-04-05 02:30:04.631897+00:00, run_duration=1.407493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:01.039379+00:00, queued_by_job_id=1, pid=5035 2024-04-05T02:30:11.185817089Z [2024-04-05T02:30:11.185+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:11.196568360Z [2024-04-05T02:30:11.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:29:00+00:00, run_id=scheduled__2024-04-05T02:29:00+00:00, run_start_date=2024-04-05 02:30:00.938113+00:00, run_end_date=2024-04-05 02:30:11.195510+00:00, run_duration=10.257397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:29:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:30:11.209727250Z [2024-04-05T02:30:11.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:31:00+00:00 2024-04-05T02:30:11.266936480Z [2024-04-05T02:30:11.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:11.267769239Z [2024-04-05T02:30:11.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:29:00+00:00, run_id=scheduled__2024-04-05T02:29:00+00:00, run_start_date=2024-04-05 02:30:00.936532+00:00, run_end_date=2024-04-05 02:30:11.267172+00:00, run_duration=10.33064, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:29:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:30:11.308368441Z [2024-04-05T02:30:11.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:31:00+00:00 2024-04-05T02:30:11.336299016Z [2024-04-05T02:30:11.335+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:30:11.336331745Z 2024-04-05T02:30:11.336585347Z [2024-04-05T02:30:11.336+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:30:11.342138607Z [2024-04-05T02:30:11.341+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:11.342186862Z 2024-04-05T02:30:11.350308151Z [2024-04-05T02:30:11.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:30:11.350488505Z [2024-04-05T02:30:11.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:30:11.461430511Z [2024-04-05T02:30:11.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:11.463793985Z [2024-04-05T02:30:11.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:11.464822856Z [2024-04-05T02:30:11.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:11.466497065Z [2024-04-05T02:30:11.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:11.500825601Z [2024-04-05T02:30:11.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:29:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:08.404427+00:00, run_end_date=2024-04-05 02:30:10.839966+00:00, run_duration=2.435539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:01.039379+00:00, queued_by_job_id=1, pid=5071 2024-04-05T02:30:11.501301327Z [2024-04-05T02:30:11.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:09.256124+00:00, run_end_date=2024-04-05 02:30:10.221567+00:00, run_duration=0.965443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:01.039379+00:00, queued_by_job_id=1, pid=5086 2024-04-05T02:30:11.501637150Z [2024-04-05T02:30:11.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:29:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:07.642936+00:00, run_end_date=2024-04-05 02:30:10.502884+00:00, run_duration=2.859948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:01.039379+00:00, queued_by_job_id=1, pid=5057 2024-04-05T02:30:11.506483707Z [2024-04-05T02:30:11.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to dfa56eba-5f18-4d91-aae5-f0d37b72454c 2024-04-05T02:30:16.230383713Z [2024-04-05T02:30:16.230+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:30:16.230407402Z 2024-04-05T02:30:16.230807967Z [2024-04-05T02:30:16.230+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:30:16.231477478Z [2024-04-05T02:30:16.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:16.231483739Z 2024-04-05T02:30:16.237604648Z [2024-04-05T02:30:16.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:30:16.238549012Z [2024-04-05T02:30:16.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:30:16.335820158Z [2024-04-05T02:30:16.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:16.336013080Z [2024-04-05T02:30:16.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:16.343725987Z [2024-04-05T02:30:16.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9249556-8a88-4a93-8ea5-529c2d77b2b6 2024-04-05T02:30:16.344269142Z [2024-04-05T02:30:16.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:15.057064+00:00, run_end_date=2024-04-05 02:30:15.764001+00:00, run_duration=0.706937, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:11.343794+00:00, queued_by_job_id=1, pid=5129 2024-04-05T02:30:19.960162187Z [2024-04-05T02:30:19.959+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:30:19.960182097Z 2024-04-05T02:30:19.960363871Z [2024-04-05T02:30:19.960+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:30:19.961021277Z [2024-04-05T02:30:19.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:19.961033789Z 2024-04-05T02:30:19.964736502Z [2024-04-05T02:30:19.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:19.964978839Z [2024-04-05T02:30:19.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:30:20.033258439Z [2024-04-05T02:30:20.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:20.034652540Z [2024-04-05T02:30:20.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:20.044930633Z [2024-04-05T02:30:20.044+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce343c08-5429-4fc2-9d52-4bcb6a3ce20e 2024-04-05T02:30:20.045091298Z [2024-04-05T02:30:20.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=0, run_start_date=2024-04-05 02:30:18.717684+00:00, run_end_date=2024-04-05 02:30:19.281398+00:00, run_duration=0.563714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:16.233552+00:00, queued_by_job_id=1, pid=5141 2024-04-05T02:30:23.494130010Z [2024-04-05T02:30:23.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:23.494156514Z [2024-04-05T02:30:23.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:25:00+00:00, run_id=scheduled__2024-04-05T02:25:00+00:00, run_start_date=2024-04-05 02:30:00.929639+00:00, run_end_date=2024-04-05 02:30:23.493473+00:00, run_duration=22.563834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:25:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:30:23.504504103Z [2024-04-05T02:30:23.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:30:23.535856649Z [2024-04-05T02:30:23.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:23.547169828Z [2024-04-05T02:30:23.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:22.079889+00:00, run_end_date=2024-04-05 02:30:22.601961+00:00, run_duration=0.522072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:19.961589+00:00, queued_by_job_id=1, pid=5153 2024-04-05T02:31:00.538405908Z [2024-04-05T02:31:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:31:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:31:00.547893731Z [2024-04-05T02:31:00.547+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:31:00.616372024Z [2024-04-05T02:31:00.615+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:31:00.616405686Z 2024-04-05T02:31:00.616412188Z 2024-04-05T02:31:00.616664094Z [2024-04-05T02:31:00.616+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:31:00.616955666Z [2024-04-05T02:31:00.616+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:31:00.620251826Z [2024-04-05T02:31:00.619+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:31:00.620279788Z 2024-04-05T02:31:00.620286573Z 2024-04-05T02:31:00.625139975Z [2024-04-05T02:31:00.624+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:31:00.625515489Z [2024-04-05T02:31:00.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:31:00.626724768Z [2024-04-05T02:31:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:31:00.626928670Z [2024-04-05T02:31:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:31:00.936409257Z [2024-04-05T02:31:00.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:31:00.938511558Z [2024-04-05T02:31:00.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:31:00.954741073Z [2024-04-05T02:31:00.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fc5ca2b-2f35-49fc-98e6-b7a94c95b896 2024-04-05T02:31:00.956173304Z [2024-04-05T02:31:00.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7cd4744-e5e5-4a59-a8cb-2739b24bd7b6 2024-04-05T02:31:07.963600085Z [2024-04-05T02:31:07.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:31:07.964768839Z [2024-04-05T02:31:07.964+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:31:00.563214+00:00, run_end_date=2024-04-05 02:31:07.964321+00:00, run_duration=7.401107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:31:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:31:07.997229117Z [2024-04-05T02:31:07.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:31:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:31:08.066046377Z [2024-04-05T02:31:08.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:31:08.076857126Z [2024-04-05T02:31:08.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:31:05.356595+00:00, run_end_date=2024-04-05 02:31:07.578969+00:00, run_duration=2.222374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:31:00.621502+00:00, queued_by_job_id=1, pid=5175 2024-04-05T02:31:09.122615616Z [2024-04-05T02:31:09.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:31:09.123319769Z [2024-04-05T02:31:09.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:31:00.567510+00:00, run_end_date=2024-04-05 02:31:09.122939+00:00, run_duration=8.555429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:31:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:31:09.136719998Z [2024-04-05T02:31:09.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:31:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:31:09.179672145Z [2024-04-05T02:31:09.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:31:09.185677459Z [2024-04-05T02:31:09.185+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:31:05.940247+00:00, run_end_date=2024-04-05 02:31:08.673593+00:00, run_duration=2.733346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:31:00.621502+00:00, queued_by_job_id=1, pid=5177 2024-04-05T02:31:43.733188072Z [2024-04-05T02:31:43.732+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:32:00.357525705Z [2024-04-05T02:32:00.356+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:32:00.386020025Z [2024-04-05T02:32:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:33:00+00:00 2024-04-05T02:32:00.398062112Z [2024-04-05T02:32:00.397+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:32:00.500490771Z [2024-04-05T02:32:00.500+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:32:00.500514634Z 2024-04-05T02:32:00.500520366Z 2024-04-05T02:32:00.500530225Z 2024-04-05T02:32:00.501180260Z [2024-04-05T02:32:00.500+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:32:00.501411838Z [2024-04-05T02:32:00.501+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:32:00.501640049Z [2024-04-05T02:32:00.501+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:32:00.502772600Z [2024-04-05T02:32:00.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:32:00.502785080Z 2024-04-05T02:32:00.502790855Z 2024-04-05T02:32:00.502809165Z 2024-04-05T02:32:00.509797529Z [2024-04-05T02:32:00.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:32:00.510067919Z [2024-04-05T02:32:00.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:32:00.510344235Z [2024-04-05T02:32:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:32:00.510459688Z [2024-04-05T02:32:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:32:00.510737444Z [2024-04-05T02:32:00.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:32:00.510859817Z [2024-04-05T02:32:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:32:01.118577399Z [2024-04-05T02:32:01.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:32:01.125929738Z [2024-04-05T02:32:01.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status queued for try_number 1 2024-04-05T02:32:01.126697137Z [2024-04-05T02:32:01.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status queued for try_number 1 2024-04-05T02:32:01.141051307Z [2024-04-05T02:32:01.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd211603-393b-405c-8a73-04b7df6872f1 2024-04-05T02:32:01.141610057Z [2024-04-05T02:32:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22999836-160a-4914-8c7b-0ade45639352 2024-04-05T02:32:01.142044498Z [2024-04-05T02:32:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e96c542-b6ba-4331-8b57-39dbd5fb33fd 2024-04-05T02:32:03.701523533Z [2024-04-05T02:32:03.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:32:03.702868170Z [2024-04-05T02:32:03.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:32:00.409117+00:00, run_end_date=2024-04-05 02:32:03.702092+00:00, run_duration=3.292975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:32:03.730670266Z [2024-04-05T02:32:03.730+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:32:03.975142364Z [2024-04-05T02:32:03.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:32:03.985307667Z [2024-04-05T02:32:03.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:32:01.872005+00:00, run_end_date=2024-04-05 02:32:02.712974+00:00, run_duration=0.840969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:32:00.503788+00:00, queued_by_job_id=1, pid=5212 2024-04-05T02:32:08.359777848Z [2024-04-05T02:32:08.358+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:32:08.361035767Z [2024-04-05T02:32:08.360+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:31:00+00:00, run_id=scheduled__2024-04-05T02:31:00+00:00, run_start_date=2024-04-05 02:32:00.411823+00:00, run_end_date=2024-04-05 02:32:08.359714+00:00, run_duration=7.947891, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:31:00+00:00, data_interval_end=2024-04-05 02:32:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:32:08.382874332Z [2024-04-05T02:32:08.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:33:00+00:00 2024-04-05T02:32:09.519788274Z [2024-04-05T02:32:09.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:32:09.519992756Z [2024-04-05T02:32:09.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:31:00+00:00, run_id=scheduled__2024-04-05T02:31:00+00:00, run_start_date=2024-04-05 02:32:00.413297+00:00, run_end_date=2024-04-05 02:32:09.519649+00:00, run_duration=9.106352, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:31:00+00:00, data_interval_end=2024-04-05 02:32:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:32:09.532170921Z [2024-04-05T02:32:09.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:33:00+00:00 2024-04-05T02:32:09.563711580Z [2024-04-05T02:32:09.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status success for try_number 1 2024-04-05T02:32:09.564096107Z [2024-04-05T02:32:09.563+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status success for try_number 1 2024-04-05T02:32:09.579575499Z [2024-04-05T02:32:09.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:31:00+00:00, map_index=-1, run_start_date=2024-04-05 02:32:04.828779+00:00, run_end_date=2024-04-05 02:32:08.302360+00:00, run_duration=3.473581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:32:00.503788+00:00, queued_by_job_id=1, pid=5252 2024-04-05T02:32:09.579860695Z [2024-04-05T02:32:09.579+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:31:00+00:00, map_index=-1, run_start_date=2024-04-05 02:32:04.129741+00:00, run_end_date=2024-04-05 02:32:08.705594+00:00, run_duration=4.575853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:32:00.503788+00:00, queued_by_job_id=1, pid=5233 2024-04-05T02:33:00.797003444Z [2024-04-05T02:33:00.796+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:33:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:33:00.816748235Z [2024-04-05T02:33:00.814+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:33:00.922974880Z [2024-04-05T02:33:00.922+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:33:00.923009023Z 2024-04-05T02:33:00.923013737Z 2024-04-05T02:33:00.923111466Z [2024-04-05T02:33:00.922+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:33:00.923215133Z [2024-04-05T02:33:00.923+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:33:00.925231100Z [2024-04-05T02:33:00.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:33:00.925246648Z 2024-04-05T02:33:00.925250655Z 2024-04-05T02:33:00.934470503Z [2024-04-05T02:33:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:33:00.934642208Z [2024-04-05T02:33:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:33:00.934979490Z [2024-04-05T02:33:00.934+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:33:00.935160096Z [2024-04-05T02:33:00.934+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:33:01.274001805Z [2024-04-05T02:33:01.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status queued for try_number 1 2024-04-05T02:33:01.274355286Z [2024-04-05T02:33:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status queued for try_number 1 2024-04-05T02:33:01.285698638Z [2024-04-05T02:33:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to c43d3116-62ad-4c90-b406-8fd8d8942980 2024-04-05T02:33:01.286056286Z [2024-04-05T02:33:01.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3a53d95c-04ec-4034-9141-f134b972a251 2024-04-05T02:33:08.788569300Z [2024-04-05T02:33:08.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:33:08.788880933Z [2024-04-05T02:33:08.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:32:00+00:00, run_id=scheduled__2024-04-05T02:32:00+00:00, run_start_date=2024-04-05 02:33:00.837310+00:00, run_end_date=2024-04-05 02:33:08.788478+00:00, run_duration=7.951168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:32:00+00:00, data_interval_end=2024-04-05 02:33:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:33:08.800656597Z [2024-04-05T02:33:08.800+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:33:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:33:08.853132425Z [2024-04-05T02:33:08.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status success for try_number 1 2024-04-05T02:33:08.860901613Z [2024-04-05T02:33:08.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:32:00+00:00, map_index=-1, run_start_date=2024-04-05 02:33:04.775342+00:00, run_end_date=2024-04-05 02:33:08.383408+00:00, run_duration=3.608066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:33:00.927481+00:00, queued_by_job_id=1, pid=5297 2024-04-05T02:33:09.910465760Z [2024-04-05T02:33:09.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:33:09.911056535Z [2024-04-05T02:33:09.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:32:00+00:00, run_id=scheduled__2024-04-05T02:32:00+00:00, run_start_date=2024-04-05 02:33:00.842153+00:00, run_end_date=2024-04-05 02:33:09.910405+00:00, run_duration=9.068252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:32:00+00:00, data_interval_end=2024-04-05 02:33:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:33:09.925821971Z [2024-04-05T02:33:09.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:33:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:33:09.963063083Z [2024-04-05T02:33:09.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status success for try_number 1 2024-04-05T02:33:09.971730286Z [2024-04-05T02:33:09.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:32:00+00:00, map_index=-1, run_start_date=2024-04-05 02:33:05.221341+00:00, run_end_date=2024-04-05 02:33:09.205460+00:00, run_duration=3.984119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:33:00.927481+00:00, queued_by_job_id=1, pid=5298 2024-04-05T02:34:00.568997822Z [2024-04-05T02:34:00.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:34:00.581474078Z [2024-04-05T02:34:00.581+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:34:00.591135719Z [2024-04-05T02:34:00.590+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:34:00.674961959Z [2024-04-05T02:34:00.674+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:34:00.674985749Z 2024-04-05T02:34:00.674996345Z 2024-04-05T02:34:00.675003259Z 2024-04-05T02:34:00.675351552Z [2024-04-05T02:34:00.674+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:34:00.675502771Z [2024-04-05T02:34:00.675+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:34:00.675764331Z [2024-04-05T02:34:00.675+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:34:00.676970498Z [2024-04-05T02:34:00.676+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:34:00.676987692Z 2024-04-05T02:34:00.676993556Z 2024-04-05T02:34:00.676998234Z 2024-04-05T02:34:00.684051547Z [2024-04-05T02:34:00.683+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:34:00.684676666Z [2024-04-05T02:34:00.683+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:34:00.686129944Z [2024-04-05T02:34:00.685+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:34:00.686178663Z [2024-04-05T02:34:00.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:34:00.686695154Z [2024-04-05T02:34:00.686+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:34:00.687984876Z [2024-04-05T02:34:00.687+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:34:01.128782590Z [2024-04-05T02:34:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status queued for try_number 1 2024-04-05T02:34:01.128817335Z [2024-04-05T02:34:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status queued for try_number 1 2024-04-05T02:34:01.128900583Z [2024-04-05T02:34:01.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status queued for try_number 1 2024-04-05T02:34:01.139224807Z [2024-04-05T02:34:01.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ed196cf-2312-479a-bd20-37e393c817f5 2024-04-05T02:34:01.139289839Z [2024-04-05T02:34:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cdf7591-c550-44ac-96fb-54e43730594e 2024-04-05T02:34:01.139388906Z [2024-04-05T02:34:01.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ee9d314-d2cb-4536-8d5d-e0983f32a96c 2024-04-05T02:34:03.697357584Z [2024-04-05T02:34:03.696+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:34:03.698918532Z [2024-04-05T02:34:03.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:32:00+00:00, run_id=scheduled__2024-04-05T02:32:00+00:00, run_start_date=2024-04-05 02:34:00.605600+00:00, run_end_date=2024-04-05 02:34:03.697279+00:00, run_duration=3.091679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:32:00+00:00, data_interval_end=2024-04-05 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:34:03.726487567Z [2024-04-05T02:34:03.717+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:34:05.281435174Z [2024-04-05T02:34:05.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status success for try_number 1 2024-04-05T02:34:05.294282644Z [2024-04-05T02:34:05.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:32:00+00:00, map_index=-1, run_start_date=2024-04-05 02:34:02.010749+00:00, run_end_date=2024-04-05 02:34:03.336199+00:00, run_duration=1.32545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:34:00.678916+00:00, queued_by_job_id=1, pid=5334 2024-04-05T02:34:08.984601070Z [2024-04-05T02:34:08.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:34:08.984816869Z [2024-04-05T02:34:08.984+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:33:00+00:00, run_id=scheduled__2024-04-05T02:33:00+00:00, run_start_date=2024-04-05 02:34:00.607115+00:00, run_end_date=2024-04-05 02:34:08.984534+00:00, run_duration=8.377419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:33:00+00:00, data_interval_end=2024-04-05 02:34:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:34:09.002052233Z [2024-04-05T02:34:09.001+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:34:09.017576856Z [2024-04-05T02:34:09.016+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:34:09.018830901Z [2024-04-05T02:34:09.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:33:00+00:00, run_id=scheduled__2024-04-05T02:33:00+00:00, run_start_date=2024-04-05 02:34:00.609055+00:00, run_end_date=2024-04-05 02:34:09.017610+00:00, run_duration=8.408555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:33:00+00:00, data_interval_end=2024-04-05 02:34:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:34:09.034447388Z [2024-04-05T02:34:09.034+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:34:09.065551155Z [2024-04-05T02:34:09.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status success for try_number 1 2024-04-05T02:34:09.066207967Z [2024-04-05T02:34:09.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status success for try_number 1 2024-04-05T02:34:09.079082568Z [2024-04-05T02:34:09.078+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:33:00+00:00, map_index=-1, run_start_date=2024-04-05 02:34:06.031036+00:00, run_end_date=2024-04-05 02:34:08.381076+00:00, run_duration=2.35004, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:34:00.678916+00:00, queued_by_job_id=1, pid=5365 2024-04-05T02:34:09.079407168Z [2024-04-05T02:34:09.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:33:00+00:00, map_index=-1, run_start_date=2024-04-05 02:34:05.982473+00:00, run_end_date=2024-04-05 02:34:08.762863+00:00, run_duration=2.78039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:34:00.678916+00:00, queued_by_job_id=1, pid=5364 2024-04-05T02:35:01.126772479Z [2024-04-05T02:35:01.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:35:01.162339597Z [2024-04-05T02:35:01.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:35:01.178477364Z [2024-04-05T02:35:01.177+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:35:01.264703059Z [2024-04-05T02:35:01.264+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:35:01.264743149Z 2024-04-05T02:35:01.264754684Z 2024-04-05T02:35:01.264759963Z 2024-04-05T02:35:01.264764667Z [2024-04-05T02:35:01.264+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:35:01.264778643Z [2024-04-05T02:35:01.264+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:35:01.264862961Z [2024-04-05T02:35:01.264+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:35:01.265519384Z [2024-04-05T02:35:01.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:35:01.265544539Z 2024-04-05T02:35:01.265550486Z 2024-04-05T02:35:01.265555230Z 2024-04-05T02:35:01.270710478Z [2024-04-05T02:35:01.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:35:01.271490979Z [2024-04-05T02:35:01.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:35:01.273219261Z [2024-04-05T02:35:01.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:35:01.275633808Z [2024-04-05T02:35:01.275+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:35:01.276521455Z [2024-04-05T02:35:01.276+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:35:01.277163871Z [2024-04-05T02:35:01.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:35:01.740950593Z [2024-04-05T02:35:01.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:01.743630622Z [2024-04-05T02:35:01.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:01.744025738Z [2024-04-05T02:35:01.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:01.763437127Z [2024-04-05T02:35:01.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 507973a2-c530-4749-95a6-582747fdbe66 2024-04-05T02:35:01.764830587Z [2024-04-05T02:35:01.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d9c0069-c3b1-42b9-97e0-0fa8eb406f00 2024-04-05T02:35:01.765165366Z [2024-04-05T02:35:01.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f39c6c2-edff-4e39-90df-282a3ce5063d 2024-04-05T02:35:08.808150166Z [2024-04-05T02:35:08.807+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:35:08.808186131Z 2024-04-05T02:35:08.808258602Z [2024-04-05T02:35:08.808+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:35:08.809285320Z [2024-04-05T02:35:08.808+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:35:08.809300382Z 2024-04-05T02:35:08.844824962Z [2024-04-05T02:35:08.844+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:35:08.845024228Z [2024-04-05T02:35:08.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:35:08.925532141Z [2024-04-05T02:35:08.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:08.925570684Z [2024-04-05T02:35:08.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:08.935999130Z [2024-04-05T02:35:08.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f69e339-8c40-462c-976e-0ca10bf0c409 2024-04-05T02:35:08.936340150Z [2024-04-05T02:35:08.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:06.877489+00:00, run_end_date=2024-04-05 02:35:07.982410+00:00, run_duration=1.104921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:01.266381+00:00, queued_by_job_id=1, pid=5430 2024-04-05T02:35:10.263791836Z [2024-04-05T02:35:10.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:35:10.265237883Z [2024-04-05T02:35:10.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:34:00+00:00, run_id=scheduled__2024-04-05T02:34:00+00:00, run_start_date=2024-04-05 02:35:01.197959+00:00, run_end_date=2024-04-05 02:35:10.264758+00:00, run_duration=9.066799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:34:00+00:00, data_interval_end=2024-04-05 02:35:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:35:10.290890033Z [2024-04-05T02:35:10.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:35:10.426119343Z [2024-04-05T02:35:10.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:10.460668244Z [2024-04-05T02:35:10.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:34:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:07.035640+00:00, run_end_date=2024-04-05 02:35:09.548123+00:00, run_duration=2.512483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:01.266381+00:00, queued_by_job_id=1, pid=5431 2024-04-05T02:35:11.689574599Z [2024-04-05T02:35:11.689+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:35:11.710523288Z [2024-04-05T02:35:11.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:34:00+00:00, run_id=scheduled__2024-04-05T02:34:00+00:00, run_start_date=2024-04-05 02:35:01.199753+00:00, run_end_date=2024-04-05 02:35:11.689502+00:00, run_duration=10.489749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:34:00+00:00, data_interval_end=2024-04-05 02:35:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:35:11.781747679Z [2024-04-05T02:35:11.781+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:35:11.854749289Z [2024-04-05T02:35:11.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:11.872225376Z [2024-04-05T02:35:11.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:34:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:07.204514+00:00, run_end_date=2024-04-05 02:35:10.015728+00:00, run_duration=2.811214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:01.266381+00:00, queued_by_job_id=1, pid=5432 2024-04-05T02:35:15.592882329Z [2024-04-05T02:35:15.590+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:35:15.592901140Z 2024-04-05T02:35:15.594378699Z [2024-04-05T02:35:15.592+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:35:15.595227055Z [2024-04-05T02:35:15.594+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:35:15.595243728Z 2024-04-05T02:35:15.603031908Z [2024-04-05T02:35:15.602+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:35:15.603399683Z [2024-04-05T02:35:15.602+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:35:15.720231112Z [2024-04-05T02:35:15.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:15.721405458Z [2024-04-05T02:35:15.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:15.732628812Z [2024-04-05T02:35:15.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55eab839-ad52-4e94-9044-cbfd8bd6d011 2024-04-05T02:35:15.734284810Z [2024-04-05T02:35:15.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:13.624405+00:00, run_end_date=2024-04-05 02:35:14.282411+00:00, run_duration=0.658006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:08.809343+00:00, queued_by_job_id=1, pid=5481 2024-04-05T02:35:19.035801715Z [2024-04-05T02:35:19.035+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:35:19.035827398Z 2024-04-05T02:35:19.035921954Z [2024-04-05T02:35:19.035+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:35:19.036529535Z [2024-04-05T02:35:19.036+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:35:19.036537791Z 2024-04-05T02:35:19.039671024Z [2024-04-05T02:35:19.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:35:19.039866954Z [2024-04-05T02:35:19.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:35:19.124521107Z [2024-04-05T02:35:19.124+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:19.126437910Z [2024-04-05T02:35:19.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:19.139204300Z [2024-04-05T02:35:19.138+0000] {scheduler_job.py:635} INFO - Setting external_id for to d58da562-94e7-437b-9261-2a1e43eb2b27 2024-04-05T02:35:19.139665874Z [2024-04-05T02:35:19.139+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=0, run_start_date=2024-04-05 02:35:17.949856+00:00, run_end_date=2024-04-05 02:35:18.312419+00:00, run_duration=0.362563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:15.595868+00:00, queued_by_job_id=1, pid=5496 2024-04-05T02:35:21.954521851Z [2024-04-05T02:35:21.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:35:21.955069459Z [2024-04-05T02:35:21.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:35:01.195779+00:00, run_end_date=2024-04-05 02:35:21.954695+00:00, run_duration=20.758916, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:35:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:35:21.964324598Z [2024-04-05T02:35:21.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:35:22.017607579Z [2024-04-05T02:35:22.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:22.031887350Z [2024-04-05T02:35:22.031+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:21.244264+00:00, run_end_date=2024-04-05 02:35:21.663424+00:00, run_duration=0.41916, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:19.036882+00:00, queued_by_job_id=1, pid=5508 2024-04-05T02:36:00.480122247Z [2024-04-05T02:36:00.478+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:36:00.502652088Z [2024-04-05T02:36:00.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:37:00+00:00 2024-04-05T02:36:00.512995460Z [2024-04-05T02:36:00.512+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:36:00.616942243Z [2024-04-05T02:36:00.616+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:36:00.616990611Z 2024-04-05T02:36:00.616996740Z 2024-04-05T02:36:00.617003150Z 2024-04-05T02:36:00.617010453Z [2024-04-05T02:36:00.616+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:36:00.617099824Z [2024-04-05T02:36:00.616+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:36:00.617301882Z [2024-04-05T02:36:00.617+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:36:00.618089850Z [2024-04-05T02:36:00.617+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:36:00.618122644Z 2024-04-05T02:36:00.618127334Z 2024-04-05T02:36:00.618130712Z 2024-04-05T02:36:00.622084542Z [2024-04-05T02:36:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:36:00.622251762Z [2024-04-05T02:36:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:36:00.622506183Z [2024-04-05T02:36:00.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:36:00.622626082Z [2024-04-05T02:36:00.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:36:00.622884554Z [2024-04-05T02:36:00.622+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:36:00.622989522Z [2024-04-05T02:36:00.622+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:36:01.004445145Z [2024-04-05T02:36:01.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status queued for try_number 1 2024-04-05T02:36:01.004656022Z [2024-04-05T02:36:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:36:01.004779794Z [2024-04-05T02:36:01.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:36:01.019785913Z [2024-04-05T02:36:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea5ead75-1bfa-41ed-9cca-ce64bdf562c4 2024-04-05T02:36:01.020004535Z [2024-04-05T02:36:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d22909b-7608-4a29-ad86-1ff2fa3ac4c0 2024-04-05T02:36:01.020243182Z [2024-04-05T02:36:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 13565784-873f-4dd9-8765-594e22cc1fff 2024-04-05T02:36:02.727889810Z [2024-04-05T02:36:02.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:36:02.728182256Z [2024-04-05T02:36:02.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:34:00+00:00, run_id=scheduled__2024-04-05T02:34:00+00:00, run_start_date=2024-04-05 02:36:00.530445+00:00, run_end_date=2024-04-05 02:36:02.727831+00:00, run_duration=2.197386, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:34:00+00:00, data_interval_end=2024-04-05 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:36:02.766386986Z [2024-04-05T02:36:02.765+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:36:04.144315810Z [2024-04-05T02:36:04.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status success for try_number 1 2024-04-05T02:36:04.161880403Z [2024-04-05T02:36:04.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:34:00+00:00, map_index=-1, run_start_date=2024-04-05 02:36:01.770925+00:00, run_end_date=2024-04-05 02:36:02.592692+00:00, run_duration=0.821767, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:36:00.618947+00:00, queued_by_job_id=1, pid=5512 2024-04-05T02:36:08.897499705Z [2024-04-05T02:36:08.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:36:08.897642357Z [2024-04-05T02:36:08.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:35:00+00:00, run_id=scheduled__2024-04-05T02:35:00+00:00, run_start_date=2024-04-05 02:36:00.532404+00:00, run_end_date=2024-04-05 02:36:08.897383+00:00, run_duration=8.364979, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:35:00+00:00, data_interval_end=2024-04-05 02:36:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:36:08.907776700Z [2024-04-05T02:36:08.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:37:00+00:00 2024-04-05T02:36:08.915309993Z [2024-04-05T02:36:08.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:36:08.917270461Z [2024-04-05T02:36:08.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:35:00+00:00, run_id=scheduled__2024-04-05T02:35:00+00:00, run_start_date=2024-04-05 02:36:00.534159+00:00, run_end_date=2024-04-05 02:36:08.915228+00:00, run_duration=8.381069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:35:00+00:00, data_interval_end=2024-04-05 02:36:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:36:08.933030210Z [2024-04-05T02:36:08.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:37:00+00:00 2024-04-05T02:36:08.999910644Z [2024-04-05T02:36:08.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:36:08.999923905Z [2024-04-05T02:36:08.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:36:09.009794623Z [2024-04-05T02:36:09.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:36:04.573082+00:00, run_end_date=2024-04-05 02:36:07.939987+00:00, run_duration=3.366905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:36:00.618947+00:00, queued_by_job_id=1, pid=5543 2024-04-05T02:36:09.010368034Z [2024-04-05T02:36:09.009+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:36:04.413076+00:00, run_end_date=2024-04-05 02:36:08.577339+00:00, run_duration=4.164263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:36:00.618947+00:00, queued_by_job_id=1, pid=5542 2024-04-05T02:36:43.825184119Z [2024-04-05T02:36:43.824+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:37:00.908669256Z [2024-04-05T02:37:00.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:37:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:37:00.928413203Z [2024-04-05T02:37:00.927+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:37:01.031283767Z [2024-04-05T02:37:01.030+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:37:01.031335598Z 2024-04-05T02:37:01.031341015Z 2024-04-05T02:37:01.031523665Z [2024-04-05T02:37:01.031+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:37:01.031645799Z [2024-04-05T02:37:01.031+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:37:01.032262337Z [2024-04-05T02:37:01.032+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:37:01.032277244Z 2024-04-05T02:37:01.032282227Z 2024-04-05T02:37:01.036937725Z [2024-04-05T02:37:01.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:37:01.037109912Z [2024-04-05T02:37:01.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:37:01.037450555Z [2024-04-05T02:37:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:37:01.037602084Z [2024-04-05T02:37:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:37:01.282409374Z [2024-04-05T02:37:01.281+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status queued for try_number 1 2024-04-05T02:37:01.282582529Z [2024-04-05T02:37:01.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status queued for try_number 1 2024-04-05T02:37:01.300102207Z [2024-04-05T02:37:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 255c80d1-3084-41ad-8863-bdd049896fdc 2024-04-05T02:37:01.300452715Z [2024-04-05T02:37:01.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d60fb88-e3f0-47dd-959f-ee71f097b6fe 2024-04-05T02:37:09.889905169Z [2024-04-05T02:37:09.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:37:09.890229083Z [2024-04-05T02:37:09.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:36:00+00:00, run_id=scheduled__2024-04-05T02:36:00+00:00, run_start_date=2024-04-05 02:37:00.959128+00:00, run_end_date=2024-04-05 02:37:09.889811+00:00, run_duration=8.930683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:36:00+00:00, data_interval_end=2024-04-05 02:37:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:37:09.900124490Z [2024-04-05T02:37:09.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:37:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:37:09.909461334Z [2024-04-05T02:37:09.909+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:37:09.909795607Z [2024-04-05T02:37:09.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:36:00+00:00, run_id=scheduled__2024-04-05T02:36:00+00:00, run_start_date=2024-04-05 02:37:00.956146+00:00, run_end_date=2024-04-05 02:37:09.909397+00:00, run_duration=8.953251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:36:00+00:00, data_interval_end=2024-04-05 02:37:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:37:09.921343724Z [2024-04-05T02:37:09.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:37:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:37:09.966190496Z [2024-04-05T02:37:09.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status success for try_number 1 2024-04-05T02:37:09.966289754Z [2024-04-05T02:37:09.966+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status success for try_number 1 2024-04-05T02:37:09.974129606Z [2024-04-05T02:37:09.973+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:36:00+00:00, map_index=-1, run_start_date=2024-04-05 02:37:04.644263+00:00, run_end_date=2024-04-05 02:37:09.453614+00:00, run_duration=4.809351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:37:01.033151+00:00, queued_by_job_id=1, pid=5587 2024-04-05T02:37:09.974617017Z [2024-04-05T02:37:09.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:36:00+00:00, map_index=-1, run_start_date=2024-04-05 02:37:05.495109+00:00, run_end_date=2024-04-05 02:37:09.040308+00:00, run_duration=3.545199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:37:01.033151+00:00, queued_by_job_id=1, pid=5606 2024-04-05T02:38:00.282294477Z [2024-04-05T02:38:00.281+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:38:00.295614727Z [2024-04-05T02:38:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:39:00+00:00 2024-04-05T02:38:00.363227334Z [2024-04-05T02:38:00.362+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:38:00.363245723Z 2024-04-05T02:38:00.363251005Z 2024-04-05T02:38:00.364030756Z [2024-04-05T02:38:00.363+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:38:00.364041523Z [2024-04-05T02:38:00.363+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:38:00.364627369Z [2024-04-05T02:38:00.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:38:00.364639877Z 2024-04-05T02:38:00.364643439Z 2024-04-05T02:38:00.367734855Z [2024-04-05T02:38:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:38:00.367860953Z [2024-04-05T02:38:00.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:38:00.368048217Z [2024-04-05T02:38:00.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:38:00.368145381Z [2024-04-05T02:38:00.368+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:38:00.560681677Z [2024-04-05T02:38:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status queued for try_number 1 2024-04-05T02:38:00.561014793Z [2024-04-05T02:38:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status queued for try_number 1 2024-04-05T02:38:00.569406626Z [2024-04-05T02:38:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec717227-6513-4b0d-be2e-a85250d20015 2024-04-05T02:38:00.569869077Z [2024-04-05T02:38:00.569+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0791308-de26-45ae-b327-d456eb59cab6 2024-04-05T02:38:00.637917667Z [2024-04-05T02:38:00.637+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:38:00.819665259Z [2024-04-05T02:38:00.819+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:38:00.819687493Z 2024-04-05T02:38:00.821209438Z [2024-04-05T02:38:00.819+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:38:00.832394282Z [2024-04-05T02:38:00.831+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:38:00.832422862Z 2024-04-05T02:38:00.840420651Z [2024-04-05T02:38:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:38:00.840907391Z [2024-04-05T02:38:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:38:00.948388366Z [2024-04-05T02:38:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status queued for try_number 1 2024-04-05T02:38:00.964053850Z [2024-04-05T02:38:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad0577d9-5bee-4680-b904-ab86c8dd579d 2024-04-05T02:38:04.964751784Z [2024-04-05T02:38:04.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:38:04.964779151Z [2024-04-05T02:38:04.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:36:00+00:00, run_id=scheduled__2024-04-05T02:36:00+00:00, run_start_date=2024-04-05 02:38:00.669677+00:00, run_end_date=2024-04-05 02:38:04.957618+00:00, run_duration=4.287941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:36:00+00:00, data_interval_end=2024-04-05 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:38:04.988859392Z [2024-04-05T02:38:04.985+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:38:05.142269668Z [2024-04-05T02:38:05.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status success for try_number 1 2024-04-05T02:38:05.179914975Z [2024-04-05T02:38:05.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:36:00+00:00, map_index=-1, run_start_date=2024-04-05 02:38:02.602978+00:00, run_end_date=2024-04-05 02:38:04.258692+00:00, run_duration=1.655714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:38:00.833107+00:00, queued_by_job_id=1, pid=5635 2024-04-05T02:38:08.686259788Z [2024-04-05T02:38:08.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:38:08.686697768Z [2024-04-05T02:38:08.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:37:00+00:00, run_id=scheduled__2024-04-05T02:37:00+00:00, run_start_date=2024-04-05 02:38:00.311022+00:00, run_end_date=2024-04-05 02:38:08.686197+00:00, run_duration=8.375175, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:37:00+00:00, data_interval_end=2024-04-05 02:38:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:38:08.705583851Z [2024-04-05T02:38:08.703+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:39:00+00:00 2024-04-05T02:38:08.731842358Z [2024-04-05T02:38:08.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:38:08.732865529Z [2024-04-05T02:38:08.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:37:00+00:00, run_id=scheduled__2024-04-05T02:37:00+00:00, run_start_date=2024-04-05 02:38:00.312842+00:00, run_end_date=2024-04-05 02:38:08.731740+00:00, run_duration=8.418898, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:37:00+00:00, data_interval_end=2024-04-05 02:38:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:38:08.750839554Z [2024-04-05T02:38:08.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:39:00+00:00 2024-04-05T02:38:08.887198592Z [2024-04-05T02:38:08.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status success for try_number 1 2024-04-05T02:38:08.912550830Z [2024-04-05T02:38:08.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:37:00+00:00, map_index=-1, run_start_date=2024-04-05 02:38:05.758934+00:00, run_end_date=2024-04-05 02:38:08.387130+00:00, run_duration=2.628196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:38:00.365164+00:00, queued_by_job_id=1, pid=5674 2024-04-05T02:38:10.006649540Z [2024-04-05T02:38:10.006+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status success for try_number 1 2024-04-05T02:38:10.014400595Z [2024-04-05T02:38:10.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:37:00+00:00, map_index=-1, run_start_date=2024-04-05 02:38:04.821786+00:00, run_end_date=2024-04-05 02:38:08.623708+00:00, run_duration=3.801922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:38:00.365164+00:00, queued_by_job_id=1, pid=5655 2024-04-05T02:39:00.823506526Z [2024-04-05T02:39:00.821+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:39:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:39:00.837280491Z [2024-04-05T02:39:00.836+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:39:00.917497228Z [2024-04-05T02:39:00.917+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:39:00.917520544Z 2024-04-05T02:39:00.917524402Z 2024-04-05T02:39:00.917776764Z [2024-04-05T02:39:00.917+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:39:00.918095575Z [2024-04-05T02:39:00.917+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:39:00.919117062Z [2024-04-05T02:39:00.918+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:39:00.919130231Z 2024-04-05T02:39:00.919134204Z 2024-04-05T02:39:00.924489080Z [2024-04-05T02:39:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:39:00.924782469Z [2024-04-05T02:39:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:39:00.925262593Z [2024-04-05T02:39:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:39:00.925833711Z [2024-04-05T02:39:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:39:01.189217371Z [2024-04-05T02:39:01.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status queued for try_number 1 2024-04-05T02:39:01.189483331Z [2024-04-05T02:39:01.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status queued for try_number 1 2024-04-05T02:39:01.200989380Z [2024-04-05T02:39:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to f964e461-8d23-4437-85ff-182636aca4fc 2024-04-05T02:39:01.201311729Z [2024-04-05T02:39:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 244d9136-2b53-4f81-8cb2-bd4a609fe153 2024-04-05T02:39:09.813359107Z [2024-04-05T02:39:09.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:39:09.814121983Z [2024-04-05T02:39:09.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:38:00+00:00, run_id=scheduled__2024-04-05T02:38:00+00:00, run_start_date=2024-04-05 02:39:00.849922+00:00, run_end_date=2024-04-05 02:39:09.813468+00:00, run_duration=8.963546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:38:00+00:00, data_interval_end=2024-04-05 02:39:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:39:09.832727299Z [2024-04-05T02:39:09.832+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:39:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:39:09.841262499Z [2024-04-05T02:39:09.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:39:09.841775949Z [2024-04-05T02:39:09.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:38:00+00:00, run_id=scheduled__2024-04-05T02:38:00+00:00, run_start_date=2024-04-05 02:39:00.851623+00:00, run_end_date=2024-04-05 02:39:09.841154+00:00, run_duration=8.989531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:38:00+00:00, data_interval_end=2024-04-05 02:39:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:39:09.857716287Z [2024-04-05T02:39:09.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:39:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:39:09.924494237Z [2024-04-05T02:39:09.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status success for try_number 1 2024-04-05T02:39:09.942216255Z [2024-04-05T02:39:09.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:38:00+00:00, map_index=-1, run_start_date=2024-04-05 02:39:05.252556+00:00, run_end_date=2024-04-05 02:39:08.836630+00:00, run_duration=3.584074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:39:00.919823+00:00, queued_by_job_id=1, pid=5719 2024-04-05T02:39:10.252419891Z [2024-04-05T02:39:10.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status success for try_number 1 2024-04-05T02:39:10.257714287Z [2024-04-05T02:39:10.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:38:00+00:00, map_index=-1, run_start_date=2024-04-05 02:39:05.495402+00:00, run_end_date=2024-04-05 02:39:09.700434+00:00, run_duration=4.205032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:39:00.919823+00:00, queued_by_job_id=1, pid=5720 2024-04-05T02:40:00.353942443Z [2024-04-05T02:40:00.353+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:41:00+00:00 2024-04-05T02:40:00.361235479Z [2024-04-05T02:40:00.360+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:40:00.386184472Z [2024-04-05T02:40:00.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:40:00.401105441Z [2024-04-05T02:40:00.400+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:40:00.543983790Z [2024-04-05T02:40:00.543+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:40:00.544014921Z 2024-04-05T02:40:00.544020808Z 2024-04-05T02:40:00.544026895Z 2024-04-05T02:40:00.544032191Z 2024-04-05T02:40:00.544216951Z [2024-04-05T02:40:00.543+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:40:00.544386536Z [2024-04-05T02:40:00.544+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:40:00.544739569Z [2024-04-05T02:40:00.544+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:40:00.545119687Z [2024-04-05T02:40:00.544+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:40:00.546778184Z [2024-04-05T02:40:00.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:00.546795443Z 2024-04-05T02:40:00.546801215Z 2024-04-05T02:40:00.546806362Z 2024-04-05T02:40:00.546810702Z 2024-04-05T02:40:00.552856420Z [2024-04-05T02:40:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:40:00.555333317Z [2024-04-05T02:40:00.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:40:00.555709566Z [2024-04-05T02:40:00.555+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:00.556015630Z [2024-04-05T02:40:00.555+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:40:00.556319499Z [2024-04-05T02:40:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:00.556496718Z [2024-04-05T02:40:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:40:00.557363458Z [2024-04-05T02:40:00.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:00.559476166Z [2024-04-05T02:40:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:40:01.211263482Z [2024-04-05T02:40:01.210+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.211766748Z [2024-04-05T02:40:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.211990466Z [2024-04-05T02:40:01.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.213155261Z [2024-04-05T02:40:01.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.234658701Z [2024-04-05T02:40:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba18d32e-16f1-44b2-ab89-e7445edb5b65 2024-04-05T02:40:01.238621685Z [2024-04-05T02:40:01.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16b4edb2-76e5-447d-8802-395e76b2889f 2024-04-05T02:40:01.239185222Z [2024-04-05T02:40:01.238+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a173291-c77f-4931-a602-338c3f68f694 2024-04-05T02:40:01.239933057Z [2024-04-05T02:40:01.239+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa56f622-1d24-4ddf-af77-f4bde8924223 2024-04-05T02:40:05.176324973Z [2024-04-05T02:40:05.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:05.182531149Z [2024-04-05T02:40:05.176+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:38:00+00:00, run_id=scheduled__2024-04-05T02:38:00+00:00, run_start_date=2024-04-05 02:40:00.420908+00:00, run_end_date=2024-04-05 02:40:05.176373+00:00, run_duration=4.755465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:38:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:40:05.237419632Z [2024-04-05T02:40:05.236+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:40:05.768117355Z [2024-04-05T02:40:05.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:05.796304366Z [2024-04-05T02:40:05.789+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:38:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:02.436687+00:00, run_end_date=2024-04-05 02:40:04.374292+00:00, run_duration=1.937605, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.548418+00:00, queued_by_job_id=1, pid=5756 2024-04-05T02:40:08.849876576Z [2024-04-05T02:40:08.847+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:40:08.849927739Z 2024-04-05T02:40:08.850547227Z [2024-04-05T02:40:08.849+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:40:08.852729320Z [2024-04-05T02:40:08.850+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:08.852742474Z 2024-04-05T02:40:08.925184581Z [2024-04-05T02:40:08.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:40:08.925297896Z [2024-04-05T02:40:08.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:40:09.202627674Z [2024-04-05T02:40:09.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:09.210228666Z [2024-04-05T02:40:09.202+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:09.235108195Z [2024-04-05T02:40:09.234+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa35aa31-6610-4f1d-8eff-386a990c9882 2024-04-05T02:40:09.242157691Z [2024-04-05T02:40:09.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:06.864664+00:00, run_end_date=2024-04-05 02:40:08.061037+00:00, run_duration=1.196373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.548418+00:00, queued_by_job_id=1, pid=5778 2024-04-05T02:40:14.917259762Z [2024-04-05T02:40:14.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:14.919597514Z [2024-04-05T02:40:14.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:39:00+00:00, run_id=scheduled__2024-04-05T02:39:00+00:00, run_start_date=2024-04-05 02:40:00.423386+00:00, run_end_date=2024-04-05 02:40:14.919085+00:00, run_duration=14.495699, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:39:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:40:15.000658414Z [2024-04-05T02:40:15.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:41:00+00:00 2024-04-05T02:40:15.120752304Z [2024-04-05T02:40:15.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:15.121005241Z [2024-04-05T02:40:15.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:39:00+00:00, run_id=scheduled__2024-04-05T02:39:00+00:00, run_start_date=2024-04-05 02:40:00.424848+00:00, run_end_date=2024-04-05 02:40:15.120668+00:00, run_duration=14.69582, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:39:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:40:15.218777969Z [2024-04-05T02:40:15.218+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:41:00+00:00 2024-04-05T02:40:15.316201887Z [2024-04-05T02:40:15.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:15.316373216Z [2024-04-05T02:40:15.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:15.341815321Z [2024-04-05T02:40:15.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:39:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:10.415534+00:00, run_end_date=2024-04-05 02:40:13.724246+00:00, run_duration=3.308712, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.548418+00:00, queued_by_job_id=1, pid=5817 2024-04-05T02:40:15.346839800Z [2024-04-05T02:40:15.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:39:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:10.354467+00:00, run_end_date=2024-04-05 02:40:13.185705+00:00, run_duration=2.831238, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.548418+00:00, queued_by_job_id=1, pid=5816 2024-04-05T02:40:18.557848440Z [2024-04-05T02:40:18.557+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:40:18.557874789Z 2024-04-05T02:40:18.557886213Z [2024-04-05T02:40:18.557+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:40:18.558562197Z [2024-04-05T02:40:18.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:18.558576772Z 2024-04-05T02:40:18.561787529Z [2024-04-05T02:40:18.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:40:18.561955455Z [2024-04-05T02:40:18.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:40:18.657201759Z [2024-04-05T02:40:18.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:18.657402627Z [2024-04-05T02:40:18.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:18.672631944Z [2024-04-05T02:40:18.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe303517-352b-47be-ad42-7f51b8835ec3 2024-04-05T02:40:18.673228869Z [2024-04-05T02:40:18.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:16.829998+00:00, run_end_date=2024-04-05 02:40:17.472697+00:00, run_duration=0.642699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:08.851828+00:00, queued_by_job_id=1, pid=5846 2024-04-05T02:40:22.111032354Z [2024-04-05T02:40:22.110+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:40:22.111079308Z 2024-04-05T02:40:22.111524980Z [2024-04-05T02:40:22.111+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:40:22.112177129Z [2024-04-05T02:40:22.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:22.112187721Z 2024-04-05T02:40:22.117275046Z [2024-04-05T02:40:22.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:22.117493615Z [2024-04-05T02:40:22.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:40:22.190845264Z [2024-04-05T02:40:22.189+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:22.190879548Z [2024-04-05T02:40:22.190+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:22.197707916Z [2024-04-05T02:40:22.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 104b0f0f-f979-46e1-8704-ac057def7390 2024-04-05T02:40:22.197861396Z [2024-04-05T02:40:22.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=0, run_start_date=2024-04-05 02:40:21.025594+00:00, run_end_date=2024-04-05 02:40:21.417161+00:00, run_duration=0.391567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:18.559403+00:00, queued_by_job_id=1, pid=5861 2024-04-05T02:40:26.045186614Z [2024-04-05T02:40:26.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:26.045785195Z [2024-04-05T02:40:26.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:35:00+00:00, run_id=scheduled__2024-04-05T02:35:00+00:00, run_start_date=2024-04-05 02:40:00.419067+00:00, run_end_date=2024-04-05 02:40:26.045080+00:00, run_duration=25.626013, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:35:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:40:26.057583313Z [2024-04-05T02:40:26.057+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:40:26.102500655Z [2024-04-05T02:40:26.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:26.111840223Z [2024-04-05T02:40:26.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:24.982739+00:00, run_end_date=2024-04-05 02:40:25.456901+00:00, run_duration=0.474162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:22.112773+00:00, queued_by_job_id=1, pid=5873 2024-04-05T02:41:00.369138892Z [2024-04-05T02:41:00.368+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:41:00.381723117Z [2024-04-05T02:41:00.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:41:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:41:00.458402726Z [2024-04-05T02:41:00.457+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:41:00.458431736Z 2024-04-05T02:41:00.458437711Z 2024-04-05T02:41:00.458727921Z [2024-04-05T02:41:00.458+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:41:00.459004122Z [2024-04-05T02:41:00.458+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:41:00.460233251Z [2024-04-05T02:41:00.460+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:41:00.460248392Z 2024-04-05T02:41:00.460253440Z 2024-04-05T02:41:00.465164097Z [2024-04-05T02:41:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:41:00.465745257Z [2024-04-05T02:41:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:41:00.466248984Z [2024-04-05T02:41:00.466+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:41:00.466697105Z [2024-04-05T02:41:00.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:41:00.792290107Z [2024-04-05T02:41:00.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:41:00.792430938Z [2024-04-05T02:41:00.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:41:00.802114622Z [2024-04-05T02:41:00.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 241048c7-7bc9-45cd-be6e-862c30d2e6d5 2024-04-05T02:41:00.802218748Z [2024-04-05T02:41:00.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to 985079f1-92ff-47e7-ba4a-1680815cf78d 2024-04-05T02:41:06.689423395Z [2024-04-05T02:41:06.688+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:41:06.690317837Z [2024-04-05T02:41:06.690+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:41:00.398240+00:00, run_end_date=2024-04-05 02:41:06.689823+00:00, run_duration=6.291583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:41:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:41:06.718106890Z [2024-04-05T02:41:06.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:41:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:41:06.794732929Z [2024-04-05T02:41:06.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:41:06.809419611Z [2024-04-05T02:41:06.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:41:03.684637+00:00, run_end_date=2024-04-05 02:41:06.202909+00:00, run_duration=2.518272, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:41:00.461267+00:00, queued_by_job_id=1, pid=5887 2024-04-05T02:41:09.012105273Z [2024-04-05T02:41:09.011+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:41:09.012515745Z [2024-04-05T02:41:09.012+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:41:00.400509+00:00, run_end_date=2024-04-05 02:41:09.012082+00:00, run_duration=8.611573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:41:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:41:09.027521958Z [2024-04-05T02:41:09.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:41:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:41:09.070328294Z [2024-04-05T02:41:09.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:41:09.074831796Z [2024-04-05T02:41:09.074+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:41:04.346366+00:00, run_end_date=2024-04-05 02:41:08.405416+00:00, run_duration=4.05905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:41:00.461267+00:00, queued_by_job_id=1, pid=5906 2024-04-05T02:41:43.914716958Z [2024-04-05T02:41:43.914+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:42:00.145023010Z [2024-04-05T02:42:00.144+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:42:00.166491148Z [2024-04-05T02:42:00.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:43:00+00:00 2024-04-05T02:42:00.186976876Z [2024-04-05T02:42:00.186+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:42:00.276642039Z [2024-04-05T02:42:00.276+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:42:00.276663687Z 2024-04-05T02:42:00.276668197Z 2024-04-05T02:42:00.276671841Z 2024-04-05T02:42:00.276786366Z [2024-04-05T02:42:00.276+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:42:00.276949682Z [2024-04-05T02:42:00.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:42:00.277074306Z [2024-04-05T02:42:00.276+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:42:00.278186053Z [2024-04-05T02:42:00.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:42:00.278213370Z 2024-04-05T02:42:00.278217266Z 2024-04-05T02:42:00.278220481Z 2024-04-05T02:42:00.281708868Z [2024-04-05T02:42:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:42:00.281902789Z [2024-04-05T02:42:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:42:00.282256005Z [2024-04-05T02:42:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:42:00.282531511Z [2024-04-05T02:42:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:42:00.283138854Z [2024-04-05T02:42:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:42:00.283517661Z [2024-04-05T02:42:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:42:00.559638343Z [2024-04-05T02:42:00.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:42:00.560026235Z [2024-04-05T02:42:00.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status queued for try_number 1 2024-04-05T02:42:00.560502112Z [2024-04-05T02:42:00.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status queued for try_number 1 2024-04-05T02:42:00.601954429Z [2024-04-05T02:42:00.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60d34d53-a00d-4de4-bc18-ef9fa69d399d 2024-04-05T02:42:00.602446633Z [2024-04-05T02:42:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19a60be6-1b17-445c-b4fa-8f84ff42bff0 2024-04-05T02:42:00.608914177Z [2024-04-05T02:42:00.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40b08ce5-061d-4a78-919d-cf1face6116f 2024-04-05T02:42:03.227320556Z [2024-04-05T02:42:03.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:42:03.227914477Z [2024-04-05T02:42:03.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:42:00.201924+00:00, run_end_date=2024-04-05 02:42:03.227243+00:00, run_duration=3.025319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:42:03.251964590Z [2024-04-05T02:42:03.251+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:42:03.370881793Z [2024-04-05T02:42:03.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:42:03.385384888Z [2024-04-05T02:42:03.385+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:42:01.709588+00:00, run_end_date=2024-04-05 02:42:02.389954+00:00, run_duration=0.680366, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:42:00.278971+00:00, queued_by_job_id=1, pid=5932 2024-04-05T02:42:06.817524939Z [2024-04-05T02:42:06.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:42:06.818156614Z [2024-04-05T02:42:06.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:41:00+00:00, run_id=scheduled__2024-04-05T02:41:00+00:00, run_start_date=2024-04-05 02:42:00.204669+00:00, run_end_date=2024-04-05 02:42:06.817427+00:00, run_duration=6.612758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:41:00+00:00, data_interval_end=2024-04-05 02:42:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:42:06.835190520Z [2024-04-05T02:42:06.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:43:00+00:00 2024-04-05T02:42:06.888776284Z [2024-04-05T02:42:06.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status success for try_number 1 2024-04-05T02:42:06.896970402Z [2024-04-05T02:42:06.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:41:00+00:00, map_index=-1, run_start_date=2024-04-05 02:42:03.916295+00:00, run_end_date=2024-04-05 02:42:06.520778+00:00, run_duration=2.604483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:42:00.278971+00:00, queued_by_job_id=1, pid=5953 2024-04-05T02:42:07.981618502Z [2024-04-05T02:42:07.981+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:42:07.982078206Z [2024-04-05T02:42:07.981+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:41:00+00:00, run_id=scheduled__2024-04-05T02:41:00+00:00, run_start_date=2024-04-05 02:42:00.203620+00:00, run_end_date=2024-04-05 02:42:07.981674+00:00, run_duration=7.778054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:41:00+00:00, data_interval_end=2024-04-05 02:42:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:42:07.994076437Z [2024-04-05T02:42:07.993+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:43:00+00:00 2024-04-05T02:42:08.037085541Z [2024-04-05T02:42:08.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status success for try_number 1 2024-04-05T02:42:08.046446259Z [2024-04-05T02:42:08.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:41:00+00:00, map_index=-1, run_start_date=2024-04-05 02:42:04.566074+00:00, run_end_date=2024-04-05 02:42:07.796820+00:00, run_duration=3.230746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:42:00.278971+00:00, queued_by_job_id=1, pid=5972 2024-04-05T02:43:00.490197116Z [2024-04-05T02:43:00.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:43:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:43:00.503303938Z [2024-04-05T02:43:00.502+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:43:00.576547191Z [2024-04-05T02:43:00.576+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:43:00.576581499Z 2024-04-05T02:43:00.576587089Z 2024-04-05T02:43:00.576678136Z [2024-04-05T02:43:00.576+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:43:00.576685973Z [2024-04-05T02:43:00.576+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:43:00.577709539Z [2024-04-05T02:43:00.577+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:43:00.577747786Z 2024-04-05T02:43:00.577762560Z 2024-04-05T02:43:00.584859909Z [2024-04-05T02:43:00.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:43:00.585129128Z [2024-04-05T02:43:00.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:43:00.586732793Z [2024-04-05T02:43:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:43:00.587194763Z [2024-04-05T02:43:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:43:00.869843814Z [2024-04-05T02:43:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status queued for try_number 1 2024-04-05T02:43:00.870130506Z [2024-04-05T02:43:00.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status queued for try_number 1 2024-04-05T02:43:00.889175064Z [2024-04-05T02:43:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 712a4791-4fea-451e-b619-72171d75917f 2024-04-05T02:43:00.889270470Z [2024-04-05T02:43:00.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34a2b024-2727-4822-98ce-f6cf70d4320a 2024-04-05T02:43:07.036296884Z [2024-04-05T02:43:07.035+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:43:07.036689376Z [2024-04-05T02:43:07.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:42:00+00:00, run_id=scheduled__2024-04-05T02:42:00+00:00, run_start_date=2024-04-05 02:43:00.522549+00:00, run_end_date=2024-04-05 02:43:07.036234+00:00, run_duration=6.513685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:42:00+00:00, data_interval_end=2024-04-05 02:43:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:43:07.049654941Z [2024-04-05T02:43:07.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:43:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:43:07.101673191Z [2024-04-05T02:43:07.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status success for try_number 1 2024-04-05T02:43:07.113094120Z [2024-04-05T02:43:07.112+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:42:00+00:00, map_index=-1, run_start_date=2024-04-05 02:43:04.349555+00:00, run_end_date=2024-04-05 02:43:06.851048+00:00, run_duration=2.501493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:43:00.579819+00:00, queued_by_job_id=1, pid=6019 2024-04-05T02:43:08.216574187Z [2024-04-05T02:43:08.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:43:08.219238198Z [2024-04-05T02:43:08.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:42:00+00:00, run_id=scheduled__2024-04-05T02:42:00+00:00, run_start_date=2024-04-05 02:43:00.525187+00:00, run_end_date=2024-04-05 02:43:08.216479+00:00, run_duration=7.691292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:42:00+00:00, data_interval_end=2024-04-05 02:43:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:43:08.236695419Z [2024-04-05T02:43:08.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:43:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:43:08.282296401Z [2024-04-05T02:43:08.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status success for try_number 1 2024-04-05T02:43:08.296285329Z [2024-04-05T02:43:08.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:42:00+00:00, map_index=-1, run_start_date=2024-04-05 02:43:04.354635+00:00, run_end_date=2024-04-05 02:43:07.272886+00:00, run_duration=2.918251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:43:00.579819+00:00, queued_by_job_id=1, pid=6018 2024-04-05T02:44:00.783833652Z [2024-04-05T02:44:00.783+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:44:00.798771334Z [2024-04-05T02:44:00.798+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:44:00.824545226Z [2024-04-05T02:44:00.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:44:00.922545888Z [2024-04-05T02:44:00.922+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:44:00.922581021Z 2024-04-05T02:44:00.922585893Z 2024-04-05T02:44:00.922589306Z 2024-04-05T02:44:00.923253071Z [2024-04-05T02:44:00.922+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:44:00.923431657Z [2024-04-05T02:44:00.923+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:44:00.923620841Z [2024-04-05T02:44:00.923+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:44:00.924243590Z [2024-04-05T02:44:00.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:44:00.924250910Z 2024-04-05T02:44:00.924255027Z 2024-04-05T02:44:00.924258689Z 2024-04-05T02:44:00.928789201Z [2024-04-05T02:44:00.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:44:00.928909778Z [2024-04-05T02:44:00.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:44:00.929200687Z [2024-04-05T02:44:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:44:00.929357731Z [2024-04-05T02:44:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:44:00.929719056Z [2024-04-05T02:44:00.929+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:44:00.930053899Z [2024-04-05T02:44:00.929+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:44:01.355243367Z [2024-04-05T02:44:01.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status queued for try_number 1 2024-04-05T02:44:01.355754213Z [2024-04-05T02:44:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status queued for try_number 1 2024-04-05T02:44:01.356729592Z [2024-04-05T02:44:01.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status queued for try_number 1 2024-04-05T02:44:01.380485144Z [2024-04-05T02:44:01.379+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad2d3cef-26a4-4922-9e02-afda03479403 2024-04-05T02:44:01.381132178Z [2024-04-05T02:44:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to aadb6d7a-b939-4ad6-96cc-aaac49f436b6 2024-04-05T02:44:01.382599258Z [2024-04-05T02:44:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43dc2bc7-5b22-41e1-9d36-064c315ea8ab 2024-04-05T02:44:06.048543036Z [2024-04-05T02:44:06.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:44:06.048998589Z [2024-04-05T02:44:06.048+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:42:00+00:00, run_id=scheduled__2024-04-05T02:42:00+00:00, run_start_date=2024-04-05 02:44:00.844760+00:00, run_end_date=2024-04-05 02:44:06.048485+00:00, run_duration=5.203725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:42:00+00:00, data_interval_end=2024-04-05 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:44:06.069674932Z [2024-04-05T02:44:06.069+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:44:06.165854210Z [2024-04-05T02:44:06.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status success for try_number 1 2024-04-05T02:44:06.172375043Z [2024-04-05T02:44:06.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:42:00+00:00, map_index=-1, run_start_date=2024-04-05 02:44:03.480377+00:00, run_end_date=2024-04-05 02:44:05.016168+00:00, run_duration=1.535791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:44:00.925161+00:00, queued_by_job_id=1, pid=6055 2024-04-05T02:44:09.764582633Z [2024-04-05T02:44:09.763+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:44:09.765319191Z [2024-04-05T02:44:09.764+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:43:00+00:00, run_id=scheduled__2024-04-05T02:43:00+00:00, run_start_date=2024-04-05 02:44:00.849223+00:00, run_end_date=2024-04-05 02:44:09.763953+00:00, run_duration=8.91473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:43:00+00:00, data_interval_end=2024-04-05 02:44:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:44:09.790717828Z [2024-04-05T02:44:09.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:44:09.832529610Z [2024-04-05T02:44:09.830+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:44:09.832551576Z [2024-04-05T02:44:09.830+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:43:00+00:00, run_id=scheduled__2024-04-05T02:43:00+00:00, run_start_date=2024-04-05 02:44:00.847392+00:00, run_end_date=2024-04-05 02:44:09.830545+00:00, run_duration=8.983153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:43:00+00:00, data_interval_end=2024-04-05 02:44:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:44:09.853739143Z [2024-04-05T02:44:09.852+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:44:09.930679708Z [2024-04-05T02:44:09.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status success for try_number 1 2024-04-05T02:44:09.931004218Z [2024-04-05T02:44:09.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status success for try_number 1 2024-04-05T02:44:09.946046948Z [2024-04-05T02:44:09.945+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:43:00+00:00, map_index=-1, run_start_date=2024-04-05 02:44:06.498560+00:00, run_end_date=2024-04-05 02:44:09.353826+00:00, run_duration=2.855266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:44:00.925161+00:00, queued_by_job_id=1, pid=6076 2024-04-05T02:44:09.946572078Z [2024-04-05T02:44:09.946+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:43:00+00:00, map_index=-1, run_start_date=2024-04-05 02:44:07.190609+00:00, run_end_date=2024-04-05 02:44:09.239416+00:00, run_duration=2.048807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:44:00.925161+00:00, queued_by_job_id=1, pid=6095 2024-04-05T02:45:00.988996228Z [2024-04-05T02:45:00.988+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:45:01.005611672Z [2024-04-05T02:45:01.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:45:01.014426763Z [2024-04-05T02:45:01.013+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:45:01.114618332Z [2024-04-05T02:45:01.114+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:45:01.114655510Z 2024-04-05T02:45:01.114660245Z 2024-04-05T02:45:01.114663612Z 2024-04-05T02:45:01.115107468Z [2024-04-05T02:45:01.114+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:45:01.115505181Z [2024-04-05T02:45:01.115+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:45:01.115801297Z [2024-04-05T02:45:01.115+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:45:01.116916689Z [2024-04-05T02:45:01.116+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:45:01.116931253Z 2024-04-05T02:45:01.116935173Z 2024-04-05T02:45:01.116938444Z 2024-04-05T02:45:01.128332533Z [2024-04-05T02:45:01.127+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:45:01.130085100Z [2024-04-05T02:45:01.128+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:45:01.131708671Z [2024-04-05T02:45:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:45:01.132255776Z [2024-04-05T02:45:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:45:01.132949713Z [2024-04-05T02:45:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:45:01.133755511Z [2024-04-05T02:45:01.133+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:45:01.647953867Z [2024-04-05T02:45:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:01.647989229Z [2024-04-05T02:45:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:01.648047526Z [2024-04-05T02:45:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:01.678097989Z [2024-04-05T02:45:01.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dc06c36-4bc0-45a1-b9d6-fa5435360349 2024-04-05T02:45:01.678212507Z [2024-04-05T02:45:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to f56ccb71-0fe2-45e1-ae00-016322a70fbe 2024-04-05T02:45:01.678356795Z [2024-04-05T02:45:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 987ceafe-48a1-47c4-b8b0-2ef0a5f08bac 2024-04-05T02:45:09.647041598Z [2024-04-05T02:45:09.646+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:45:09.647061998Z 2024-04-05T02:45:09.647145127Z [2024-04-05T02:45:09.646+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:45:09.647701521Z [2024-04-05T02:45:09.647+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:45:09.647712866Z 2024-04-05T02:45:09.651180381Z [2024-04-05T02:45:09.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:45:09.651280902Z [2024-04-05T02:45:09.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:45:09.850484217Z [2024-04-05T02:45:09.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:09.850789100Z [2024-04-05T02:45:09.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:09.865860640Z [2024-04-05T02:45:09.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27c15eae-ab82-438a-8eb2-7e20f6a8432a 2024-04-05T02:45:09.866439660Z [2024-04-05T02:45:09.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:07.434939+00:00, run_end_date=2024-04-05 02:45:08.622564+00:00, run_duration=1.187625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:01.119180+00:00, queued_by_job_id=1, pid=6152 2024-04-05T02:45:11.361038487Z [2024-04-05T02:45:11.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:45:11.362748554Z [2024-04-05T02:45:11.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:44:00+00:00, run_id=scheduled__2024-04-05T02:44:00+00:00, run_start_date=2024-04-05 02:45:01.029110+00:00, run_end_date=2024-04-05 02:45:11.361362+00:00, run_duration=10.332252, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:44:00+00:00, data_interval_end=2024-04-05 02:45:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:45:11.396898003Z [2024-04-05T02:45:11.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:45:11.416508220Z [2024-04-05T02:45:11.416+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:45:11.417497676Z [2024-04-05T02:45:11.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:44:00+00:00, run_id=scheduled__2024-04-05T02:44:00+00:00, run_start_date=2024-04-05 02:45:01.027212+00:00, run_end_date=2024-04-05 02:45:11.417096+00:00, run_duration=10.389884, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:44:00+00:00, data_interval_end=2024-04-05 02:45:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:45:11.438146634Z [2024-04-05T02:45:11.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:45:11.602854653Z [2024-04-05T02:45:11.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:11.603058808Z [2024-04-05T02:45:11.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:11.632531170Z [2024-04-05T02:45:11.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:44:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:07.299160+00:00, run_end_date=2024-04-05 02:45:10.443635+00:00, run_duration=3.144475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:01.119180+00:00, queued_by_job_id=1, pid=6151 2024-04-05T02:45:11.633429769Z [2024-04-05T02:45:11.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:44:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:08.001505+00:00, run_end_date=2024-04-05 02:45:10.011576+00:00, run_duration=2.010071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:01.119180+00:00, queued_by_job_id=1, pid=6153 2024-04-05T02:45:15.067325629Z [2024-04-05T02:45:15.066+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:45:15.067389692Z 2024-04-05T02:45:15.067410692Z [2024-04-05T02:45:15.067+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:45:15.071261182Z [2024-04-05T02:45:15.070+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:45:15.071281450Z 2024-04-05T02:45:15.079120549Z [2024-04-05T02:45:15.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:45:15.079140861Z [2024-04-05T02:45:15.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:45:15.223029290Z [2024-04-05T02:45:15.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:15.223127887Z [2024-04-05T02:45:15.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:15.240885798Z [2024-04-05T02:45:15.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to c78af1e4-3ea6-4116-9a62-a545fd24c0ec 2024-04-05T02:45:15.240994464Z [2024-04-05T02:45:15.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:13.667086+00:00, run_end_date=2024-04-05 02:45:14.331079+00:00, run_duration=0.663993, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:09.648313+00:00, queued_by_job_id=1, pid=6201 2024-04-05T02:45:18.192525505Z [2024-04-05T02:45:18.192+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:45:18.192580635Z 2024-04-05T02:45:18.192591266Z [2024-04-05T02:45:18.192+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:45:18.193160243Z [2024-04-05T02:45:18.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:45:18.193171875Z 2024-04-05T02:45:18.196123251Z [2024-04-05T02:45:18.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:45:18.196233968Z [2024-04-05T02:45:18.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:45:18.258099094Z [2024-04-05T02:45:18.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:18.258145546Z [2024-04-05T02:45:18.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:18.266310797Z [2024-04-05T02:45:18.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01b42800-d25d-4e01-a8a0-e41ac7be5027 2024-04-05T02:45:18.266605455Z [2024-04-05T02:45:18.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=0, run_start_date=2024-04-05 02:45:17.517726+00:00, run_end_date=2024-04-05 02:45:17.871632+00:00, run_duration=0.353906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:15.073554+00:00, queued_by_job_id=1, pid=6216 2024-04-05T02:45:21.441964750Z [2024-04-05T02:45:21.441+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:45:21.442410215Z [2024-04-05T02:45:21.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:45:01.024934+00:00, run_end_date=2024-04-05 02:45:21.441824+00:00, run_duration=20.41689, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:45:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:45:21.456558598Z [2024-04-05T02:45:21.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:45:21.505257064Z [2024-04-05T02:45:21.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:21.515127043Z [2024-04-05T02:45:21.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:20.170640+00:00, run_end_date=2024-04-05 02:45:20.624036+00:00, run_duration=0.453396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:18.193650+00:00, queued_by_job_id=1, pid=6228 2024-04-05T02:46:00.490762584Z [2024-04-05T02:46:00.490+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:46:00.512969257Z [2024-04-05T02:46:00.511+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:46:00.533581657Z [2024-04-05T02:46:00.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:47:00+00:00 2024-04-05T02:46:00.610024356Z [2024-04-05T02:46:00.609+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:46:00.610043421Z 2024-04-05T02:46:00.610050003Z 2024-04-05T02:46:00.610055178Z 2024-04-05T02:46:00.610123794Z [2024-04-05T02:46:00.609+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:46:00.610253403Z [2024-04-05T02:46:00.610+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:46:00.610363382Z [2024-04-05T02:46:00.610+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:46:00.612313589Z [2024-04-05T02:46:00.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:46:00.612340095Z 2024-04-05T02:46:00.612346231Z 2024-04-05T02:46:00.612350918Z 2024-04-05T02:46:00.617519043Z [2024-04-05T02:46:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:46:00.617617365Z [2024-04-05T02:46:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:46:00.617831200Z [2024-04-05T02:46:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:46:00.617892128Z [2024-04-05T02:46:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:46:00.618222443Z [2024-04-05T02:46:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:46:00.618332990Z [2024-04-05T02:46:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:46:00.943174801Z [2024-04-05T02:46:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status queued for try_number 1 2024-04-05T02:46:00.943330091Z [2024-04-05T02:46:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:46:00.943512344Z [2024-04-05T02:46:00.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:46:00.961658877Z [2024-04-05T02:46:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0459a836-6b22-46cc-bfee-6a92bdfd9879 2024-04-05T02:46:00.962066274Z [2024-04-05T02:46:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 598ac23d-8c84-4b01-a7e5-18768f7303e7 2024-04-05T02:46:00.963063565Z [2024-04-05T02:46:00.962+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83078ba5-76bd-472f-9c5e-07815ddbdd46 2024-04-05T02:46:03.518573613Z [2024-04-05T02:46:03.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:46:03.518604048Z [2024-04-05T02:46:03.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:44:00+00:00, run_id=scheduled__2024-04-05T02:44:00+00:00, run_start_date=2024-04-05 02:46:00.550741+00:00, run_end_date=2024-04-05 02:46:03.517299+00:00, run_duration=2.966558, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:44:00+00:00, data_interval_end=2024-04-05 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:46:03.533946976Z [2024-04-05T02:46:03.532+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:46:03.646860576Z [2024-04-05T02:46:03.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status success for try_number 1 2024-04-05T02:46:03.657411425Z [2024-04-05T02:46:03.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:44:00+00:00, map_index=-1, run_start_date=2024-04-05 02:46:01.604835+00:00, run_end_date=2024-04-05 02:46:02.354291+00:00, run_duration=0.749456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:46:00.613801+00:00, queued_by_job_id=1, pid=6232 2024-04-05T02:46:08.731836674Z [2024-04-05T02:46:08.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:46:08.732611288Z [2024-04-05T02:46:08.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:45:00+00:00, run_id=scheduled__2024-04-05T02:45:00+00:00, run_start_date=2024-04-05 02:46:00.553302+00:00, run_end_date=2024-04-05 02:46:08.731745+00:00, run_duration=8.178443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:45:00+00:00, data_interval_end=2024-04-05 02:46:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:46:08.751083346Z [2024-04-05T02:46:08.750+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:47:00+00:00 2024-04-05T02:46:08.797042845Z [2024-04-05T02:46:08.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:46:08.817347158Z [2024-04-05T02:46:08.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:46:04.471986+00:00, run_end_date=2024-04-05 02:46:07.781744+00:00, run_duration=3.309758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:46:00.613801+00:00, queued_by_job_id=1, pid=6263 2024-04-05T02:46:09.866225023Z [2024-04-05T02:46:09.865+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:46:09.866638219Z [2024-04-05T02:46:09.866+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:45:00+00:00, run_id=scheduled__2024-04-05T02:45:00+00:00, run_start_date=2024-04-05 02:46:00.554736+00:00, run_end_date=2024-04-05 02:46:09.866176+00:00, run_duration=9.31144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:45:00+00:00, data_interval_end=2024-04-05 02:46:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:46:09.879884343Z [2024-04-05T02:46:09.879+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:47:00+00:00 2024-04-05T02:46:09.915993369Z [2024-04-05T02:46:09.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:46:09.922396107Z [2024-04-05T02:46:09.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:46:04.307396+00:00, run_end_date=2024-04-05 02:46:08.710332+00:00, run_duration=4.402936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:46:00.613801+00:00, queued_by_job_id=1, pid=6262 2024-04-05T02:46:44.026708246Z [2024-04-05T02:46:44.026+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:47:00.027064675Z [2024-04-05T02:47:00.026+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:47:00.047539427Z [2024-04-05T02:47:00.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:47:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:47:00.143542985Z [2024-04-05T02:47:00.143+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:47:00.143567229Z 2024-04-05T02:47:00.143572091Z 2024-04-05T02:47:00.143637297Z [2024-04-05T02:47:00.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:47:00.143675082Z [2024-04-05T02:47:00.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:47:00.144655001Z [2024-04-05T02:47:00.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:47:00.144669861Z 2024-04-05T02:47:00.144675154Z 2024-04-05T02:47:00.149330025Z [2024-04-05T02:47:00.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:47:00.149452985Z [2024-04-05T02:47:00.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:47:00.149951901Z [2024-04-05T02:47:00.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:47:00.150141310Z [2024-04-05T02:47:00.149+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:47:00.317404273Z [2024-04-05T02:47:00.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status queued for try_number 1 2024-04-05T02:47:00.317667836Z [2024-04-05T02:47:00.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status queued for try_number 1 2024-04-05T02:47:00.337368129Z [2024-04-05T02:47:00.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bb1e9d7-765f-4867-9277-6feca13826ba 2024-04-05T02:47:00.337786628Z [2024-04-05T02:47:00.337+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a79b255-1373-4c6a-99ad-8fe1648e3476 2024-04-05T02:47:08.378939526Z [2024-04-05T02:47:08.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:47:08.379748704Z [2024-04-05T02:47:08.379+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:46:00+00:00, run_id=scheduled__2024-04-05T02:46:00+00:00, run_start_date=2024-04-05 02:47:00.071812+00:00, run_end_date=2024-04-05 02:47:08.379233+00:00, run_duration=8.307421, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:46:00+00:00, data_interval_end=2024-04-05 02:47:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:47:08.402822726Z [2024-04-05T02:47:08.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:47:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:47:08.458107735Z [2024-04-05T02:47:08.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status success for try_number 1 2024-04-05T02:47:08.471177844Z [2024-04-05T02:47:08.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:46:00+00:00, map_index=-1, run_start_date=2024-04-05 02:47:04.476125+00:00, run_end_date=2024-04-05 02:47:08.195395+00:00, run_duration=3.71927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:47:00.145120+00:00, queued_by_job_id=1, pid=6318 2024-04-05T02:47:09.513721881Z [2024-04-05T02:47:09.513+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:47:09.515266869Z [2024-04-05T02:47:09.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:46:00+00:00, run_id=scheduled__2024-04-05T02:46:00+00:00, run_start_date=2024-04-05 02:47:00.074204+00:00, run_end_date=2024-04-05 02:47:09.513641+00:00, run_duration=9.439437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:46:00+00:00, data_interval_end=2024-04-05 02:47:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:47:09.524624350Z [2024-04-05T02:47:09.524+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:47:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:47:09.566310030Z [2024-04-05T02:47:09.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status success for try_number 1 2024-04-05T02:47:09.575175802Z [2024-04-05T02:47:09.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:46:00+00:00, map_index=-1, run_start_date=2024-04-05 02:47:03.868208+00:00, run_end_date=2024-04-05 02:47:08.735079+00:00, run_duration=4.866871, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:47:00.145120+00:00, queued_by_job_id=1, pid=6308 2024-04-05T02:48:00.210095915Z [2024-04-05T02:48:00.209+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:48:00.222211575Z [2024-04-05T02:48:00.221+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:48:00.241846767Z [2024-04-05T02:48:00.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:49:00+00:00 2024-04-05T02:48:00.340027317Z [2024-04-05T02:48:00.338+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:48:00.340042344Z 2024-04-05T02:48:00.340046644Z 2024-04-05T02:48:00.340050007Z 2024-04-05T02:48:00.340642450Z [2024-04-05T02:48:00.340+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:48:00.341018442Z [2024-04-05T02:48:00.340+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:48:00.341262964Z [2024-04-05T02:48:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:48:00.342528277Z [2024-04-05T02:48:00.342+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:48:00.342539887Z 2024-04-05T02:48:00.342544738Z 2024-04-05T02:48:00.342548938Z 2024-04-05T02:48:00.347313477Z [2024-04-05T02:48:00.346+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:48:00.347674553Z [2024-04-05T02:48:00.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:48:00.348162439Z [2024-04-05T02:48:00.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:48:00.348616239Z [2024-04-05T02:48:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:48:00.349626190Z [2024-04-05T02:48:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:48:00.349887715Z [2024-04-05T02:48:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:48:00.613405054Z [2024-04-05T02:48:00.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status queued for try_number 1 2024-04-05T02:48:00.613727882Z [2024-04-05T02:48:00.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status queued for try_number 1 2024-04-05T02:48:00.614045558Z [2024-04-05T02:48:00.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status queued for try_number 1 2024-04-05T02:48:00.625555298Z [2024-04-05T02:48:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8524515a-830b-4046-a27b-30d9f2dfc66c 2024-04-05T02:48:00.627822148Z [2024-04-05T02:48:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5c333e8-cf2f-4201-89b9-4a603df45e51 2024-04-05T02:48:00.628131351Z [2024-04-05T02:48:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59b73cfb-9aef-4111-a2e1-9c7e67f03240 2024-04-05T02:48:02.863015047Z [2024-04-05T02:48:02.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:48:02.870177397Z [2024-04-05T02:48:02.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:46:00+00:00, run_id=scheduled__2024-04-05T02:46:00+00:00, run_start_date=2024-04-05 02:48:00.253525+00:00, run_end_date=2024-04-05 02:48:02.862374+00:00, run_duration=2.608849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:46:00+00:00, data_interval_end=2024-04-05 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:48:02.897676549Z [2024-04-05T02:48:02.896+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:48:03.047567702Z [2024-04-05T02:48:03.046+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status success for try_number 1 2024-04-05T02:48:03.060901829Z [2024-04-05T02:48:03.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:46:00+00:00, map_index=-1, run_start_date=2024-04-05 02:48:01.374359+00:00, run_end_date=2024-04-05 02:48:02.016976+00:00, run_duration=0.642617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:48:00.343697+00:00, queued_by_job_id=1, pid=6353 2024-04-05T02:48:06.839160489Z [2024-04-05T02:48:06.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:48:06.839191821Z [2024-04-05T02:48:06.835+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:47:00+00:00, run_id=scheduled__2024-04-05T02:47:00+00:00, run_start_date=2024-04-05 02:48:00.256037+00:00, run_end_date=2024-04-05 02:48:06.835692+00:00, run_duration=6.579655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:47:00+00:00, data_interval_end=2024-04-05 02:48:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:48:06.853582916Z [2024-04-05T02:48:06.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:49:00+00:00 2024-04-05T02:48:06.914650843Z [2024-04-05T02:48:06.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status success for try_number 1 2024-04-05T02:48:06.922679295Z [2024-04-05T02:48:06.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:47:00+00:00, map_index=-1, run_start_date=2024-04-05 02:48:03.565920+00:00, run_end_date=2024-04-05 02:48:06.448902+00:00, run_duration=2.882982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:48:00.343697+00:00, queued_by_job_id=1, pid=6374 2024-04-05T02:48:09.563589671Z [2024-04-05T02:48:09.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:48:09.563916149Z [2024-04-05T02:48:09.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:47:00+00:00, run_id=scheduled__2024-04-05T02:47:00+00:00, run_start_date=2024-04-05 02:48:00.254856+00:00, run_end_date=2024-04-05 02:48:09.563457+00:00, run_duration=9.308601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:47:00+00:00, data_interval_end=2024-04-05 02:48:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:48:09.573664892Z [2024-04-05T02:48:09.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:49:00+00:00 2024-04-05T02:48:09.613697352Z [2024-04-05T02:48:09.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status success for try_number 1 2024-04-05T02:48:09.618973659Z [2024-04-05T02:48:09.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:47:00+00:00, map_index=-1, run_start_date=2024-04-05 02:48:04.127275+00:00, run_end_date=2024-04-05 02:48:09.200363+00:00, run_duration=5.073088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:48:00.343697+00:00, queued_by_job_id=1, pid=6393 2024-04-05T02:49:00.277741560Z [2024-04-05T02:49:00.277+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:49:00.301233920Z [2024-04-05T02:49:00.300+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:49:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:49:00.368143315Z [2024-04-05T02:49:00.367+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:49:00.368177485Z 2024-04-05T02:49:00.368181559Z 2024-04-05T02:49:00.368837649Z [2024-04-05T02:49:00.368+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:49:00.369111415Z [2024-04-05T02:49:00.368+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:49:00.371939524Z [2024-04-05T02:49:00.371+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:49:00.371956547Z 2024-04-05T02:49:00.371961185Z 2024-04-05T02:49:00.376494677Z [2024-04-05T02:49:00.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:49:00.376892057Z [2024-04-05T02:49:00.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:49:00.378221998Z [2024-04-05T02:49:00.377+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:49:00.378603395Z [2024-04-05T02:49:00.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:49:00.659109361Z [2024-04-05T02:49:00.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status queued for try_number 1 2024-04-05T02:49:00.659565753Z [2024-04-05T02:49:00.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status queued for try_number 1 2024-04-05T02:49:00.684440591Z [2024-04-05T02:49:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 966e83a0-d191-4e5e-aa6c-784dea94828a 2024-04-05T02:49:00.684640438Z [2024-04-05T02:49:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to a964a233-0ca9-409c-9369-4888d2400b8b 2024-04-05T02:49:06.743902500Z [2024-04-05T02:49:06.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:49:06.744382911Z [2024-04-05T02:49:06.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:48:00+00:00, run_id=scheduled__2024-04-05T02:48:00+00:00, run_start_date=2024-04-05 02:49:00.320223+00:00, run_end_date=2024-04-05 02:49:06.743849+00:00, run_duration=6.423626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:48:00+00:00, data_interval_end=2024-04-05 02:49:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:49:06.757289063Z [2024-04-05T02:49:06.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:49:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:49:06.767018138Z [2024-04-05T02:49:06.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:49:06.767388755Z [2024-04-05T02:49:06.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:48:00+00:00, run_id=scheduled__2024-04-05T02:48:00+00:00, run_start_date=2024-04-05 02:49:00.321816+00:00, run_end_date=2024-04-05 02:49:06.766939+00:00, run_duration=6.445123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:48:00+00:00, data_interval_end=2024-04-05 02:49:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:49:06.777113473Z [2024-04-05T02:49:06.776+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:49:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:49:06.829169054Z [2024-04-05T02:49:06.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status success for try_number 1 2024-04-05T02:49:06.840848611Z [2024-04-05T02:49:06.840+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:48:00+00:00, map_index=-1, run_start_date=2024-04-05 02:49:03.588701+00:00, run_end_date=2024-04-05 02:49:05.787038+00:00, run_duration=2.198337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:49:00.373384+00:00, queued_by_job_id=1, pid=6437 2024-04-05T02:49:07.802282391Z [2024-04-05T02:49:07.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status success for try_number 1 2024-04-05T02:49:07.807666763Z [2024-04-05T02:49:07.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:48:00+00:00, map_index=-1, run_start_date=2024-04-05 02:49:03.792903+00:00, run_end_date=2024-04-05 02:49:06.592845+00:00, run_duration=2.799942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:49:00.373384+00:00, queued_by_job_id=1, pid=6438 2024-04-05T02:50:00.297713194Z [2024-04-05T02:50:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:51:00+00:00 2024-04-05T02:50:00.338675164Z [2024-04-05T02:50:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:50:00.365111396Z [2024-04-05T02:50:00.364+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:50:00.374873799Z [2024-04-05T02:50:00.374+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:50:00.522370014Z [2024-04-05T02:50:00.520+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:50:00.522396738Z 2024-04-05T02:50:00.522400383Z 2024-04-05T02:50:00.522404560Z 2024-04-05T02:50:00.522408225Z 2024-04-05T02:50:00.522674848Z [2024-04-05T02:50:00.522+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:50:00.522990742Z [2024-04-05T02:50:00.522+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:50:00.523141541Z [2024-04-05T02:50:00.522+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:50:00.523338732Z [2024-04-05T02:50:00.523+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:50:00.524097632Z [2024-04-05T02:50:00.523+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:50:00.524123547Z 2024-04-05T02:50:00.524128836Z 2024-04-05T02:50:00.524132824Z 2024-04-05T02:50:00.524136340Z 2024-04-05T02:50:00.529151616Z [2024-04-05T02:50:00.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:50:00.529387921Z [2024-04-05T02:50:00.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:50:00.530120288Z [2024-04-05T02:50:00.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:00.530346487Z [2024-04-05T02:50:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:50:00.530646505Z [2024-04-05T02:50:00.530+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:00.530848430Z [2024-04-05T02:50:00.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:50:00.531526092Z [2024-04-05T02:50:00.531+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:00.531860956Z [2024-04-05T02:50:00.531+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:50:01.050596617Z [2024-04-05T02:50:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.050734987Z [2024-04-05T02:50:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.050805997Z [2024-04-05T02:50:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.050881896Z [2024-04-05T02:50:01.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.061019569Z [2024-04-05T02:50:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d764606-e2d2-4a92-8d2d-c06f5114cdd2 2024-04-05T02:50:01.061100633Z [2024-04-05T02:50:01.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0633d066-a343-4a6f-9dd3-ee3513d38c7f 2024-04-05T02:50:01.061210595Z [2024-04-05T02:50:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82c9d428-5dec-4726-89cc-e296403992d9 2024-04-05T02:50:01.061312255Z [2024-04-05T02:50:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to aab8b4f4-1c78-4dae-9670-c0f34ee66406 2024-04-05T02:50:05.998642980Z [2024-04-05T02:50:05.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:05.999098900Z [2024-04-05T02:50:05.998+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:48:00+00:00, run_id=scheduled__2024-04-05T02:48:00+00:00, run_start_date=2024-04-05 02:50:00.393156+00:00, run_end_date=2024-04-05 02:50:05.998662+00:00, run_duration=5.605506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:48:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:50:06.051927117Z [2024-04-05T02:50:06.051+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:50:06.371719950Z [2024-04-05T02:50:06.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:06.400223908Z [2024-04-05T02:50:06.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:48:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:04.004459+00:00, run_end_date=2024-04-05 02:50:05.120852+00:00, run_duration=1.116393, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.525321+00:00, queued_by_job_id=1, pid=6476 2024-04-05T02:50:10.988732749Z [2024-04-05T02:50:10.988+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:10.990388548Z [2024-04-05T02:50:10.990+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:49:00+00:00, run_id=scheduled__2024-04-05T02:49:00+00:00, run_start_date=2024-04-05 02:50:00.395966+00:00, run_end_date=2024-04-05 02:50:10.988662+00:00, run_duration=10.592696, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:49:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:50:11.012565356Z [2024-04-05T02:50:11.012+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:51:00+00:00 2024-04-05T02:50:11.087342055Z [2024-04-05T02:50:11.086+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:50:11.087364856Z 2024-04-05T02:50:11.087438394Z [2024-04-05T02:50:11.087+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:50:11.088530602Z [2024-04-05T02:50:11.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:50:11.088543419Z 2024-04-05T02:50:11.091894696Z [2024-04-05T02:50:11.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:50:11.091991796Z [2024-04-05T02:50:11.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:50:11.238415540Z [2024-04-05T02:50:11.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:11.238441114Z [2024-04-05T02:50:11.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:11.238655452Z [2024-04-05T02:50:11.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:11.248927638Z [2024-04-05T02:50:11.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:08.349966+00:00, run_end_date=2024-04-05 02:50:09.636690+00:00, run_duration=1.286724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.525321+00:00, queued_by_job_id=1, pid=6525 2024-04-05T02:50:11.249276198Z [2024-04-05T02:50:11.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:49:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:07.618240+00:00, run_end_date=2024-04-05 02:50:10.448838+00:00, run_duration=2.830598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.525321+00:00, queued_by_job_id=1, pid=6503 2024-04-05T02:50:11.249879308Z [2024-04-05T02:50:11.249+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2d1782b-1ca3-4027-adec-5cc507589808 2024-04-05T02:50:11.303424051Z [2024-04-05T02:50:11.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:11.303670358Z [2024-04-05T02:50:11.303+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:49:00+00:00, run_id=scheduled__2024-04-05T02:49:00+00:00, run_start_date=2024-04-05 02:50:00.394712+00:00, run_end_date=2024-04-05 02:50:11.303317+00:00, run_duration=10.908605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:49:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:50:11.318217449Z [2024-04-05T02:50:11.317+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:51:00+00:00 2024-04-05T02:50:11.383943014Z [2024-04-05T02:50:11.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:11.390924568Z [2024-04-05T02:50:11.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:49:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:09.058095+00:00, run_end_date=2024-04-05 02:50:11.068393+00:00, run_duration=2.010298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.525321+00:00, queued_by_job_id=1, pid=6526 2024-04-05T02:50:15.127393700Z [2024-04-05T02:50:15.126+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:50:15.127428976Z 2024-04-05T02:50:15.127721668Z [2024-04-05T02:50:15.127+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:50:15.128381745Z [2024-04-05T02:50:15.128+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:50:15.128395640Z 2024-04-05T02:50:15.134899456Z [2024-04-05T02:50:15.134+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:50:15.135183627Z [2024-04-05T02:50:15.134+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:50:15.249528479Z [2024-04-05T02:50:15.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:15.264501456Z [2024-04-05T02:50:15.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to 729672dc-2a0b-48c4-a2e2-2b9940dcc281 2024-04-05T02:50:15.421297364Z [2024-04-05T02:50:15.420+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:15.430115716Z [2024-04-05T02:50:15.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:14.236519+00:00, run_end_date=2024-04-05 02:50:14.885817+00:00, run_duration=0.649298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:11.088861+00:00, queued_by_job_id=1, pid=6568 2024-04-05T02:50:18.594134561Z [2024-04-05T02:50:18.593+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:50:18.594162800Z 2024-04-05T02:50:18.594389719Z [2024-04-05T02:50:18.594+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:50:18.595251505Z [2024-04-05T02:50:18.595+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:50:18.595274688Z 2024-04-05T02:50:18.598544465Z [2024-04-05T02:50:18.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:18.598744284Z [2024-04-05T02:50:18.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:50:18.678107436Z [2024-04-05T02:50:18.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:18.678259714Z [2024-04-05T02:50:18.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:18.695671184Z [2024-04-05T02:50:18.695+0000] {scheduler_job.py:635} INFO - Setting external_id for to 002a042d-23d6-495e-9225-06fb48cdc990 2024-04-05T02:50:18.695966497Z [2024-04-05T02:50:18.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=0, run_start_date=2024-04-05 02:50:17.503920+00:00, run_end_date=2024-04-05 02:50:17.944826+00:00, run_duration=0.440906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:15.128816+00:00, queued_by_job_id=1, pid=6580 2024-04-05T02:50:21.879785044Z [2024-04-05T02:50:21.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:21.880242487Z [2024-04-05T02:50:21.879+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:45:00+00:00, run_id=scheduled__2024-04-05T02:45:00+00:00, run_start_date=2024-04-05 02:50:00.391569+00:00, run_end_date=2024-04-05 02:50:21.879692+00:00, run_duration=21.488123, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:45:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:50:21.894064448Z [2024-04-05T02:50:21.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:50:21.933748635Z [2024-04-05T02:50:21.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:21.955631761Z [2024-04-05T02:50:21.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:21.025775+00:00, run_end_date=2024-04-05 02:50:21.468243+00:00, run_duration=0.442468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:18.595786+00:00, queued_by_job_id=1, pid=6592 2024-04-05T02:51:00.081400270Z [2024-04-05T02:51:00.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:51:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:51:00.092350923Z [2024-04-05T02:51:00.091+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:51:00.172157743Z [2024-04-05T02:51:00.171+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:51:00.172173645Z 2024-04-05T02:51:00.172177173Z 2024-04-05T02:51:00.172398562Z [2024-04-05T02:51:00.172+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:51:00.172508065Z [2024-04-05T02:51:00.172+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:51:00.173215588Z [2024-04-05T02:51:00.173+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:51:00.173227250Z 2024-04-05T02:51:00.173231226Z 2024-04-05T02:51:00.176805163Z [2024-04-05T02:51:00.176+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:51:00.176963823Z [2024-04-05T02:51:00.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:51:00.177166691Z [2024-04-05T02:51:00.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:51:00.177322400Z [2024-04-05T02:51:00.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:51:00.337481149Z [2024-04-05T02:51:00.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:51:00.337591088Z [2024-04-05T02:51:00.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:51:00.347499134Z [2024-04-05T02:51:00.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc295a56-54ba-4137-8976-6254e7bcab7d 2024-04-05T02:51:00.347552190Z [2024-04-05T02:51:00.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 897734a8-b9ab-46c9-a7f9-8babf7eeae97 2024-04-05T02:51:07.529674333Z [2024-04-05T02:51:07.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:51:07.530094533Z [2024-04-05T02:51:07.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:51:00.107350+00:00, run_end_date=2024-04-05 02:51:07.529562+00:00, run_duration=7.422212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:51:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:51:07.558707652Z [2024-04-05T02:51:07.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:51:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:51:07.777816298Z [2024-04-05T02:51:07.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:51:07.786534090Z [2024-04-05T02:51:07.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:51:03.884910+00:00, run_end_date=2024-04-05 02:51:07.406707+00:00, run_duration=3.521797, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:51:00.173906+00:00, queued_by_job_id=1, pid=6616 2024-04-05T02:51:10.210575691Z [2024-04-05T02:51:10.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:51:10.210993846Z [2024-04-05T02:51:10.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:51:00.108996+00:00, run_end_date=2024-04-05 02:51:10.210527+00:00, run_duration=10.101531, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:51:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:51:10.222605811Z [2024-04-05T02:51:10.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:51:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:51:10.284025163Z [2024-04-05T02:51:10.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:51:10.298736040Z [2024-04-05T02:51:10.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:51:03.724258+00:00, run_end_date=2024-04-05 02:51:09.077039+00:00, run_duration=5.352781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:51:00.173906+00:00, queued_by_job_id=1, pid=6615 2024-04-05T02:51:44.114541500Z [2024-04-05T02:51:44.113+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:51:55.849066253Z [2024-04-05T02:51:55.848+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:51:55.849092373Z 2024-04-05T02:51:55.849171452Z [2024-04-05T02:51:55.849+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-05T02:51:55.850120505Z [2024-04-05T02:51:55.849+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:51:55.850138709Z 2024-04-05T02:51:55.855090121Z [2024-04-05T02:51:55.854+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240405025153_097514', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:51:55.855538525Z [2024-04-05T02:51:55.855+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240405025153_097514', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-05T02:51:55.938379879Z [2024-04-05T02:51:55.938+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240405025153_097514 exited with status queued for try_number 1 2024-04-05T02:51:55.952188975Z [2024-04-05T02:51:55.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to d4f2c10a-69df-4580-9461-e000e5d2e01b 2024-04-05T02:51:58.246050999Z [2024-04-05T02:51:58.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:51:58.246751457Z [2024-04-05T02:51:58.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-05 02:51:53.955047+00:00, run_id=vdu_down_20240405025153_097514, run_start_date=2024-04-05 02:51:55.801870+00:00, run_end_date=2024-04-05 02:51:58.245940+00:00, run_duration=2.44407, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 02:51:53.955047+00:00, data_interval_end=2024-04-05 02:51:53.955047+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-05T02:51:58.250586265Z [2024-04-05T02:51:58.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-05T02:51:58.279419617Z [2024-04-05T02:51:58.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240405025153_097514 exited with status success for try_number 1 2024-04-05T02:51:58.286620658Z [2024-04-05T02:51:58.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240405025153_097514, map_index=-1, run_start_date=2024-04-05 02:51:56.840601+00:00, run_end_date=2024-04-05 02:51:57.354152+00:00, run_duration=0.513551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:51:55.850665+00:00, queued_by_job_id=1, pid=6649 2024-04-05T02:52:00.481834388Z [2024-04-05T02:52:00.481+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:52:00.522353426Z [2024-04-05T02:52:00.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:53:00+00:00 2024-04-05T02:52:00.533557677Z [2024-04-05T02:52:00.533+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:52:00.617001269Z [2024-04-05T02:52:00.616+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:52:00.617025822Z 2024-04-05T02:52:00.617030640Z 2024-04-05T02:52:00.617035222Z 2024-04-05T02:52:00.617050028Z [2024-04-05T02:52:00.616+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:52:00.617111702Z [2024-04-05T02:52:00.616+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:52:00.617193681Z [2024-04-05T02:52:00.617+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:52:00.617793567Z [2024-04-05T02:52:00.617+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:52:00.617807068Z 2024-04-05T02:52:00.617816688Z 2024-04-05T02:52:00.617821514Z 2024-04-05T02:52:00.620729903Z [2024-04-05T02:52:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:52:00.620844146Z [2024-04-05T02:52:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:52:00.621289200Z [2024-04-05T02:52:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:52:00.621453583Z [2024-04-05T02:52:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:52:00.621609237Z [2024-04-05T02:52:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:52:00.621657488Z [2024-04-05T02:52:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:52:01.075867260Z [2024-04-05T02:52:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:52:01.076033569Z [2024-04-05T02:52:01.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status queued for try_number 1 2024-04-05T02:52:01.076228842Z [2024-04-05T02:52:01.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status queued for try_number 1 2024-04-05T02:52:01.090745289Z [2024-04-05T02:52:01.089+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60cc7a1c-8d33-40b3-b704-6d4eda6d923b 2024-04-05T02:52:01.091404432Z [2024-04-05T02:52:01.091+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3413bd32-9a29-4c83-87c7-750ceaab9a82 2024-04-05T02:52:01.092535047Z [2024-04-05T02:52:01.092+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6f7d8e4-633f-479d-9064-c095957c9c5f 2024-04-05T02:52:03.570462021Z [2024-04-05T02:52:03.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:52:03.571382182Z [2024-04-05T02:52:03.571+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:52:00.550373+00:00, run_end_date=2024-04-05 02:52:03.570661+00:00, run_duration=3.020288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:52:03.605689822Z [2024-04-05T02:52:03.605+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:52:03.785666398Z [2024-04-05T02:52:03.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:52:03.807873878Z [2024-04-05T02:52:03.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:52:02.007290+00:00, run_end_date=2024-04-05 02:52:02.745985+00:00, run_duration=0.738695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:52:00.618439+00:00, queued_by_job_id=1, pid=6663 2024-04-05T02:52:08.933721878Z [2024-04-05T02:52:08.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:52:08.935966314Z [2024-04-05T02:52:08.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:51:00+00:00, run_id=scheduled__2024-04-05T02:51:00+00:00, run_start_date=2024-04-05 02:52:00.552638+00:00, run_end_date=2024-04-05 02:52:08.935623+00:00, run_duration=8.382985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:51:00+00:00, data_interval_end=2024-04-05 02:52:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:52:08.954336956Z [2024-04-05T02:52:08.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:53:00+00:00 2024-04-05T02:52:09.013477972Z [2024-04-05T02:52:09.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status success for try_number 1 2024-04-05T02:52:09.018906368Z [2024-04-05T02:52:09.018+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:51:00+00:00, map_index=-1, run_start_date=2024-04-05 02:52:05.475605+00:00, run_end_date=2024-04-05 02:52:08.766501+00:00, run_duration=3.290896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:52:00.618439+00:00, queued_by_job_id=1, pid=6693 2024-04-05T02:52:09.510846382Z [2024-04-05T02:52:09.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:52:09.511243766Z [2024-04-05T02:52:09.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:51:00+00:00, run_id=scheduled__2024-04-05T02:51:00+00:00, run_start_date=2024-04-05 02:52:00.555315+00:00, run_end_date=2024-04-05 02:52:09.510804+00:00, run_duration=8.955489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:51:00+00:00, data_interval_end=2024-04-05 02:52:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:52:09.532227136Z [2024-04-05T02:52:09.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:53:00+00:00 2024-04-05T02:52:09.588551037Z [2024-04-05T02:52:09.588+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status success for try_number 1 2024-04-05T02:52:09.602475703Z [2024-04-05T02:52:09.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:51:00+00:00, map_index=-1, run_start_date=2024-04-05 02:52:05.991000+00:00, run_end_date=2024-04-05 02:52:09.184558+00:00, run_duration=3.193558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:52:00.618439+00:00, queued_by_job_id=1, pid=6694 2024-04-05T02:53:00.965893604Z [2024-04-05T02:53:00.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:00.975988008Z [2024-04-05T02:53:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:53:01.035169096Z [2024-04-05T02:53:01.034+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:53:01.035195038Z 2024-04-05T02:53:01.035200036Z 2024-04-05T02:53:01.035235532Z [2024-04-05T02:53:01.035+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:53:01.035321942Z [2024-04-05T02:53:01.035+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:53:01.035964713Z [2024-04-05T02:53:01.035+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:53:01.035983204Z 2024-04-05T02:53:01.035990371Z 2024-04-05T02:53:01.039427145Z [2024-04-05T02:53:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:53:01.050280270Z [2024-04-05T02:53:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:53:01.050596791Z [2024-04-05T02:53:01.050+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:53:01.050662943Z [2024-04-05T02:53:01.050+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:53:01.380368352Z [2024-04-05T02:53:01.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:01.380414387Z [2024-04-05T02:53:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:01.394629233Z [2024-04-05T02:53:01.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to fcc1294a-4a18-4f95-8a6e-15f43c88000e 2024-04-05T02:53:01.394920686Z [2024-04-05T02:53:01.394+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8018bdba-e369-48e1-9fa2-1721dca83831 2024-04-05T02:53:07.736742178Z [2024-04-05T02:53:07.736+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:53:07.737483741Z [2024-04-05T02:53:07.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:53:00.986213+00:00, run_end_date=2024-04-05 02:53:07.736880+00:00, run_duration=6.750667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:53:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:53:07.792819781Z [2024-04-05T02:53:07.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:08.027361590Z [2024-04-05T02:53:08.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:08.039346200Z [2024-04-05T02:53:08.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:04.517441+00:00, run_end_date=2024-04-05 02:53:07.037451+00:00, run_duration=2.52001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:01.036470+00:00, queued_by_job_id=1, pid=6739 2024-04-05T02:53:09.093095297Z [2024-04-05T02:53:09.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:53:09.093670933Z [2024-04-05T02:53:09.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:53:00.987505+00:00, run_end_date=2024-04-05 02:53:09.093008+00:00, run_duration=8.105503, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:53:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:53:09.108433828Z [2024-04-05T02:53:09.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:09.169686016Z [2024-04-05T02:53:09.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:09.210578841Z [2024-04-05T02:53:09.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:05.348711+00:00, run_end_date=2024-04-05 02:53:08.546541+00:00, run_duration=3.19783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:01.036470+00:00, queued_by_job_id=1, pid=6758 2024-04-05T02:53:32.868664099Z [2024-04-05T02:53:32.868+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:32.951539748Z [2024-04-05T02:53:32.948+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:53:32.951595717Z 2024-04-05T02:53:32.951603426Z [2024-04-05T02:53:32.949+0000] {scheduler_job.py:425} INFO - DAG vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:53:32.951610301Z [2024-04-05T02:53:32.950+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:53:32.951615495Z 2024-04-05T02:53:32.954694066Z [2024-04-05T02:53:32.954+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:53:32.954800663Z [2024-04-05T02:53:32.954+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:53:33.028258516Z [2024-04-05T02:53:33.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:33.039788798Z [2024-04-05T02:53:33.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to cddab4e7-994f-4c13-a918-c080d9718ff4 2024-04-05T02:53:36.880005877Z [2024-04-05T02:53:36.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:53:36.880460933Z [2024-04-05T02:53:36.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:53:32.890119+00:00, run_end_date=2024-04-05 02:53:36.880119+00:00, run_duration=3.99, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:53:00+00:00, dag_hash=3a12f6c379f75e062b2063b212d2b757 2024-04-05T02:53:36.890680502Z [2024-04-05T02:53:36.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:36.933744154Z [2024-04-05T02:53:36.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:36.941917634Z [2024-04-05T02:53:36.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:35.201650+00:00, run_end_date=2024-04-05 02:53:36.586716+00:00, run_duration=1.385066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:32.951008+00:00, queued_by_job_id=1, pid=6791 2024-04-05T02:53:40.869780573Z [2024-04-05T02:53:40.869+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:53:40.916937950Z [2024-04-05T02:53:40.916+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:53:40.916957461Z 2024-04-05T02:53:40.917047601Z [2024-04-05T02:53:40.916+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:53:40.917526016Z [2024-04-05T02:53:40.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:53:40.917534398Z 2024-04-05T02:53:40.920411222Z [2024-04-05T02:53:40.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:53:40.920488811Z [2024-04-05T02:53:40.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:53:40.994579746Z [2024-04-05T02:53:40.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:41.000693585Z [2024-04-05T02:53:41.000+0000] {scheduler_job.py:635} INFO - Setting external_id for to b10227e1-0161-483d-8d10-2db76f53cade 2024-04-05T02:53:45.508801808Z [2024-04-05T02:53:45.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:53:45.509221767Z [2024-04-05T02:53:45.508+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:53:40.881420+00:00, run_end_date=2024-04-05 02:53:45.508708+00:00, run_duration=4.627288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:53:00+00:00, dag_hash=433bdee1a17b3a0c9a37c0ad972b2ff2 2024-04-05T02:53:45.520060446Z [2024-04-05T02:53:45.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:45.561132205Z [2024-04-05T02:53:45.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:45.568876750Z [2024-04-05T02:53:45.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:42.780400+00:00, run_end_date=2024-04-05 02:53:44.685302+00:00, run_duration=1.904902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:40.917816+00:00, queued_by_job_id=1, pid=6812 2024-04-05T02:53:50.451886249Z [2024-04-05T02:53:50.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:53:50.520282319Z [2024-04-05T02:53:50.519+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:53:50.520313112Z 2024-04-05T02:53:50.520481659Z [2024-04-05T02:53:50.520+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:53:50.521490982Z [2024-04-05T02:53:50.521+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:53:50.521512414Z 2024-04-05T02:53:50.525355371Z [2024-04-05T02:53:50.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:53:50.525524350Z [2024-04-05T02:53:50.525+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:53:50.595700683Z [2024-04-05T02:53:50.595+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:50.602481852Z [2024-04-05T02:53:50.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5533ba2c-8af7-4c57-a9d4-4c42f471b819 2024-04-05T02:53:53.375998543Z [2024-04-05T02:53:53.375+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:53:53.376024334Z 2024-04-05T02:53:53.376228659Z [2024-04-05T02:53:53.376+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:53:53.376849541Z [2024-04-05T02:53:53.376+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:53:53.376855492Z 2024-04-05T02:53:53.379043995Z [2024-04-05T02:53:53.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:53:53.379203297Z [2024-04-05T02:53:53.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'split_metrics', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:53:53.498954687Z [2024-04-05T02:53:53.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.split_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:53.498977377Z [2024-04-05T02:53:53.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:53.512163166Z [2024-04-05T02:53:53.511+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bb76193-1c50-414a-b93f-27ab24f99f8f 2024-04-05T02:53:53.513136785Z [2024-04-05T02:53:53.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:52.712985+00:00, run_end_date=2024-04-05 02:53:53.103204+00:00, run_duration=0.390219, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:50.522086+00:00, queued_by_job_id=1, pid=6833 2024-04-05T02:53:54.849234855Z [2024-04-05T02:53:54.848+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:53:54.849274431Z 2024-04-05T02:53:54.853173599Z [2024-04-05T02:53:54.852+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-05T02:53:54.854198102Z [2024-04-05T02:53:54.853+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:53:54.854215056Z 2024-04-05T02:53:54.863045314Z [2024-04-05T02:53:54.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240405025353_496573', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:53:54.863552784Z [2024-04-05T02:53:54.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240405025353_496573', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-05T02:53:54.921434314Z [2024-04-05T02:53:54.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240405025353_496573 exited with status queued for try_number 1 2024-04-05T02:53:54.927469080Z [2024-04-05T02:53:54.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbff7bc5-0e9f-4580-a428-87c52dcd7327 2024-04-05T02:53:57.283999519Z [2024-04-05T02:53:57.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:53:57.284644451Z [2024-04-05T02:53:57.284+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-05 02:53:53.874040+00:00, run_id=vdu_down_20240405025353_496573, run_start_date=2024-04-05 02:53:54.732978+00:00, run_end_date=2024-04-05 02:53:57.284159+00:00, run_duration=2.551181, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 02:53:53.874040+00:00, data_interval_end=2024-04-05 02:53:53.874040+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-05T02:53:57.289399978Z [2024-04-05T02:53:57.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-05T02:53:57.317026451Z [2024-04-05T02:53:57.316+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:53:57.317051506Z 2024-04-05T02:53:57.317192117Z [2024-04-05T02:53:57.316+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:53:57.317867612Z [2024-04-05T02:53:57.317+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:53:57.317880545Z 2024-04-05T02:53:57.320605060Z [2024-04-05T02:53:57.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:53:57.320850014Z [2024-04-05T02:53:57.320+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'collect_metrics', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:53:57.386349755Z [2024-04-05T02:53:57.384+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.collect_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:57.386376039Z [2024-04-05T02:53:57.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.split_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:57.386379951Z [2024-04-05T02:53:57.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240405025353_496573 exited with status success for try_number 1 2024-04-05T02:53:57.395916794Z [2024-04-05T02:53:57.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240405025353_496573, map_index=-1, run_start_date=2024-04-05 02:53:55.891535+00:00, run_end_date=2024-04-05 02:53:56.488195+00:00, run_duration=0.59666, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:54.854906+00:00, queued_by_job_id=1, pid=6854 2024-04-05T02:53:57.396223218Z [2024-04-05T02:53:57.395+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6100b6e0-aeb3-4780-ade5-3d2c58312c36 2024-04-05T02:53:57.396522480Z [2024-04-05T02:53:57.396+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:56.057070+00:00, run_end_date=2024-04-05 02:53:56.567228+00:00, run_duration=0.510158, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:53.377249+00:00, queued_by_job_id=1, pid=6855 2024-04-05T02:54:00.326280971Z [2024-04-05T02:54:00.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:00.346679669Z [2024-04-05T02:54:00.346+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:00.362273185Z [2024-04-05T02:54:00.361+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:54:00.372746833Z [2024-04-05T02:54:00.372+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:54:00.381606125Z [2024-04-05T02:54:00.381+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:54:00.534794967Z [2024-04-05T02:54:00.534+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-05T02:54:00.534813204Z 2024-04-05T02:54:00.534817263Z 2024-04-05T02:54:00.534821329Z 2024-04-05T02:54:00.534824737Z 2024-04-05T02:54:00.534846676Z 2024-04-05T02:54:00.534849971Z 2024-04-05T02:54:00.535125177Z [2024-04-05T02:54:00.534+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:54:00.535391761Z [2024-04-05T02:54:00.535+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:54:00.535615568Z [2024-04-05T02:54:00.535+0000] {scheduler_job.py:425} INFO - DAG vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:54:00.535863784Z [2024-04-05T02:54:00.535+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:54:00.536177231Z [2024-04-05T02:54:00.535+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:54:00.536317259Z [2024-04-05T02:54:00.536+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:54:00.537099156Z [2024-04-05T02:54:00.536+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:54:00.537144950Z 2024-04-05T02:54:00.537155498Z 2024-04-05T02:54:00.537164429Z 2024-04-05T02:54:00.537173333Z 2024-04-05T02:54:00.537182660Z 2024-04-05T02:54:00.537191342Z 2024-04-05T02:54:00.541936720Z [2024-04-05T02:54:00.541+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.542384249Z [2024-04-05T02:54:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'send_prometheus', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:54:00.542884226Z [2024-04-05T02:54:00.542+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.543007577Z [2024-04-05T02:54:00.542+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:54:00.543317070Z [2024-04-05T02:54:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.543390284Z [2024-04-05T02:54:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:54:00.543702012Z [2024-04-05T02:54:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.543903026Z [2024-04-05T02:54:00.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:54:00.544182016Z [2024-04-05T02:54:00.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.544373660Z [2024-04-05T02:54:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:54:00.544686914Z [2024-04-05T02:54:00.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.544851191Z [2024-04-05T02:54:00.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:54:01.157783674Z [2024-04-05T02:54:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.send_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:01.157827781Z [2024-04-05T02:54:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:01.157897692Z [2024-04-05T02:54:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:01.158034481Z [2024-04-05T02:54:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:01.160050294Z [2024-04-05T02:54:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:01.160289862Z [2024-04-05T02:54:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:01.160396957Z [2024-04-05T02:54:01.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.collect_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:01.183644396Z [2024-04-05T02:54:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22f551d8-d462-4617-b785-2e40662d29fd 2024-04-05T02:54:01.183799501Z [2024-04-05T02:54:01.183+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=0, run_start_date=2024-04-05 02:53:59.320666+00:00, run_end_date=2024-04-05 02:53:59.673074+00:00, run_duration=0.352408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:57.318262+00:00, queued_by_job_id=1, pid=6876 2024-04-05T02:54:01.184122612Z [2024-04-05T02:54:01.183+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b0c4de4-07b9-447c-a54b-6ce672f42fc9 2024-04-05T02:54:01.188419765Z [2024-04-05T02:54:01.184+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d42a10a-b88b-41de-a068-8ff2fab255ef 2024-04-05T02:54:01.188639017Z [2024-04-05T02:54:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6027f574-cf9e-4890-b9eb-ee96039b621b 2024-04-05T02:54:01.188815110Z [2024-04-05T02:54:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to adcddb08-3023-45c8-9142-b0770becb068 2024-04-05T02:54:01.188964844Z [2024-04-05T02:54:01.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 939f59b9-ade6-4933-bf37-1f10075b6486 2024-04-05T02:54:05.581054755Z [2024-04-05T02:54:05.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:05.581630784Z [2024-04-05T02:54:05.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:54:00.395509+00:00, run_end_date=2024-04-05 02:54:05.581172+00:00, run_duration=5.185663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:54:05.591186878Z [2024-04-05T02:54:05.590+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:54:06.047676864Z [2024-04-05T02:54:06.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:06.119024584Z [2024-04-05T02:54:06.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:03.186302+00:00, run_end_date=2024-04-05 02:54:04.820386+00:00, run_duration=1.634084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.538577+00:00, queued_by_job_id=1, pid=6883 2024-04-05T02:54:12.632542501Z [2024-04-05T02:54:12.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:12.633053798Z [2024-04-05T02:54:12.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9, execution_date=2024-04-05 02:53:00+00:00, run_id=scheduled__2024-04-05T02:53:00+00:00, run_start_date=2024-04-05 02:54:00.396897+00:00, run_end_date=2024-04-05 02:54:12.632473+00:00, run_duration=12.235576, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:53:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=3a12f6c379f75e062b2063b212d2b757 2024-04-05T02:54:12.730531103Z [2024-04-05T02:54:12.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:12.933838529Z [2024-04-05T02:54:12.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:12.934190504Z [2024-04-05T02:54:12.933+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, execution_date=2024-04-05 02:45:00+00:00, run_id=scheduled__2024-04-05T02:45:00+00:00, run_start_date=2024-04-05 02:53:50.467813+00:00, run_end_date=2024-04-05 02:54:12.933640+00:00, run_duration=22.465827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:45:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=8156a6fa105f751dda2a29df1ba8dc00 2024-04-05T02:54:12.947383248Z [2024-04-05T02:54:12.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:14.175502655Z [2024-04-05T02:54:14.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:14.175636335Z [2024-04-05T02:54:14.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:53:00+00:00, run_id=scheduled__2024-04-05T02:53:00+00:00, run_start_date=2024-04-05 02:54:00.400572+00:00, run_end_date=2024-04-05 02:54:14.175384+00:00, run_duration=13.774812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:53:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:54:14.201316562Z [2024-04-05T02:54:14.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:14.223306610Z [2024-04-05T02:54:14.222+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:14.223459266Z [2024-04-05T02:54:14.223+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, execution_date=2024-04-05 02:53:00+00:00, run_id=scheduled__2024-04-05T02:53:00+00:00, run_start_date=2024-04-05 02:54:00.399351+00:00, run_end_date=2024-04-05 02:54:14.223227+00:00, run_duration=13.823876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:53:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=433bdee1a17b3a0c9a37c0ad972b2ff2 2024-04-05T02:54:14.243691661Z [2024-04-05T02:54:14.243+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:14.332745251Z [2024-04-05T02:54:14.332+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.send_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:14.335623380Z [2024-04-05T02:54:14.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:14.335675556Z [2024-04-05T02:54:14.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:14.335740514Z [2024-04-05T02:54:14.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:14.356467825Z [2024-04-05T02:54:14.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:11.636486+00:00, run_end_date=2024-04-05 02:54:12.504086+00:00, run_duration=0.8676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.538577+00:00, queued_by_job_id=1, pid=6967 2024-04-05T02:54:14.357071874Z [2024-04-05T02:54:14.356+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:53:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:08.744295+00:00, run_end_date=2024-04-05 02:54:12.434121+00:00, run_duration=3.689826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.538577+00:00, queued_by_job_id=1, pid=6916 2024-04-05T02:54:14.357206188Z [2024-04-05T02:54:14.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:53:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:09.346179+00:00, run_end_date=2024-04-05 02:54:13.384338+00:00, run_duration=4.038159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.538577+00:00, queued_by_job_id=1, pid=6926 2024-04-05T02:54:14.357364315Z [2024-04-05T02:54:14.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:53:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:09.843163+00:00, run_end_date=2024-04-05 02:54:13.494638+00:00, run_duration=3.651475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.538577+00:00, queued_by_job_id=1, pid=6936 2024-04-05T02:54:16.574581385Z [2024-04-05T02:54:16.574+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:16.575380851Z [2024-04-05T02:54:16.574+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:53:00+00:00, run_id=scheduled__2024-04-05T02:53:00+00:00, run_start_date=2024-04-05 02:54:00.398194+00:00, run_end_date=2024-04-05 02:54:16.574721+00:00, run_duration=16.176527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:53:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:54:16.594984311Z [2024-04-05T02:54:16.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:16.681038187Z [2024-04-05T02:54:16.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:16.695463125Z [2024-04-05T02:54:16.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:53:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:13.093934+00:00, run_end_date=2024-04-05 02:54:15.431011+00:00, run_duration=2.337077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.538577+00:00, queued_by_job_id=1, pid=6983 2024-04-05T02:55:00.946720455Z [2024-04-05T02:55:00.946+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:00.968242770Z [2024-04-05T02:55:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:55:00.986499334Z [2024-04-05T02:55:00.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:00.995895186Z [2024-04-05T02:55:00.995+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:55:01.007889451Z [2024-04-05T02:55:01.007+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:55:01.026624513Z [2024-04-05T02:55:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:55:01.182977036Z [2024-04-05T02:55:01.182+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-05T02:55:01.183028675Z 2024-04-05T02:55:01.183037505Z 2024-04-05T02:55:01.183046486Z 2024-04-05T02:55:01.183053922Z 2024-04-05T02:55:01.183061424Z 2024-04-05T02:55:01.183069003Z 2024-04-05T02:55:01.183754410Z [2024-04-05T02:55:01.183+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:55:01.184167202Z [2024-04-05T02:55:01.183+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:55:01.184482810Z [2024-04-05T02:55:01.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:55:01.185092068Z [2024-04-05T02:55:01.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:55:01.185550029Z [2024-04-05T02:55:01.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:55:01.186077121Z [2024-04-05T02:55:01.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:55:01.187481811Z [2024-04-05T02:55:01.187+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:01.187499628Z 2024-04-05T02:55:01.187504988Z 2024-04-05T02:55:01.187510867Z 2024-04-05T02:55:01.187515838Z 2024-04-05T02:55:01.187521390Z 2024-04-05T02:55:01.187526931Z 2024-04-05T02:55:01.197232796Z [2024-04-05T02:55:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:55:01.197732409Z [2024-04-05T02:55:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:55:01.198213787Z [2024-04-05T02:55:01.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:55:01.198530222Z [2024-04-05T02:55:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:55:01.198968268Z [2024-04-05T02:55:01.198+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:01.199115921Z [2024-04-05T02:55:01.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:55:01.199394775Z [2024-04-05T02:55:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:01.199566199Z [2024-04-05T02:55:01.199+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:55:01.200102798Z [2024-04-05T02:55:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:01.200335007Z [2024-04-05T02:55:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:55:01.200781197Z [2024-04-05T02:55:01.200+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:01.201008997Z [2024-04-05T02:55:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:55:01.801409375Z [2024-04-05T02:55:01.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.801693769Z [2024-04-05T02:55:01.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.801968834Z [2024-04-05T02:55:01.801+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.802356943Z [2024-04-05T02:55:01.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.804134040Z [2024-04-05T02:55:01.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.804287584Z [2024-04-05T02:55:01.804+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.821620363Z [2024-04-05T02:55:01.818+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e83fa02-09c1-411b-8d61-57cf230d5f27 2024-04-05T02:55:01.822179857Z [2024-04-05T02:55:01.821+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36e827fa-21a8-4a5d-b5e6-441a65f43686 2024-04-05T02:55:01.822561208Z [2024-04-05T02:55:01.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51a6acd7-672b-4382-bb5e-912b32b071a3 2024-04-05T02:55:01.822985267Z [2024-04-05T02:55:01.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to b84efb7f-b5ea-49cc-a31d-535798f08f9a 2024-04-05T02:55:01.823418887Z [2024-04-05T02:55:01.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67764125-1c12-4d9c-a0c9-3b31c04fedf4 2024-04-05T02:55:01.823904902Z [2024-04-05T02:55:01.823+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccc3a9a0-2409-48cf-a336-818bb5dc9aff 2024-04-05T02:55:08.099846341Z [2024-04-05T02:55:08.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status failed for try_number 1 2024-04-05T02:55:08.100477485Z [2024-04-05T02:55:08.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status failed for try_number 1 2024-04-05T02:55:08.111781441Z [2024-04-05T02:55:08.111+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.189728+00:00, queued_by_job_id=1, pid=None 2024-04-05T02:55:08.112387634Z [2024-04-05T02:55:08.112+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:55:08.127522984Z [2024-04-05T02:55:08.127+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:55:08.174003456Z [2024-04-05T02:55:08.173+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T025400, start_date=, end_date=20240405T025508 2024-04-05T02:55:08.211290568Z [2024-04-05T02:55:08.210+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.189728+00:00, queued_by_job_id=1, pid=None 2024-04-05T02:55:08.214872535Z [2024-04-05T02:55:08.214+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:55:08.229767274Z [2024-04-05T02:55:08.229+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:55:08.287996664Z [2024-04-05T02:55:08.285+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T025400, start_date=, end_date=20240405T025508 2024-04-05T02:55:09.244485234Z [2024-04-05T02:55:09.244+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:55:09.244527644Z 2024-04-05T02:55:09.246625532Z [2024-04-05T02:55:09.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:55:09.247347864Z [2024-04-05T02:55:09.247+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:09.247390208Z 2024-04-05T02:55:09.253588670Z [2024-04-05T02:55:09.253+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:55:09.253673502Z [2024-04-05T02:55:09.253+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:55:09.358640305Z [2024-04-05T02:55:09.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:09.358679669Z [2024-04-05T02:55:09.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status failed for try_number 1 2024-04-05T02:55:09.358703424Z [2024-04-05T02:55:09.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:09.380233134Z [2024-04-05T02:55:09.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.189728+00:00, queued_by_job_id=1, pid=None 2024-04-05T02:55:09.381229340Z [2024-04-05T02:55:09.380+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:55:09.394952396Z [2024-04-05T02:55:09.394+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:55:09.436504613Z [2024-04-05T02:55:09.436+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=extract_metrics_from_vnfrs, execution_date=20240405T025000, start_date=, end_date=20240405T025509 2024-04-05T02:55:09.466565506Z [2024-04-05T02:55:09.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to 955872cc-ef2e-4261-b4fd-bdb3a26122a4 2024-04-05T02:55:09.467000658Z [2024-04-05T02:55:09.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:06.776271+00:00, run_end_date=2024-04-05 02:55:08.007574+00:00, run_duration=1.231303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.189728+00:00, queued_by_job_id=1, pid=7030 2024-04-05T02:55:11.141627262Z [2024-04-05T02:55:11.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:55:11.142304622Z [2024-04-05T02:55:11.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:54:00+00:00, run_id=scheduled__2024-04-05T02:54:00+00:00, run_start_date=2024-04-05 02:55:01.044800+00:00, run_end_date=2024-04-05 02:55:11.141493+00:00, run_duration=10.096693, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:54:00+00:00, data_interval_end=2024-04-05 02:55:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:55:11.154180922Z [2024-04-05T02:55:11.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:11.163131977Z [2024-04-05T02:55:11.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:55:11.163747811Z [2024-04-05T02:55:11.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:54:00+00:00, run_id=scheduled__2024-04-05T02:54:00+00:00, run_start_date=2024-04-05 02:55:01.046827+00:00, run_end_date=2024-04-05 02:55:11.163038+00:00, run_duration=10.116211, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:54:00+00:00, data_interval_end=2024-04-05 02:55:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:55:11.174294560Z [2024-04-05T02:55:11.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:11.295055151Z [2024-04-05T02:55:11.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:11.295283365Z [2024-04-05T02:55:11.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:11.305762613Z [2024-04-05T02:55:11.305+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:08.948088+00:00, run_end_date=2024-04-05 02:55:10.637828+00:00, run_duration=1.68974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.189728+00:00, queued_by_job_id=1, pid=7109 2024-04-05T02:55:11.306457469Z [2024-04-05T02:55:11.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:07.617951+00:00, run_end_date=2024-04-05 02:55:09.839770+00:00, run_duration=2.221819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.189728+00:00, queued_by_job_id=1, pid=7072 2024-04-05T02:55:13.786534606Z [2024-04-05T02:55:13.784+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:55:13.786582431Z 2024-04-05T02:55:13.787308931Z [2024-04-05T02:55:13.786+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:55:13.790761196Z [2024-04-05T02:55:13.787+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:13.790777800Z 2024-04-05T02:55:13.799447475Z [2024-04-05T02:55:13.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:55:13.799860942Z [2024-04-05T02:55:13.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:55:13.935037875Z [2024-04-05T02:55:13.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:13.935284987Z [2024-04-05T02:55:13.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:13.954413713Z [2024-04-05T02:55:13.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b5b45e4-0b56-47a4-abfa-25e4a4b11554 2024-04-05T02:55:13.954906997Z [2024-04-05T02:55:13.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:12.103309+00:00, run_end_date=2024-04-05 02:55:12.729861+00:00, run_duration=0.626552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:09.247748+00:00, queued_by_job_id=1, pid=7140 2024-04-05T02:55:16.931137735Z [2024-04-05T02:55:16.930+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:55:16.931180093Z 2024-04-05T02:55:16.931504255Z [2024-04-05T02:55:16.931+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:55:16.932863482Z [2024-04-05T02:55:16.932+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:16.932884432Z 2024-04-05T02:55:16.937414067Z [2024-04-05T02:55:16.937+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:16.937855446Z [2024-04-05T02:55:16.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:55:16.988731490Z [2024-04-05T02:55:16.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:16.988951783Z [2024-04-05T02:55:16.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:16.996634571Z [2024-04-05T02:55:16.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa18c333-ff6b-4c24-9cfa-3648ad752b6f 2024-04-05T02:55:16.997242605Z [2024-04-05T02:55:16.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=0, run_start_date=2024-04-05 02:55:16.279003+00:00, run_end_date=2024-04-05 02:55:16.672980+00:00, run_duration=0.393977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:13.790721+00:00, queued_by_job_id=1, pid=7155 2024-04-05T02:55:19.202526734Z [2024-04-05T02:55:19.201+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:55:19.202938403Z [2024-04-05T02:55:19.202+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:55:01.042650+00:00, run_end_date=2024-04-05 02:55:19.202272+00:00, run_duration=18.159622, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:55:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T02:55:19.211833341Z [2024-04-05T02:55:19.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:55:19.265941242Z [2024-04-05T02:55:19.265+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:55:19.266041872Z 2024-04-05T02:55:19.266415084Z [2024-04-05T02:55:19.265+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:55:19.267575496Z [2024-04-05T02:55:19.267+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:19.267592182Z 2024-04-05T02:55:19.271534180Z [2024-04-05T02:55:19.271+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:19.271681126Z [2024-04-05T02:55:19.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:55:19.337797801Z [2024-04-05T02:55:19.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 2 2024-04-05T02:55:19.338156353Z [2024-04-05T02:55:19.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:19.352352150Z [2024-04-05T02:55:19.351+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9a3fccc-658d-4bd6-8de0-550d04b30f59 2024-04-05T02:55:19.353237528Z [2024-04-05T02:55:19.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:18.553853+00:00, run_end_date=2024-04-05 02:55:18.884569+00:00, run_duration=0.330716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:16.933687+00:00, queued_by_job_id=1, pid=7167 2024-04-05T02:55:21.835340372Z [2024-04-05T02:55:21.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status failed for try_number 2 2024-04-05T02:55:21.842504667Z [2024-04-05T02:55:21.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 02:55:08.250266+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:19.268259+00:00, queued_by_job_id=1, pid=None 2024-04-05T02:55:21.842995256Z [2024-04-05T02:55:21.842+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:55:21.845627338Z [2024-04-05T02:55:21.845+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:55:21.868759831Z [2024-04-05T02:55:21.868+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T025400, start_date=, end_date=20240405T025521 2024-04-05T02:55:22.614894530Z [2024-04-05T02:55:22.614+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T02:55:22.615278322Z [2024-04-05T02:55:22.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, execution_date=2024-04-05 02:54:00+00:00, run_id=scheduled__2024-04-05T02:54:00+00:00, run_start_date=2024-04-05 02:55:01.045809+00:00, run_end_date=2024-04-05 02:55:22.614765+00:00, run_duration=21.568956, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:54:00+00:00, data_interval_end=2024-04-05 02:55:00+00:00, dag_hash=433bdee1a17b3a0c9a37c0ad972b2ff2 2024-04-05T02:55:22.630067108Z [2024-04-05T02:55:22.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:56:00.275286145Z [2024-04-05T02:56:00.274+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:56:00.297608444Z [2024-04-05T02:56:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:57:00+00:00 2024-04-05T02:56:00.306764382Z [2024-04-05T02:56:00.306+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:56:00.315638049Z [2024-04-05T02:56:00.315+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:56:00.407775593Z [2024-04-05T02:56:00.407+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:56:00.407801957Z 2024-04-05T02:56:00.407806529Z 2024-04-05T02:56:00.407810065Z 2024-04-05T02:56:00.407813385Z 2024-04-05T02:56:00.407994181Z [2024-04-05T02:56:00.407+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:56:00.408286361Z [2024-04-05T02:56:00.408+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:56:00.408456365Z [2024-04-05T02:56:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:56:00.408644570Z [2024-04-05T02:56:00.408+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9 has 0/16 running and queued tasks 2024-04-05T02:56:00.409445228Z [2024-04-05T02:56:00.409+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:56:00.409464028Z 2024-04-05T02:56:00.409511001Z 2024-04-05T02:56:00.409517597Z 2024-04-05T02:56:00.409522249Z 2024-04-05T02:56:00.414546481Z [2024-04-05T02:56:00.414+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:56:00.415605399Z [2024-04-05T02:56:00.415+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:56:00.416053874Z [2024-04-05T02:56:00.415+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:56:00.416289091Z [2024-04-05T02:56:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:56:00.416652680Z [2024-04-05T02:56:00.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:56:00.416984849Z [2024-04-05T02:56:00.416+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:56:00.417239612Z [2024-04-05T02:56:00.417+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:56:00.417445603Z [2024-04-05T02:56:00.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:56:00.999581105Z [2024-04-05T02:56:00.998+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:56:00.999860404Z [2024-04-05T02:56:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:56:01.000096845Z [2024-04-05T02:56:00.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:56:01.002834803Z [2024-04-05T02:56:01.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:56:01.022420593Z [2024-04-05T02:56:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to 744eb848-fbb8-427b-bf49-7464f4ddc112 2024-04-05T02:56:01.026403038Z [2024-04-05T02:56:01.025+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00a0ca97-b279-43e3-b651-0de5d25ebd77 2024-04-05T02:56:01.027701873Z [2024-04-05T02:56:01.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38b22e3c-f340-41ff-823b-110fee063ce4 2024-04-05T02:56:01.028196749Z [2024-04-05T02:56:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to f434add1-8816-491f-a5e8-68fd722e01d8 2024-04-05T02:56:02.438767816Z [2024-04-05T02:56:02.438+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:56:02.441567672Z [2024-04-05T02:56:02.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:54:00+00:00, run_id=scheduled__2024-04-05T02:54:00+00:00, run_start_date=2024-04-05 02:56:00.327238+00:00, run_end_date=2024-04-05 02:56:02.438643+00:00, run_duration=2.111405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:54:00+00:00, data_interval_end=2024-04-05 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:56:02.466242641Z [2024-04-05T02:56:02.462+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:56:02.627537698Z [2024-04-05T02:56:02.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status success for try_number 1 2024-04-05T02:56:02.670209080Z [2024-04-05T02:56:02.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=2024-04-05 02:56:01.396626+00:00, run_end_date=2024-04-05 02:56:01.921452+00:00, run_duration=0.524826, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:56:00.410671+00:00, queued_by_job_id=1, pid=7192 2024-04-05T02:56:04.428400874Z [2024-04-05T02:56:04.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status failed for try_number 1 2024-04-05T02:56:04.436798406Z [2024-04-05T02:56:04.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:56:00.410671+00:00, queued_by_job_id=1, pid=None 2024-04-05T02:56:04.437282984Z [2024-04-05T02:56:04.437+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:56:04.440433448Z [2024-04-05T02:56:04.439+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T02:56:04.457421556Z [2024-04-05T02:56:04.457+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_163a77e5-4994-427f-bab8-7059acc1d7f9, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T025500, start_date=, end_date=20240405T025604 2024-04-05T02:56:06.174710555Z [2024-04-05T02:56:06.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:56:06.174941143Z [2024-04-05T02:56:06.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:55:00+00:00, run_id=scheduled__2024-04-05T02:55:00+00:00, run_start_date=2024-04-05 02:56:00.329799+00:00, run_end_date=2024-04-05 02:56:06.174664+00:00, run_duration=5.844865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:55:00+00:00, data_interval_end=2024-04-05 02:56:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:56:06.186081074Z [2024-04-05T02:56:06.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:57:00+00:00 2024-04-05T02:56:06.250347929Z [2024-04-05T02:56:06.249+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:56:06.250377430Z [2024-04-05T02:56:06.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:56:06.257776801Z [2024-04-05T02:56:06.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:56:03.866018+00:00, run_end_date=2024-04-05 02:56:06.064480+00:00, run_duration=2.198462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:56:00.410671+00:00, queued_by_job_id=1, pid=7225 2024-04-05T02:56:06.258270180Z [2024-04-05T02:56:06.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:56:03.896284+00:00, run_end_date=2024-04-05 02:56:05.700635+00:00, run_duration=1.804351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:56:00.410671+00:00, queued_by_job_id=1, pid=7226 2024-04-05T02:56:07.027117667Z [2024-04-05T02:56:07.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:56:07.027666853Z [2024-04-05T02:56:07.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:55:00+00:00, run_id=scheduled__2024-04-05T02:55:00+00:00, run_start_date=2024-04-05 02:56:00.332905+00:00, run_end_date=2024-04-05 02:56:07.027284+00:00, run_duration=6.694379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:55:00+00:00, data_interval_end=2024-04-05 02:56:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:56:07.036399028Z [2024-04-05T02:56:07.036+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:57:00+00:00 2024-04-05T02:56:44.175303729Z [2024-04-05T02:56:44.174+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:57:00.195078089Z [2024-04-05T02:57:00.194+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:57:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:57:00.207936745Z [2024-04-05T02:57:00.207+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:57:00.280406634Z [2024-04-05T02:57:00.280+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:57:00.280434003Z 2024-04-05T02:57:00.280438390Z 2024-04-05T02:57:00.280661927Z [2024-04-05T02:57:00.280+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:57:00.280858184Z [2024-04-05T02:57:00.280+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:57:00.281624587Z [2024-04-05T02:57:00.281+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:57:00.281637811Z 2024-04-05T02:57:00.281641240Z 2024-04-05T02:57:00.284888617Z [2024-04-05T02:57:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:57:00.285144696Z [2024-04-05T02:57:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:57:00.285544543Z [2024-04-05T02:57:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:57:00.285743519Z [2024-04-05T02:57:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:57:00.597996570Z [2024-04-05T02:57:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status queued for try_number 1 2024-04-05T02:57:00.598139979Z [2024-04-05T02:57:00.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status queued for try_number 1 2024-04-05T02:57:00.626410579Z [2024-04-05T02:57:00.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 744a604e-080f-4038-85a2-b9b99d6567d9 2024-04-05T02:57:00.627434757Z [2024-04-05T02:57:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to f38a3b06-077e-4c98-bf87-6959e81d9a28 2024-04-05T02:57:05.979757392Z [2024-04-05T02:57:05.979+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:57:05.980855693Z [2024-04-05T02:57:05.980+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:56:00+00:00, run_id=scheduled__2024-04-05T02:56:00+00:00, run_start_date=2024-04-05 02:57:00.222930+00:00, run_end_date=2024-04-05 02:57:05.980358+00:00, run_duration=5.757428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:56:00+00:00, data_interval_end=2024-04-05 02:57:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:57:05.995446011Z [2024-04-05T02:57:05.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:57:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:57:06.004568375Z [2024-04-05T02:57:06.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:57:06.005891854Z [2024-04-05T02:57:06.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:56:00+00:00, run_id=scheduled__2024-04-05T02:56:00+00:00, run_start_date=2024-04-05 02:57:00.224473+00:00, run_end_date=2024-04-05 02:57:06.005478+00:00, run_duration=5.781005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:56:00+00:00, data_interval_end=2024-04-05 02:57:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:57:06.017011027Z [2024-04-05T02:57:06.016+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:57:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:57:06.057842349Z [2024-04-05T02:57:06.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status success for try_number 1 2024-04-05T02:57:06.058570396Z [2024-04-05T02:57:06.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status success for try_number 1 2024-04-05T02:57:06.065667789Z [2024-04-05T02:57:06.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:56:00+00:00, map_index=-1, run_start_date=2024-04-05 02:57:03.030046+00:00, run_end_date=2024-04-05 02:57:05.772800+00:00, run_duration=2.742754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:57:00.282280+00:00, queued_by_job_id=1, pid=7297 2024-04-05T02:57:06.066167566Z [2024-04-05T02:57:06.065+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:56:00+00:00, map_index=-1, run_start_date=2024-04-05 02:57:02.730430+00:00, run_end_date=2024-04-05 02:57:04.983280+00:00, run_duration=2.25285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:57:00.282280+00:00, queued_by_job_id=1, pid=7296 2024-04-05T02:58:01.070171933Z [2024-04-05T02:58:01.069+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:58:01.082056028Z [2024-04-05T02:58:01.081+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:58:01.096063201Z [2024-04-05T02:58:01.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T02:59:00+00:00 2024-04-05T02:58:01.185754383Z [2024-04-05T02:58:01.185+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:58:01.185807517Z 2024-04-05T02:58:01.185817964Z 2024-04-05T02:58:01.185823693Z 2024-04-05T02:58:01.185930805Z [2024-04-05T02:58:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:58:01.186220751Z [2024-04-05T02:58:01.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:58:01.186358932Z [2024-04-05T02:58:01.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:58:01.187090403Z [2024-04-05T02:58:01.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:58:01.187110428Z 2024-04-05T02:58:01.187157170Z 2024-04-05T02:58:01.187162685Z 2024-04-05T02:58:01.191400313Z [2024-04-05T02:58:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:58:01.191537385Z [2024-04-05T02:58:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:58:01.191906538Z [2024-04-05T02:58:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:58:01.192061615Z [2024-04-05T02:58:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:58:01.192354989Z [2024-04-05T02:58:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:58:01.192480125Z [2024-04-05T02:58:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:58:01.480957020Z [2024-04-05T02:58:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status queued for try_number 1 2024-04-05T02:58:01.481092530Z [2024-04-05T02:58:01.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status queued for try_number 1 2024-04-05T02:58:01.481305427Z [2024-04-05T02:58:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status queued for try_number 1 2024-04-05T02:58:01.501927579Z [2024-04-05T02:58:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to eaa5e82e-cb39-40c2-9ab8-38c28fa3de5c 2024-04-05T02:58:01.502956945Z [2024-04-05T02:58:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb834c96-cf04-4286-a698-e6c558e978c4 2024-04-05T02:58:01.503399542Z [2024-04-05T02:58:01.503+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab101e0f-5666-4c33-b45b-0f7850751909 2024-04-05T02:58:04.188170803Z [2024-04-05T02:58:04.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:58:04.189878102Z [2024-04-05T02:58:04.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:56:00+00:00, run_id=scheduled__2024-04-05T02:56:00+00:00, run_start_date=2024-04-05 02:58:01.114412+00:00, run_end_date=2024-04-05 02:58:04.188025+00:00, run_duration=3.073613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:56:00+00:00, data_interval_end=2024-04-05 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:58:04.213449888Z [2024-04-05T02:58:04.212+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:58:04.356940264Z [2024-04-05T02:58:04.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status success for try_number 1 2024-04-05T02:58:04.379149897Z [2024-04-05T02:58:04.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:56:00+00:00, map_index=-1, run_start_date=2024-04-05 02:58:02.394802+00:00, run_end_date=2024-04-05 02:58:03.748602+00:00, run_duration=1.3538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:58:01.188020+00:00, queued_by_job_id=1, pid=7332 2024-04-05T02:58:08.501207012Z [2024-04-05T02:58:08.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:58:08.501953840Z [2024-04-05T02:58:08.501+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:57:00+00:00, run_id=scheduled__2024-04-05T02:57:00+00:00, run_start_date=2024-04-05 02:58:01.117114+00:00, run_end_date=2024-04-05 02:58:08.501439+00:00, run_duration=7.384325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:57:00+00:00, data_interval_end=2024-04-05 02:58:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:58:08.520868188Z [2024-04-05T02:58:08.520+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T02:59:00+00:00 2024-04-05T02:58:08.530405777Z [2024-04-05T02:58:08.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:58:08.531294344Z [2024-04-05T02:58:08.531+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:57:00+00:00, run_id=scheduled__2024-04-05T02:57:00+00:00, run_start_date=2024-04-05 02:58:01.115888+00:00, run_end_date=2024-04-05 02:58:08.530564+00:00, run_duration=7.414676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:57:00+00:00, data_interval_end=2024-04-05 02:58:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:58:08.545538899Z [2024-04-05T02:58:08.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T02:59:00+00:00 2024-04-05T02:58:08.574952855Z [2024-04-05T02:58:08.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status success for try_number 1 2024-04-05T02:58:08.575348653Z [2024-04-05T02:58:08.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status success for try_number 1 2024-04-05T02:58:08.582434681Z [2024-04-05T02:58:08.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:57:00+00:00, map_index=-1, run_start_date=2024-04-05 02:58:05.154202+00:00, run_end_date=2024-04-05 02:58:07.740637+00:00, run_duration=2.586435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:58:01.188020+00:00, queued_by_job_id=1, pid=7353 2024-04-05T02:58:08.582919464Z [2024-04-05T02:58:08.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:57:00+00:00, map_index=-1, run_start_date=2024-04-05 02:58:06.294933+00:00, run_end_date=2024-04-05 02:58:07.940333+00:00, run_duration=1.6454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:58:01.188020+00:00, queued_by_job_id=1, pid=7372 2024-04-05T02:59:00.431422910Z [2024-04-05T02:59:00.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:59:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:59:00.439976952Z [2024-04-05T02:59:00.439+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:59:00.510932498Z [2024-04-05T02:59:00.510+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T02:59:00.510959218Z 2024-04-05T02:59:00.510963054Z 2024-04-05T02:59:00.511204608Z [2024-04-05T02:59:00.510+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:59:00.511437820Z [2024-04-05T02:59:00.511+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T02:59:00.512368153Z [2024-04-05T02:59:00.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:59:00.512374049Z 2024-04-05T02:59:00.512377713Z 2024-04-05T02:59:00.518232516Z [2024-04-05T02:59:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:59:00.518413268Z [2024-04-05T02:59:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:59:00.518938540Z [2024-04-05T02:59:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:59:00.519168610Z [2024-04-05T02:59:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:59:00.783069846Z [2024-04-05T02:59:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status queued for try_number 1 2024-04-05T02:59:00.783109707Z [2024-04-05T02:59:00.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status queued for try_number 1 2024-04-05T02:59:00.791661193Z [2024-04-05T02:59:00.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40abf25e-9770-459f-8456-8d7ff5b51c2a 2024-04-05T02:59:00.791881324Z [2024-04-05T02:59:00.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to de3229be-91e9-46e5-9f65-0bcf472137a3 2024-04-05T02:59:05.880372033Z [2024-04-05T02:59:05.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:59:05.880889647Z [2024-04-05T02:59:05.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:58:00+00:00, run_id=scheduled__2024-04-05T02:58:00+00:00, run_start_date=2024-04-05 02:59:00.452363+00:00, run_end_date=2024-04-05 02:59:05.880278+00:00, run_duration=5.427915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:58:00+00:00, data_interval_end=2024-04-05 02:59:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T02:59:05.891234276Z [2024-04-05T02:59:05.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:59:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:59:05.957734731Z [2024-04-05T02:59:05.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status success for try_number 1 2024-04-05T02:59:05.971886609Z [2024-04-05T02:59:05.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:58:00+00:00, map_index=-1, run_start_date=2024-04-05 02:59:03.196478+00:00, run_end_date=2024-04-05 02:59:05.116888+00:00, run_duration=1.92041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:59:00.513254+00:00, queued_by_job_id=1, pid=7418 2024-04-05T02:59:07.017734076Z [2024-04-05T02:59:07.017+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:59:07.018024536Z [2024-04-05T02:59:07.017+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:58:00+00:00, run_id=scheduled__2024-04-05T02:58:00+00:00, run_start_date=2024-04-05 02:59:00.453771+00:00, run_end_date=2024-04-05 02:59:07.017699+00:00, run_duration=6.563928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:58:00+00:00, data_interval_end=2024-04-05 02:59:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T02:59:07.030113287Z [2024-04-05T02:59:07.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T02:59:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:59:07.081150376Z [2024-04-05T02:59:07.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status success for try_number 1 2024-04-05T02:59:07.090152384Z [2024-04-05T02:59:07.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:58:00+00:00, map_index=-1, run_start_date=2024-04-05 02:59:03.213127+00:00, run_end_date=2024-04-05 02:59:05.892607+00:00, run_duration=2.67948, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:59:00.513254+00:00, queued_by_job_id=1, pid=7417 2024-04-05T03:00:00.304112461Z [2024-04-05T03:00:00.303+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:00:00.311014012Z [2024-04-05T03:00:00.310+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:00:00.322598917Z [2024-04-05T03:00:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:00:00+00:00, run_after=2024-04-05T03:05:00+00:00 2024-04-05T03:00:00.345670113Z [2024-04-05T03:00:00.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:00:00+00:00, run_after=2024-04-05T03:01:00+00:00 2024-04-05T03:00:00.422928559Z [2024-04-05T03:00:00.422+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T03:00:00.422975592Z 2024-04-05T03:00:00.422985376Z 2024-04-05T03:00:00.422995025Z 2024-04-05T03:00:00.423003923Z 2024-04-05T03:00:00.423201786Z [2024-04-05T03:00:00.422+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:00:00.423553227Z [2024-04-05T03:00:00.423+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:00:00.424304385Z [2024-04-05T03:00:00.423+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:00:00.424379259Z [2024-04-05T03:00:00.424+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:00:00.425207319Z [2024-04-05T03:00:00.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:00:00.425230924Z 2024-04-05T03:00:00.425241018Z 2024-04-05T03:00:00.425250122Z 2024-04-05T03:00:00.425258800Z 2024-04-05T03:00:00.428894233Z [2024-04-05T03:00:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:00:00.429124172Z [2024-04-05T03:00:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:00:00.429614088Z [2024-04-05T03:00:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:00:00.429816000Z [2024-04-05T03:00:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:00:00.430265988Z [2024-04-05T03:00:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:00:00.431853128Z [2024-04-05T03:00:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:00:00.432277764Z [2024-04-05T03:00:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:00:00.432479927Z [2024-04-05T03:00:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:00:00.899047125Z [2024-04-05T03:00:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T03:00:00.901742248Z [2024-04-05T03:00:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status queued for try_number 1 2024-04-05T03:00:00.902079659Z [2024-04-05T03:00:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:59:00+00:00 exited with status queued for try_number 1 2024-04-05T03:00:00.902136220Z [2024-04-05T03:00:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:59:00+00:00 exited with status queued for try_number 1 2024-04-05T03:00:00.911939181Z [2024-04-05T03:00:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6099c979-5f21-428a-bc7f-22c29181f48c 2024-04-05T03:00:00.912321675Z [2024-04-05T03:00:00.911+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfdabd9d-7e01-42cc-adc2-2eba7934d2db 2024-04-05T03:00:00.912544615Z [2024-04-05T03:00:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41c1eff6-5cf2-4593-ac79-0b8e932ab7d8 2024-04-05T03:00:00.912705643Z [2024-04-05T03:00:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 29f7ef3a-494c-4e56-b1a3-28c1fbdb84bc 2024-04-05T03:00:02.148379916Z [2024-04-05T03:00:02.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:00:02.149713919Z [2024-04-05T03:00:02.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:58:00+00:00, run_id=scheduled__2024-04-05T02:58:00+00:00, run_start_date=2024-04-05 03:00:00.359530+00:00, run_end_date=2024-04-05 03:00:02.148285+00:00, run_duration=1.788755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:58:00+00:00, data_interval_end=2024-04-05 03:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:00:02.172885071Z [2024-04-05T03:00:02.172+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:00:00+00:00, run_after=2024-04-05T03:02:00+00:00 2024-04-05T03:00:02.247540825Z [2024-04-05T03:00:02.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status success for try_number 1 2024-04-05T03:00:02.262534062Z [2024-04-05T03:00:02.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:58:00+00:00, map_index=-1, run_start_date=2024-04-05 03:00:01.343431+00:00, run_end_date=2024-04-05 03:00:01.724771+00:00, run_duration=0.38134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:00:00.426180+00:00, queued_by_job_id=1, pid=7454 2024-04-05T03:00:04.778553412Z [2024-04-05T03:00:04.778+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:00:04.778589031Z 2024-04-05T03:00:04.778615652Z [2024-04-05T03:00:04.778+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:00:04.779143101Z [2024-04-05T03:00:04.778+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:00:04.779153562Z 2024-04-05T03:00:04.788987664Z [2024-04-05T03:00:04.788+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:00:04.789042812Z [2024-04-05T03:00:04.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:00:05.020375240Z [2024-04-05T03:00:05.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T03:00:05.034355543Z [2024-04-05T03:00:05.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T03:00:05.061086290Z [2024-04-05T03:00:05.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to db208419-3b6d-4216-b856-4f6f52870a26 2024-04-05T03:00:05.063292134Z [2024-04-05T03:00:05.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=2024-04-05 03:00:03.140178+00:00, run_end_date=2024-04-05 03:00:04.102254+00:00, run_duration=0.962076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:00:00.426180+00:00, queued_by_job_id=1, pid=7495 2024-04-05T03:00:05.191247604Z [2024-04-05T03:00:05.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:00:05.191558991Z [2024-04-05T03:00:05.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:59:00+00:00, run_id=scheduled__2024-04-05T02:59:00+00:00, run_start_date=2024-04-05 03:00:00.361589+00:00, run_end_date=2024-04-05 03:00:05.191175+00:00, run_duration=4.829586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:59:00+00:00, data_interval_end=2024-04-05 03:00:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:00:05.241613911Z [2024-04-05T03:00:05.241+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:00:00+00:00, run_after=2024-04-05T03:01:00+00:00 2024-04-05T03:00:05.445257323Z [2024-04-05T03:00:05.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:59:00+00:00 exited with status success for try_number 1 2024-04-05T03:00:05.492143557Z [2024-04-05T03:00:05.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:59:00+00:00, map_index=-1, run_start_date=2024-04-05 03:00:03.038486+00:00, run_end_date=2024-04-05 03:00:04.865829+00:00, run_duration=1.827343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:00:00.426180+00:00, queued_by_job_id=1, pid=7485 2024-04-05T03:00:06.069867580Z [2024-04-05T03:00:06.067+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:00:06.070190815Z [2024-04-05T03:00:06.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:59:00+00:00, run_id=scheduled__2024-04-05T02:59:00+00:00, run_start_date=2024-04-05 03:00:00.362949+00:00, run_end_date=2024-04-05 03:00:06.069771+00:00, run_duration=5.706822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:59:00+00:00, data_interval_end=2024-04-05 03:00:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:00:06.121753989Z [2024-04-05T03:00:06.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:00:00+00:00, run_after=2024-04-05T03:01:00+00:00 2024-04-05T03:00:07.661954184Z [2024-04-05T03:00:07.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:59:00+00:00 exited with status success for try_number 1 2024-04-05T03:00:07.670625307Z [2024-04-05T03:00:07.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:59:00+00:00, map_index=-1, run_start_date=2024-04-05 03:00:03.745216+00:00, run_end_date=2024-04-05 03:00:05.942389+00:00, run_duration=2.197173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:00:00.426180+00:00, queued_by_job_id=1, pid=7496 2024-04-05T03:00:09.335296400Z [2024-04-05T03:00:09.334+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:00:09.335353579Z 2024-04-05T03:00:09.335690627Z [2024-04-05T03:00:09.335+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:00:09.336549690Z [2024-04-05T03:00:09.336+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:00:09.336573340Z 2024-04-05T03:00:09.339362993Z [2024-04-05T03:00:09.339+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:00:09.339584332Z [2024-04-05T03:00:09.339+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:00:09.388426280Z [2024-04-05T03:00:09.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T03:00:09.388461333Z [2024-04-05T03:00:09.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T03:00:09.399266162Z [2024-04-05T03:00:09.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to dcdc5445-8700-4aed-94b7-b4d7ee4c8c03 2024-04-05T03:00:09.399525935Z [2024-04-05T03:00:09.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=2024-04-05 03:00:07.737827+00:00, run_end_date=2024-04-05 03:00:08.188109+00:00, run_duration=0.450282, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:00:04.783081+00:00, queued_by_job_id=1, pid=7535 2024-04-05T03:00:12.698948755Z [2024-04-05T03:00:12.698+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:00:12.698986231Z 2024-04-05T03:00:12.699161905Z [2024-04-05T03:00:12.698+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:00:12.700642679Z [2024-04-05T03:00:12.700+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:00:12.700664213Z 2024-04-05T03:00:12.706768930Z [2024-04-05T03:00:12.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:00:12.706917639Z [2024-04-05T03:00:12.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:00:12.850154852Z [2024-04-05T03:00:12.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T03:00:12.850324356Z [2024-04-05T03:00:12.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T03:00:12.864824130Z [2024-04-05T03:00:12.864+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ca08b62-1534-480f-8b88-b63055b71983 2024-04-05T03:00:12.865613913Z [2024-04-05T03:00:12.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=0, run_start_date=2024-04-05 03:00:11.238675+00:00, run_end_date=2024-04-05 03:00:11.640291+00:00, run_duration=0.401616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:00:09.337014+00:00, queued_by_job_id=1, pid=7558 2024-04-05T03:00:16.658788071Z [2024-04-05T03:00:16.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:00:16.659543001Z [2024-04-05T03:00:16.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 02:55:00+00:00, run_id=scheduled__2024-04-05T02:55:00+00:00, run_start_date=2024-04-05 03:00:00.358233+00:00, run_end_date=2024-04-05 03:00:16.658831+00:00, run_duration=16.300598, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:55:00+00:00, data_interval_end=2024-04-05 03:00:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:00:16.669712572Z [2024-04-05T03:00:16.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:00:00+00:00, run_after=2024-04-05T03:05:00+00:00 2024-04-05T03:00:16.702106332Z [2024-04-05T03:00:16.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T03:00:16.709005869Z [2024-04-05T03:00:16.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=2024-04-05 03:00:15.099639+00:00, run_end_date=2024-04-05 03:00:15.624404+00:00, run_duration=0.524765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:00:12.703143+00:00, queued_by_job_id=1, pid=7573 2024-04-05T03:01:00.381277622Z [2024-04-05T03:01:00.380+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:01:00+00:00, run_after=2024-04-05T03:02:00+00:00 2024-04-05T03:01:00.388645358Z [2024-04-05T03:01:00.388+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:01:00.438422660Z [2024-04-05T03:01:00.437+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:01:00.438448939Z 2024-04-05T03:01:00.438452662Z 2024-04-05T03:01:00.438714085Z [2024-04-05T03:01:00.438+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:01:00.439100311Z [2024-04-05T03:01:00.438+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:01:00.440121841Z [2024-04-05T03:01:00.439+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:01:00.440141488Z 2024-04-05T03:01:00.440150388Z 2024-04-05T03:01:00.443853384Z [2024-04-05T03:01:00.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:01:00.444193172Z [2024-04-05T03:01:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:01:00.444741507Z [2024-04-05T03:01:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:01:00.445076361Z [2024-04-05T03:01:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:01:00.616873505Z [2024-04-05T03:01:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status queued for try_number 1 2024-04-05T03:01:00.617039255Z [2024-04-05T03:01:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status queued for try_number 1 2024-04-05T03:01:00.626437842Z [2024-04-05T03:01:00.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d7e45ee-3e2b-4a10-9a40-87a326f07477 2024-04-05T03:01:00.626692122Z [2024-04-05T03:01:00.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to 188b790f-c407-4382-96d4-73fca1a45edd 2024-04-05T03:01:04.642444045Z [2024-04-05T03:01:04.636+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:01:04.642469158Z [2024-04-05T03:01:04.637+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:00:00+00:00, run_id=scheduled__2024-04-05T03:00:00+00:00, run_start_date=2024-04-05 03:01:00.397819+00:00, run_end_date=2024-04-05 03:01:04.636520+00:00, run_duration=4.238701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:00:00+00:00, data_interval_end=2024-04-05 03:01:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:01:04.655280518Z [2024-04-05T03:01:04.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:01:00+00:00, run_after=2024-04-05T03:02:00+00:00 2024-04-05T03:01:04.666148902Z [2024-04-05T03:01:04.665+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:01:04.666372559Z [2024-04-05T03:01:04.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:00:00+00:00, run_id=scheduled__2024-04-05T03:00:00+00:00, run_start_date=2024-04-05 03:01:00.398965+00:00, run_end_date=2024-04-05 03:01:04.666000+00:00, run_duration=4.267035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:00:00+00:00, data_interval_end=2024-04-05 03:01:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:01:04.684792510Z [2024-04-05T03:01:04.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:01:00+00:00, run_after=2024-04-05T03:02:00+00:00 2024-04-05T03:01:04.721560855Z [2024-04-05T03:01:04.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status success for try_number 1 2024-04-05T03:01:04.721820878Z [2024-04-05T03:01:04.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status success for try_number 1 2024-04-05T03:01:04.729140283Z [2024-04-05T03:01:04.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:00:00+00:00, map_index=-1, run_start_date=2024-04-05 03:01:02.590679+00:00, run_end_date=2024-04-05 03:01:04.098870+00:00, run_duration=1.508191, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:01:00.441039+00:00, queued_by_job_id=1, pid=7597 2024-04-05T03:01:04.729470454Z [2024-04-05T03:01:04.729+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:00:00+00:00, map_index=-1, run_start_date=2024-04-05 03:01:02.253083+00:00, run_end_date=2024-04-05 03:01:04.517743+00:00, run_duration=2.26466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:01:00.441039+00:00, queued_by_job_id=1, pid=7595 2024-04-05T03:01:44.250358845Z [2024-04-05T03:01:44.249+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:02:00.386355510Z [2024-04-05T03:02:00.385+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:02:00.393283380Z [2024-04-05T03:02:00.392+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:02:00.407233595Z [2024-04-05T03:02:00.406+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:02:00+00:00, run_after=2024-04-05T03:03:00+00:00 2024-04-05T03:02:00.474403622Z [2024-04-05T03:02:00.474+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:02:00.474429919Z 2024-04-05T03:02:00.474434490Z 2024-04-05T03:02:00.474437813Z 2024-04-05T03:02:00.474719758Z [2024-04-05T03:02:00.474+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:02:00.475017436Z [2024-04-05T03:02:00.474+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:02:00.475343487Z [2024-04-05T03:02:00.475+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:02:00.476138378Z [2024-04-05T03:02:00.475+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:02:00.476145479Z 2024-04-05T03:02:00.476149087Z 2024-04-05T03:02:00.476152458Z 2024-04-05T03:02:00.480375571Z [2024-04-05T03:02:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:02:00.480837666Z [2024-04-05T03:02:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:02:00.481239099Z [2024-04-05T03:02:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:02:00.481533974Z [2024-04-05T03:02:00.481+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:02:00.482140975Z [2024-04-05T03:02:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:02:00.482418606Z [2024-04-05T03:02:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:02:00.726825673Z [2024-04-05T03:02:00.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status queued for try_number 1 2024-04-05T03:02:00.726862503Z [2024-04-05T03:02:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:01:00+00:00 exited with status queued for try_number 1 2024-04-05T03:02:00.726866273Z [2024-04-05T03:02:00.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:01:00+00:00 exited with status queued for try_number 1 2024-04-05T03:02:00.742272291Z [2024-04-05T03:02:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to cee1f114-fcb1-4211-aede-9d15ba797ee9 2024-04-05T03:02:00.742304521Z [2024-04-05T03:02:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6042a0ca-a54f-48b4-98d1-4b147e7b2af7 2024-04-05T03:02:00.742308339Z [2024-04-05T03:02:00.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 549d2433-dd27-4c74-8d0d-dfe9397a3252 2024-04-05T03:02:01.969566829Z [2024-04-05T03:02:01.968+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:02:01.970459805Z [2024-04-05T03:02:01.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:00:00+00:00, run_id=scheduled__2024-04-05T03:00:00+00:00, run_start_date=2024-04-05 03:02:00.418381+00:00, run_end_date=2024-04-05 03:02:01.969813+00:00, run_duration=1.551432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:00:00+00:00, data_interval_end=2024-04-05 03:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:02:01.996451182Z [2024-04-05T03:02:01.995+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:02:00+00:00, run_after=2024-04-05T03:04:00+00:00 2024-04-05T03:02:03.412923947Z [2024-04-05T03:02:03.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status success for try_number 1 2024-04-05T03:02:03.418788128Z [2024-04-05T03:02:03.418+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:00:00+00:00, map_index=-1, run_start_date=2024-04-05 03:02:01.412857+00:00, run_end_date=2024-04-05 03:02:01.877043+00:00, run_duration=0.464186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:02:00.477145+00:00, queued_by_job_id=1, pid=7632 2024-04-05T03:02:05.652418872Z [2024-04-05T03:02:05.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:02:05.653004598Z [2024-04-05T03:02:05.652+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:01:00+00:00, run_id=scheduled__2024-04-05T03:01:00+00:00, run_start_date=2024-04-05 03:02:00.420660+00:00, run_end_date=2024-04-05 03:02:05.652623+00:00, run_duration=5.231963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:01:00+00:00, data_interval_end=2024-04-05 03:02:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:02:05.681200588Z [2024-04-05T03:02:05.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:02:00+00:00, run_after=2024-04-05T03:03:00+00:00 2024-04-05T03:02:05.695499837Z [2024-04-05T03:02:05.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:02:05.696860523Z [2024-04-05T03:02:05.696+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:01:00+00:00, run_id=scheduled__2024-04-05T03:01:00+00:00, run_start_date=2024-04-05 03:02:00.419625+00:00, run_end_date=2024-04-05 03:02:05.696458+00:00, run_duration=5.276833, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:01:00+00:00, data_interval_end=2024-04-05 03:02:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:02:05.723775940Z [2024-04-05T03:02:05.723+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:02:00+00:00, run_after=2024-04-05T03:03:00+00:00 2024-04-05T03:02:05.784171975Z [2024-04-05T03:02:05.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:01:00+00:00 exited with status success for try_number 1 2024-04-05T03:02:05.784325051Z [2024-04-05T03:02:05.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:01:00+00:00 exited with status success for try_number 1 2024-04-05T03:02:05.801520346Z [2024-04-05T03:02:05.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:01:00+00:00, map_index=-1, run_start_date=2024-04-05 03:02:03.414317+00:00, run_end_date=2024-04-05 03:02:05.506264+00:00, run_duration=2.091947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:02:00.477145+00:00, queued_by_job_id=1, pid=7659 2024-04-05T03:02:05.807002001Z [2024-04-05T03:02:05.806+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:01:00+00:00, map_index=-1, run_start_date=2024-04-05 03:02:03.810125+00:00, run_end_date=2024-04-05 03:02:05.371346+00:00, run_duration=1.561221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:02:00.477145+00:00, queued_by_job_id=1, pid=7663 2024-04-05T03:03:00.180082349Z [2024-04-05T03:03:00.179+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:03:00+00:00, run_after=2024-04-05T03:04:00+00:00 2024-04-05T03:03:00.187392573Z [2024-04-05T03:03:00.187+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:03:00.239361726Z [2024-04-05T03:03:00.239+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:03:00.239408944Z 2024-04-05T03:03:00.239412893Z 2024-04-05T03:03:00.239423249Z [2024-04-05T03:03:00.239+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:03:00.239717380Z [2024-04-05T03:03:00.239+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:03:00.240305265Z [2024-04-05T03:03:00.240+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:03:00.240312681Z 2024-04-05T03:03:00.240315822Z 2024-04-05T03:03:00.242871524Z [2024-04-05T03:03:00.242+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:03:00.242964759Z [2024-04-05T03:03:00.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:03:00.243164538Z [2024-04-05T03:03:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:03:00.243235947Z [2024-04-05T03:03:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:03:00.381630900Z [2024-04-05T03:03:00.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:02:00+00:00 exited with status queued for try_number 1 2024-04-05T03:03:00.381881383Z [2024-04-05T03:03:00.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:02:00+00:00 exited with status queued for try_number 1 2024-04-05T03:03:00.389718315Z [2024-04-05T03:03:00.389+0000] {scheduler_job.py:635} INFO - Setting external_id for to b391505b-62a3-4a9a-89f5-17bb0451b3c9 2024-04-05T03:03:00.390091078Z [2024-04-05T03:03:00.389+0000] {scheduler_job.py:635} INFO - Setting external_id for to 447fe705-78de-4409-bfb8-67df9b81a934 2024-04-05T03:03:04.188269435Z [2024-04-05T03:03:04.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:03:04.188631354Z [2024-04-05T03:03:04.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:02:00+00:00, run_id=scheduled__2024-04-05T03:02:00+00:00, run_start_date=2024-04-05 03:03:00.197492+00:00, run_end_date=2024-04-05 03:03:04.188088+00:00, run_duration=3.990596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:02:00+00:00, data_interval_end=2024-04-05 03:03:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:03:04.199777583Z [2024-04-05T03:03:04.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:03:00+00:00, run_after=2024-04-05T03:04:00+00:00 2024-04-05T03:03:04.259715987Z [2024-04-05T03:03:04.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:02:00+00:00 exited with status success for try_number 1 2024-04-05T03:03:04.271254103Z [2024-04-05T03:03:04.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:02:00+00:00, map_index=-1, run_start_date=2024-04-05 03:03:02.117517+00:00, run_end_date=2024-04-05 03:03:03.845176+00:00, run_duration=1.727659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:03:00.240738+00:00, queued_by_job_id=1, pid=7717 2024-04-05T03:03:05.328087653Z [2024-04-05T03:03:05.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:03:05.329962390Z [2024-04-05T03:03:05.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:02:00+00:00, run_id=scheduled__2024-04-05T03:02:00+00:00, run_start_date=2024-04-05 03:03:00.198705+00:00, run_end_date=2024-04-05 03:03:05.327981+00:00, run_duration=5.129276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:02:00+00:00, data_interval_end=2024-04-05 03:03:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:03:05.348228647Z [2024-04-05T03:03:05.347+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:03:00+00:00, run_after=2024-04-05T03:04:00+00:00 2024-04-05T03:03:05.415827281Z [2024-04-05T03:03:05.415+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:02:00+00:00 exited with status success for try_number 1 2024-04-05T03:03:05.422826301Z [2024-04-05T03:03:05.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:02:00+00:00, map_index=-1, run_start_date=2024-04-05 03:03:02.266976+00:00, run_end_date=2024-04-05 03:03:04.286318+00:00, run_duration=2.019342, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:03:00.240738+00:00, queued_by_job_id=1, pid=7718 2024-04-05T03:04:01.077631358Z [2024-04-05T03:04:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:04:01.087657663Z [2024-04-05T03:04:01.087+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:04:01.108098780Z [2024-04-05T03:04:01.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:04:00+00:00, run_after=2024-04-05T03:05:00+00:00 2024-04-05T03:04:01.192032865Z [2024-04-05T03:04:01.191+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:04:01.192062060Z 2024-04-05T03:04:01.192066430Z 2024-04-05T03:04:01.192069523Z 2024-04-05T03:04:01.192156053Z [2024-04-05T03:04:01.191+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:04:01.192307214Z [2024-04-05T03:04:01.192+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:04:01.192371868Z [2024-04-05T03:04:01.192+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:04:01.193006348Z [2024-04-05T03:04:01.192+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:04:01.193014645Z 2024-04-05T03:04:01.193018425Z 2024-04-05T03:04:01.193021781Z 2024-04-05T03:04:01.196271505Z [2024-04-05T03:04:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:04:01.196430948Z [2024-04-05T03:04:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:04:01.196707599Z [2024-04-05T03:04:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:04:01.196836880Z [2024-04-05T03:04:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:04:01.197097814Z [2024-04-05T03:04:01.196+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:04:01.197202233Z [2024-04-05T03:04:01.197+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:04:01.477892237Z [2024-04-05T03:04:01.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:02:00+00:00 exited with status queued for try_number 1 2024-04-05T03:04:01.478045523Z [2024-04-05T03:04:01.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:03:00+00:00 exited with status queued for try_number 1 2024-04-05T03:04:01.481264347Z [2024-04-05T03:04:01.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:03:00+00:00 exited with status queued for try_number 1 2024-04-05T03:04:01.500265641Z [2024-04-05T03:04:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb31b38a-e852-470c-b1fc-b26bcdb3330a 2024-04-05T03:04:01.500610502Z [2024-04-05T03:04:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73cc3d1f-8809-42f3-bc78-0cec432ee909 2024-04-05T03:04:01.501090159Z [2024-04-05T03:04:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87c0b3a5-fcd7-4a48-939d-1ebf5555f798 2024-04-05T03:04:03.928038647Z [2024-04-05T03:04:03.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:04:03.928645883Z [2024-04-05T03:04:03.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:02:00+00:00, run_id=scheduled__2024-04-05T03:02:00+00:00, run_start_date=2024-04-05 03:04:01.124769+00:00, run_end_date=2024-04-05 03:04:03.927928+00:00, run_duration=2.803159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:02:00+00:00, data_interval_end=2024-04-05 03:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:04:03.947104293Z [2024-04-05T03:04:03.946+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:04:00+00:00, run_after=2024-04-05T03:06:00+00:00 2024-04-05T03:04:04.074417924Z [2024-04-05T03:04:04.074+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:02:00+00:00 exited with status success for try_number 1 2024-04-05T03:04:04.094064998Z [2024-04-05T03:04:04.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:02:00+00:00, map_index=-1, run_start_date=2024-04-05 03:04:02.295483+00:00, run_end_date=2024-04-05 03:04:03.144997+00:00, run_duration=0.849514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:04:01.193766+00:00, queued_by_job_id=1, pid=7753 2024-04-05T03:04:07.056630424Z [2024-04-05T03:04:07.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:04:07.056810531Z [2024-04-05T03:04:07.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:03:00+00:00, run_id=scheduled__2024-04-05T03:03:00+00:00, run_start_date=2024-04-05 03:04:01.128276+00:00, run_end_date=2024-04-05 03:04:07.056537+00:00, run_duration=5.928261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:03:00+00:00, data_interval_end=2024-04-05 03:04:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:04:07.066473907Z [2024-04-05T03:04:07.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:04:00+00:00, run_after=2024-04-05T03:05:00+00:00 2024-04-05T03:04:07.073866422Z [2024-04-05T03:04:07.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:04:07.074080839Z [2024-04-05T03:04:07.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:03:00+00:00, run_id=scheduled__2024-04-05T03:03:00+00:00, run_start_date=2024-04-05 03:04:01.126707+00:00, run_end_date=2024-04-05 03:04:07.073776+00:00, run_duration=5.947069, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:03:00+00:00, data_interval_end=2024-04-05 03:04:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:04:07.084917950Z [2024-04-05T03:04:07.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:04:00+00:00, run_after=2024-04-05T03:05:00+00:00 2024-04-05T03:04:07.129015354Z [2024-04-05T03:04:07.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:03:00+00:00 exited with status success for try_number 1 2024-04-05T03:04:07.129145082Z [2024-04-05T03:04:07.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:03:00+00:00 exited with status success for try_number 1 2024-04-05T03:04:07.138354535Z [2024-04-05T03:04:07.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:03:00+00:00, map_index=-1, run_start_date=2024-04-05 03:04:04.037664+00:00, run_end_date=2024-04-05 03:04:06.556875+00:00, run_duration=2.519211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:04:01.193766+00:00, queued_by_job_id=1, pid=7783 2024-04-05T03:04:07.138720425Z [2024-04-05T03:04:07.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:03:00+00:00, map_index=-1, run_start_date=2024-04-05 03:04:04.028982+00:00, run_end_date=2024-04-05 03:04:06.361900+00:00, run_duration=2.332918, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:04:01.193766+00:00, queued_by_job_id=1, pid=7782 2024-04-05T03:05:00.606431543Z [2024-04-05T03:05:00.605+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:05:00.627298357Z [2024-04-05T03:05:00.626+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:05:00+00:00, run_after=2024-04-05T03:06:00+00:00 2024-04-05T03:05:00.640804065Z [2024-04-05T03:05:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:05:00+00:00, run_after=2024-04-05T03:10:00+00:00 2024-04-05T03:05:00.838896011Z [2024-04-05T03:05:00.838+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:05:00.838925934Z 2024-04-05T03:05:00.838930681Z 2024-04-05T03:05:00.838934259Z 2024-04-05T03:05:00.839237087Z [2024-04-05T03:05:00.838+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:05:00.839555476Z [2024-04-05T03:05:00.839+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:05:00.839936643Z [2024-04-05T03:05:00.839+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:05:00.840657765Z [2024-04-05T03:05:00.840+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:05:00.840669624Z 2024-04-05T03:05:00.840674305Z 2024-04-05T03:05:00.840677774Z 2024-04-05T03:05:00.844757575Z [2024-04-05T03:05:00.844+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:05:00.845010977Z [2024-04-05T03:05:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:05:00.845300434Z [2024-04-05T03:05:00.845+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:05:00.845423419Z [2024-04-05T03:05:00.845+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:05:00.845689557Z [2024-04-05T03:05:00.845+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:05:00.846049679Z [2024-04-05T03:05:00.845+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:05:01.174332883Z [2024-04-05T03:05:01.173+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status queued for try_number 1 2024-04-05T03:05:01.174687166Z [2024-04-05T03:05:01.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:04:00+00:00 exited with status queued for try_number 1 2024-04-05T03:05:01.174830945Z [2024-04-05T03:05:01.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:04:00+00:00 exited with status queued for try_number 1 2024-04-05T03:05:01.185433509Z [2024-04-05T03:05:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e56b255-df53-4bbf-a18c-a6c269d92e20 2024-04-05T03:05:01.185701961Z [2024-04-05T03:05:01.185+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3ce375d-af6e-4d2f-8dfc-1b94596df07e 2024-04-05T03:05:01.186386641Z [2024-04-05T03:05:01.186+0000] {scheduler_job.py:635} INFO - Setting external_id for to 326360a0-3221-4fd2-8fac-97e7c751bddf 2024-04-05T03:05:06.352290639Z [2024-04-05T03:05:06.351+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:05:06.352327393Z 2024-04-05T03:05:06.352688122Z [2024-04-05T03:05:06.352+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:05:06.355216645Z [2024-04-05T03:05:06.354+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:05:06.355235156Z 2024-04-05T03:05:06.359077153Z [2024-04-05T03:05:06.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:05:06.359389897Z [2024-04-05T03:05:06.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:05:06.446890153Z [2024-04-05T03:05:06.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status queued for try_number 1 2024-04-05T03:05:06.457188290Z [2024-04-05T03:05:06.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9841e23d-b60b-4208-9ef9-9046a02a5e4a 2024-04-05T03:05:06.641868208Z [2024-04-05T03:05:06.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status success for try_number 1 2024-04-05T03:05:06.649211800Z [2024-04-05T03:05:06.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:00:00+00:00, map_index=-1, run_start_date=2024-04-05 03:05:05.387151+00:00, run_end_date=2024-04-05 03:05:06.185029+00:00, run_duration=0.797878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:05:00.841744+00:00, queued_by_job_id=1, pid=7868 2024-04-05T03:05:07.617305695Z [2024-04-05T03:05:07.616+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:05:07.626592498Z [2024-04-05T03:05:07.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:04:00+00:00, run_id=scheduled__2024-04-05T03:04:00+00:00, run_start_date=2024-04-05 03:05:00.679028+00:00, run_end_date=2024-04-05 03:05:07.617176+00:00, run_duration=6.938148, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:04:00+00:00, data_interval_end=2024-04-05 03:05:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:05:07.646515555Z [2024-04-05T03:05:07.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:05:00+00:00, run_after=2024-04-05T03:06:00+00:00 2024-04-05T03:05:07.656823504Z [2024-04-05T03:05:07.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:05:07.658355028Z [2024-04-05T03:05:07.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:04:00+00:00, run_id=scheduled__2024-04-05T03:04:00+00:00, run_start_date=2024-04-05 03:05:00.671580+00:00, run_end_date=2024-04-05 03:05:07.656700+00:00, run_duration=6.98512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:04:00+00:00, data_interval_end=2024-04-05 03:05:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:05:07.681002553Z [2024-04-05T03:05:07.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:05:00+00:00, run_after=2024-04-05T03:06:00+00:00 2024-04-05T03:05:07.738151688Z [2024-04-05T03:05:07.737+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:04:00+00:00 exited with status success for try_number 1 2024-04-05T03:05:07.738187827Z [2024-04-05T03:05:07.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:04:00+00:00 exited with status success for try_number 1 2024-04-05T03:05:07.745370223Z [2024-04-05T03:05:07.744+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:04:00+00:00, map_index=-1, run_start_date=2024-04-05 03:05:04.372082+00:00, run_end_date=2024-04-05 03:05:06.746146+00:00, run_duration=2.374064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:05:00.841744+00:00, queued_by_job_id=1, pid=7839 2024-04-05T03:05:07.745588343Z [2024-04-05T03:05:07.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:04:00+00:00, map_index=-1, run_start_date=2024-04-05 03:05:04.404586+00:00, run_end_date=2024-04-05 03:05:06.834916+00:00, run_duration=2.43033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:05:00.841744+00:00, queued_by_job_id=1, pid=7840 2024-04-05T03:05:11.586628850Z [2024-04-05T03:05:11.586+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:05:11.586656675Z 2024-04-05T03:05:11.587158888Z [2024-04-05T03:05:11.586+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:05:11.588362006Z [2024-04-05T03:05:11.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:05:11.588373725Z 2024-04-05T03:05:11.592016185Z [2024-04-05T03:05:11.591+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:05:11.592440992Z [2024-04-05T03:05:11.592+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:05:11.655859475Z [2024-04-05T03:05:11.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status queued for try_number 1 2024-04-05T03:05:11.656702839Z [2024-04-05T03:05:11.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status success for try_number 1 2024-04-05T03:05:11.667283688Z [2024-04-05T03:05:11.666+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65697086-ff5d-475b-87e0-26a03ef81a72 2024-04-05T03:05:11.667350957Z [2024-04-05T03:05:11.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:00:00+00:00, map_index=-1, run_start_date=2024-04-05 03:05:10.029193+00:00, run_end_date=2024-04-05 03:05:10.457097+00:00, run_duration=0.427904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:05:06.355851+00:00, queued_by_job_id=1, pid=7899 2024-04-05T03:05:15.144265589Z [2024-04-05T03:05:15.143+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:05:15.144347262Z 2024-04-05T03:05:15.144447172Z [2024-04-05T03:05:15.144+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:05:15.145240936Z [2024-04-05T03:05:15.144+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:05:15.145249712Z 2024-04-05T03:05:15.150085964Z [2024-04-05T03:05:15.149+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:05:15.150483534Z [2024-04-05T03:05:15.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:05:15.273716254Z [2024-04-05T03:05:15.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status queued for try_number 1 2024-04-05T03:05:15.273792640Z [2024-04-05T03:05:15.273+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status success for try_number 1 2024-04-05T03:05:15.293915563Z [2024-04-05T03:05:15.293+0000] {scheduler_job.py:635} INFO - Setting external_id for to 428db1cb-121e-4e99-9527-3c7e19911c3a 2024-04-05T03:05:15.294107396Z [2024-04-05T03:05:15.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:00:00+00:00, map_index=0, run_start_date=2024-04-05 03:05:14.125293+00:00, run_end_date=2024-04-05 03:05:14.515100+00:00, run_duration=0.389807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:05:11.589039+00:00, queued_by_job_id=1, pid=7914 2024-04-05T03:05:17.803684945Z [2024-04-05T03:05:17.803+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:05:17.804086003Z [2024-04-05T03:05:17.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:00:00+00:00, run_id=scheduled__2024-04-05T03:00:00+00:00, run_start_date=2024-04-05 03:05:00.670274+00:00, run_end_date=2024-04-05 03:05:17.803555+00:00, run_duration=17.133281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:00:00+00:00, data_interval_end=2024-04-05 03:05:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:05:17.813947718Z [2024-04-05T03:05:17.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:05:00+00:00, run_after=2024-04-05T03:10:00+00:00 2024-04-05T03:05:17.861834805Z [2024-04-05T03:05:17.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:00:00+00:00 exited with status success for try_number 1 2024-04-05T03:05:17.872502770Z [2024-04-05T03:05:17.871+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:00:00+00:00, map_index=-1, run_start_date=2024-04-05 03:05:17.105455+00:00, run_end_date=2024-04-05 03:05:17.473046+00:00, run_duration=0.367591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:05:15.145685+00:00, queued_by_job_id=1, pid=7926 2024-04-05T03:06:00.210327931Z [2024-04-05T03:06:00.209+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:06:00.224763764Z [2024-04-05T03:06:00.224+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:06:00+00:00, run_after=2024-04-05T03:07:00+00:00 2024-04-05T03:06:00.234983675Z [2024-04-05T03:06:00.234+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:06:00.311007771Z [2024-04-05T03:06:00.310+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:06:00.311050799Z 2024-04-05T03:06:00.311056799Z 2024-04-05T03:06:00.311061761Z 2024-04-05T03:06:00.311076175Z [2024-04-05T03:06:00.310+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:06:00.311219146Z [2024-04-05T03:06:00.311+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:06:00.311387330Z [2024-04-05T03:06:00.311+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:06:00.311938123Z [2024-04-05T03:06:00.311+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:06:00.311954195Z 2024-04-05T03:06:00.311960233Z 2024-04-05T03:06:00.311965469Z 2024-04-05T03:06:00.315418779Z [2024-04-05T03:06:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:06:00.315535818Z [2024-04-05T03:06:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:06:00.315546267Z [2024-04-05T03:06:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:06:00.315551276Z [2024-04-05T03:06:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:06:00.315567152Z [2024-04-05T03:06:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:06:00.315585066Z [2024-04-05T03:06:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:06:00.536395486Z [2024-04-05T03:06:00.535+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:04:00+00:00 exited with status queued for try_number 1 2024-04-05T03:06:00.536518660Z [2024-04-05T03:06:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status queued for try_number 1 2024-04-05T03:06:00.536650728Z [2024-04-05T03:06:00.536+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status queued for try_number 1 2024-04-05T03:06:00.548392472Z [2024-04-05T03:06:00.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to feb2b090-6f87-4ba7-a5e9-f281efc68194 2024-04-05T03:06:00.548560951Z [2024-04-05T03:06:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to decf3704-d39e-4fe5-9b1b-4a0416ac013b 2024-04-05T03:06:00.548805259Z [2024-04-05T03:06:00.548+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34de4328-77a3-41dd-aaef-f8466a26e8c4 2024-04-05T03:06:02.436907569Z [2024-04-05T03:06:02.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:06:02.444459959Z [2024-04-05T03:06:02.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:04:00+00:00, run_id=scheduled__2024-04-05T03:04:00+00:00, run_start_date=2024-04-05 03:06:00.245399+00:00, run_end_date=2024-04-05 03:06:02.436435+00:00, run_duration=2.191036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:04:00+00:00, data_interval_end=2024-04-05 03:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:06:02.470101844Z [2024-04-05T03:06:02.467+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:06:00+00:00, run_after=2024-04-05T03:08:00+00:00 2024-04-05T03:06:02.576046908Z [2024-04-05T03:06:02.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:04:00+00:00 exited with status success for try_number 1 2024-04-05T03:06:02.586648275Z [2024-04-05T03:06:02.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:04:00+00:00, map_index=-1, run_start_date=2024-04-05 03:06:01.682965+00:00, run_end_date=2024-04-05 03:06:02.189590+00:00, run_duration=0.506625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:06:00.312543+00:00, queued_by_job_id=1, pid=7931 2024-04-05T03:06:05.987145793Z [2024-04-05T03:06:05.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:06:05.987290309Z [2024-04-05T03:06:05.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:05:00+00:00, run_id=scheduled__2024-04-05T03:05:00+00:00, run_start_date=2024-04-05 03:06:00.249235+00:00, run_end_date=2024-04-05 03:06:05.987039+00:00, run_duration=5.737804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:05:00+00:00, data_interval_end=2024-04-05 03:06:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:06:05.997827562Z [2024-04-05T03:06:05.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:06:00+00:00, run_after=2024-04-05T03:07:00+00:00 2024-04-05T03:06:06.035275767Z [2024-04-05T03:06:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status success for try_number 1 2024-04-05T03:06:06.040164737Z [2024-04-05T03:06:06.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:05:00+00:00, map_index=-1, run_start_date=2024-04-05 03:06:02.598203+00:00, run_end_date=2024-04-05 03:06:04.931865+00:00, run_duration=2.333662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:06:00.312543+00:00, queued_by_job_id=1, pid=7950 2024-04-05T03:06:09.272085874Z [2024-04-05T03:06:09.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:06:09.272267478Z [2024-04-05T03:06:09.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:05:00+00:00, run_id=scheduled__2024-04-05T03:05:00+00:00, run_start_date=2024-04-05 03:06:00.247368+00:00, run_end_date=2024-04-05 03:06:09.271929+00:00, run_duration=9.024561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:05:00+00:00, data_interval_end=2024-04-05 03:06:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:06:09.281033698Z [2024-04-05T03:06:09.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:06:00+00:00, run_after=2024-04-05T03:07:00+00:00 2024-04-05T03:06:09.316058645Z [2024-04-05T03:06:09.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status success for try_number 1 2024-04-05T03:06:09.323477485Z [2024-04-05T03:06:09.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:05:00+00:00, map_index=-1, run_start_date=2024-04-05 03:06:04.292785+00:00, run_end_date=2024-04-05 03:06:08.540999+00:00, run_duration=4.248214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:06:00.312543+00:00, queued_by_job_id=1, pid=7970 2024-04-05T03:06:44.314173647Z [2024-04-05T03:06:44.313+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:07:00.619819717Z [2024-04-05T03:07:00.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:07:00+00:00, run_after=2024-04-05T03:08:00+00:00 2024-04-05T03:07:00.627815626Z [2024-04-05T03:07:00.627+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:07:00.679718755Z [2024-04-05T03:07:00.679+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:07:00.679748868Z 2024-04-05T03:07:00.679752838Z 2024-04-05T03:07:00.680005587Z [2024-04-05T03:07:00.679+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:07:00.680218715Z [2024-04-05T03:07:00.680+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:07:00.680853648Z [2024-04-05T03:07:00.680+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:07:00.680865883Z 2024-04-05T03:07:00.680869851Z 2024-04-05T03:07:00.684230949Z [2024-04-05T03:07:00.683+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:07:00.684401286Z [2024-04-05T03:07:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:07:00.684633501Z [2024-04-05T03:07:00.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:07:00.684720850Z [2024-04-05T03:07:00.684+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:07:00.909992928Z [2024-04-05T03:07:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:06:00+00:00 exited with status queued for try_number 1 2024-04-05T03:07:00.910025549Z [2024-04-05T03:07:00.909+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:06:00+00:00 exited with status queued for try_number 1 2024-04-05T03:07:00.918584689Z [2024-04-05T03:07:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6066805b-1248-437a-aeeb-dc3c831065da 2024-04-05T03:07:00.918645996Z [2024-04-05T03:07:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0176c03-1b4e-4aac-b5c3-ffa6e148b8e8 2024-04-05T03:07:06.199821125Z [2024-04-05T03:07:06.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:07:06.200219364Z [2024-04-05T03:07:06.199+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:06:00+00:00, run_id=scheduled__2024-04-05T03:06:00+00:00, run_start_date=2024-04-05 03:07:00.638570+00:00, run_end_date=2024-04-05 03:07:06.199762+00:00, run_duration=5.561192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:06:00+00:00, data_interval_end=2024-04-05 03:07:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:07:06.211920460Z [2024-04-05T03:07:06.211+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:07:00+00:00, run_after=2024-04-05T03:08:00+00:00 2024-04-05T03:07:06.225064701Z [2024-04-05T03:07:06.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:07:06.227069344Z [2024-04-05T03:07:06.225+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:06:00+00:00, run_id=scheduled__2024-04-05T03:06:00+00:00, run_start_date=2024-04-05 03:07:00.639826+00:00, run_end_date=2024-04-05 03:07:06.225014+00:00, run_duration=5.585188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:06:00+00:00, data_interval_end=2024-04-05 03:07:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:07:06.252180105Z [2024-04-05T03:07:06.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:07:00+00:00, run_after=2024-04-05T03:08:00+00:00 2024-04-05T03:07:06.335562629Z [2024-04-05T03:07:06.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:06:00+00:00 exited with status success for try_number 1 2024-04-05T03:07:06.343473210Z [2024-04-05T03:07:06.342+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:06:00+00:00, map_index=-1, run_start_date=2024-04-05 03:07:02.946574+00:00, run_end_date=2024-04-05 03:07:05.312155+00:00, run_duration=2.365581, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:07:00.681473+00:00, queued_by_job_id=1, pid=8015 2024-04-05T03:07:07.412830946Z [2024-04-05T03:07:07.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:06:00+00:00 exited with status success for try_number 1 2024-04-05T03:07:07.420605649Z [2024-04-05T03:07:07.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:06:00+00:00, map_index=-1, run_start_date=2024-04-05 03:07:03.225199+00:00, run_end_date=2024-04-05 03:07:06.155926+00:00, run_duration=2.930727, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:07:00.681473+00:00, queued_by_job_id=1, pid=8016 2024-04-05T03:08:00.686138463Z [2024-04-05T03:08:00.685+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:08:00.705744897Z [2024-04-05T03:08:00.705+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:08:00+00:00, run_after=2024-04-05T03:09:00+00:00 2024-04-05T03:08:00.733512883Z [2024-04-05T03:08:00.733+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:08:00.829243440Z [2024-04-05T03:08:00.828+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:08:00.829273461Z 2024-04-05T03:08:00.829280427Z 2024-04-05T03:08:00.829284259Z 2024-04-05T03:08:00.829530123Z [2024-04-05T03:08:00.829+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:08:00.829726744Z [2024-04-05T03:08:00.829+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:08:00.829925276Z [2024-04-05T03:08:00.829+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:08:00.830603762Z [2024-04-05T03:08:00.830+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:08:00.830620157Z 2024-04-05T03:08:00.830626000Z 2024-04-05T03:08:00.830650808Z 2024-04-05T03:08:00.833902561Z [2024-04-05T03:08:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:08:00.834258502Z [2024-04-05T03:08:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:08:00.834724496Z [2024-04-05T03:08:00.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:08:00.834929419Z [2024-04-05T03:08:00.834+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:08:00.835737412Z [2024-04-05T03:08:00.835+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:08:00.835750892Z [2024-04-05T03:08:00.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:08:01.089944546Z [2024-04-05T03:08:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:06:00+00:00 exited with status queued for try_number 1 2024-04-05T03:08:01.090094233Z [2024-04-05T03:08:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:07:00+00:00 exited with status queued for try_number 1 2024-04-05T03:08:01.090292664Z [2024-04-05T03:08:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:07:00+00:00 exited with status queued for try_number 1 2024-04-05T03:08:01.103259817Z [2024-04-05T03:08:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to 722f5c09-1153-4cb5-a279-0126e81faf29 2024-04-05T03:08:01.103426268Z [2024-04-05T03:08:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b667739-10c2-4905-9467-6194dd9d6efd 2024-04-05T03:08:01.103685695Z [2024-04-05T03:08:01.103+0000] {scheduler_job.py:635} INFO - Setting external_id for to d133a2d1-6c84-4574-b442-d5fd6d5e37e0 2024-04-05T03:08:02.261034078Z [2024-04-05T03:08:02.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:08:02.261433845Z [2024-04-05T03:08:02.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:06:00+00:00, run_id=scheduled__2024-04-05T03:06:00+00:00, run_start_date=2024-04-05 03:08:00.771093+00:00, run_end_date=2024-04-05 03:08:02.260956+00:00, run_duration=1.489863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:06:00+00:00, data_interval_end=2024-04-05 03:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:08:02.274075188Z [2024-04-05T03:08:02.270+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:08:00+00:00, run_after=2024-04-05T03:10:00+00:00 2024-04-05T03:08:02.465829595Z [2024-04-05T03:08:02.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:06:00+00:00 exited with status success for try_number 1 2024-04-05T03:08:02.479914781Z [2024-04-05T03:08:02.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:06:00+00:00, map_index=-1, run_start_date=2024-04-05 03:08:01.677122+00:00, run_end_date=2024-04-05 03:08:02.189192+00:00, run_duration=0.51207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:08:00.831362+00:00, queued_by_job_id=1, pid=8051 2024-04-05T03:08:07.143180997Z [2024-04-05T03:08:07.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:08:07.143596523Z [2024-04-05T03:08:07.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:07:00+00:00, run_id=scheduled__2024-04-05T03:07:00+00:00, run_start_date=2024-04-05 03:08:00.774963+00:00, run_end_date=2024-04-05 03:08:07.143286+00:00, run_duration=6.368323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:07:00+00:00, data_interval_end=2024-04-05 03:08:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:08:07.154580258Z [2024-04-05T03:08:07.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:08:00+00:00, run_after=2024-04-05T03:09:00+00:00 2024-04-05T03:08:07.162688973Z [2024-04-05T03:08:07.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:08:07.163056221Z [2024-04-05T03:08:07.162+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:07:00+00:00, run_id=scheduled__2024-04-05T03:07:00+00:00, run_start_date=2024-04-05 03:08:00.773377+00:00, run_end_date=2024-04-05 03:08:07.162749+00:00, run_duration=6.389372, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:07:00+00:00, data_interval_end=2024-04-05 03:08:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:08:07.180600512Z [2024-04-05T03:08:07.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:08:00+00:00, run_after=2024-04-05T03:09:00+00:00 2024-04-05T03:08:07.237518796Z [2024-04-05T03:08:07.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:07:00+00:00 exited with status success for try_number 1 2024-04-05T03:08:07.237872230Z [2024-04-05T03:08:07.237+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:07:00+00:00 exited with status success for try_number 1 2024-04-05T03:08:07.253117145Z [2024-04-05T03:08:07.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:07:00+00:00, map_index=-1, run_start_date=2024-04-05 03:08:03.981473+00:00, run_end_date=2024-04-05 03:08:06.115306+00:00, run_duration=2.133833, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:08:00.831362+00:00, queued_by_job_id=1, pid=8081 2024-04-05T03:08:07.253742291Z [2024-04-05T03:08:07.253+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:07:00+00:00, map_index=-1, run_start_date=2024-04-05 03:08:04.260935+00:00, run_end_date=2024-04-05 03:08:06.448693+00:00, run_duration=2.187758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:08:00.831362+00:00, queued_by_job_id=1, pid=8082 2024-04-05T03:09:00.312040837Z [2024-04-05T03:09:00.311+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:09:00.327270452Z [2024-04-05T03:09:00.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:09:00+00:00, run_after=2024-04-05T03:10:00+00:00 2024-04-05T03:09:00.387778446Z [2024-04-05T03:09:00.387+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:09:00.387811025Z 2024-04-05T03:09:00.387816402Z 2024-04-05T03:09:00.388028129Z [2024-04-05T03:09:00.387+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:09:00.388250198Z [2024-04-05T03:09:00.388+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:09:00.389510198Z [2024-04-05T03:09:00.389+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:09:00.389520803Z 2024-04-05T03:09:00.389524629Z 2024-04-05T03:09:00.394330068Z [2024-04-05T03:09:00.393+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:09:00.394458372Z [2024-04-05T03:09:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:09:00.395018741Z [2024-04-05T03:09:00.394+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:09:00.395241547Z [2024-04-05T03:09:00.394+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:09:00.571100958Z [2024-04-05T03:09:00.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:08:00+00:00 exited with status queued for try_number 1 2024-04-05T03:09:00.571319226Z [2024-04-05T03:09:00.571+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:08:00+00:00 exited with status queued for try_number 1 2024-04-05T03:09:00.580742147Z [2024-04-05T03:09:00.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to c702609d-fd44-4ab6-ae06-b45abdfa4ddf 2024-04-05T03:09:00.586109156Z [2024-04-05T03:09:00.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to c925f9b7-2cf2-4f03-8724-4c0b66068eff 2024-04-05T03:09:05.137857213Z [2024-04-05T03:09:05.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:09:05.138944503Z [2024-04-05T03:09:05.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:08:00+00:00, run_id=scheduled__2024-04-05T03:08:00+00:00, run_start_date=2024-04-05 03:09:00.342032+00:00, run_end_date=2024-04-05 03:09:05.138331+00:00, run_duration=4.796299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:08:00+00:00, data_interval_end=2024-04-05 03:09:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:09:05.157380844Z [2024-04-05T03:09:05.156+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:09:00+00:00, run_after=2024-04-05T03:10:00+00:00 2024-04-05T03:09:05.170632172Z [2024-04-05T03:09:05.170+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:09:05.171218397Z [2024-04-05T03:09:05.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:08:00+00:00, run_id=scheduled__2024-04-05T03:08:00+00:00, run_start_date=2024-04-05 03:09:00.340665+00:00, run_end_date=2024-04-05 03:09:05.170696+00:00, run_duration=4.830031, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:08:00+00:00, data_interval_end=2024-04-05 03:09:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:09:05.192238125Z [2024-04-05T03:09:05.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:09:00+00:00, run_after=2024-04-05T03:10:00+00:00 2024-04-05T03:09:05.229376016Z [2024-04-05T03:09:05.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:08:00+00:00 exited with status success for try_number 1 2024-04-05T03:09:05.229522063Z [2024-04-05T03:09:05.229+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:08:00+00:00 exited with status success for try_number 1 2024-04-05T03:09:05.241853297Z [2024-04-05T03:09:05.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:08:00+00:00, map_index=-1, run_start_date=2024-04-05 03:09:02.445688+00:00, run_end_date=2024-04-05 03:09:04.459459+00:00, run_duration=2.013771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:09:00.390510+00:00, queued_by_job_id=1, pid=8138 2024-04-05T03:09:05.244180662Z [2024-04-05T03:09:05.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:08:00+00:00, map_index=-1, run_start_date=2024-04-05 03:09:02.350793+00:00, run_end_date=2024-04-05 03:09:04.252003+00:00, run_duration=1.90121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:09:00.390510+00:00, queued_by_job_id=1, pid=8137 2024-04-05T03:10:00.625088015Z [2024-04-05T03:10:00.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:10:00+00:00, run_after=2024-04-05T03:15:00+00:00 2024-04-05T03:10:00.644290472Z [2024-04-05T03:10:00.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:10:00+00:00, run_after=2024-04-05T03:11:00+00:00 2024-04-05T03:10:00.653325897Z [2024-04-05T03:10:00.652+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:10:00.660137402Z [2024-04-05T03:10:00.659+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:10:00.789757035Z [2024-04-05T03:10:00.789+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T03:10:00.789790633Z 2024-04-05T03:10:00.789796557Z 2024-04-05T03:10:00.789802369Z 2024-04-05T03:10:00.789807314Z 2024-04-05T03:10:00.791038067Z [2024-04-05T03:10:00.790+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:10:00.791242107Z [2024-04-05T03:10:00.790+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:10:00.791509477Z [2024-04-05T03:10:00.791+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:10:00.791758216Z [2024-04-05T03:10:00.791+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:10:00.792914279Z [2024-04-05T03:10:00.792+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:10:00.792931861Z 2024-04-05T03:10:00.792938597Z 2024-04-05T03:10:00.792945302Z 2024-04-05T03:10:00.792951176Z 2024-04-05T03:10:00.798671031Z [2024-04-05T03:10:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:10:00.798875779Z [2024-04-05T03:10:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:10:00.799211888Z [2024-04-05T03:10:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:10:00.799389146Z [2024-04-05T03:10:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:10:00.799755288Z [2024-04-05T03:10:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:10:00.800023137Z [2024-04-05T03:10:00.799+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:10:00.801299015Z [2024-04-05T03:10:00.800+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:10:00.801313198Z [2024-04-05T03:10:00.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:10:01.105264272Z [2024-04-05T03:10:01.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status queued for try_number 1 2024-04-05T03:10:01.105554560Z [2024-04-05T03:10:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:08:00+00:00 exited with status queued for try_number 1 2024-04-05T03:10:01.105720984Z [2024-04-05T03:10:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:09:00+00:00 exited with status queued for try_number 1 2024-04-05T03:10:01.105897277Z [2024-04-05T03:10:01.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:09:00+00:00 exited with status queued for try_number 1 2024-04-05T03:10:01.117998421Z [2024-04-05T03:10:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to b1de3562-a1f5-4e20-8f7a-3b369c221127 2024-04-05T03:10:01.118273238Z [2024-04-05T03:10:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 452e1a8f-6858-4ca0-87f9-9db8e8fee6fa 2024-04-05T03:10:01.118510041Z [2024-04-05T03:10:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 623a9d35-4814-4469-9d85-57a26c93571a 2024-04-05T03:10:01.118811043Z [2024-04-05T03:10:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to afebcaf5-4daa-4502-b4d6-2be7ad977fbe 2024-04-05T03:10:02.693937909Z [2024-04-05T03:10:02.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:10:02.694148955Z [2024-04-05T03:10:02.693+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:08:00+00:00, run_id=scheduled__2024-04-05T03:08:00+00:00, run_start_date=2024-04-05 03:10:00.673951+00:00, run_end_date=2024-04-05 03:10:02.693828+00:00, run_duration=2.019877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:08:00+00:00, data_interval_end=2024-04-05 03:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:10:02.706132280Z [2024-04-05T03:10:02.705+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:10:00+00:00, run_after=2024-04-05T03:12:00+00:00 2024-04-05T03:10:02.846945395Z [2024-04-05T03:10:02.846+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:08:00+00:00 exited with status success for try_number 1 2024-04-05T03:10:02.863898432Z [2024-04-05T03:10:02.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:08:00+00:00, map_index=-1, run_start_date=2024-04-05 03:10:01.757737+00:00, run_end_date=2024-04-05 03:10:02.161579+00:00, run_duration=0.403842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:10:00.793892+00:00, queued_by_job_id=1, pid=8175 2024-04-05T03:10:05.133465586Z [2024-04-05T03:10:05.133+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:10:05.133506645Z 2024-04-05T03:10:05.133553156Z [2024-04-05T03:10:05.133+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:10:05.134337315Z [2024-04-05T03:10:05.134+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:10:05.134361785Z 2024-04-05T03:10:05.137345993Z [2024-04-05T03:10:05.137+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:10:05.137376354Z [2024-04-05T03:10:05.137+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:10:05.217823206Z [2024-04-05T03:10:05.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status queued for try_number 1 2024-04-05T03:10:05.217861800Z [2024-04-05T03:10:05.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status success for try_number 1 2024-04-05T03:10:05.224918193Z [2024-04-05T03:10:05.224+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20ce42de-3a54-4e5f-98d8-950c4c3a7be0 2024-04-05T03:10:05.225029332Z [2024-04-05T03:10:05.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:05:00+00:00, map_index=-1, run_start_date=2024-04-05 03:10:03.967563+00:00, run_end_date=2024-04-05 03:10:04.690011+00:00, run_duration=0.722448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:10:00.793892+00:00, queued_by_job_id=1, pid=8217 2024-04-05T03:10:06.598412066Z [2024-04-05T03:10:06.593+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:10:06.599137177Z [2024-04-05T03:10:06.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:09:00+00:00, run_id=scheduled__2024-04-05T03:09:00+00:00, run_start_date=2024-04-05 03:10:00.677248+00:00, run_end_date=2024-04-05 03:10:06.598495+00:00, run_duration=5.921247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:09:00+00:00, data_interval_end=2024-04-05 03:10:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:10:06.649678288Z [2024-04-05T03:10:06.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:10:00+00:00, run_after=2024-04-05T03:11:00+00:00 2024-04-05T03:10:06.665228047Z [2024-04-05T03:10:06.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:10:06.666836256Z [2024-04-05T03:10:06.666+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:09:00+00:00, run_id=scheduled__2024-04-05T03:09:00+00:00, run_start_date=2024-04-05 03:10:00.675537+00:00, run_end_date=2024-04-05 03:10:06.666184+00:00, run_duration=5.990647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:09:00+00:00, data_interval_end=2024-04-05 03:10:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:10:06.686448383Z [2024-04-05T03:10:06.686+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:10:00+00:00, run_after=2024-04-05T03:11:00+00:00 2024-04-05T03:10:06.755007805Z [2024-04-05T03:10:06.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:09:00+00:00 exited with status success for try_number 1 2024-04-05T03:10:06.755666617Z [2024-04-05T03:10:06.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:09:00+00:00 exited with status success for try_number 1 2024-04-05T03:10:06.764844245Z [2024-04-05T03:10:06.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:09:00+00:00, map_index=-1, run_start_date=2024-04-05 03:10:04.029028+00:00, run_end_date=2024-04-05 03:10:06.193017+00:00, run_duration=2.163989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:10:00.793892+00:00, queued_by_job_id=1, pid=8216 2024-04-05T03:10:06.765320370Z [2024-04-05T03:10:06.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:09:00+00:00, map_index=-1, run_start_date=2024-04-05 03:10:03.900606+00:00, run_end_date=2024-04-05 03:10:05.603254+00:00, run_duration=1.702648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:10:00.793892+00:00, queued_by_job_id=1, pid=8215 2024-04-05T03:10:09.022775178Z [2024-04-05T03:10:09.022+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:10:09.022808122Z 2024-04-05T03:10:09.022996183Z [2024-04-05T03:10:09.022+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:10:09.023808162Z [2024-04-05T03:10:09.023+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:10:09.023825244Z 2024-04-05T03:10:09.031749374Z [2024-04-05T03:10:09.031+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:10:09.031970038Z [2024-04-05T03:10:09.031+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:10:09.092689840Z [2024-04-05T03:10:09.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status queued for try_number 1 2024-04-05T03:10:09.093117731Z [2024-04-05T03:10:09.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status success for try_number 1 2024-04-05T03:10:09.101251556Z [2024-04-05T03:10:09.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a19e907-6590-4bf4-ac32-b2257712dcc7 2024-04-05T03:10:09.101680944Z [2024-04-05T03:10:09.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:05:00+00:00, map_index=-1, run_start_date=2024-04-05 03:10:07.732707+00:00, run_end_date=2024-04-05 03:10:08.144639+00:00, run_duration=0.411932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:10:05.134714+00:00, queued_by_job_id=1, pid=8256 2024-04-05T03:10:12.939222236Z [2024-04-05T03:10:12.938+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:10:12.939264015Z 2024-04-05T03:10:12.939277313Z [2024-04-05T03:10:12.939+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:10:12.939995700Z [2024-04-05T03:10:12.939+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:10:12.940028446Z 2024-04-05T03:10:12.942863658Z [2024-04-05T03:10:12.942+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:10:12.942922946Z [2024-04-05T03:10:12.942+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:10:13.059437689Z [2024-04-05T03:10:13.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status queued for try_number 1 2024-04-05T03:10:13.059510505Z [2024-04-05T03:10:13.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status success for try_number 1 2024-04-05T03:10:13.071857076Z [2024-04-05T03:10:13.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89dcba10-b44b-4ae9-93a9-2d6c9a486dc5 2024-04-05T03:10:13.072070460Z [2024-04-05T03:10:13.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:05:00+00:00, map_index=0, run_start_date=2024-04-05 03:10:10.891149+00:00, run_end_date=2024-04-05 03:10:12.493088+00:00, run_duration=1.601939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:10:09.024237+00:00, queued_by_job_id=1, pid=8278 2024-04-05T03:10:15.393877657Z [2024-04-05T03:10:15.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:10:15.394195117Z [2024-04-05T03:10:15.393+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:05:00+00:00, run_id=scheduled__2024-04-05T03:05:00+00:00, run_start_date=2024-04-05 03:10:00.672016+00:00, run_end_date=2024-04-05 03:10:15.393831+00:00, run_duration=14.721815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:05:00+00:00, data_interval_end=2024-04-05 03:10:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:10:15.401522972Z [2024-04-05T03:10:15.401+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:10:00+00:00, run_after=2024-04-05T03:15:00+00:00 2024-04-05T03:10:15.438981220Z [2024-04-05T03:10:15.438+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:05:00+00:00 exited with status success for try_number 1 2024-04-05T03:10:15.450466997Z [2024-04-05T03:10:15.450+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:05:00+00:00, map_index=-1, run_start_date=2024-04-05 03:10:14.818907+00:00, run_end_date=2024-04-05 03:10:15.198217+00:00, run_duration=0.37931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:10:12.940268+00:00, queued_by_job_id=1, pid=8302 2024-04-05T03:11:01.013722999Z [2024-04-05T03:11:01.013+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:11:01.037778304Z [2024-04-05T03:11:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:11:00+00:00, run_after=2024-04-05T03:12:00+00:00 2024-04-05T03:11:01.105182785Z [2024-04-05T03:11:01.104+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:11:01.105213443Z 2024-04-05T03:11:01.105218618Z 2024-04-05T03:11:01.105250182Z [2024-04-05T03:11:01.105+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:11:01.105316837Z [2024-04-05T03:11:01.105+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:11:01.106193189Z [2024-04-05T03:11:01.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:11:01.106207601Z 2024-04-05T03:11:01.106212038Z 2024-04-05T03:11:01.110178483Z [2024-04-05T03:11:01.109+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:11:01.110362298Z [2024-04-05T03:11:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:11:01.110664041Z [2024-04-05T03:11:01.110+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:11:01.110767515Z [2024-04-05T03:11:01.110+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:11:01.294507876Z [2024-04-05T03:11:01.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status queued for try_number 1 2024-04-05T03:11:01.298521916Z [2024-04-05T03:11:01.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status queued for try_number 1 2024-04-05T03:11:01.320112603Z [2024-04-05T03:11:01.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to c49f6496-b543-4060-92d0-fcd9e85eb818 2024-04-05T03:11:01.320438276Z [2024-04-05T03:11:01.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to efd55c67-eef1-4c0e-b235-1140fbec8906 2024-04-05T03:11:07.727131046Z [2024-04-05T03:11:07.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:11:07.727840272Z [2024-04-05T03:11:07.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:10:00+00:00, run_id=scheduled__2024-04-05T03:10:00+00:00, run_start_date=2024-04-05 03:11:01.058089+00:00, run_end_date=2024-04-05 03:11:07.727000+00:00, run_duration=6.668911, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:10:00+00:00, data_interval_end=2024-04-05 03:11:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:11:07.739311184Z [2024-04-05T03:11:07.738+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:11:00+00:00, run_after=2024-04-05T03:12:00+00:00 2024-04-05T03:11:07.749962716Z [2024-04-05T03:11:07.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:11:07.751130480Z [2024-04-05T03:11:07.750+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:10:00+00:00, run_id=scheduled__2024-04-05T03:10:00+00:00, run_start_date=2024-04-05 03:11:01.060204+00:00, run_end_date=2024-04-05 03:11:07.749849+00:00, run_duration=6.689645, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:10:00+00:00, data_interval_end=2024-04-05 03:11:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:11:07.766336804Z [2024-04-05T03:11:07.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:11:00+00:00, run_after=2024-04-05T03:12:00+00:00 2024-04-05T03:11:07.794788746Z [2024-04-05T03:11:07.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status success for try_number 1 2024-04-05T03:11:07.795045040Z [2024-04-05T03:11:07.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status success for try_number 1 2024-04-05T03:11:07.810132634Z [2024-04-05T03:11:07.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:10:00+00:00, map_index=-1, run_start_date=2024-04-05 03:11:03.860779+00:00, run_end_date=2024-04-05 03:11:07.534615+00:00, run_duration=3.673836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:11:01.106957+00:00, queued_by_job_id=1, pid=8326 2024-04-05T03:11:07.811805363Z [2024-04-05T03:11:07.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:10:00+00:00, map_index=-1, run_start_date=2024-04-05 03:11:03.636617+00:00, run_end_date=2024-04-05 03:11:07.374880+00:00, run_duration=3.738263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:11:01.106957+00:00, queued_by_job_id=1, pid=8325 2024-04-05T03:11:44.344131803Z [2024-04-05T03:11:44.343+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:12:00.354966776Z [2024-04-05T03:12:00.353+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:12:00.367029843Z [2024-04-05T03:12:00.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:12:00+00:00, run_after=2024-04-05T03:13:00+00:00 2024-04-05T03:12:00.376893489Z [2024-04-05T03:12:00.376+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:12:00.486992989Z [2024-04-05T03:12:00.486+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:12:00.487028202Z 2024-04-05T03:12:00.487035877Z 2024-04-05T03:12:00.487041753Z 2024-04-05T03:12:00.487349823Z [2024-04-05T03:12:00.487+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:12:00.487745904Z [2024-04-05T03:12:00.487+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:12:00.487937768Z [2024-04-05T03:12:00.487+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:12:00.488878864Z [2024-04-05T03:12:00.488+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:12:00.488890884Z 2024-04-05T03:12:00.488896950Z 2024-04-05T03:12:00.488901448Z 2024-04-05T03:12:00.494517975Z [2024-04-05T03:12:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:12:00.494619640Z [2024-04-05T03:12:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:12:00.494872147Z [2024-04-05T03:12:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:12:00.494978755Z [2024-04-05T03:12:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:12:00.495416637Z [2024-04-05T03:12:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:12:00.495625346Z [2024-04-05T03:12:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:12:00.736201940Z [2024-04-05T03:12:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status queued for try_number 1 2024-04-05T03:12:00.736654016Z [2024-04-05T03:12:00.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:11:00+00:00 exited with status queued for try_number 1 2024-04-05T03:12:00.739358619Z [2024-04-05T03:12:00.736+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:11:00+00:00 exited with status queued for try_number 1 2024-04-05T03:12:00.764214834Z [2024-04-05T03:12:00.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91393acd-d79e-4647-bf15-86e852ba9b04 2024-04-05T03:12:00.764378777Z [2024-04-05T03:12:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 817bb137-987c-45e4-b6dd-b8b53d0a7515 2024-04-05T03:12:00.764478551Z [2024-04-05T03:12:00.764+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b71d0cf-7812-45ed-a8da-8ffe038d1639 2024-04-05T03:12:01.903868839Z [2024-04-05T03:12:01.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:12:01.904594747Z [2024-04-05T03:12:01.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:10:00+00:00, run_id=scheduled__2024-04-05T03:10:00+00:00, run_start_date=2024-04-05 03:12:00.388661+00:00, run_end_date=2024-04-05 03:12:01.903764+00:00, run_duration=1.515103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:10:00+00:00, data_interval_end=2024-04-05 03:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:12:01.916067223Z [2024-04-05T03:12:01.915+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:12:00+00:00, run_after=2024-04-05T03:14:00+00:00 2024-04-05T03:12:01.975446829Z [2024-04-05T03:12:01.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status success for try_number 1 2024-04-05T03:12:01.984024100Z [2024-04-05T03:12:01.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:10:00+00:00, map_index=-1, run_start_date=2024-04-05 03:12:01.212209+00:00, run_end_date=2024-04-05 03:12:01.668539+00:00, run_duration=0.45633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:12:00.490271+00:00, queued_by_job_id=1, pid=8360 2024-04-05T03:12:05.898268024Z [2024-04-05T03:12:05.897+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:12:05.898995255Z [2024-04-05T03:12:05.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:11:00+00:00, run_id=scheduled__2024-04-05T03:11:00+00:00, run_start_date=2024-04-05 03:12:00.394604+00:00, run_end_date=2024-04-05 03:12:05.898219+00:00, run_duration=5.503615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:11:00+00:00, data_interval_end=2024-04-05 03:12:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:12:05.924499220Z [2024-04-05T03:12:05.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:12:00+00:00, run_after=2024-04-05T03:13:00+00:00 2024-04-05T03:12:05.938615686Z [2024-04-05T03:12:05.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:12:05.938970701Z [2024-04-05T03:12:05.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:11:00+00:00, run_id=scheduled__2024-04-05T03:11:00+00:00, run_start_date=2024-04-05 03:12:00.391546+00:00, run_end_date=2024-04-05 03:12:05.938522+00:00, run_duration=5.546976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:11:00+00:00, data_interval_end=2024-04-05 03:12:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:12:05.953259633Z [2024-04-05T03:12:05.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:12:00+00:00, run_after=2024-04-05T03:13:00+00:00 2024-04-05T03:12:05.994407556Z [2024-04-05T03:12:05.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:11:00+00:00 exited with status success for try_number 1 2024-04-05T03:12:05.994537787Z [2024-04-05T03:12:05.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:11:00+00:00 exited with status success for try_number 1 2024-04-05T03:12:06.001760040Z [2024-04-05T03:12:06.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:11:00+00:00, map_index=-1, run_start_date=2024-04-05 03:12:02.859899+00:00, run_end_date=2024-04-05 03:12:05.058560+00:00, run_duration=2.198661, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:12:00.490271+00:00, queued_by_job_id=1, pid=8390 2024-04-05T03:12:06.002134299Z [2024-04-05T03:12:06.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:11:00+00:00, map_index=-1, run_start_date=2024-04-05 03:12:02.577895+00:00, run_end_date=2024-04-05 03:12:04.754007+00:00, run_duration=2.176112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:12:00.490271+00:00, queued_by_job_id=1, pid=8389 2024-04-05T03:13:00.530144215Z [2024-04-05T03:13:00.529+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:13:00.552445144Z [2024-04-05T03:13:00.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:13:00+00:00, run_after=2024-04-05T03:14:00+00:00 2024-04-05T03:13:00.611605372Z [2024-04-05T03:13:00.611+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:13:00.611635529Z 2024-04-05T03:13:00.611639601Z 2024-04-05T03:13:00.612180683Z [2024-04-05T03:13:00.611+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:13:00.612645119Z [2024-04-05T03:13:00.612+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:13:00.614264631Z [2024-04-05T03:13:00.613+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:13:00.614285975Z 2024-04-05T03:13:00.614293804Z 2024-04-05T03:13:00.619899440Z [2024-04-05T03:13:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:13:00.620135443Z [2024-04-05T03:13:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:13:00.620535102Z [2024-04-05T03:13:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:13:00.620732416Z [2024-04-05T03:13:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:13:00.841991584Z [2024-04-05T03:13:00.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:12:00+00:00 exited with status queued for try_number 1 2024-04-05T03:13:00.842476073Z [2024-04-05T03:13:00.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:12:00+00:00 exited with status queued for try_number 1 2024-04-05T03:13:00.852445725Z [2024-04-05T03:13:00.851+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e6b252c-db54-405b-9ac6-efcdc730055f 2024-04-05T03:13:00.852823259Z [2024-04-05T03:13:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to a257157d-1491-4da2-9028-6a2ddfd92b6a 2024-04-05T03:13:07.866901208Z [2024-04-05T03:13:07.866+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:13:07.867632113Z [2024-04-05T03:13:07.867+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:12:00+00:00, run_id=scheduled__2024-04-05T03:12:00+00:00, run_start_date=2024-04-05 03:13:00.566392+00:00, run_end_date=2024-04-05 03:13:07.866782+00:00, run_duration=7.30039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:12:00+00:00, data_interval_end=2024-04-05 03:13:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:13:07.879147912Z [2024-04-05T03:13:07.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:13:00+00:00, run_after=2024-04-05T03:14:00+00:00 2024-04-05T03:13:07.918486509Z [2024-04-05T03:13:07.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:12:00+00:00 exited with status success for try_number 1 2024-04-05T03:13:07.925155924Z [2024-04-05T03:13:07.924+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:12:00+00:00, map_index=-1, run_start_date=2024-04-05 03:13:02.828807+00:00, run_end_date=2024-04-05 03:13:06.975599+00:00, run_duration=4.146792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:13:00.615910+00:00, queued_by_job_id=1, pid=8443 2024-04-05T03:13:08.972636780Z [2024-04-05T03:13:08.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:13:08.972903381Z [2024-04-05T03:13:08.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:12:00+00:00, run_id=scheduled__2024-04-05T03:12:00+00:00, run_start_date=2024-04-05 03:13:00.567837+00:00, run_end_date=2024-04-05 03:13:08.972441+00:00, run_duration=8.404604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:12:00+00:00, data_interval_end=2024-04-05 03:13:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:13:08.983896758Z [2024-04-05T03:13:08.983+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:13:00+00:00, run_after=2024-04-05T03:14:00+00:00 2024-04-05T03:13:09.020173821Z [2024-04-05T03:13:09.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:12:00+00:00 exited with status success for try_number 1 2024-04-05T03:13:09.026032516Z [2024-04-05T03:13:09.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:12:00+00:00, map_index=-1, run_start_date=2024-04-05 03:13:03.164541+00:00, run_end_date=2024-04-05 03:13:08.380386+00:00, run_duration=5.215845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:13:00.615910+00:00, queued_by_job_id=1, pid=8445 2024-04-05T03:14:00.372561559Z [2024-04-05T03:14:00.372+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:14:00+00:00, run_after=2024-04-05T03:15:00+00:00 2024-04-05T03:14:00.379649080Z [2024-04-05T03:14:00.379+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:14:00.385713202Z [2024-04-05T03:14:00.385+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:14:00.470166980Z [2024-04-05T03:14:00.469+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:14:00.470228143Z 2024-04-05T03:14:00.470324843Z 2024-04-05T03:14:00.470352401Z 2024-04-05T03:14:00.470475881Z [2024-04-05T03:14:00.470+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:14:00.470691816Z [2024-04-05T03:14:00.470+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:14:00.470910060Z [2024-04-05T03:14:00.470+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:14:00.472174306Z [2024-04-05T03:14:00.471+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:14:00.472197433Z 2024-04-05T03:14:00.472204385Z 2024-04-05T03:14:00.472210523Z 2024-04-05T03:14:00.480332897Z [2024-04-05T03:14:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:14:00.480906902Z [2024-04-05T03:14:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:14:00.482245246Z [2024-04-05T03:14:00.481+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:14:00.483174759Z [2024-04-05T03:14:00.482+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:14:00.483978318Z [2024-04-05T03:14:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:14:00.484469898Z [2024-04-05T03:14:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:14:00.825045533Z [2024-04-05T03:14:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:12:00+00:00 exited with status queued for try_number 1 2024-04-05T03:14:00.825322266Z [2024-04-05T03:14:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:13:00+00:00 exited with status queued for try_number 1 2024-04-05T03:14:00.825554695Z [2024-04-05T03:14:00.825+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:13:00+00:00 exited with status queued for try_number 1 2024-04-05T03:14:00.833958743Z [2024-04-05T03:14:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8d94465-120c-4d55-ab9c-2899dcbe37b4 2024-04-05T03:14:00.834185106Z [2024-04-05T03:14:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8030100-98d0-4678-a1a3-4d57d9215a6f 2024-04-05T03:14:00.834419587Z [2024-04-05T03:14:00.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3be0dbb8-73d3-4b10-9656-a4df6334dbad 2024-04-05T03:14:02.767021838Z [2024-04-05T03:14:02.766+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:14:02.768615773Z [2024-04-05T03:14:02.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:12:00+00:00, run_id=scheduled__2024-04-05T03:12:00+00:00, run_start_date=2024-04-05 03:14:00.398602+00:00, run_end_date=2024-04-05 03:14:02.768152+00:00, run_duration=2.36955, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:12:00+00:00, data_interval_end=2024-04-05 03:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:14:02.799327294Z [2024-04-05T03:14:02.799+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:14:00+00:00, run_after=2024-04-05T03:16:00+00:00 2024-04-05T03:14:02.871878633Z [2024-04-05T03:14:02.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:12:00+00:00 exited with status success for try_number 1 2024-04-05T03:14:02.886343402Z [2024-04-05T03:14:02.885+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:12:00+00:00, map_index=-1, run_start_date=2024-04-05 03:14:01.306748+00:00, run_end_date=2024-04-05 03:14:01.704124+00:00, run_duration=0.397376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:14:00.474966+00:00, queued_by_job_id=1, pid=8480 2024-04-05T03:14:05.940414422Z [2024-04-05T03:14:05.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:14:05.940862688Z [2024-04-05T03:14:05.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:13:00+00:00, run_id=scheduled__2024-04-05T03:13:00+00:00, run_start_date=2024-04-05 03:14:00.399969+00:00, run_end_date=2024-04-05 03:14:05.940463+00:00, run_duration=5.540494, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:13:00+00:00, data_interval_end=2024-04-05 03:14:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:14:05.963189273Z [2024-04-05T03:14:05.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:14:00+00:00, run_after=2024-04-05T03:15:00+00:00 2024-04-05T03:14:05.993866768Z [2024-04-05T03:14:05.993+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:14:05.994357209Z [2024-04-05T03:14:05.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:13:00+00:00, run_id=scheduled__2024-04-05T03:13:00+00:00, run_start_date=2024-04-05 03:14:00.401248+00:00, run_end_date=2024-04-05 03:14:05.994031+00:00, run_duration=5.592783, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:13:00+00:00, data_interval_end=2024-04-05 03:14:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:14:06.007093651Z [2024-04-05T03:14:06.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:14:00+00:00, run_after=2024-04-05T03:15:00+00:00 2024-04-05T03:14:06.048716107Z [2024-04-05T03:14:06.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:13:00+00:00 exited with status success for try_number 1 2024-04-05T03:14:06.048930783Z [2024-04-05T03:14:06.048+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:13:00+00:00 exited with status success for try_number 1 2024-04-05T03:14:06.062949037Z [2024-04-05T03:14:06.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:13:00+00:00, map_index=-1, run_start_date=2024-04-05 03:14:02.690355+00:00, run_end_date=2024-04-05 03:14:05.067347+00:00, run_duration=2.376992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:14:00.474966+00:00, queued_by_job_id=1, pid=8510 2024-04-05T03:14:06.063249894Z [2024-04-05T03:14:06.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:13:00+00:00, map_index=-1, run_start_date=2024-04-05 03:14:02.694769+00:00, run_end_date=2024-04-05 03:14:05.323275+00:00, run_duration=2.628506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:14:00.474966+00:00, queued_by_job_id=1, pid=8511 2024-04-05T03:15:00.117888583Z [2024-04-05T03:15:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:15:00+00:00, run_after=2024-04-05T03:20:00+00:00 2024-04-05T03:15:00.133808581Z [2024-04-05T03:15:00.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:15:00+00:00, run_after=2024-04-05T03:16:00+00:00 2024-04-05T03:15:00.141128830Z [2024-04-05T03:15:00.140+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:15:00.223980856Z [2024-04-05T03:15:00.223+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:15:00.224009223Z 2024-04-05T03:15:00.224014346Z 2024-04-05T03:15:00.224018329Z 2024-04-05T03:15:00.224228950Z [2024-04-05T03:15:00.223+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:15:00.224481898Z [2024-04-05T03:15:00.224+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:15:00.224731985Z [2024-04-05T03:15:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:15:00.225511696Z [2024-04-05T03:15:00.225+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:15:00.225525648Z 2024-04-05T03:15:00.225530248Z 2024-04-05T03:15:00.225553060Z 2024-04-05T03:15:00.229868520Z [2024-04-05T03:15:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:15:00.230198214Z [2024-04-05T03:15:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:15:00.230318089Z [2024-04-05T03:15:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:15:00.230489513Z [2024-04-05T03:15:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:15:00.230802275Z [2024-04-05T03:15:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:15:00.230907400Z [2024-04-05T03:15:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:15:00.469891786Z [2024-04-05T03:15:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status queued for try_number 1 2024-04-05T03:15:00.469948785Z [2024-04-05T03:15:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:14:00+00:00 exited with status queued for try_number 1 2024-04-05T03:15:00.469953726Z [2024-04-05T03:15:00.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:14:00+00:00 exited with status queued for try_number 1 2024-04-05T03:15:00.478631917Z [2024-04-05T03:15:00.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fcbf8b0-7b89-4881-a5d9-00ff6f8a0784 2024-04-05T03:15:00.479652756Z [2024-04-05T03:15:00.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0cd14cd-bf62-4c6a-8720-9b8034ca8bfe 2024-04-05T03:15:00.479799737Z [2024-04-05T03:15:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03d37ae3-ebaa-4c0e-a379-e1bc720e0722 2024-04-05T03:15:04.538662985Z [2024-04-05T03:15:04.538+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:15:04.539103804Z [2024-04-05T03:15:04.538+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:14:00+00:00, run_id=scheduled__2024-04-05T03:14:00+00:00, run_start_date=2024-04-05 03:15:00.153142+00:00, run_end_date=2024-04-05 03:15:04.538536+00:00, run_duration=4.385394, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:14:00+00:00, data_interval_end=2024-04-05 03:15:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:15:04.550082646Z [2024-04-05T03:15:04.549+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:15:00+00:00, run_after=2024-04-05T03:16:00+00:00 2024-04-05T03:15:04.595564770Z [2024-04-05T03:15:04.593+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:15:04.595595662Z 2024-04-05T03:15:04.597539254Z [2024-04-05T03:15:04.594+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:15:04.598406598Z [2024-04-05T03:15:04.598+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:15:04.598448175Z 2024-04-05T03:15:04.602145785Z [2024-04-05T03:15:04.601+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:15:04.602167242Z [2024-04-05T03:15:04.601+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:15:04.731620302Z [2024-04-05T03:15:04.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status queued for try_number 1 2024-04-05T03:15:04.731830279Z [2024-04-05T03:15:04.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status success for try_number 1 2024-04-05T03:15:04.731975373Z [2024-04-05T03:15:04.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:14:00+00:00 exited with status success for try_number 1 2024-04-05T03:15:04.740265194Z [2024-04-05T03:15:04.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:10:00+00:00, map_index=-1, run_start_date=2024-04-05 03:15:02.652454+00:00, run_end_date=2024-04-05 03:15:03.640396+00:00, run_duration=0.987942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:15:00.226404+00:00, queued_by_job_id=1, pid=8579 2024-04-05T03:15:04.740695507Z [2024-04-05T03:15:04.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa34be79-27e2-4a2e-80d3-8ccda854562b 2024-04-05T03:15:04.740975741Z [2024-04-05T03:15:04.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:14:00+00:00, map_index=-1, run_start_date=2024-04-05 03:15:02.405090+00:00, run_end_date=2024-04-05 03:15:04.113598+00:00, run_duration=1.708508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:15:00.226404+00:00, queued_by_job_id=1, pid=8577 2024-04-05T03:15:06.101153656Z [2024-04-05T03:15:06.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:14:00+00:00 exited with status success for try_number 1 2024-04-05T03:15:06.116771814Z [2024-04-05T03:15:06.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:14:00+00:00, map_index=-1, run_start_date=2024-04-05 03:15:02.596520+00:00, run_end_date=2024-04-05 03:15:05.761790+00:00, run_duration=3.16527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:15:00.226404+00:00, queued_by_job_id=1, pid=8578 2024-04-05T03:15:07.184159436Z [2024-04-05T03:15:07.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:15:07.184569330Z [2024-04-05T03:15:07.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:14:00+00:00, run_id=scheduled__2024-04-05T03:14:00+00:00, run_start_date=2024-04-05 03:15:00.154152+00:00, run_end_date=2024-04-05 03:15:07.184017+00:00, run_duration=7.029865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:14:00+00:00, data_interval_end=2024-04-05 03:15:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:15:07.205634387Z [2024-04-05T03:15:07.205+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:15:00+00:00, run_after=2024-04-05T03:16:00+00:00 2024-04-05T03:15:07.290440367Z [2024-04-05T03:15:07.290+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:15:07.290466682Z 2024-04-05T03:15:07.290503066Z [2024-04-05T03:15:07.290+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:15:07.291168798Z [2024-04-05T03:15:07.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:15:07.291180366Z 2024-04-05T03:15:07.294060153Z [2024-04-05T03:15:07.293+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:15:07.294192182Z [2024-04-05T03:15:07.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:15:07.364839718Z [2024-04-05T03:15:07.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status queued for try_number 1 2024-04-05T03:15:07.372836744Z [2024-04-05T03:15:07.372+0000] {scheduler_job.py:635} INFO - Setting external_id for to 383d81d7-502e-424b-9fdb-055802503ae4 2024-04-05T03:15:07.627911398Z [2024-04-05T03:15:07.627+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status success for try_number 1 2024-04-05T03:15:07.644963882Z [2024-04-05T03:15:07.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:10:00+00:00, map_index=-1, run_start_date=2024-04-05 03:15:06.704934+00:00, run_end_date=2024-04-05 03:15:07.172113+00:00, run_duration=0.467179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:15:04.598978+00:00, queued_by_job_id=1, pid=8618 2024-04-05T03:15:10.880097664Z [2024-04-05T03:15:10.879+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:15:10.880137334Z 2024-04-05T03:15:10.880148828Z [2024-04-05T03:15:10.880+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:15:10.880681739Z [2024-04-05T03:15:10.880+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:15:10.880688834Z 2024-04-05T03:15:10.882837310Z [2024-04-05T03:15:10.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:15:10.882901656Z [2024-04-05T03:15:10.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:15:10.934911705Z [2024-04-05T03:15:10.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status queued for try_number 1 2024-04-05T03:15:10.934950707Z [2024-04-05T03:15:10.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status success for try_number 1 2024-04-05T03:15:10.942387472Z [2024-04-05T03:15:10.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1693775a-dc6c-4dcc-95e7-119d98aa32c8 2024-04-05T03:15:10.942545428Z [2024-04-05T03:15:10.942+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:10:00+00:00, map_index=0, run_start_date=2024-04-05 03:15:09.367714+00:00, run_end_date=2024-04-05 03:15:10.634160+00:00, run_duration=1.266446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:15:07.291583+00:00, queued_by_job_id=1, pid=8630 2024-04-05T03:15:13.592074152Z [2024-04-05T03:15:13.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:15:13.592633175Z [2024-04-05T03:15:13.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:10:00+00:00, run_id=scheduled__2024-04-05T03:10:00+00:00, run_start_date=2024-04-05 03:15:00.152027+00:00, run_end_date=2024-04-05 03:15:13.591945+00:00, run_duration=13.439918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:10:00+00:00, data_interval_end=2024-04-05 03:15:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:15:13.601663990Z [2024-04-05T03:15:13.601+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:15:00+00:00, run_after=2024-04-05T03:20:00+00:00 2024-04-05T03:15:13.694823530Z [2024-04-05T03:15:13.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:10:00+00:00 exited with status success for try_number 1 2024-04-05T03:15:13.701474504Z [2024-04-05T03:15:13.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:10:00+00:00, map_index=-1, run_start_date=2024-04-05 03:15:12.540708+00:00, run_end_date=2024-04-05 03:15:12.957834+00:00, run_duration=0.417126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:15:10.880981+00:00, queued_by_job_id=1, pid=8664 2024-04-05T03:16:00.169040658Z [2024-04-05T03:16:00.168+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:16:00.176506033Z [2024-04-05T03:16:00.176+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:16:00.188217022Z [2024-04-05T03:16:00.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:16:00+00:00, run_after=2024-04-05T03:17:00+00:00 2024-04-05T03:16:00.256174712Z [2024-04-05T03:16:00.255+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:16:00.256201749Z 2024-04-05T03:16:00.256206100Z 2024-04-05T03:16:00.256209518Z 2024-04-05T03:16:00.256333894Z [2024-04-05T03:16:00.256+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:16:00.256516468Z [2024-04-05T03:16:00.256+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:16:00.256662130Z [2024-04-05T03:16:00.256+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:16:00.257214474Z [2024-04-05T03:16:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:16:00.257240368Z 2024-04-05T03:16:00.257244262Z 2024-04-05T03:16:00.257247673Z 2024-04-05T03:16:00.260338857Z [2024-04-05T03:16:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:16:00.260577840Z [2024-04-05T03:16:00.260+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:16:00.260968959Z [2024-04-05T03:16:00.260+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:16:00.261236711Z [2024-04-05T03:16:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:16:00.261544483Z [2024-04-05T03:16:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:16:00.261675157Z [2024-04-05T03:16:00.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:16:00.457647923Z [2024-04-05T03:16:00.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:14:00+00:00 exited with status queued for try_number 1 2024-04-05T03:16:00.458037161Z [2024-04-05T03:16:00.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status queued for try_number 1 2024-04-05T03:16:00.458264342Z [2024-04-05T03:16:00.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status queued for try_number 1 2024-04-05T03:16:00.466483878Z [2024-04-05T03:16:00.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a8a6e39-f37a-47ca-a043-cb2367884f77 2024-04-05T03:16:00.466809387Z [2024-04-05T03:16:00.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59f76d6c-9658-44e6-a699-b59d3bbf9651 2024-04-05T03:16:00.467069718Z [2024-04-05T03:16:00.466+0000] {scheduler_job.py:635} INFO - Setting external_id for to 991d4fd9-493d-4943-a273-f0e93c829e26 2024-04-05T03:16:02.620217971Z [2024-04-05T03:16:02.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:16:02.620739123Z [2024-04-05T03:16:02.620+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:14:00+00:00, run_id=scheduled__2024-04-05T03:14:00+00:00, run_start_date=2024-04-05 03:16:00.199781+00:00, run_end_date=2024-04-05 03:16:02.620130+00:00, run_duration=2.420349, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:14:00+00:00, data_interval_end=2024-04-05 03:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:16:02.629383791Z [2024-04-05T03:16:02.629+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:16:00+00:00, run_after=2024-04-05T03:18:00+00:00 2024-04-05T03:16:02.697540699Z [2024-04-05T03:16:02.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:14:00+00:00 exited with status success for try_number 1 2024-04-05T03:16:02.705789345Z [2024-04-05T03:16:02.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:14:00+00:00, map_index=-1, run_start_date=2024-04-05 03:16:01.139013+00:00, run_end_date=2024-04-05 03:16:01.786820+00:00, run_duration=0.647807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:16:00.257939+00:00, queued_by_job_id=1, pid=8668 2024-04-05T03:16:05.550207615Z [2024-04-05T03:16:05.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:16:05.550388236Z [2024-04-05T03:16:05.550+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:15:00+00:00, run_id=scheduled__2024-04-05T03:15:00+00:00, run_start_date=2024-04-05 03:16:00.203061+00:00, run_end_date=2024-04-05 03:16:05.550105+00:00, run_duration=5.347044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:15:00+00:00, data_interval_end=2024-04-05 03:16:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:16:05.564000387Z [2024-04-05T03:16:05.563+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:16:00+00:00, run_after=2024-04-05T03:17:00+00:00 2024-04-05T03:16:05.620435207Z [2024-04-05T03:16:05.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status success for try_number 1 2024-04-05T03:16:05.630090010Z [2024-04-05T03:16:05.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:15:00+00:00, map_index=-1, run_start_date=2024-04-05 03:16:02.875659+00:00, run_end_date=2024-04-05 03:16:05.377502+00:00, run_duration=2.501843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:16:00.257939+00:00, queued_by_job_id=1, pid=8690 2024-04-05T03:16:06.696415457Z [2024-04-05T03:16:06.695+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:16:06.697634045Z [2024-04-05T03:16:06.697+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:15:00+00:00, run_id=scheduled__2024-04-05T03:15:00+00:00, run_start_date=2024-04-05 03:16:00.201172+00:00, run_end_date=2024-04-05 03:16:06.696299+00:00, run_duration=6.495127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:15:00+00:00, data_interval_end=2024-04-05 03:16:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:16:06.707203181Z [2024-04-05T03:16:06.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:16:00+00:00, run_after=2024-04-05T03:17:00+00:00 2024-04-05T03:16:06.739445794Z [2024-04-05T03:16:06.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status success for try_number 1 2024-04-05T03:16:06.746879114Z [2024-04-05T03:16:06.746+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:15:00+00:00, map_index=-1, run_start_date=2024-04-05 03:16:03.411302+00:00, run_end_date=2024-04-05 03:16:05.702155+00:00, run_duration=2.290853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:16:00.257939+00:00, queued_by_job_id=1, pid=8708 2024-04-05T03:16:44.429169753Z [2024-04-05T03:16:44.427+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:17:00.159039623Z [2024-04-05T03:17:00.158+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:17:00.174832153Z [2024-04-05T03:17:00.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:17:00+00:00, run_after=2024-04-05T03:18:00+00:00 2024-04-05T03:17:00.227095207Z [2024-04-05T03:17:00.226+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:17:00.227147783Z 2024-04-05T03:17:00.227155853Z 2024-04-05T03:17:00.227194774Z [2024-04-05T03:17:00.226+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:17:00.227433012Z [2024-04-05T03:17:00.227+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:17:00.228099519Z [2024-04-05T03:17:00.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:17:00.228110990Z 2024-04-05T03:17:00.228117518Z 2024-04-05T03:17:00.231677825Z [2024-04-05T03:17:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:17:00.231853903Z [2024-04-05T03:17:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:17:00.232174317Z [2024-04-05T03:17:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:17:00.232388977Z [2024-04-05T03:17:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:17:00.382256562Z [2024-04-05T03:17:00.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:16:00+00:00 exited with status queued for try_number 1 2024-04-05T03:17:00.382512973Z [2024-04-05T03:17:00.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:16:00+00:00 exited with status queued for try_number 1 2024-04-05T03:17:00.393044321Z [2024-04-05T03:17:00.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b4971cc-3569-4f0c-b141-91f9cdcaf9f8 2024-04-05T03:17:00.393343626Z [2024-04-05T03:17:00.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to aac107e2-45e3-4837-bd35-4e0ca50e0b82 2024-04-05T03:17:04.172514988Z [2024-04-05T03:17:04.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:17:04.172917912Z [2024-04-05T03:17:04.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:16:00+00:00, run_id=scheduled__2024-04-05T03:16:00+00:00, run_start_date=2024-04-05 03:17:00.185294+00:00, run_end_date=2024-04-05 03:17:04.172532+00:00, run_duration=3.987238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:16:00+00:00, data_interval_end=2024-04-05 03:17:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:17:04.184864564Z [2024-04-05T03:17:04.184+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:17:00+00:00, run_after=2024-04-05T03:18:00+00:00 2024-04-05T03:17:04.268915306Z [2024-04-05T03:17:04.268+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:16:00+00:00 exited with status success for try_number 1 2024-04-05T03:17:04.278097545Z [2024-04-05T03:17:04.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:16:00+00:00, map_index=-1, run_start_date=2024-04-05 03:17:02.090221+00:00, run_end_date=2024-04-05 03:17:03.945629+00:00, run_duration=1.855408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:17:00.229341+00:00, queued_by_job_id=1, pid=8754 2024-04-05T03:17:05.353818693Z [2024-04-05T03:17:05.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:17:05.354571835Z [2024-04-05T03:17:05.354+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:16:00+00:00, run_id=scheduled__2024-04-05T03:16:00+00:00, run_start_date=2024-04-05 03:17:00.186693+00:00, run_end_date=2024-04-05 03:17:05.353693+00:00, run_duration=5.167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:16:00+00:00, data_interval_end=2024-04-05 03:17:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:17:05.381854777Z [2024-04-05T03:17:05.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:17:00+00:00, run_after=2024-04-05T03:18:00+00:00 2024-04-05T03:17:05.458976798Z [2024-04-05T03:17:05.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:16:00+00:00 exited with status success for try_number 1 2024-04-05T03:17:05.480662418Z [2024-04-05T03:17:05.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:16:00+00:00, map_index=-1, run_start_date=2024-04-05 03:17:02.074186+00:00, run_end_date=2024-04-05 03:17:04.208576+00:00, run_duration=2.13439, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:17:00.229341+00:00, queued_by_job_id=1, pid=8753 2024-04-05T03:18:01.041214912Z [2024-04-05T03:18:01.040+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:18:01.052756888Z [2024-04-05T03:18:01.052+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:18:01.080017929Z [2024-04-05T03:18:01.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:18:00+00:00, run_after=2024-04-05T03:19:00+00:00 2024-04-05T03:18:01.178034138Z [2024-04-05T03:18:01.177+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:18:01.178063088Z 2024-04-05T03:18:01.178068900Z 2024-04-05T03:18:01.178074498Z 2024-04-05T03:18:01.178159776Z [2024-04-05T03:18:01.178+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:18:01.178315447Z [2024-04-05T03:18:01.178+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:18:01.178472397Z [2024-04-05T03:18:01.178+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:18:01.179155005Z [2024-04-05T03:18:01.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:18:01.179164221Z 2024-04-05T03:18:01.179168197Z 2024-04-05T03:18:01.179202752Z 2024-04-05T03:18:01.183374813Z [2024-04-05T03:18:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:18:01.183557008Z [2024-04-05T03:18:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:18:01.183874811Z [2024-04-05T03:18:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:18:01.184046612Z [2024-04-05T03:18:01.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:18:01.184303542Z [2024-04-05T03:18:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:18:01.184426468Z [2024-04-05T03:18:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:18:01.401529550Z [2024-04-05T03:18:01.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:16:00+00:00 exited with status queued for try_number 1 2024-04-05T03:18:01.401909045Z [2024-04-05T03:18:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:17:00+00:00 exited with status queued for try_number 1 2024-04-05T03:18:01.402113002Z [2024-04-05T03:18:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:17:00+00:00 exited with status queued for try_number 1 2024-04-05T03:18:01.412418491Z [2024-04-05T03:18:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6665a97-fa38-4494-86fa-cf37c81808ca 2024-04-05T03:18:01.412638627Z [2024-04-05T03:18:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72a1b58c-ae0a-4034-badf-fc313ca69dab 2024-04-05T03:18:01.412842725Z [2024-04-05T03:18:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ba3860a-c600-4e74-9f7f-8611d03c5f2d 2024-04-05T03:18:03.711469693Z [2024-04-05T03:18:03.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:18:03.711934228Z [2024-04-05T03:18:03.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:16:00+00:00, run_id=scheduled__2024-04-05T03:16:00+00:00, run_start_date=2024-04-05 03:18:01.107131+00:00, run_end_date=2024-04-05 03:18:03.711484+00:00, run_duration=2.604353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:16:00+00:00, data_interval_end=2024-04-05 03:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:18:03.721357393Z [2024-04-05T03:18:03.720+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:18:00+00:00, run_after=2024-04-05T03:20:00+00:00 2024-04-05T03:18:03.798669966Z [2024-04-05T03:18:03.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:16:00+00:00 exited with status success for try_number 1 2024-04-05T03:18:03.804548147Z [2024-04-05T03:18:03.804+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:16:00+00:00, map_index=-1, run_start_date=2024-04-05 03:18:02.148793+00:00, run_end_date=2024-04-05 03:18:02.879162+00:00, run_duration=0.730369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:18:01.179989+00:00, queued_by_job_id=1, pid=8788 2024-04-05T03:18:06.227739389Z [2024-04-05T03:18:06.226+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:18:06.228828997Z [2024-04-05T03:18:06.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:17:00+00:00, run_id=scheduled__2024-04-05T03:17:00+00:00, run_start_date=2024-04-05 03:18:01.110747+00:00, run_end_date=2024-04-05 03:18:06.227696+00:00, run_duration=5.116949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:17:00+00:00, data_interval_end=2024-04-05 03:18:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:18:06.266901990Z [2024-04-05T03:18:06.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:18:00+00:00, run_after=2024-04-05T03:19:00+00:00 2024-04-05T03:18:06.287817702Z [2024-04-05T03:18:06.287+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:18:06.290867520Z [2024-04-05T03:18:06.290+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:17:00+00:00, run_id=scheduled__2024-04-05T03:17:00+00:00, run_start_date=2024-04-05 03:18:01.108846+00:00, run_end_date=2024-04-05 03:18:06.288398+00:00, run_duration=5.179552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:17:00+00:00, data_interval_end=2024-04-05 03:18:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:18:06.313162913Z [2024-04-05T03:18:06.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:18:00+00:00, run_after=2024-04-05T03:19:00+00:00 2024-04-05T03:18:06.355326133Z [2024-04-05T03:18:06.354+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:17:00+00:00 exited with status success for try_number 1 2024-04-05T03:18:06.355668955Z [2024-04-05T03:18:06.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:17:00+00:00 exited with status success for try_number 1 2024-04-05T03:18:06.366656785Z [2024-04-05T03:18:06.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:17:00+00:00, map_index=-1, run_start_date=2024-04-05 03:18:03.835981+00:00, run_end_date=2024-04-05 03:18:05.898158+00:00, run_duration=2.062177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:18:01.179989+00:00, queued_by_job_id=1, pid=8818 2024-04-05T03:18:06.367107353Z [2024-04-05T03:18:06.366+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:17:00+00:00, map_index=-1, run_start_date=2024-04-05 03:18:03.973583+00:00, run_end_date=2024-04-05 03:18:05.728375+00:00, run_duration=1.754792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:18:01.179989+00:00, queued_by_job_id=1, pid=8819 2024-04-05T03:19:00.148145246Z [2024-04-05T03:19:00.147+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:19:00.167443005Z [2024-04-05T03:19:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:19:00+00:00, run_after=2024-04-05T03:20:00+00:00 2024-04-05T03:19:00.230664016Z [2024-04-05T03:19:00.230+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:19:00.230737982Z 2024-04-05T03:19:00.230748159Z 2024-04-05T03:19:00.230988560Z [2024-04-05T03:19:00.230+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:19:00.231093182Z [2024-04-05T03:19:00.230+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:19:00.231738260Z [2024-04-05T03:19:00.231+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:19:00.231761557Z 2024-04-05T03:19:00.231769103Z 2024-04-05T03:19:00.236606904Z [2024-04-05T03:19:00.236+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:19:00.236982853Z [2024-04-05T03:19:00.236+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:19:00.237449662Z [2024-04-05T03:19:00.237+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:19:00.237719765Z [2024-04-05T03:19:00.237+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:19:00.411760017Z [2024-04-05T03:19:00.410+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:18:00+00:00 exited with status queued for try_number 1 2024-04-05T03:19:00.412084422Z [2024-04-05T03:19:00.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:18:00+00:00 exited with status queued for try_number 1 2024-04-05T03:19:00.424694435Z [2024-04-05T03:19:00.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to e475fbe4-162a-43d8-bbc9-95b5d0eb3575 2024-04-05T03:19:00.425022991Z [2024-04-05T03:19:00.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cf638e1-f83d-4178-ae6d-0c4a428269e5 2024-04-05T03:19:04.184273352Z [2024-04-05T03:19:04.183+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:19:04.184866325Z [2024-04-05T03:19:04.184+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:18:00+00:00, run_id=scheduled__2024-04-05T03:18:00+00:00, run_start_date=2024-04-05 03:19:00.181797+00:00, run_end_date=2024-04-05 03:19:04.184323+00:00, run_duration=4.002526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:18:00+00:00, data_interval_end=2024-04-05 03:19:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:19:04.196340314Z [2024-04-05T03:19:04.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:19:00+00:00, run_after=2024-04-05T03:20:00+00:00 2024-04-05T03:19:04.206122266Z [2024-04-05T03:19:04.205+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:19:04.206565285Z [2024-04-05T03:19:04.206+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:18:00+00:00, run_id=scheduled__2024-04-05T03:18:00+00:00, run_start_date=2024-04-05 03:19:00.183221+00:00, run_end_date=2024-04-05 03:19:04.206151+00:00, run_duration=4.02293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:18:00+00:00, data_interval_end=2024-04-05 03:19:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:19:04.217122116Z [2024-04-05T03:19:04.216+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:19:00+00:00, run_after=2024-04-05T03:20:00+00:00 2024-04-05T03:19:04.259456221Z [2024-04-05T03:19:04.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:18:00+00:00 exited with status success for try_number 1 2024-04-05T03:19:04.270356196Z [2024-04-05T03:19:04.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:18:00+00:00, map_index=-1, run_start_date=2024-04-05 03:19:02.099333+00:00, run_end_date=2024-04-05 03:19:03.755114+00:00, run_duration=1.655781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:19:00.232169+00:00, queued_by_job_id=1, pid=8873 2024-04-05T03:19:05.360808743Z [2024-04-05T03:19:05.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:18:00+00:00 exited with status success for try_number 1 2024-04-05T03:19:05.374564435Z [2024-04-05T03:19:05.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:18:00+00:00, map_index=-1, run_start_date=2024-04-05 03:19:02.305604+00:00, run_end_date=2024-04-05 03:19:04.137602+00:00, run_duration=1.831998, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:19:00.232169+00:00, queued_by_job_id=1, pid=8874 2024-04-05T03:20:00.419260123Z [2024-04-05T03:20:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:20:00+00:00, run_after=2024-04-05T03:21:00+00:00 2024-04-05T03:20:00.428773308Z [2024-04-05T03:20:00.428+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:20:00.440339109Z [2024-04-05T03:20:00.439+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:20:00.460369821Z [2024-04-05T03:20:00.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:20:00+00:00, run_after=2024-04-05T03:25:00+00:00 2024-04-05T03:20:00.568773787Z [2024-04-05T03:20:00.568+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T03:20:00.568808957Z 2024-04-05T03:20:00.568814789Z 2024-04-05T03:20:00.568820287Z 2024-04-05T03:20:00.568824970Z 2024-04-05T03:20:00.568980446Z [2024-04-05T03:20:00.568+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:20:00.569283647Z [2024-04-05T03:20:00.569+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:20:00.569598493Z [2024-04-05T03:20:00.569+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:20:00.569851128Z [2024-04-05T03:20:00.569+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:20:00.571466673Z [2024-04-05T03:20:00.571+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:20:00.571488019Z 2024-04-05T03:20:00.571493628Z 2024-04-05T03:20:00.571498740Z 2024-04-05T03:20:00.571503884Z 2024-04-05T03:20:00.577672893Z [2024-04-05T03:20:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:20:00.579220529Z [2024-04-05T03:20:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:20:00.579851644Z [2024-04-05T03:20:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:20:00.580194781Z [2024-04-05T03:20:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:20:00.580802893Z [2024-04-05T03:20:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:20:00.581159368Z [2024-04-05T03:20:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:20:00.581744151Z [2024-04-05T03:20:00.581+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:20:00.582029401Z [2024-04-05T03:20:00.581+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:20:00.958565688Z [2024-04-05T03:20:00.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status queued for try_number 1 2024-04-05T03:20:00.958890465Z [2024-04-05T03:20:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:18:00+00:00 exited with status queued for try_number 1 2024-04-05T03:20:00.959134870Z [2024-04-05T03:20:00.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:19:00+00:00 exited with status queued for try_number 1 2024-04-05T03:20:00.959442881Z [2024-04-05T03:20:00.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:19:00+00:00 exited with status queued for try_number 1 2024-04-05T03:20:00.971135868Z [2024-04-05T03:20:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to f01fb1fa-ea96-46b2-9b82-b72bf872762e 2024-04-05T03:20:00.971810068Z [2024-04-05T03:20:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to cec8c672-d18d-4c4d-aead-31e3eeb5cf90 2024-04-05T03:20:00.972177687Z [2024-04-05T03:20:00.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1181edd1-f935-489c-a9a1-074205cf0b16 2024-04-05T03:20:00.972514505Z [2024-04-05T03:20:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b7426a4-f87b-4757-a8b1-e31f62c77567 2024-04-05T03:20:02.980499589Z [2024-04-05T03:20:02.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:20:02.980534394Z [2024-04-05T03:20:02.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:18:00+00:00, run_id=scheduled__2024-04-05T03:18:00+00:00, run_start_date=2024-04-05 03:20:00.477791+00:00, run_end_date=2024-04-05 03:20:02.979005+00:00, run_duration=2.501214, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:18:00+00:00, data_interval_end=2024-04-05 03:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:20:02.996111669Z [2024-04-05T03:20:02.994+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:20:00+00:00, run_after=2024-04-05T03:22:00+00:00 2024-04-05T03:20:03.137018791Z [2024-04-05T03:20:03.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:18:00+00:00 exited with status success for try_number 1 2024-04-05T03:20:03.145877968Z [2024-04-05T03:20:03.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:18:00+00:00, map_index=-1, run_start_date=2024-04-05 03:20:01.599666+00:00, run_end_date=2024-04-05 03:20:02.154963+00:00, run_duration=0.555297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:20:00.573389+00:00, queued_by_job_id=1, pid=8910 2024-04-05T03:20:04.731626978Z [2024-04-05T03:20:04.731+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:20:04.731663148Z 2024-04-05T03:20:04.731951297Z [2024-04-05T03:20:04.731+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:20:04.733231548Z [2024-04-05T03:20:04.732+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:20:04.733256031Z 2024-04-05T03:20:04.737826689Z [2024-04-05T03:20:04.737+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:20:04.738470630Z [2024-04-05T03:20:04.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:20:04.837027699Z [2024-04-05T03:20:04.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status queued for try_number 1 2024-04-05T03:20:04.837076788Z [2024-04-05T03:20:04.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status success for try_number 1 2024-04-05T03:20:04.848907759Z [2024-04-05T03:20:04.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 381a7050-588e-47ca-b10c-39419a7e05b4 2024-04-05T03:20:04.853366166Z [2024-04-05T03:20:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:15:00+00:00, map_index=-1, run_start_date=2024-04-05 03:20:03.629005+00:00, run_end_date=2024-04-05 03:20:04.231738+00:00, run_duration=0.602733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:20:00.573389+00:00, queued_by_job_id=1, pid=8950 2024-04-05T03:20:06.150455463Z [2024-04-05T03:20:06.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:20:06.150646752Z [2024-04-05T03:20:06.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:19:00+00:00, run_id=scheduled__2024-04-05T03:19:00+00:00, run_start_date=2024-04-05 03:20:00.478938+00:00, run_end_date=2024-04-05 03:20:06.150314+00:00, run_duration=5.671376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:19:00+00:00, data_interval_end=2024-04-05 03:20:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:20:06.188741592Z [2024-04-05T03:20:06.188+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:20:00+00:00, run_after=2024-04-05T03:21:00+00:00 2024-04-05T03:20:06.219645370Z [2024-04-05T03:20:06.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:20:06.219797763Z [2024-04-05T03:20:06.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:19:00+00:00, run_id=scheduled__2024-04-05T03:19:00+00:00, run_start_date=2024-04-05 03:20:00.480102+00:00, run_end_date=2024-04-05 03:20:06.219552+00:00, run_duration=5.73945, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:19:00+00:00, data_interval_end=2024-04-05 03:20:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:20:06.262261797Z [2024-04-05T03:20:06.249+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:20:00+00:00, run_after=2024-04-05T03:21:00+00:00 2024-04-05T03:20:06.471108441Z [2024-04-05T03:20:06.470+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:19:00+00:00 exited with status success for try_number 1 2024-04-05T03:20:06.471237912Z [2024-04-05T03:20:06.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:19:00+00:00 exited with status success for try_number 1 2024-04-05T03:20:06.498926295Z [2024-04-05T03:20:06.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:19:00+00:00, map_index=-1, run_start_date=2024-04-05 03:20:03.621841+00:00, run_end_date=2024-04-05 03:20:05.804701+00:00, run_duration=2.18286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:20:00.573389+00:00, queued_by_job_id=1, pid=8949 2024-04-05T03:20:06.499132733Z [2024-04-05T03:20:06.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:19:00+00:00, map_index=-1, run_start_date=2024-04-05 03:20:03.680262+00:00, run_end_date=2024-04-05 03:20:05.250829+00:00, run_duration=1.570567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:20:00.573389+00:00, queued_by_job_id=1, pid=8951 2024-04-05T03:20:08.236929389Z [2024-04-05T03:20:08.231+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:20:08.236958495Z 2024-04-05T03:20:08.236962204Z [2024-04-05T03:20:08.234+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:20:08.236966341Z [2024-04-05T03:20:08.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:20:08.236969563Z 2024-04-05T03:20:08.238744614Z [2024-04-05T03:20:08.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:20:08.239091289Z [2024-04-05T03:20:08.238+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:20:08.298939924Z [2024-04-05T03:20:08.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status queued for try_number 1 2024-04-05T03:20:08.299233311Z [2024-04-05T03:20:08.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status success for try_number 1 2024-04-05T03:20:08.305837828Z [2024-04-05T03:20:08.305+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea1340b5-f33c-4881-b9f1-6988c2792dfc 2024-04-05T03:20:08.306381974Z [2024-04-05T03:20:08.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:15:00+00:00, map_index=-1, run_start_date=2024-04-05 03:20:07.237338+00:00, run_end_date=2024-04-05 03:20:07.652435+00:00, run_duration=0.415097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:20:04.734123+00:00, queued_by_job_id=1, pid=8989 2024-04-05T03:20:11.715582759Z [2024-04-05T03:20:11.715+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:20:11.715620234Z 2024-04-05T03:20:11.715779183Z [2024-04-05T03:20:11.715+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:20:11.716469670Z [2024-04-05T03:20:11.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:20:11.716486108Z 2024-04-05T03:20:11.722911533Z [2024-04-05T03:20:11.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:20:11.723126020Z [2024-04-05T03:20:11.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:20:11.820537435Z [2024-04-05T03:20:11.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status queued for try_number 1 2024-04-05T03:20:11.820644867Z [2024-04-05T03:20:11.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status success for try_number 1 2024-04-05T03:20:11.830016489Z [2024-04-05T03:20:11.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to d82d36bb-072d-45b6-a2ac-c4cbcdd79138 2024-04-05T03:20:11.830352971Z [2024-04-05T03:20:11.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:15:00+00:00, map_index=0, run_start_date=2024-04-05 03:20:10.032866+00:00, run_end_date=2024-04-05 03:20:11.339808+00:00, run_duration=1.306942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:20:08.235835+00:00, queued_by_job_id=1, pid=9011 2024-04-05T03:20:14.473738423Z [2024-04-05T03:20:14.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:20:14.475800090Z [2024-04-05T03:20:14.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:15:00+00:00, run_id=scheduled__2024-04-05T03:15:00+00:00, run_start_date=2024-04-05 03:20:00.476613+00:00, run_end_date=2024-04-05 03:20:14.475318+00:00, run_duration=13.998705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:15:00+00:00, data_interval_end=2024-04-05 03:20:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:20:14.487043051Z [2024-04-05T03:20:14.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:20:00+00:00, run_after=2024-04-05T03:25:00+00:00 2024-04-05T03:20:14.526608706Z [2024-04-05T03:20:14.526+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:15:00+00:00 exited with status success for try_number 1 2024-04-05T03:20:14.533616864Z [2024-04-05T03:20:14.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:15:00+00:00, map_index=-1, run_start_date=2024-04-05 03:20:13.863491+00:00, run_end_date=2024-04-05 03:20:14.266405+00:00, run_duration=0.402914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:20:11.717015+00:00, queued_by_job_id=1, pid=9035 2024-04-05T03:21:00.664426426Z [2024-04-05T03:21:00.664+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:21:00.679569289Z [2024-04-05T03:21:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:21:00+00:00, run_after=2024-04-05T03:22:00+00:00 2024-04-05T03:21:00.748343416Z [2024-04-05T03:21:00.747+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:21:00.748373698Z 2024-04-05T03:21:00.748379281Z 2024-04-05T03:21:00.748404577Z [2024-04-05T03:21:00.747+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:21:00.748510364Z [2024-04-05T03:21:00.748+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:21:00.749602921Z [2024-04-05T03:21:00.749+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:21:00.749623866Z 2024-04-05T03:21:00.749630348Z 2024-04-05T03:21:00.758946526Z [2024-04-05T03:21:00.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:21:00.759058655Z [2024-04-05T03:21:00.758+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:21:00.759651204Z [2024-04-05T03:21:00.759+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:21:00.770497967Z [2024-04-05T03:21:00.759+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:21:00.949877047Z [2024-04-05T03:21:00.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status queued for try_number 1 2024-04-05T03:21:00.950360827Z [2024-04-05T03:21:00.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status queued for try_number 1 2024-04-05T03:21:00.961770132Z [2024-04-05T03:21:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to da1cb293-36c1-4434-94fa-092b7bab1d06 2024-04-05T03:21:00.961858110Z [2024-04-05T03:21:00.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14ea2714-eea3-4545-9e13-b76e6ffe9ade 2024-04-05T03:21:05.214728613Z [2024-04-05T03:21:05.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:21:05.215177674Z [2024-04-05T03:21:05.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:20:00+00:00, run_id=scheduled__2024-04-05T03:20:00+00:00, run_start_date=2024-04-05 03:21:00.694579+00:00, run_end_date=2024-04-05 03:21:05.214765+00:00, run_duration=4.520186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:20:00+00:00, data_interval_end=2024-04-05 03:21:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:21:05.226178674Z [2024-04-05T03:21:05.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:21:00+00:00, run_after=2024-04-05T03:22:00+00:00 2024-04-05T03:21:05.299566730Z [2024-04-05T03:21:05.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status success for try_number 1 2024-04-05T03:21:05.307980649Z [2024-04-05T03:21:05.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:20:00+00:00, map_index=-1, run_start_date=2024-04-05 03:21:02.946425+00:00, run_end_date=2024-04-05 03:21:05.025409+00:00, run_duration=2.078984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:21:00.754889+00:00, queued_by_job_id=1, pid=9049 2024-04-05T03:21:06.374039184Z [2024-04-05T03:21:06.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:21:06.374610915Z [2024-04-05T03:21:06.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:20:00+00:00, run_id=scheduled__2024-04-05T03:20:00+00:00, run_start_date=2024-04-05 03:21:00.692401+00:00, run_end_date=2024-04-05 03:21:06.373891+00:00, run_duration=5.68149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:20:00+00:00, data_interval_end=2024-04-05 03:21:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:21:06.384128674Z [2024-04-05T03:21:06.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:21:00+00:00, run_after=2024-04-05T03:22:00+00:00 2024-04-05T03:21:06.426146896Z [2024-04-05T03:21:06.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status success for try_number 1 2024-04-05T03:21:06.436042335Z [2024-04-05T03:21:06.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:20:00+00:00, map_index=-1, run_start_date=2024-04-05 03:21:03.740247+00:00, run_end_date=2024-04-05 03:21:05.284799+00:00, run_duration=1.544552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:21:00.754889+00:00, queued_by_job_id=1, pid=9068 2024-04-05T03:21:44.494660818Z [2024-04-05T03:21:44.494+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:22:00.873389143Z [2024-04-05T03:22:00.872+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:22:00.899668033Z [2024-04-05T03:22:00.899+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:22:00+00:00, run_after=2024-04-05T03:23:00+00:00 2024-04-05T03:22:00.910913933Z [2024-04-05T03:22:00.910+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:22:00.994216340Z [2024-04-05T03:22:00.993+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:22:00.994247659Z 2024-04-05T03:22:00.994254526Z 2024-04-05T03:22:00.994259997Z 2024-04-05T03:22:00.994774984Z [2024-04-05T03:22:00.994+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:22:00.995124887Z [2024-04-05T03:22:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:22:00.995523717Z [2024-04-05T03:22:00.995+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:22:00.997133051Z [2024-04-05T03:22:00.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:22:00.997149383Z 2024-04-05T03:22:00.997155194Z 2024-04-05T03:22:00.997160395Z 2024-04-05T03:22:01.006693730Z [2024-04-05T03:22:01.006+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:22:01.006974165Z [2024-04-05T03:22:01.006+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:22:01.007314472Z [2024-04-05T03:22:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:22:01.007489654Z [2024-04-05T03:22:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:22:01.007770288Z [2024-04-05T03:22:01.007+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:22:01.007926994Z [2024-04-05T03:22:01.007+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:22:01.369585874Z [2024-04-05T03:22:01.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status queued for try_number 1 2024-04-05T03:22:01.370269040Z [2024-04-05T03:22:01.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:21:00+00:00 exited with status queued for try_number 1 2024-04-05T03:22:01.370614956Z [2024-04-05T03:22:01.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:21:00+00:00 exited with status queued for try_number 1 2024-04-05T03:22:01.385734975Z [2024-04-05T03:22:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to 073fa767-54eb-4c7e-89de-fa8038e34abe 2024-04-05T03:22:01.386043035Z [2024-04-05T03:22:01.385+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab72cfa9-8ea2-4460-8f50-c394b2200886 2024-04-05T03:22:01.386217932Z [2024-04-05T03:22:01.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dce2cbb-d42b-4e90-b9f5-1ece82c92b45 2024-04-05T03:22:02.572228329Z [2024-04-05T03:22:02.571+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:22:02.573459142Z [2024-04-05T03:22:02.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:20:00+00:00, run_id=scheduled__2024-04-05T03:20:00+00:00, run_start_date=2024-04-05 03:22:00.924973+00:00, run_end_date=2024-04-05 03:22:02.572958+00:00, run_duration=1.647985, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:20:00+00:00, data_interval_end=2024-04-05 03:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:22:02.584695593Z [2024-04-05T03:22:02.584+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:22:00+00:00, run_after=2024-04-05T03:24:00+00:00 2024-04-05T03:22:03.777133519Z [2024-04-05T03:22:03.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status success for try_number 1 2024-04-05T03:22:03.788604145Z [2024-04-05T03:22:03.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:20:00+00:00, map_index=-1, run_start_date=2024-04-05 03:22:01.962256+00:00, run_end_date=2024-04-05 03:22:02.538395+00:00, run_duration=0.576139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:22:00.999287+00:00, queued_by_job_id=1, pid=9094 2024-04-05T03:22:05.675876884Z [2024-04-05T03:22:05.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:22:05.676508199Z [2024-04-05T03:22:05.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:21:00+00:00, run_id=scheduled__2024-04-05T03:21:00+00:00, run_start_date=2024-04-05 03:22:00.926581+00:00, run_end_date=2024-04-05 03:22:05.675735+00:00, run_duration=4.749154, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:21:00+00:00, data_interval_end=2024-04-05 03:22:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:22:05.685342763Z [2024-04-05T03:22:05.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:22:00+00:00, run_after=2024-04-05T03:23:00+00:00 2024-04-05T03:22:05.727498796Z [2024-04-05T03:22:05.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:21:00+00:00 exited with status success for try_number 1 2024-04-05T03:22:05.735474858Z [2024-04-05T03:22:05.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:21:00+00:00, map_index=-1, run_start_date=2024-04-05 03:22:03.867976+00:00, run_end_date=2024-04-05 03:22:05.563634+00:00, run_duration=1.695658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:22:00.999287+00:00, queued_by_job_id=1, pid=9124 2024-04-05T03:22:07.863779939Z [2024-04-05T03:22:07.863+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:22:07.864344574Z [2024-04-05T03:22:07.864+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:21:00+00:00, run_id=scheduled__2024-04-05T03:21:00+00:00, run_start_date=2024-04-05 03:22:00.927667+00:00, run_end_date=2024-04-05 03:22:07.863711+00:00, run_duration=6.936044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:21:00+00:00, data_interval_end=2024-04-05 03:22:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:22:07.878059544Z [2024-04-05T03:22:07.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:22:00+00:00, run_after=2024-04-05T03:23:00+00:00 2024-04-05T03:22:07.906542330Z [2024-04-05T03:22:07.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:21:00+00:00 exited with status success for try_number 1 2024-04-05T03:22:07.911870910Z [2024-04-05T03:22:07.911+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:21:00+00:00, map_index=-1, run_start_date=2024-04-05 03:22:03.894102+00:00, run_end_date=2024-04-05 03:22:07.149450+00:00, run_duration=3.255348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:22:00.999287+00:00, queued_by_job_id=1, pid=9125 2024-04-05T03:23:00.513863596Z [2024-04-05T03:23:00.513+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:23:00.526832538Z [2024-04-05T03:23:00.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:23:00+00:00, run_after=2024-04-05T03:24:00+00:00 2024-04-05T03:23:00.592084384Z [2024-04-05T03:23:00.590+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:23:00.592107080Z 2024-04-05T03:23:00.592112230Z 2024-04-05T03:23:00.593081586Z [2024-04-05T03:23:00.592+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:23:00.593689543Z [2024-04-05T03:23:00.593+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:23:00.594589454Z [2024-04-05T03:23:00.594+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:23:00.594600850Z 2024-04-05T03:23:00.594604263Z 2024-04-05T03:23:00.598397489Z [2024-04-05T03:23:00.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:23:00.598579273Z [2024-04-05T03:23:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:23:00.598944368Z [2024-04-05T03:23:00.598+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:23:00.599142522Z [2024-04-05T03:23:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:23:00.854204953Z [2024-04-05T03:23:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:22:00+00:00 exited with status queued for try_number 1 2024-04-05T03:23:00.854240558Z [2024-04-05T03:23:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:22:00+00:00 exited with status queued for try_number 1 2024-04-05T03:23:00.872961687Z [2024-04-05T03:23:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc4df95d-a7ff-4aac-b7c4-065c4142e3dc 2024-04-05T03:23:00.873570118Z [2024-04-05T03:23:00.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bb4fff1-d706-4781-97e8-b38f25337117 2024-04-05T03:23:05.687280438Z [2024-04-05T03:23:05.686+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:23:05.687620140Z [2024-04-05T03:23:05.687+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:22:00+00:00, run_id=scheduled__2024-04-05T03:22:00+00:00, run_start_date=2024-04-05 03:23:00.542088+00:00, run_end_date=2024-04-05 03:23:05.687189+00:00, run_duration=5.145101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:22:00+00:00, data_interval_end=2024-04-05 03:23:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:23:05.697814774Z [2024-04-05T03:23:05.697+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:23:00+00:00, run_after=2024-04-05T03:24:00+00:00 2024-04-05T03:23:06.080979206Z [2024-04-05T03:23:06.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:23:06.081626331Z [2024-04-05T03:23:06.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:22:00+00:00, run_id=scheduled__2024-04-05T03:22:00+00:00, run_start_date=2024-04-05 03:23:00.540274+00:00, run_end_date=2024-04-05 03:23:06.080886+00:00, run_duration=5.540612, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:22:00+00:00, data_interval_end=2024-04-05 03:23:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:23:06.105340730Z [2024-04-05T03:23:06.104+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:23:00+00:00, run_after=2024-04-05T03:24:00+00:00 2024-04-05T03:23:06.139785336Z [2024-04-05T03:23:06.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:22:00+00:00 exited with status success for try_number 1 2024-04-05T03:23:06.139970366Z [2024-04-05T03:23:06.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:22:00+00:00 exited with status success for try_number 1 2024-04-05T03:23:06.149116813Z [2024-04-05T03:23:06.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:22:00+00:00, map_index=-1, run_start_date=2024-04-05 03:23:02.982580+00:00, run_end_date=2024-04-05 03:23:05.623556+00:00, run_duration=2.640976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:23:00.595555+00:00, queued_by_job_id=1, pid=9179 2024-04-05T03:23:06.150053897Z [2024-04-05T03:23:06.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:22:00+00:00, map_index=-1, run_start_date=2024-04-05 03:23:03.146703+00:00, run_end_date=2024-04-05 03:23:05.895397+00:00, run_duration=2.748694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:23:00.595555+00:00, queued_by_job_id=1, pid=9180 2024-04-05T03:24:00.281988877Z [2024-04-05T03:24:00.281+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:24:00.289288414Z [2024-04-05T03:24:00.288+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:24:00.304856853Z [2024-04-05T03:24:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:24:00+00:00, run_after=2024-04-05T03:25:00+00:00 2024-04-05T03:24:00.381052464Z [2024-04-05T03:24:00.380+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:24:00.381104203Z 2024-04-05T03:24:00.381111188Z 2024-04-05T03:24:00.381116743Z 2024-04-05T03:24:00.381247119Z [2024-04-05T03:24:00.380+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:24:00.381531031Z [2024-04-05T03:24:00.381+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:24:00.381812512Z [2024-04-05T03:24:00.381+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:24:00.382933053Z [2024-04-05T03:24:00.382+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:24:00.382945472Z 2024-04-05T03:24:00.382949109Z 2024-04-05T03:24:00.382952787Z 2024-04-05T03:24:00.388181474Z [2024-04-05T03:24:00.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:24:00.388372065Z [2024-04-05T03:24:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:24:00.388802309Z [2024-04-05T03:24:00.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:24:00.389089276Z [2024-04-05T03:24:00.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:24:00.389538476Z [2024-04-05T03:24:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:24:00.389788249Z [2024-04-05T03:24:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:24:00.636294160Z [2024-04-05T03:24:00.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:22:00+00:00 exited with status queued for try_number 1 2024-04-05T03:24:00.636611324Z [2024-04-05T03:24:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:23:00+00:00 exited with status queued for try_number 1 2024-04-05T03:24:00.636666141Z [2024-04-05T03:24:00.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:23:00+00:00 exited with status queued for try_number 1 2024-04-05T03:24:00.653423315Z [2024-04-05T03:24:00.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4ffd3c4-8315-4c49-993d-1f14c82e69f8 2024-04-05T03:24:00.653489650Z [2024-04-05T03:24:00.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02292ee8-9186-4623-a0a2-88ce3c240bc3 2024-04-05T03:24:00.653646763Z [2024-04-05T03:24:00.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to abffe4cd-4eb6-4916-87c5-d8ede3072cf7 2024-04-05T03:24:03.105166793Z [2024-04-05T03:24:03.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:24:03.105865548Z [2024-04-05T03:24:03.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:22:00+00:00, run_id=scheduled__2024-04-05T03:22:00+00:00, run_start_date=2024-04-05 03:24:00.315569+00:00, run_end_date=2024-04-05 03:24:03.105374+00:00, run_duration=2.789805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:22:00+00:00, data_interval_end=2024-04-05 03:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:24:03.115708915Z [2024-04-05T03:24:03.115+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:24:00+00:00, run_after=2024-04-05T03:26:00+00:00 2024-04-05T03:24:03.452036935Z [2024-04-05T03:24:03.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:22:00+00:00 exited with status success for try_number 1 2024-04-05T03:24:03.478510351Z [2024-04-05T03:24:03.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:22:00+00:00, map_index=-1, run_start_date=2024-04-05 03:24:01.694288+00:00, run_end_date=2024-04-05 03:24:02.405588+00:00, run_duration=0.7113, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:24:00.384245+00:00, queued_by_job_id=1, pid=9215 2024-04-05T03:24:06.525244589Z [2024-04-05T03:24:06.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:24:06.525754499Z [2024-04-05T03:24:06.525+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:23:00+00:00, run_id=scheduled__2024-04-05T03:23:00+00:00, run_start_date=2024-04-05 03:24:00.317950+00:00, run_end_date=2024-04-05 03:24:06.525118+00:00, run_duration=6.207168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:23:00+00:00, data_interval_end=2024-04-05 03:24:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:24:06.535083982Z [2024-04-05T03:24:06.534+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:24:00+00:00, run_after=2024-04-05T03:25:00+00:00 2024-04-05T03:24:06.541801447Z [2024-04-05T03:24:06.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:24:06.542144614Z [2024-04-05T03:24:06.541+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:23:00+00:00, run_id=scheduled__2024-04-05T03:23:00+00:00, run_start_date=2024-04-05 03:24:00.316860+00:00, run_end_date=2024-04-05 03:24:06.541714+00:00, run_duration=6.224854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:23:00+00:00, data_interval_end=2024-04-05 03:24:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:24:06.552179765Z [2024-04-05T03:24:06.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:24:00+00:00, run_after=2024-04-05T03:25:00+00:00 2024-04-05T03:24:06.579924723Z [2024-04-05T03:24:06.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:23:00+00:00 exited with status success for try_number 1 2024-04-05T03:24:06.580169821Z [2024-04-05T03:24:06.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:23:00+00:00 exited with status success for try_number 1 2024-04-05T03:24:06.585924146Z [2024-04-05T03:24:06.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:23:00+00:00, map_index=-1, run_start_date=2024-04-05 03:24:03.912720+00:00, run_end_date=2024-04-05 03:24:05.990318+00:00, run_duration=2.077598, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:24:00.384245+00:00, queued_by_job_id=1, pid=9246 2024-04-05T03:24:06.586151813Z [2024-04-05T03:24:06.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:23:00+00:00, map_index=-1, run_start_date=2024-04-05 03:24:03.861603+00:00, run_end_date=2024-04-05 03:24:05.999340+00:00, run_duration=2.137737, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:24:00.384245+00:00, queued_by_job_id=1, pid=9245 2024-04-05T03:25:00.467433774Z [2024-04-05T03:25:00.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:25:00+00:00, run_after=2024-04-05T03:26:00+00:00 2024-04-05T03:25:00.479352975Z [2024-04-05T03:25:00.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:25:00+00:00, run_after=2024-04-05T03:30:00+00:00 2024-04-05T03:25:00.486408563Z [2024-04-05T03:25:00.486+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:25:00.551719048Z [2024-04-05T03:25:00.550+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:25:00.551746108Z 2024-04-05T03:25:00.551750921Z 2024-04-05T03:25:00.551754260Z 2024-04-05T03:25:00.551757732Z [2024-04-05T03:25:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:25:00.551761077Z [2024-04-05T03:25:00.551+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:25:00.551764519Z [2024-04-05T03:25:00.551+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:25:00.552222052Z [2024-04-05T03:25:00.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:25:00.552235259Z 2024-04-05T03:25:00.552239577Z 2024-04-05T03:25:00.552243002Z 2024-04-05T03:25:00.556480511Z [2024-04-05T03:25:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:25:00.556725267Z [2024-04-05T03:25:00.556+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:25:00.557155328Z [2024-04-05T03:25:00.556+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:25:00.557382086Z [2024-04-05T03:25:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:25:00.557649660Z [2024-04-05T03:25:00.557+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:25:00.557830820Z [2024-04-05T03:25:00.557+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:25:00.833051559Z [2024-04-05T03:25:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status queued for try_number 1 2024-04-05T03:25:00.835302969Z [2024-04-05T03:25:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:24:00+00:00 exited with status queued for try_number 1 2024-04-05T03:25:00.835585812Z [2024-04-05T03:25:00.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:24:00+00:00 exited with status queued for try_number 1 2024-04-05T03:25:00.843965829Z [2024-04-05T03:25:00.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e30e101-531d-497d-b634-257739c51ca2 2024-04-05T03:25:00.844182915Z [2024-04-05T03:25:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4652506-e59d-4f0d-a1cd-1ccfaf12c0ef 2024-04-05T03:25:00.844346706Z [2024-04-05T03:25:00.844+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a05723e-fa84-4ed3-aa7c-b42ee71822d8 2024-04-05T03:25:05.372256156Z [2024-04-05T03:25:05.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:25:05.372510801Z [2024-04-05T03:25:05.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:24:00+00:00, run_id=scheduled__2024-04-05T03:24:00+00:00, run_start_date=2024-04-05 03:25:00.497423+00:00, run_end_date=2024-04-05 03:25:05.372132+00:00, run_duration=4.874709, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:24:00+00:00, data_interval_end=2024-04-05 03:25:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:25:05.409573271Z [2024-04-05T03:25:05.409+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:25:00+00:00, run_after=2024-04-05T03:26:00+00:00 2024-04-05T03:25:05.493419016Z [2024-04-05T03:25:05.493+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:25:05.493447833Z 2024-04-05T03:25:05.494283711Z [2024-04-05T03:25:05.494+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:25:05.495089760Z [2024-04-05T03:25:05.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:25:05.495102462Z 2024-04-05T03:25:05.502261720Z [2024-04-05T03:25:05.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:25:05.502522863Z [2024-04-05T03:25:05.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:25:05.589492422Z [2024-04-05T03:25:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status queued for try_number 1 2024-04-05T03:25:05.589919918Z [2024-04-05T03:25:05.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status success for try_number 1 2024-04-05T03:25:05.590263391Z [2024-04-05T03:25:05.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:24:00+00:00 exited with status success for try_number 1 2024-04-05T03:25:05.599788295Z [2024-04-05T03:25:05.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55d49ab7-a445-44a5-8e16-979b0c087151 2024-04-05T03:25:05.600156578Z [2024-04-05T03:25:05.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:20:00+00:00, map_index=-1, run_start_date=2024-04-05 03:25:03.163062+00:00, run_end_date=2024-04-05 03:25:04.334061+00:00, run_duration=1.170999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:25:00.553026+00:00, queued_by_job_id=1, pid=9312 2024-04-05T03:25:05.600731050Z [2024-04-05T03:25:05.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:24:00+00:00, map_index=-1, run_start_date=2024-04-05 03:25:03.052814+00:00, run_end_date=2024-04-05 03:25:05.241296+00:00, run_duration=2.188482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:25:00.553026+00:00, queued_by_job_id=1, pid=9310 2024-04-05T03:25:08.117528328Z [2024-04-05T03:25:08.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:25:08.118268981Z [2024-04-05T03:25:08.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:24:00+00:00, run_id=scheduled__2024-04-05T03:24:00+00:00, run_start_date=2024-04-05 03:25:00.498630+00:00, run_end_date=2024-04-05 03:25:08.117696+00:00, run_duration=7.619066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:24:00+00:00, data_interval_end=2024-04-05 03:25:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:25:08.136910878Z [2024-04-05T03:25:08.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:25:00+00:00, run_after=2024-04-05T03:26:00+00:00 2024-04-05T03:25:08.258478388Z [2024-04-05T03:25:08.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:24:00+00:00 exited with status success for try_number 1 2024-04-05T03:25:08.267183386Z [2024-04-05T03:25:08.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:24:00+00:00, map_index=-1, run_start_date=2024-04-05 03:25:03.803898+00:00, run_end_date=2024-04-05 03:25:06.983471+00:00, run_duration=3.179573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:25:00.553026+00:00, queued_by_job_id=1, pid=9313 2024-04-05T03:25:09.354497099Z [2024-04-05T03:25:09.353+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:25:09.354532303Z 2024-04-05T03:25:09.354537224Z [2024-04-05T03:25:09.354+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:25:09.356113508Z [2024-04-05T03:25:09.355+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:25:09.356153096Z 2024-04-05T03:25:09.359583779Z [2024-04-05T03:25:09.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:25:09.359857623Z [2024-04-05T03:25:09.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:25:09.439638969Z [2024-04-05T03:25:09.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status queued for try_number 1 2024-04-05T03:25:09.440099672Z [2024-04-05T03:25:09.439+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status success for try_number 1 2024-04-05T03:25:09.448192229Z [2024-04-05T03:25:09.447+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52c6b3f3-2a12-4760-96a7-f0b6c52f3a81 2024-04-05T03:25:09.448659453Z [2024-04-05T03:25:09.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:20:00+00:00, map_index=-1, run_start_date=2024-04-05 03:25:07.715571+00:00, run_end_date=2024-04-05 03:25:08.202655+00:00, run_duration=0.487084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:25:05.496956+00:00, queued_by_job_id=1, pid=9352 2024-04-05T03:25:13.111286210Z [2024-04-05T03:25:13.110+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:25:13.111317259Z 2024-04-05T03:25:13.113537838Z [2024-04-05T03:25:13.111+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:25:13.113564541Z [2024-04-05T03:25:13.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:25:13.113570740Z 2024-04-05T03:25:13.129186248Z [2024-04-05T03:25:13.128+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:25:13.129288798Z [2024-04-05T03:25:13.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:25:13.362439137Z [2024-04-05T03:25:13.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status queued for try_number 1 2024-04-05T03:25:13.362771915Z [2024-04-05T03:25:13.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status success for try_number 1 2024-04-05T03:25:13.382352481Z [2024-04-05T03:25:13.381+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b41ff7f-c443-4da9-9c2a-f5996a42a8c1 2024-04-05T03:25:13.382640568Z [2024-04-05T03:25:13.382+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:20:00+00:00, map_index=0, run_start_date=2024-04-05 03:25:11.409469+00:00, run_end_date=2024-04-05 03:25:12.699311+00:00, run_duration=1.289842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:25:09.356621+00:00, queued_by_job_id=1, pid=9375 2024-04-05T03:25:16.675160599Z [2024-04-05T03:25:16.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:25:16.675539997Z [2024-04-05T03:25:16.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:20:00+00:00, run_id=scheduled__2024-04-05T03:20:00+00:00, run_start_date=2024-04-05 03:25:00.496141+00:00, run_end_date=2024-04-05 03:25:16.675015+00:00, run_duration=16.178874, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:20:00+00:00, data_interval_end=2024-04-05 03:25:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:25:16.682688277Z [2024-04-05T03:25:16.682+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:25:00+00:00, run_after=2024-04-05T03:30:00+00:00 2024-04-05T03:25:16.719167152Z [2024-04-05T03:25:16.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:20:00+00:00 exited with status success for try_number 1 2024-04-05T03:25:16.725473992Z [2024-04-05T03:25:16.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:20:00+00:00, map_index=-1, run_start_date=2024-04-05 03:25:15.287422+00:00, run_end_date=2024-04-05 03:25:15.694400+00:00, run_duration=0.406978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:25:13.114345+00:00, queued_by_job_id=1, pid=9399 2024-04-05T03:26:00.782904937Z [2024-04-05T03:26:00.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:26:00+00:00, run_after=2024-04-05T03:27:00+00:00 2024-04-05T03:26:00.791991506Z [2024-04-05T03:26:00.791+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:26:00.798614042Z [2024-04-05T03:26:00.798+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:26:00.869253269Z [2024-04-05T03:26:00.868+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:26:00.869285401Z 2024-04-05T03:26:00.869290490Z 2024-04-05T03:26:00.869293972Z 2024-04-05T03:26:00.869773705Z [2024-04-05T03:26:00.869+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:26:00.870054039Z [2024-04-05T03:26:00.869+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:26:00.870301802Z [2024-04-05T03:26:00.870+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:26:00.871210634Z [2024-04-05T03:26:00.870+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:26:00.871220654Z 2024-04-05T03:26:00.871224368Z 2024-04-05T03:26:00.871227873Z 2024-04-05T03:26:00.876221992Z [2024-04-05T03:26:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:26:00.876527780Z [2024-04-05T03:26:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:26:00.876863784Z [2024-04-05T03:26:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:26:00.877218645Z [2024-04-05T03:26:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:26:00.877915142Z [2024-04-05T03:26:00.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:26:00.878153532Z [2024-04-05T03:26:00.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:26:01.131463538Z [2024-04-05T03:26:01.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:24:00+00:00 exited with status queued for try_number 1 2024-04-05T03:26:01.131596556Z [2024-04-05T03:26:01.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status queued for try_number 1 2024-04-05T03:26:01.131692046Z [2024-04-05T03:26:01.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status queued for try_number 1 2024-04-05T03:26:01.141373270Z [2024-04-05T03:26:01.140+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8316a4df-60e1-4eea-b1ef-ceb107e42738 2024-04-05T03:26:01.141414733Z [2024-04-05T03:26:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to f81e2d1b-78de-4aa3-b050-d89373a9af5d 2024-04-05T03:26:01.141551718Z [2024-04-05T03:26:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b2281e7-7be4-4e1b-80fb-23b23dca819b 2024-04-05T03:26:03.746326630Z [2024-04-05T03:26:03.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:26:03.746764216Z [2024-04-05T03:26:03.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:24:00+00:00, run_id=scheduled__2024-04-05T03:24:00+00:00, run_start_date=2024-04-05 03:26:00.815641+00:00, run_end_date=2024-04-05 03:26:03.746173+00:00, run_duration=2.930532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:24:00+00:00, data_interval_end=2024-04-05 03:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:26:03.755763532Z [2024-04-05T03:26:03.755+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:26:00+00:00, run_after=2024-04-05T03:28:00+00:00 2024-04-05T03:26:03.824370697Z [2024-04-05T03:26:03.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:24:00+00:00 exited with status success for try_number 1 2024-04-05T03:26:03.831160182Z [2024-04-05T03:26:03.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:24:00+00:00, map_index=-1, run_start_date=2024-04-05 03:26:01.962973+00:00, run_end_date=2024-04-05 03:26:02.710469+00:00, run_duration=0.747496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:26:00.872472+00:00, queued_by_job_id=1, pid=9403 2024-04-05T03:26:07.169028871Z [2024-04-05T03:26:07.168+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:26:07.169533941Z [2024-04-05T03:26:07.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:25:00+00:00, run_id=scheduled__2024-04-05T03:25:00+00:00, run_start_date=2024-04-05 03:26:00.816883+00:00, run_end_date=2024-04-05 03:26:07.169115+00:00, run_duration=6.352232, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:25:00+00:00, data_interval_end=2024-04-05 03:26:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:26:07.181261055Z [2024-04-05T03:26:07.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:26:00+00:00, run_after=2024-04-05T03:27:00+00:00 2024-04-05T03:26:07.220952777Z [2024-04-05T03:26:07.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status success for try_number 1 2024-04-05T03:26:07.226637329Z [2024-04-05T03:26:07.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:25:00+00:00, map_index=-1, run_start_date=2024-04-05 03:26:04.212228+00:00, run_end_date=2024-04-05 03:26:06.610679+00:00, run_duration=2.398451, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:26:00.872472+00:00, queued_by_job_id=1, pid=9433 2024-04-05T03:26:08.782792965Z [2024-04-05T03:26:08.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:26:08.783101575Z [2024-04-05T03:26:08.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:25:00+00:00, run_id=scheduled__2024-04-05T03:25:00+00:00, run_start_date=2024-04-05 03:26:00.817939+00:00, run_end_date=2024-04-05 03:26:08.782656+00:00, run_duration=7.964717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:25:00+00:00, data_interval_end=2024-04-05 03:26:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:26:08.792358550Z [2024-04-05T03:26:08.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:26:00+00:00, run_after=2024-04-05T03:27:00+00:00 2024-04-05T03:26:08.820546047Z [2024-04-05T03:26:08.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status success for try_number 1 2024-04-05T03:26:08.826979715Z [2024-04-05T03:26:08.826+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:25:00+00:00, map_index=-1, run_start_date=2024-04-05 03:26:04.437110+00:00, run_end_date=2024-04-05 03:26:07.658132+00:00, run_duration=3.221022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:26:00.872472+00:00, queued_by_job_id=1, pid=9434 2024-04-05T03:26:44.594248570Z [2024-04-05T03:26:44.593+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:26:47.016243649Z [2024-04-05T03:26:47.015+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:26:47.016303807Z 2024-04-05T03:26:47.016420689Z [2024-04-05T03:26:47.016+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-05T03:26:47.017109934Z [2024-04-05T03:26:47.016+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:26:47.017122010Z 2024-04-05T03:26:47.020335245Z [2024-04-05T03:26:47.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240405032646_421237', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:26:47.020550997Z [2024-04-05T03:26:47.020+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240405032646_421237', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-05T03:26:47.095033711Z [2024-04-05T03:26:47.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405032646_421237 exited with status queued for try_number 1 2024-04-05T03:26:47.100810849Z [2024-04-05T03:26:47.100+0000] {scheduler_job.py:635} INFO - Setting external_id for to edb81ce8-6a7f-4bbc-876d-87cbf96a434a 2024-04-05T03:26:48.317170134Z [2024-04-05T03:26:48.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:26:48.317529621Z [2024-04-05T03:26:48.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-05 03:26:46.386656+00:00, run_id=scaleout_vdu_20240405032646_421237, run_start_date=2024-04-05 03:26:46.976822+00:00, run_end_date=2024-04-05 03:26:48.317194+00:00, run_duration=1.340372, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 03:26:46.386656+00:00, data_interval_end=2024-04-05 03:26:46.386656+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-05T03:26:48.320736872Z [2024-04-05T03:26:48.320+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-05T03:26:48.349442465Z [2024-04-05T03:26:48.349+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405032646_421237 exited with status success for try_number 1 2024-04-05T03:26:48.356066434Z [2024-04-05T03:26:48.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240405032646_421237, map_index=-1, run_start_date=2024-04-05 03:26:47.666372+00:00, run_end_date=2024-04-05 03:26:48.042213+00:00, run_duration=0.375841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:26:47.017524+00:00, queued_by_job_id=1, pid=9467 2024-04-05T03:27:01.020726458Z [2024-04-05T03:27:01.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:27:00+00:00, run_after=2024-04-05T03:28:00+00:00 2024-04-05T03:27:01.032582422Z [2024-04-05T03:27:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:27:01.137020610Z [2024-04-05T03:27:01.136+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:27:01.137056681Z 2024-04-05T03:27:01.137062658Z 2024-04-05T03:27:01.137473447Z [2024-04-05T03:27:01.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:27:01.137782214Z [2024-04-05T03:27:01.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:27:01.138852990Z [2024-04-05T03:27:01.138+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:27:01.138864259Z 2024-04-05T03:27:01.138869436Z 2024-04-05T03:27:01.144794825Z [2024-04-05T03:27:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:27:01.145762561Z [2024-04-05T03:27:01.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:27:01.146232570Z [2024-04-05T03:27:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:27:01.146487764Z [2024-04-05T03:27:01.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:27:01.336043661Z [2024-04-05T03:27:01.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:26:00+00:00 exited with status queued for try_number 1 2024-04-05T03:27:01.338469972Z [2024-04-05T03:27:01.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:26:00+00:00 exited with status queued for try_number 1 2024-04-05T03:27:01.347581760Z [2024-04-05T03:27:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7ef829a-3487-448a-be4e-b8fffcdf26c2 2024-04-05T03:27:01.348137638Z [2024-04-05T03:27:01.347+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ab9902f-274e-4bfa-b50c-76a0c6ad5bf3 2024-04-05T03:27:07.063978214Z [2024-04-05T03:27:07.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:27:07.064279733Z [2024-04-05T03:27:07.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:26:00+00:00, run_id=scheduled__2024-04-05T03:26:00+00:00, run_start_date=2024-04-05 03:27:01.050573+00:00, run_end_date=2024-04-05 03:27:07.063874+00:00, run_duration=6.013301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:26:00+00:00, data_interval_end=2024-04-05 03:27:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:27:07.087709999Z [2024-04-05T03:27:07.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:27:00+00:00, run_after=2024-04-05T03:28:00+00:00 2024-04-05T03:27:07.120480919Z [2024-04-05T03:27:07.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:26:00+00:00 exited with status success for try_number 1 2024-04-05T03:27:07.125550290Z [2024-04-05T03:27:07.125+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:26:00+00:00, map_index=-1, run_start_date=2024-04-05 03:27:03.816251+00:00, run_end_date=2024-04-05 03:27:06.134543+00:00, run_duration=2.318292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:27:01.139918+00:00, queued_by_job_id=1, pid=9501 2024-04-05T03:27:07.697808098Z [2024-04-05T03:27:07.697+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:27:07.698483152Z [2024-04-05T03:27:07.698+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:26:00+00:00, run_id=scheduled__2024-04-05T03:26:00+00:00, run_start_date=2024-04-05 03:27:01.052157+00:00, run_end_date=2024-04-05 03:27:07.697966+00:00, run_duration=6.645809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:26:00+00:00, data_interval_end=2024-04-05 03:27:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:27:07.710654144Z [2024-04-05T03:27:07.710+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:27:00+00:00, run_after=2024-04-05T03:28:00+00:00 2024-04-05T03:27:07.742536999Z [2024-04-05T03:27:07.742+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:26:00+00:00 exited with status success for try_number 1 2024-04-05T03:27:07.749261102Z [2024-04-05T03:27:07.748+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:26:00+00:00, map_index=-1, run_start_date=2024-04-05 03:27:03.588147+00:00, run_end_date=2024-04-05 03:27:07.035300+00:00, run_duration=3.447153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:27:01.139918+00:00, queued_by_job_id=1, pid=9500 2024-04-05T03:28:00.197930624Z [2024-04-05T03:28:00.197+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:28:00.205692127Z [2024-04-05T03:28:00.205+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:28:00.221420988Z [2024-04-05T03:28:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:28:00+00:00, run_after=2024-04-05T03:29:00+00:00 2024-04-05T03:28:00.327231910Z [2024-04-05T03:28:00.326+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:28:00.327261499Z 2024-04-05T03:28:00.327266904Z 2024-04-05T03:28:00.327271491Z 2024-04-05T03:28:00.327745082Z [2024-04-05T03:28:00.327+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:28:00.327942755Z [2024-04-05T03:28:00.327+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:28:00.328154507Z [2024-04-05T03:28:00.328+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:28:00.328941711Z [2024-04-05T03:28:00.328+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:28:00.328956065Z 2024-04-05T03:28:00.328961107Z 2024-04-05T03:28:00.328965555Z 2024-04-05T03:28:00.333055927Z [2024-04-05T03:28:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:28:00.333294772Z [2024-04-05T03:28:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:28:00.333647267Z [2024-04-05T03:28:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:28:00.333834985Z [2024-04-05T03:28:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:28:00.334190677Z [2024-04-05T03:28:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:28:00.334366652Z [2024-04-05T03:28:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:28:00.679162736Z [2024-04-05T03:28:00.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:26:00+00:00 exited with status queued for try_number 1 2024-04-05T03:28:00.679377058Z [2024-04-05T03:28:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:27:00+00:00 exited with status queued for try_number 1 2024-04-05T03:28:00.679537718Z [2024-04-05T03:28:00.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:27:00+00:00 exited with status queued for try_number 1 2024-04-05T03:28:00.694524840Z [2024-04-05T03:28:00.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09341cf1-e903-4538-b682-aeec75190afe 2024-04-05T03:28:00.695131062Z [2024-04-05T03:28:00.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f0f3a45-4165-4d7e-a2af-9d08283c35f6 2024-04-05T03:28:00.695405912Z [2024-04-05T03:28:00.694+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d5ff38e-e182-4f2d-b3a5-1db8d4c99e34 2024-04-05T03:28:01.937843538Z [2024-04-05T03:28:01.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:28:01.938444331Z [2024-04-05T03:28:01.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:26:00+00:00, run_id=scheduled__2024-04-05T03:26:00+00:00, run_start_date=2024-04-05 03:28:00.251463+00:00, run_end_date=2024-04-05 03:28:01.937828+00:00, run_duration=1.686365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:26:00+00:00, data_interval_end=2024-04-05 03:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:28:01.957081805Z [2024-04-05T03:28:01.956+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:28:00+00:00, run_after=2024-04-05T03:30:00+00:00 2024-04-05T03:28:02.035667449Z [2024-04-05T03:28:02.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:26:00+00:00 exited with status success for try_number 1 2024-04-05T03:28:02.045069335Z [2024-04-05T03:28:02.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:26:00+00:00, map_index=-1, run_start_date=2024-04-05 03:28:01.174415+00:00, run_end_date=2024-04-05 03:28:01.560497+00:00, run_duration=0.386082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:28:00.329932+00:00, queued_by_job_id=1, pid=9536 2024-04-05T03:28:05.635718789Z [2024-04-05T03:28:05.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:28:05.636186535Z [2024-04-05T03:28:05.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:27:00+00:00, run_id=scheduled__2024-04-05T03:27:00+00:00, run_start_date=2024-04-05 03:28:00.255720+00:00, run_end_date=2024-04-05 03:28:05.635596+00:00, run_duration=5.379876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:27:00+00:00, data_interval_end=2024-04-05 03:28:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:28:05.656489708Z [2024-04-05T03:28:05.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:28:00+00:00, run_after=2024-04-05T03:29:00+00:00 2024-04-05T03:28:05.668814148Z [2024-04-05T03:28:05.667+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:28:05.670379030Z [2024-04-05T03:28:05.670+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:27:00+00:00, run_id=scheduled__2024-04-05T03:27:00+00:00, run_start_date=2024-04-05 03:28:00.254412+00:00, run_end_date=2024-04-05 03:28:05.668702+00:00, run_duration=5.41429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:27:00+00:00, data_interval_end=2024-04-05 03:28:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:28:05.693241911Z [2024-04-05T03:28:05.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:28:00+00:00, run_after=2024-04-05T03:29:00+00:00 2024-04-05T03:28:05.740366172Z [2024-04-05T03:28:05.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:27:00+00:00 exited with status success for try_number 1 2024-04-05T03:28:05.740562228Z [2024-04-05T03:28:05.740+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:27:00+00:00 exited with status success for try_number 1 2024-04-05T03:28:05.753319089Z [2024-04-05T03:28:05.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:27:00+00:00, map_index=-1, run_start_date=2024-04-05 03:28:02.745963+00:00, run_end_date=2024-04-05 03:28:04.552181+00:00, run_duration=1.806218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:28:00.329932+00:00, queued_by_job_id=1, pid=9567 2024-04-05T03:28:05.753611389Z [2024-04-05T03:28:05.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:27:00+00:00, map_index=-1, run_start_date=2024-04-05 03:28:02.351221+00:00, run_end_date=2024-04-05 03:28:04.789088+00:00, run_duration=2.437867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:28:00.329932+00:00, queued_by_job_id=1, pid=9566 2024-04-05T03:29:00.443618323Z [2024-04-05T03:29:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:29:00+00:00, run_after=2024-04-05T03:30:00+00:00 2024-04-05T03:29:00.453721644Z [2024-04-05T03:29:00.453+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:29:00.545450583Z [2024-04-05T03:29:00.544+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:29:00.545488232Z 2024-04-05T03:29:00.545495490Z 2024-04-05T03:29:00.545501544Z [2024-04-05T03:29:00.545+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:29:00.546050798Z [2024-04-05T03:29:00.545+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:29:00.547002236Z [2024-04-05T03:29:00.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:29:00.547019250Z 2024-04-05T03:29:00.547024364Z 2024-04-05T03:29:00.551840098Z [2024-04-05T03:29:00.551+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:29:00.552309455Z [2024-04-05T03:29:00.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:29:00.552984908Z [2024-04-05T03:29:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:29:00.553207083Z [2024-04-05T03:29:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:29:00.785348521Z [2024-04-05T03:29:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:28:00+00:00 exited with status queued for try_number 1 2024-04-05T03:29:00.785367509Z [2024-04-05T03:29:00.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:28:00+00:00 exited with status queued for try_number 1 2024-04-05T03:29:00.809476707Z [2024-04-05T03:29:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9243f3ac-f940-497e-a02a-fce9f37c79fb 2024-04-05T03:29:00.809776720Z [2024-04-05T03:29:00.809+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4d42940-8e4c-46b0-93aa-44144bf817ca 2024-04-05T03:29:05.915003266Z [2024-04-05T03:29:05.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:29:05.915487920Z [2024-04-05T03:29:05.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:28:00+00:00, run_id=scheduled__2024-04-05T03:28:00+00:00, run_start_date=2024-04-05 03:29:00.469064+00:00, run_end_date=2024-04-05 03:29:05.915104+00:00, run_duration=5.44604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:28:00+00:00, data_interval_end=2024-04-05 03:29:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:29:05.925841273Z [2024-04-05T03:29:05.925+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:29:00+00:00, run_after=2024-04-05T03:30:00+00:00 2024-04-05T03:29:07.077498948Z [2024-04-05T03:29:07.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:29:07.078307763Z [2024-04-05T03:29:07.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:28:00+00:00, run_id=scheduled__2024-04-05T03:28:00+00:00, run_start_date=2024-04-05 03:29:00.472680+00:00, run_end_date=2024-04-05 03:29:07.077381+00:00, run_duration=6.604701, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:28:00+00:00, data_interval_end=2024-04-05 03:29:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:29:07.087184046Z [2024-04-05T03:29:07.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:29:00+00:00, run_after=2024-04-05T03:30:00+00:00 2024-04-05T03:29:07.118283382Z [2024-04-05T03:29:07.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:28:00+00:00 exited with status success for try_number 1 2024-04-05T03:29:07.118563115Z [2024-04-05T03:29:07.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:28:00+00:00 exited with status success for try_number 1 2024-04-05T03:29:07.137684627Z [2024-04-05T03:29:07.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:28:00+00:00, map_index=-1, run_start_date=2024-04-05 03:29:02.966461+00:00, run_end_date=2024-04-05 03:29:05.819592+00:00, run_duration=2.853131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:29:00.548058+00:00, queued_by_job_id=1, pid=9622 2024-04-05T03:29:07.138089172Z [2024-04-05T03:29:07.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:28:00+00:00, map_index=-1, run_start_date=2024-04-05 03:29:02.770780+00:00, run_end_date=2024-04-05 03:29:06.442528+00:00, run_duration=3.671748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:29:00.548058+00:00, queued_by_job_id=1, pid=9621 2024-04-05T03:30:00.952759880Z [2024-04-05T03:30:00.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:30:00+00:00, run_after=2024-04-05T03:31:00+00:00 2024-04-05T03:30:00.967008650Z [2024-04-05T03:30:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:30:00+00:00, run_after=2024-04-05T03:35:00+00:00 2024-04-05T03:30:00.975444119Z [2024-04-05T03:30:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:30:00.983763924Z [2024-04-05T03:30:00.983+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:30:01.084190072Z [2024-04-05T03:30:01.083+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T03:30:01.084237474Z 2024-04-05T03:30:01.084249888Z 2024-04-05T03:30:01.084261173Z 2024-04-05T03:30:01.084270719Z 2024-04-05T03:30:01.084296119Z [2024-04-05T03:30:01.084+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:30:01.084824962Z [2024-04-05T03:30:01.084+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:30:01.085039200Z [2024-04-05T03:30:01.084+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:30:01.085300517Z [2024-04-05T03:30:01.084+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:30:01.086187440Z [2024-04-05T03:30:01.085+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:30:01.086216477Z 2024-04-05T03:30:01.086230312Z 2024-04-05T03:30:01.086242648Z 2024-04-05T03:30:01.086255065Z 2024-04-05T03:30:01.092372145Z [2024-04-05T03:30:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:30:01.092745157Z [2024-04-05T03:30:01.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:30:01.093370131Z [2024-04-05T03:30:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:30:01.093675155Z [2024-04-05T03:30:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:30:01.094392349Z [2024-04-05T03:30:01.093+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:30:01.094421433Z [2024-04-05T03:30:01.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:30:01.094872228Z [2024-04-05T03:30:01.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:30:01.095049659Z [2024-04-05T03:30:01.094+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:30:01.596822134Z [2024-04-05T03:30:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status queued for try_number 1 2024-04-05T03:30:01.596926865Z [2024-04-05T03:30:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:28:00+00:00 exited with status queued for try_number 1 2024-04-05T03:30:01.597012985Z [2024-04-05T03:30:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:29:00+00:00 exited with status queued for try_number 1 2024-04-05T03:30:01.597076033Z [2024-04-05T03:30:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:29:00+00:00 exited with status queued for try_number 1 2024-04-05T03:30:01.610740976Z [2024-04-05T03:30:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 14a91526-4f3e-4826-af7a-5332aedff4e7 2024-04-05T03:30:01.610811134Z [2024-04-05T03:30:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2abdd08-b0ff-41f4-b774-cc4b69bf790d 2024-04-05T03:30:01.610950632Z [2024-04-05T03:30:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 142db6fa-46d1-4884-9cf1-1d3f0202b26c 2024-04-05T03:30:01.611077437Z [2024-04-05T03:30:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 79745c16-f372-487c-bf3e-53dade20b947 2024-04-05T03:30:03.074112882Z [2024-04-05T03:30:03.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:30:03.074189330Z [2024-04-05T03:30:03.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:28:00+00:00, run_id=scheduled__2024-04-05T03:28:00+00:00, run_start_date=2024-04-05 03:30:00.995145+00:00, run_end_date=2024-04-05 03:30:03.071630+00:00, run_duration=2.076485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:28:00+00:00, data_interval_end=2024-04-05 03:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:30:03.083968533Z [2024-04-05T03:30:03.082+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:30:00+00:00, run_after=2024-04-05T03:32:00+00:00 2024-04-05T03:30:03.285408073Z [2024-04-05T03:30:03.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:28:00+00:00 exited with status success for try_number 1 2024-04-05T03:30:03.296229849Z [2024-04-05T03:30:03.295+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:28:00+00:00, map_index=-1, run_start_date=2024-04-05 03:30:01.880733+00:00, run_end_date=2024-04-05 03:30:02.543545+00:00, run_duration=0.662812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:30:01.087128+00:00, queued_by_job_id=1, pid=9659 2024-04-05T03:30:08.465665462Z [2024-04-05T03:30:08.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:30:08.467409537Z [2024-04-05T03:30:08.467+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:29:00+00:00, run_id=scheduled__2024-04-05T03:29:00+00:00, run_start_date=2024-04-05 03:30:00.996231+00:00, run_end_date=2024-04-05 03:30:08.465572+00:00, run_duration=7.469341, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:29:00+00:00, data_interval_end=2024-04-05 03:30:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:30:08.477849811Z [2024-04-05T03:30:08.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:30:00+00:00, run_after=2024-04-05T03:31:00+00:00 2024-04-05T03:30:08.525240910Z [2024-04-05T03:30:08.523+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:30:08.525265361Z 2024-04-05T03:30:08.525270045Z [2024-04-05T03:30:08.524+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:30:08.526292331Z [2024-04-05T03:30:08.526+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:30:08.526310977Z 2024-04-05T03:30:08.529948644Z [2024-04-05T03:30:08.529+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:30:08.530893869Z [2024-04-05T03:30:08.530+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:30:08.623893992Z [2024-04-05T03:30:08.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status queued for try_number 1 2024-04-05T03:30:08.624380912Z [2024-04-05T03:30:08.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status success for try_number 1 2024-04-05T03:30:08.624639723Z [2024-04-05T03:30:08.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:29:00+00:00 exited with status success for try_number 1 2024-04-05T03:30:08.632658629Z [2024-04-05T03:30:08.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86be55a3-07fe-4948-9578-690056cbaa18 2024-04-05T03:30:08.633022182Z [2024-04-05T03:30:08.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:25:00+00:00, map_index=-1, run_start_date=2024-04-05 03:30:06.642282+00:00, run_end_date=2024-04-05 03:30:07.408488+00:00, run_duration=0.766206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:30:01.087128+00:00, queued_by_job_id=1, pid=9719 2024-04-05T03:30:08.633343386Z [2024-04-05T03:30:08.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:29:00+00:00, map_index=-1, run_start_date=2024-04-05 03:30:04.932952+00:00, run_end_date=2024-04-05 03:30:08.432696+00:00, run_duration=3.499744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:30:01.087128+00:00, queued_by_job_id=1, pid=9691 2024-04-05T03:30:10.119472195Z [2024-04-05T03:30:10.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:30:10.119618699Z [2024-04-05T03:30:10.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:29:00+00:00, run_id=scheduled__2024-04-05T03:29:00+00:00, run_start_date=2024-04-05 03:30:00.997246+00:00, run_end_date=2024-04-05 03:30:10.119327+00:00, run_duration=9.122081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:29:00+00:00, data_interval_end=2024-04-05 03:30:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:30:10.140200078Z [2024-04-05T03:30:10.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:30:00+00:00, run_after=2024-04-05T03:31:00+00:00 2024-04-05T03:30:10.248456012Z [2024-04-05T03:30:10.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:29:00+00:00 exited with status success for try_number 1 2024-04-05T03:30:10.264597164Z [2024-04-05T03:30:10.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:29:00+00:00, map_index=-1, run_start_date=2024-04-05 03:30:04.919852+00:00, run_end_date=2024-04-05 03:30:08.990330+00:00, run_duration=4.070478, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:30:01.087128+00:00, queued_by_job_id=1, pid=9690 2024-04-05T03:30:11.338817972Z [2024-04-05T03:30:11.338+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:30:11.338847774Z 2024-04-05T03:30:11.339237752Z [2024-04-05T03:30:11.338+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:30:11.340283888Z [2024-04-05T03:30:11.339+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:30:11.340290838Z 2024-04-05T03:30:11.344326672Z [2024-04-05T03:30:11.343+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:30:11.344527033Z [2024-04-05T03:30:11.344+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:30:11.388743620Z [2024-04-05T03:30:11.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status queued for try_number 1 2024-04-05T03:30:11.389050872Z [2024-04-05T03:30:11.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status success for try_number 1 2024-04-05T03:30:11.397389259Z [2024-04-05T03:30:11.396+0000] {scheduler_job.py:635} INFO - Setting external_id for to 213cba13-6cf1-404a-b3d8-dd763eb014df 2024-04-05T03:30:11.397914446Z [2024-04-05T03:30:11.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:25:00+00:00, map_index=-1, run_start_date=2024-04-05 03:30:10.680450+00:00, run_end_date=2024-04-05 03:30:11.101771+00:00, run_duration=0.421321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:30:08.526739+00:00, queued_by_job_id=1, pid=9749 2024-04-05T03:30:14.725131423Z [2024-04-05T03:30:14.724+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:30:14.725178554Z 2024-04-05T03:30:14.725250755Z [2024-04-05T03:30:14.725+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:30:14.726440043Z [2024-04-05T03:30:14.725+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:30:14.726457428Z 2024-04-05T03:30:14.731506805Z [2024-04-05T03:30:14.731+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:30:14.731697433Z [2024-04-05T03:30:14.731+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:30:14.819347089Z [2024-04-05T03:30:14.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status queued for try_number 1 2024-04-05T03:30:14.819636509Z [2024-04-05T03:30:14.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status success for try_number 1 2024-04-05T03:30:14.837144361Z [2024-04-05T03:30:14.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc026d97-0e1e-48ef-b5a2-a145e98fb5be 2024-04-05T03:30:14.837656473Z [2024-04-05T03:30:14.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:25:00+00:00, map_index=0, run_start_date=2024-04-05 03:30:13.264069+00:00, run_end_date=2024-04-05 03:30:13.738721+00:00, run_duration=0.474652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:30:11.341011+00:00, queued_by_job_id=1, pid=9764 2024-04-05T03:30:17.596039584Z [2024-04-05T03:30:17.595+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:30:17.596470544Z [2024-04-05T03:30:17.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:25:00+00:00, run_id=scheduled__2024-04-05T03:25:00+00:00, run_start_date=2024-04-05 03:30:00.993890+00:00, run_end_date=2024-04-05 03:30:17.596085+00:00, run_duration=16.602195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:25:00+00:00, data_interval_end=2024-04-05 03:30:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:30:17.604433766Z [2024-04-05T03:30:17.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:30:00+00:00, run_after=2024-04-05T03:35:00+00:00 2024-04-05T03:30:17.640156717Z [2024-04-05T03:30:17.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:25:00+00:00 exited with status success for try_number 1 2024-04-05T03:30:17.647940493Z [2024-04-05T03:30:17.647+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:25:00+00:00, map_index=-1, run_start_date=2024-04-05 03:30:16.642360+00:00, run_end_date=2024-04-05 03:30:17.053559+00:00, run_duration=0.411199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:30:14.727204+00:00, queued_by_job_id=1, pid=9776 2024-04-05T03:31:00.372436994Z [2024-04-05T03:31:00.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:31:00+00:00, run_after=2024-04-05T03:32:00+00:00 2024-04-05T03:31:00.381116808Z [2024-04-05T03:31:00.380+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:31:00.448336839Z [2024-04-05T03:31:00.447+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:31:00.448382642Z 2024-04-05T03:31:00.448391778Z 2024-04-05T03:31:00.449280822Z [2024-04-05T03:31:00.448+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:31:00.449902731Z [2024-04-05T03:31:00.449+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:31:00.451302566Z [2024-04-05T03:31:00.450+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:31:00.451327838Z 2024-04-05T03:31:00.451359746Z 2024-04-05T03:31:00.457352769Z [2024-04-05T03:31:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:31:00.458057545Z [2024-04-05T03:31:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:31:00.458807743Z [2024-04-05T03:31:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:31:00.459350894Z [2024-04-05T03:31:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:31:00.620648490Z [2024-04-05T03:31:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status queued for try_number 1 2024-04-05T03:31:00.620690113Z [2024-04-05T03:31:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status queued for try_number 1 2024-04-05T03:31:00.627410834Z [2024-04-05T03:31:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to d523c931-1447-433d-a813-c419ddadb693 2024-04-05T03:31:00.627549196Z [2024-04-05T03:31:00.627+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbf06972-458a-4b0b-86b6-12365370c316 2024-04-05T03:31:05.793712525Z [2024-04-05T03:31:05.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:31:05.794801901Z [2024-04-05T03:31:05.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:30:00+00:00, run_id=scheduled__2024-04-05T03:30:00+00:00, run_start_date=2024-04-05 03:31:00.392787+00:00, run_end_date=2024-04-05 03:31:05.793693+00:00, run_duration=5.400906, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:30:00+00:00, data_interval_end=2024-04-05 03:31:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:31:05.810855733Z [2024-04-05T03:31:05.810+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:31:00+00:00, run_after=2024-04-05T03:32:00+00:00 2024-04-05T03:31:05.873904001Z [2024-04-05T03:31:05.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status success for try_number 1 2024-04-05T03:31:05.880973928Z [2024-04-05T03:31:05.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:30:00+00:00, map_index=-1, run_start_date=2024-04-05 03:31:02.565952+00:00, run_end_date=2024-04-05 03:31:05.120961+00:00, run_duration=2.555009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:31:00.452475+00:00, queued_by_job_id=1, pid=9799 2024-04-05T03:31:06.941283216Z [2024-04-05T03:31:06.940+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:31:06.941608096Z [2024-04-05T03:31:06.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:30:00+00:00, run_id=scheduled__2024-04-05T03:30:00+00:00, run_start_date=2024-04-05 03:31:00.394169+00:00, run_end_date=2024-04-05 03:31:06.941280+00:00, run_duration=6.547111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:30:00+00:00, data_interval_end=2024-04-05 03:31:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:31:06.955099656Z [2024-04-05T03:31:06.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:31:00+00:00, run_after=2024-04-05T03:32:00+00:00 2024-04-05T03:31:06.989085514Z [2024-04-05T03:31:06.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status success for try_number 1 2024-04-05T03:31:06.995323496Z [2024-04-05T03:31:06.994+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:30:00+00:00, map_index=-1, run_start_date=2024-04-05 03:31:02.799877+00:00, run_end_date=2024-04-05 03:31:05.851553+00:00, run_duration=3.051676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:31:00.452475+00:00, queued_by_job_id=1, pid=9800 2024-04-05T03:31:44.662051429Z [2024-04-05T03:31:44.661+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:32:00.691807613Z [2024-04-05T03:32:00.691+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:32:00.722578270Z [2024-04-05T03:32:00.717+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:32:00+00:00, run_after=2024-04-05T03:33:00+00:00 2024-04-05T03:32:00.732194049Z [2024-04-05T03:32:00.731+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:32:00.817710954Z [2024-04-05T03:32:00.817+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:32:00.817740095Z 2024-04-05T03:32:00.817764250Z 2024-04-05T03:32:00.817768378Z 2024-04-05T03:32:00.817787807Z [2024-04-05T03:32:00.817+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:32:00.818243544Z [2024-04-05T03:32:00.817+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:32:00.818623526Z [2024-04-05T03:32:00.818+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:32:00.819969762Z [2024-04-05T03:32:00.819+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:32:00.819983313Z 2024-04-05T03:32:00.819998822Z 2024-04-05T03:32:00.820003777Z 2024-04-05T03:32:00.824623946Z [2024-04-05T03:32:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:32:00.824820991Z [2024-04-05T03:32:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:32:00.825129825Z [2024-04-05T03:32:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:32:00.825288897Z [2024-04-05T03:32:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:32:00.825689389Z [2024-04-05T03:32:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:32:00.825794903Z [2024-04-05T03:32:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:32:01.083007266Z [2024-04-05T03:32:01.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status queued for try_number 1 2024-04-05T03:32:01.083343991Z [2024-04-05T03:32:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:31:00+00:00 exited with status queued for try_number 1 2024-04-05T03:32:01.083599641Z [2024-04-05T03:32:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:31:00+00:00 exited with status queued for try_number 1 2024-04-05T03:32:01.093947734Z [2024-04-05T03:32:01.093+0000] {scheduler_job.py:635} INFO - Setting external_id for to 690ace0c-c379-4779-8519-7ab7c3a3882c 2024-04-05T03:32:01.094308922Z [2024-04-05T03:32:01.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9545b78b-9031-4283-8bd5-9e5f64394c34 2024-04-05T03:32:01.094663191Z [2024-04-05T03:32:01.094+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b71f137-fc1e-4f96-8dc3-12b5dd58ef45 2024-04-05T03:32:03.309635429Z [2024-04-05T03:32:03.309+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:32:03.310041272Z [2024-04-05T03:32:03.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:30:00+00:00, run_id=scheduled__2024-04-05T03:30:00+00:00, run_start_date=2024-04-05 03:32:00.754850+00:00, run_end_date=2024-04-05 03:32:03.309627+00:00, run_duration=2.554777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:30:00+00:00, data_interval_end=2024-04-05 03:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:32:03.321239670Z [2024-04-05T03:32:03.320+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:32:00+00:00, run_after=2024-04-05T03:34:00+00:00 2024-04-05T03:32:03.423046359Z [2024-04-05T03:32:03.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status success for try_number 1 2024-04-05T03:32:03.433235389Z [2024-04-05T03:32:03.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:30:00+00:00, map_index=-1, run_start_date=2024-04-05 03:32:01.813012+00:00, run_end_date=2024-04-05 03:32:02.247230+00:00, run_duration=0.434218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:32:00.821311+00:00, queued_by_job_id=1, pid=9834 2024-04-05T03:32:06.649944633Z [2024-04-05T03:32:06.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:32:06.650371958Z [2024-04-05T03:32:06.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:31:00+00:00, run_id=scheduled__2024-04-05T03:31:00+00:00, run_start_date=2024-04-05 03:32:00.756628+00:00, run_end_date=2024-04-05 03:32:06.649814+00:00, run_duration=5.893186, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:31:00+00:00, data_interval_end=2024-04-05 03:32:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:32:06.662449841Z [2024-04-05T03:32:06.662+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:32:00+00:00, run_after=2024-04-05T03:33:00+00:00 2024-04-05T03:32:06.703145856Z [2024-04-05T03:32:06.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:31:00+00:00 exited with status success for try_number 1 2024-04-05T03:32:06.715418916Z [2024-04-05T03:32:06.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:31:00+00:00, map_index=-1, run_start_date=2024-04-05 03:32:03.382670+00:00, run_end_date=2024-04-05 03:32:05.645619+00:00, run_duration=2.262949, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:32:00.821311+00:00, queued_by_job_id=1, pid=9864 2024-04-05T03:32:07.751041368Z [2024-04-05T03:32:07.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:32:07.751229277Z [2024-04-05T03:32:07.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:31:00+00:00, run_id=scheduled__2024-04-05T03:31:00+00:00, run_start_date=2024-04-05 03:32:00.757885+00:00, run_end_date=2024-04-05 03:32:07.750931+00:00, run_duration=6.993046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:31:00+00:00, data_interval_end=2024-04-05 03:32:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:32:07.759696155Z [2024-04-05T03:32:07.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:32:00+00:00, run_after=2024-04-05T03:33:00+00:00 2024-04-05T03:32:07.795286235Z [2024-04-05T03:32:07.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:31:00+00:00 exited with status success for try_number 1 2024-04-05T03:32:07.799925748Z [2024-04-05T03:32:07.799+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:31:00+00:00, map_index=-1, run_start_date=2024-04-05 03:32:03.727381+00:00, run_end_date=2024-04-05 03:32:06.996455+00:00, run_duration=3.269074, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:32:00.821311+00:00, queued_by_job_id=1, pid=9865 2024-04-05T03:32:47.105074597Z [2024-04-05T03:32:47.104+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:32:47.105104920Z 2024-04-05T03:32:47.105118344Z [2024-04-05T03:32:47.104+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-05T03:32:47.105710884Z [2024-04-05T03:32:47.105+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:32:47.105719784Z 2024-04-05T03:32:47.107808689Z [2024-04-05T03:32:47.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240405033246_838086', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:32:47.107982882Z [2024-04-05T03:32:47.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240405033246_838086', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-05T03:32:47.149116603Z [2024-04-05T03:32:47.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405033246_838086 exited with status queued for try_number 1 2024-04-05T03:32:47.157696008Z [2024-04-05T03:32:47.157+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff748c48-17a5-4a34-9807-abf67e8ed8b8 2024-04-05T03:32:48.442747251Z [2024-04-05T03:32:48.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:32:48.443280947Z [2024-04-05T03:32:48.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-05 03:32:46.381841+00:00, run_id=scaleout_vdu_20240405033246_838086, run_start_date=2024-04-05 03:32:47.079715+00:00, run_end_date=2024-04-05 03:32:48.442858+00:00, run_duration=1.363143, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 03:32:46.381841+00:00, data_interval_end=2024-04-05 03:32:46.381841+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-05T03:32:48.446830860Z [2024-04-05T03:32:48.446+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-05T03:32:48.471787023Z [2024-04-05T03:32:48.471+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405033246_838086 exited with status success for try_number 1 2024-04-05T03:32:48.482334824Z [2024-04-05T03:32:48.481+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240405033246_838086, map_index=-1, run_start_date=2024-04-05 03:32:47.848909+00:00, run_end_date=2024-04-05 03:32:48.164068+00:00, run_duration=0.315159, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:32:47.106063+00:00, queued_by_job_id=1, pid=9899 2024-04-05T03:33:00.176480600Z [2024-04-05T03:33:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:33:00.200219347Z [2024-04-05T03:33:00.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:33:00+00:00, run_after=2024-04-05T03:34:00+00:00 2024-04-05T03:33:00.260571942Z [2024-04-05T03:33:00.259+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:33:00.260607724Z 2024-04-05T03:33:00.260630239Z 2024-04-05T03:33:00.261359126Z [2024-04-05T03:33:00.260+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:33:00.262001233Z [2024-04-05T03:33:00.261+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:33:00.263537546Z [2024-04-05T03:33:00.263+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:33:00.263565971Z 2024-04-05T03:33:00.263569507Z 2024-04-05T03:33:00.269029331Z [2024-04-05T03:33:00.268+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:33:00.269642883Z [2024-04-05T03:33:00.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:33:00.270426971Z [2024-04-05T03:33:00.270+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:33:00.270849628Z [2024-04-05T03:33:00.270+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:33:00.444726641Z [2024-04-05T03:33:00.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:32:00+00:00 exited with status queued for try_number 1 2024-04-05T03:33:00.444889314Z [2024-04-05T03:33:00.444+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:32:00+00:00 exited with status queued for try_number 1 2024-04-05T03:33:00.456949678Z [2024-04-05T03:33:00.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11d902c1-e797-45a7-b5ff-03d9706a2c3b 2024-04-05T03:33:00.457077097Z [2024-04-05T03:33:00.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 516e55d4-c4c5-44e4-9051-634a1d1b4d97 2024-04-05T03:33:04.833823310Z [2024-04-05T03:33:04.833+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:33:04.834211479Z [2024-04-05T03:33:04.833+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:32:00+00:00, run_id=scheduled__2024-04-05T03:32:00+00:00, run_start_date=2024-04-05 03:33:00.216116+00:00, run_end_date=2024-04-05 03:33:04.833779+00:00, run_duration=4.617663, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:32:00+00:00, data_interval_end=2024-04-05 03:33:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:33:04.844460128Z [2024-04-05T03:33:04.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:33:00+00:00, run_after=2024-04-05T03:34:00+00:00 2024-04-05T03:33:04.890326651Z [2024-04-05T03:33:04.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:32:00+00:00 exited with status success for try_number 1 2024-04-05T03:33:04.895924229Z [2024-04-05T03:33:04.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:32:00+00:00, map_index=-1, run_start_date=2024-04-05 03:33:02.169336+00:00, run_end_date=2024-04-05 03:33:04.648147+00:00, run_duration=2.478811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:33:00.264953+00:00, queued_by_job_id=1, pid=9931 2024-04-05T03:33:05.533321667Z [2024-04-05T03:33:05.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:33:05.533839485Z [2024-04-05T03:33:05.533+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:32:00+00:00, run_id=scheduled__2024-04-05T03:32:00+00:00, run_start_date=2024-04-05 03:33:00.214779+00:00, run_end_date=2024-04-05 03:33:05.533226+00:00, run_duration=5.318447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:32:00+00:00, data_interval_end=2024-04-05 03:33:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:33:05.552548483Z [2024-04-05T03:33:05.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:33:00+00:00, run_after=2024-04-05T03:34:00+00:00 2024-04-05T03:33:05.585901636Z [2024-04-05T03:33:05.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:32:00+00:00 exited with status success for try_number 1 2024-04-05T03:33:05.595434828Z [2024-04-05T03:33:05.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:32:00+00:00, map_index=-1, run_start_date=2024-04-05 03:33:02.432469+00:00, run_end_date=2024-04-05 03:33:05.032015+00:00, run_duration=2.599546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:33:00.264953+00:00, queued_by_job_id=1, pid=9932 2024-04-05T03:34:00.251974331Z [2024-04-05T03:34:00.251+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:34:00.264033074Z [2024-04-05T03:34:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:34:00+00:00, run_after=2024-04-05T03:35:00+00:00 2024-04-05T03:34:00.271310420Z [2024-04-05T03:34:00.270+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:34:00.342532282Z [2024-04-05T03:34:00.342+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:34:00.342569035Z 2024-04-05T03:34:00.342641400Z 2024-04-05T03:34:00.342674012Z 2024-04-05T03:34:00.342736355Z [2024-04-05T03:34:00.342+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:34:00.342993891Z [2024-04-05T03:34:00.342+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:34:00.343354961Z [2024-04-05T03:34:00.343+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:34:00.344802632Z [2024-04-05T03:34:00.344+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:34:00.344820785Z 2024-04-05T03:34:00.344828645Z 2024-04-05T03:34:00.344835620Z 2024-04-05T03:34:00.348723059Z [2024-04-05T03:34:00.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:34:00.348952212Z [2024-04-05T03:34:00.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:34:00.349406601Z [2024-04-05T03:34:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:34:00.349758833Z [2024-04-05T03:34:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:34:00.350095690Z [2024-04-05T03:34:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:34:00.350288084Z [2024-04-05T03:34:00.350+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:34:00.572924673Z [2024-04-05T03:34:00.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:32:00+00:00 exited with status queued for try_number 1 2024-04-05T03:34:00.573019323Z [2024-04-05T03:34:00.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:33:00+00:00 exited with status queued for try_number 1 2024-04-05T03:34:00.573337282Z [2024-04-05T03:34:00.572+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:33:00+00:00 exited with status queued for try_number 1 2024-04-05T03:34:00.585746343Z [2024-04-05T03:34:00.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to 772176c9-2660-40ed-b23c-c60b7ba92245 2024-04-05T03:34:00.586177472Z [2024-04-05T03:34:00.585+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd7e8f99-61ab-45ce-8421-c42485638439 2024-04-05T03:34:00.586448176Z [2024-04-05T03:34:00.586+0000] {scheduler_job.py:635} INFO - Setting external_id for to 16c11f1b-019e-4bc6-aef1-15cb819142b1 2024-04-05T03:34:02.486156655Z [2024-04-05T03:34:02.481+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:34:02.486193127Z [2024-04-05T03:34:02.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:32:00+00:00, run_id=scheduled__2024-04-05T03:32:00+00:00, run_start_date=2024-04-05 03:34:00.280391+00:00, run_end_date=2024-04-05 03:34:02.482971+00:00, run_duration=2.20258, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:32:00+00:00, data_interval_end=2024-04-05 03:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:34:02.518754681Z [2024-04-05T03:34:02.518+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:34:00+00:00, run_after=2024-04-05T03:36:00+00:00 2024-04-05T03:34:02.670332705Z [2024-04-05T03:34:02.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:32:00+00:00 exited with status success for try_number 1 2024-04-05T03:34:02.684269312Z [2024-04-05T03:34:02.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:32:00+00:00, map_index=-1, run_start_date=2024-04-05 03:34:01.133150+00:00, run_end_date=2024-04-05 03:34:01.597048+00:00, run_duration=0.463898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:34:00.345764+00:00, queued_by_job_id=1, pid=9968 2024-04-05T03:34:05.302487946Z [2024-04-05T03:34:05.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:34:05.303003628Z [2024-04-05T03:34:05.302+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:33:00+00:00, run_id=scheduled__2024-04-05T03:33:00+00:00, run_start_date=2024-04-05 03:34:00.281505+00:00, run_end_date=2024-04-05 03:34:05.302612+00:00, run_duration=5.021107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:33:00+00:00, data_interval_end=2024-04-05 03:34:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:34:05.314626801Z [2024-04-05T03:34:05.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:34:00+00:00, run_after=2024-04-05T03:35:00+00:00 2024-04-05T03:34:05.377438128Z [2024-04-05T03:34:05.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:33:00+00:00 exited with status success for try_number 1 2024-04-05T03:34:05.385426350Z [2024-04-05T03:34:05.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:33:00+00:00, map_index=-1, run_start_date=2024-04-05 03:34:02.536431+00:00, run_end_date=2024-04-05 03:34:04.529375+00:00, run_duration=1.992944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:34:00.345764+00:00, queued_by_job_id=1, pid=9999 2024-04-05T03:34:06.456417296Z [2024-04-05T03:34:06.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:34:06.461983667Z [2024-04-05T03:34:06.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:33:00+00:00, run_id=scheduled__2024-04-05T03:33:00+00:00, run_start_date=2024-04-05 03:34:00.282544+00:00, run_end_date=2024-04-05 03:34:06.461199+00:00, run_duration=6.178655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:33:00+00:00, data_interval_end=2024-04-05 03:34:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:34:06.474303674Z [2024-04-05T03:34:06.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:34:00+00:00, run_after=2024-04-05T03:35:00+00:00 2024-04-05T03:34:06.504417309Z [2024-04-05T03:34:06.504+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:33:00+00:00 exited with status success for try_number 1 2024-04-05T03:34:06.509217321Z [2024-04-05T03:34:06.508+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:33:00+00:00, map_index=-1, run_start_date=2024-04-05 03:34:02.526686+00:00, run_end_date=2024-04-05 03:34:05.874933+00:00, run_duration=3.348247, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:34:00.345764+00:00, queued_by_job_id=1, pid=9998 2024-04-05T03:34:46.995680492Z [2024-04-05T03:34:46.995+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:34:46.995711109Z 2024-04-05T03:34:46.995723088Z [2024-04-05T03:34:46.995+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-05T03:34:46.996386225Z [2024-04-05T03:34:46.996+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:34:46.996399255Z 2024-04-05T03:34:47.000132865Z [2024-04-05T03:34:46.999+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240405033446_928531', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:34:47.002587332Z [2024-04-05T03:34:47.000+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240405033446_928531', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-05T03:34:47.115700742Z [2024-04-05T03:34:47.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405033446_928531 exited with status queued for try_number 1 2024-04-05T03:34:47.127718091Z [2024-04-05T03:34:47.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to 657acef7-26c9-43c7-b43b-9b7e3463aa7d 2024-04-05T03:34:48.267906137Z [2024-04-05T03:34:48.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:34:48.268782332Z [2024-04-05T03:34:48.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-05 03:34:46.395201+00:00, run_id=scaleout_vdu_20240405033446_928531, run_start_date=2024-04-05 03:34:46.968605+00:00, run_end_date=2024-04-05 03:34:48.268445+00:00, run_duration=1.29984, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 03:34:46.395201+00:00, data_interval_end=2024-04-05 03:34:46.395201+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-05T03:34:48.272715697Z [2024-04-05T03:34:48.272+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-05T03:34:48.312154309Z [2024-04-05T03:34:48.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405033446_928531 exited with status success for try_number 1 2024-04-05T03:34:48.322233582Z [2024-04-05T03:34:48.321+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240405033446_928531, map_index=-1, run_start_date=2024-04-05 03:34:47.770545+00:00, run_end_date=2024-04-05 03:34:48.141130+00:00, run_duration=0.370585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:34:46.996801+00:00, queued_by_job_id=1, pid=10032 2024-04-05T03:35:00.407363496Z [2024-04-05T03:35:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:35:00+00:00, run_after=2024-04-05T03:36:00+00:00 2024-04-05T03:35:00.414457597Z [2024-04-05T03:35:00.414+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:35:00.429158793Z [2024-04-05T03:35:00.428+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:35:00+00:00, run_after=2024-04-05T03:40:00+00:00 2024-04-05T03:35:00.499493560Z [2024-04-05T03:35:00.499+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:35:00.499536802Z 2024-04-05T03:35:00.499544868Z 2024-04-05T03:35:00.499551070Z 2024-04-05T03:35:00.499557672Z [2024-04-05T03:35:00.499+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:35:00.499591017Z [2024-04-05T03:35:00.499+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:35:00.499872742Z [2024-04-05T03:35:00.499+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:35:00.500513508Z [2024-04-05T03:35:00.500+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:35:00.500527295Z 2024-04-05T03:35:00.500531307Z 2024-04-05T03:35:00.500534667Z 2024-04-05T03:35:00.504004816Z [2024-04-05T03:35:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:35:00.504254765Z [2024-04-05T03:35:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:35:00.504566303Z [2024-04-05T03:35:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:35:00.504791038Z [2024-04-05T03:35:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:35:00.505087556Z [2024-04-05T03:35:00.504+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:35:00.505150872Z [2024-04-05T03:35:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:35:00.824498972Z [2024-04-05T03:35:00.823+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status queued for try_number 1 2024-04-05T03:35:00.824697018Z [2024-04-05T03:35:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:34:00+00:00 exited with status queued for try_number 1 2024-04-05T03:35:00.824851474Z [2024-04-05T03:35:00.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:34:00+00:00 exited with status queued for try_number 1 2024-04-05T03:35:00.833340867Z [2024-04-05T03:35:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 040ee712-de7d-4735-b9f9-b77729264170 2024-04-05T03:35:00.833652257Z [2024-04-05T03:35:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f2a24cd-578e-4a01-affc-4154fc42165c 2024-04-05T03:35:00.833804547Z [2024-04-05T03:35:00.833+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6bab84e8-f130-497e-bcf5-6aef388e6709 2024-04-05T03:35:04.758560910Z [2024-04-05T03:35:04.758+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:35:04.758590049Z 2024-04-05T03:35:04.758673764Z [2024-04-05T03:35:04.758+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:35:04.759118545Z [2024-04-05T03:35:04.758+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:35:04.759128409Z 2024-04-05T03:35:04.761850339Z [2024-04-05T03:35:04.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:35:04.761939875Z [2024-04-05T03:35:04.761+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:35:04.838663363Z [2024-04-05T03:35:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status queued for try_number 1 2024-04-05T03:35:04.838999349Z [2024-04-05T03:35:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status success for try_number 1 2024-04-05T03:35:04.855217792Z [2024-04-05T03:35:04.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4489b107-1a17-42c4-aba8-ba0c9330d4b7 2024-04-05T03:35:04.855737355Z [2024-04-05T03:35:04.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:30:00+00:00, map_index=-1, run_start_date=2024-04-05 03:35:03.733678+00:00, run_end_date=2024-04-05 03:35:04.444794+00:00, run_duration=0.711116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:35:00.501189+00:00, queued_by_job_id=1, pid=10077 2024-04-05T03:35:06.135685940Z [2024-04-05T03:35:06.135+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:35:06.136172864Z [2024-04-05T03:35:06.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:34:00+00:00, run_id=scheduled__2024-04-05T03:34:00+00:00, run_start_date=2024-04-05 03:35:00.441251+00:00, run_end_date=2024-04-05 03:35:06.135708+00:00, run_duration=5.694457, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:34:00+00:00, data_interval_end=2024-04-05 03:35:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:35:06.146501262Z [2024-04-05T03:35:06.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:35:00+00:00, run_after=2024-04-05T03:36:00+00:00 2024-04-05T03:35:06.156499242Z [2024-04-05T03:35:06.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:35:06.156782780Z [2024-04-05T03:35:06.156+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:34:00+00:00, run_id=scheduled__2024-04-05T03:34:00+00:00, run_start_date=2024-04-05 03:35:00.442481+00:00, run_end_date=2024-04-05 03:35:06.156454+00:00, run_duration=5.713973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:34:00+00:00, data_interval_end=2024-04-05 03:35:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:35:06.168454142Z [2024-04-05T03:35:06.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:35:00+00:00, run_after=2024-04-05T03:36:00+00:00 2024-04-05T03:35:06.214390459Z [2024-04-05T03:35:06.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:34:00+00:00 exited with status success for try_number 1 2024-04-05T03:35:06.214462343Z [2024-04-05T03:35:06.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:34:00+00:00 exited with status success for try_number 1 2024-04-05T03:35:06.224163790Z [2024-04-05T03:35:06.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:34:00+00:00, map_index=-1, run_start_date=2024-04-05 03:35:03.260516+00:00, run_end_date=2024-04-05 03:35:05.362270+00:00, run_duration=2.101754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:35:00.501189+00:00, queued_by_job_id=1, pid=10075 2024-04-05T03:35:06.224675228Z [2024-04-05T03:35:06.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:34:00+00:00, map_index=-1, run_start_date=2024-04-05 03:35:03.271708+00:00, run_end_date=2024-04-05 03:35:05.819395+00:00, run_duration=2.547687, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:35:00.501189+00:00, queued_by_job_id=1, pid=10076 2024-04-05T03:35:08.752785363Z [2024-04-05T03:35:08.752+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:35:08.752887926Z 2024-04-05T03:35:08.752933832Z [2024-04-05T03:35:08.752+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:35:08.753820056Z [2024-04-05T03:35:08.753+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:35:08.753846345Z 2024-04-05T03:35:08.757583169Z [2024-04-05T03:35:08.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:35:08.758051610Z [2024-04-05T03:35:08.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:35:08.813337191Z [2024-04-05T03:35:08.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status queued for try_number 1 2024-04-05T03:35:08.813381581Z [2024-04-05T03:35:08.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status success for try_number 1 2024-04-05T03:35:08.821164008Z [2024-04-05T03:35:08.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5b7566e-53a4-482d-a9a5-97913d7cea47 2024-04-05T03:35:08.821526643Z [2024-04-05T03:35:08.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:30:00+00:00, map_index=-1, run_start_date=2024-04-05 03:35:06.985618+00:00, run_end_date=2024-04-05 03:35:07.446854+00:00, run_duration=0.461236, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:35:04.759502+00:00, queued_by_job_id=1, pid=10116 2024-04-05T03:35:12.094582115Z [2024-04-05T03:35:12.094+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:35:12.094631227Z 2024-04-05T03:35:12.094876181Z [2024-04-05T03:35:12.094+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:35:12.095769309Z [2024-04-05T03:35:12.095+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:35:12.095783579Z 2024-04-05T03:35:12.098561861Z [2024-04-05T03:35:12.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:35:12.098883124Z [2024-04-05T03:35:12.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:35:12.168479131Z [2024-04-05T03:35:12.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status queued for try_number 1 2024-04-05T03:35:12.168563585Z [2024-04-05T03:35:12.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status success for try_number 1 2024-04-05T03:35:12.175749165Z [2024-04-05T03:35:12.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98b2e6ad-c9b1-40b0-8843-da1dd6ff2d39 2024-04-05T03:35:12.176033788Z [2024-04-05T03:35:12.175+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:30:00+00:00, map_index=0, run_start_date=2024-04-05 03:35:10.463939+00:00, run_end_date=2024-04-05 03:35:11.645744+00:00, run_duration=1.181805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:35:08.754537+00:00, queued_by_job_id=1, pid=10138 2024-04-05T03:35:15.037589264Z [2024-04-05T03:35:15.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:35:15.038614208Z [2024-04-05T03:35:15.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:30:00+00:00, run_id=scheduled__2024-04-05T03:30:00+00:00, run_start_date=2024-04-05 03:35:00.439951+00:00, run_end_date=2024-04-05 03:35:15.037294+00:00, run_duration=14.597343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:30:00+00:00, data_interval_end=2024-04-05 03:35:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:35:15.055289464Z [2024-04-05T03:35:15.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:35:00+00:00, run_after=2024-04-05T03:40:00+00:00 2024-04-05T03:35:16.152021809Z [2024-04-05T03:35:16.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:30:00+00:00 exited with status success for try_number 1 2024-04-05T03:35:16.158872132Z [2024-04-05T03:35:16.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:30:00+00:00, map_index=-1, run_start_date=2024-04-05 03:35:14.512960+00:00, run_end_date=2024-04-05 03:35:14.997052+00:00, run_duration=0.484092, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:35:12.096213+00:00, queued_by_job_id=1, pid=10162 2024-04-05T03:36:00.688017443Z [2024-04-05T03:36:00.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:36:00+00:00, run_after=2024-04-05T03:37:00+00:00 2024-04-05T03:36:00.708317832Z [2024-04-05T03:36:00.706+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:36:00.731608616Z [2024-04-05T03:36:00.726+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:36:00.818941931Z [2024-04-05T03:36:00.818+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:36:00.818970591Z 2024-04-05T03:36:00.818975420Z 2024-04-05T03:36:00.818979936Z 2024-04-05T03:36:00.819119847Z [2024-04-05T03:36:00.818+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:36:00.819281258Z [2024-04-05T03:36:00.819+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:36:00.819443794Z [2024-04-05T03:36:00.819+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:36:00.820156271Z [2024-04-05T03:36:00.819+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:36:00.820166585Z 2024-04-05T03:36:00.820171111Z 2024-04-05T03:36:00.820175608Z 2024-04-05T03:36:00.824753202Z [2024-04-05T03:36:00.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:36:00.824949381Z [2024-04-05T03:36:00.824+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:36:00.825331728Z [2024-04-05T03:36:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:36:00.825581200Z [2024-04-05T03:36:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:36:00.825853719Z [2024-04-05T03:36:00.825+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:36:00.826139178Z [2024-04-05T03:36:00.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:36:01.069318145Z [2024-04-05T03:36:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:34:00+00:00 exited with status queued for try_number 1 2024-04-05T03:36:01.069478588Z [2024-04-05T03:36:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status queued for try_number 1 2024-04-05T03:36:01.069646583Z [2024-04-05T03:36:01.069+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status queued for try_number 1 2024-04-05T03:36:01.081194197Z [2024-04-05T03:36:01.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf86800a-cb8c-49e2-ade4-d411b54b9530 2024-04-05T03:36:01.081223203Z [2024-04-05T03:36:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05dfa47f-305b-4ec9-a739-f7f338eac940 2024-04-05T03:36:01.081363018Z [2024-04-05T03:36:01.081+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64c877c9-9ffb-4577-9562-74459d37a74c 2024-04-05T03:36:02.427165612Z [2024-04-05T03:36:02.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:36:02.427205433Z [2024-04-05T03:36:02.426+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:34:00+00:00, run_id=scheduled__2024-04-05T03:34:00+00:00, run_start_date=2024-04-05 03:36:00.739621+00:00, run_end_date=2024-04-05 03:36:02.426304+00:00, run_duration=1.686683, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:34:00+00:00, data_interval_end=2024-04-05 03:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:36:02.463022287Z [2024-04-05T03:36:02.456+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:36:00+00:00, run_after=2024-04-05T03:38:00+00:00 2024-04-05T03:36:02.608704756Z [2024-04-05T03:36:02.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:34:00+00:00 exited with status success for try_number 1 2024-04-05T03:36:02.624369192Z [2024-04-05T03:36:02.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:34:00+00:00, map_index=-1, run_start_date=2024-04-05 03:36:01.595729+00:00, run_end_date=2024-04-05 03:36:02.056285+00:00, run_duration=0.460556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:36:00.820893+00:00, queued_by_job_id=1, pid=10166 2024-04-05T03:36:06.050939515Z [2024-04-05T03:36:06.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:36:06.051334919Z [2024-04-05T03:36:06.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:35:00+00:00, run_id=scheduled__2024-04-05T03:35:00+00:00, run_start_date=2024-04-05 03:36:00.746087+00:00, run_end_date=2024-04-05 03:36:06.050893+00:00, run_duration=5.304806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:35:00+00:00, data_interval_end=2024-04-05 03:36:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:36:06.061294414Z [2024-04-05T03:36:06.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:36:00+00:00, run_after=2024-04-05T03:37:00+00:00 2024-04-05T03:36:06.068556459Z [2024-04-05T03:36:06.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:36:06.068784266Z [2024-04-05T03:36:06.068+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:35:00+00:00, run_id=scheduled__2024-04-05T03:35:00+00:00, run_start_date=2024-04-05 03:36:00.741485+00:00, run_end_date=2024-04-05 03:36:06.068425+00:00, run_duration=5.32694, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:35:00+00:00, data_interval_end=2024-04-05 03:36:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:36:06.080289283Z [2024-04-05T03:36:06.079+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:36:00+00:00, run_after=2024-04-05T03:37:00+00:00 2024-04-05T03:36:06.108477066Z [2024-04-05T03:36:06.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status success for try_number 1 2024-04-05T03:36:06.108675919Z [2024-04-05T03:36:06.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status success for try_number 1 2024-04-05T03:36:06.115474757Z [2024-04-05T03:36:06.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:35:00+00:00, map_index=-1, run_start_date=2024-04-05 03:36:02.924720+00:00, run_end_date=2024-04-05 03:36:05.068754+00:00, run_duration=2.144034, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:36:00.820893+00:00, queued_by_job_id=1, pid=10187 2024-04-05T03:36:06.115704024Z [2024-04-05T03:36:06.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:35:00+00:00, map_index=-1, run_start_date=2024-04-05 03:36:03.581699+00:00, run_end_date=2024-04-05 03:36:05.812521+00:00, run_duration=2.230822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:36:00.820893+00:00, queued_by_job_id=1, pid=10206 2024-04-05T03:36:44.727530785Z [2024-04-05T03:36:44.727+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:36:45.816850257Z [2024-04-05T03:36:45.816+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:36:45.816877779Z 2024-04-05T03:36:45.816942246Z [2024-04-05T03:36:45.816+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-05T03:36:45.817663957Z [2024-04-05T03:36:45.817+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:36:45.817676726Z 2024-04-05T03:36:45.821944216Z [2024-04-05T03:36:45.821+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240405033644_742208', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:36:45.822005577Z [2024-04-05T03:36:45.821+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240405033644_742208', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-05T03:36:45.886208944Z [2024-04-05T03:36:45.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240405033644_742208 exited with status queued for try_number 1 2024-04-05T03:36:45.896296248Z [2024-04-05T03:36:45.895+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a4d8840-16ce-497f-b300-670568be15b0 2024-04-05T03:36:47.029661763Z [2024-04-05T03:36:47.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:36:47.030337932Z [2024-04-05T03:36:47.029+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-05 03:36:44.985716+00:00, run_id=vdu_alarm_20240405033644_742208, run_start_date=2024-04-05 03:36:45.781228+00:00, run_end_date=2024-04-05 03:36:47.029565+00:00, run_duration=1.248337, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 03:36:44.985716+00:00, data_interval_end=2024-04-05 03:36:44.985716+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-05T03:36:47.035451067Z [2024-04-05T03:36:47.035+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-05T03:36:47.075597029Z [2024-04-05T03:36:47.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240405033644_742208 exited with status success for try_number 1 2024-04-05T03:36:47.083311018Z [2024-04-05T03:36:47.082+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240405033644_742208, map_index=-1, run_start_date=2024-04-05 03:36:46.462783+00:00, run_end_date=2024-04-05 03:36:46.805301+00:00, run_duration=0.342518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:36:45.818303+00:00, queued_by_job_id=1, pid=10231 2024-04-05T03:37:00.676978219Z [2024-04-05T03:37:00.676+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:37:00.693349888Z [2024-04-05T03:37:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:37:00+00:00, run_after=2024-04-05T03:38:00+00:00 2024-04-05T03:37:00.785899834Z [2024-04-05T03:37:00.784+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:37:00.785926507Z 2024-04-05T03:37:00.785930450Z 2024-04-05T03:37:00.785946058Z [2024-04-05T03:37:00.784+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:37:00.785949327Z [2024-04-05T03:37:00.784+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:37:00.785952910Z [2024-04-05T03:37:00.785+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:37:00.785956417Z 2024-04-05T03:37:00.785959499Z 2024-04-05T03:37:00.790065368Z [2024-04-05T03:37:00.789+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:37:00.790193515Z [2024-04-05T03:37:00.789+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:37:00.790489120Z [2024-04-05T03:37:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:37:00.790609937Z [2024-04-05T03:37:00.790+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:37:00.964959474Z [2024-04-05T03:37:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:36:00+00:00 exited with status queued for try_number 1 2024-04-05T03:37:00.965000911Z [2024-04-05T03:37:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:36:00+00:00 exited with status queued for try_number 1 2024-04-05T03:37:00.972450630Z [2024-04-05T03:37:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to caf5e17c-abdc-421c-b54f-1ecbd1997401 2024-04-05T03:37:00.972503730Z [2024-04-05T03:37:00.972+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1abb97e0-4544-4c24-b5d5-0702cac1014f 2024-04-05T03:37:05.828665176Z [2024-04-05T03:37:05.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:37:05.828901953Z [2024-04-05T03:37:05.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:36:00+00:00, run_id=scheduled__2024-04-05T03:36:00+00:00, run_start_date=2024-04-05 03:37:00.715440+00:00, run_end_date=2024-04-05 03:37:05.828586+00:00, run_duration=5.113146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:36:00+00:00, data_interval_end=2024-04-05 03:37:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:37:05.856725542Z [2024-04-05T03:37:05.856+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:37:00+00:00, run_after=2024-04-05T03:38:00+00:00 2024-04-05T03:37:05.872143664Z [2024-04-05T03:37:05.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:37:05.872379499Z [2024-04-05T03:37:05.872+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:36:00+00:00, run_id=scheduled__2024-04-05T03:36:00+00:00, run_start_date=2024-04-05 03:37:00.717725+00:00, run_end_date=2024-04-05 03:37:05.872065+00:00, run_duration=5.15434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:36:00+00:00, data_interval_end=2024-04-05 03:37:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:37:05.892646925Z [2024-04-05T03:37:05.892+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:37:00+00:00, run_after=2024-04-05T03:38:00+00:00 2024-04-05T03:37:05.927292974Z [2024-04-05T03:37:05.924+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:36:00+00:00 exited with status success for try_number 1 2024-04-05T03:37:05.935357660Z [2024-04-05T03:37:05.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:36:00+00:00, map_index=-1, run_start_date=2024-04-05 03:37:02.881482+00:00, run_end_date=2024-04-05 03:37:05.079463+00:00, run_duration=2.197981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:37:00.786738+00:00, queued_by_job_id=1, pid=10264 2024-04-05T03:37:07.016672274Z [2024-04-05T03:37:07.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:36:00+00:00 exited with status success for try_number 1 2024-04-05T03:37:07.022455266Z [2024-04-05T03:37:07.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:36:00+00:00, map_index=-1, run_start_date=2024-04-05 03:37:02.755145+00:00, run_end_date=2024-04-05 03:37:05.712741+00:00, run_duration=2.957596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:37:00.786738+00:00, queued_by_job_id=1, pid=10263 2024-04-05T03:38:00.391648645Z [2024-04-05T03:38:00.391+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:38:00.399718476Z [2024-04-05T03:38:00.399+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:38:00.416604161Z [2024-04-05T03:38:00.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:38:00+00:00, run_after=2024-04-05T03:39:00+00:00 2024-04-05T03:38:00.485319435Z [2024-04-05T03:38:00.484+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:38:00.485351279Z 2024-04-05T03:38:00.485355741Z 2024-04-05T03:38:00.485359506Z 2024-04-05T03:38:00.485721397Z [2024-04-05T03:38:00.485+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:38:00.486075158Z [2024-04-05T03:38:00.485+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:38:00.486286077Z [2024-04-05T03:38:00.486+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:38:00.487236955Z [2024-04-05T03:38:00.486+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:38:00.487249801Z 2024-04-05T03:38:00.487253633Z 2024-04-05T03:38:00.487257057Z 2024-04-05T03:38:00.491003367Z [2024-04-05T03:38:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:38:00.491226891Z [2024-04-05T03:38:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:38:00.491558183Z [2024-04-05T03:38:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:38:00.491732537Z [2024-04-05T03:38:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:38:00.492062717Z [2024-04-05T03:38:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:38:00.492253853Z [2024-04-05T03:38:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:38:00.868197528Z [2024-04-05T03:38:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:36:00+00:00 exited with status queued for try_number 1 2024-04-05T03:38:00.868279987Z [2024-04-05T03:38:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:37:00+00:00 exited with status queued for try_number 1 2024-04-05T03:38:00.868447469Z [2024-04-05T03:38:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:37:00+00:00 exited with status queued for try_number 1 2024-04-05T03:38:00.879943072Z [2024-04-05T03:38:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64ae47ac-4289-4c53-a474-e499a342947f 2024-04-05T03:38:00.880007787Z [2024-04-05T03:38:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 221d2c4c-c5b9-4520-b730-10f8d8ca4053 2024-04-05T03:38:00.880104311Z [2024-04-05T03:38:00.879+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2886fa95-0395-4f4f-9e62-6c0120653ed2 2024-04-05T03:38:02.125292507Z [2024-04-05T03:38:02.124+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:38:02.128336699Z [2024-04-05T03:38:02.127+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:36:00+00:00, run_id=scheduled__2024-04-05T03:36:00+00:00, run_start_date=2024-04-05 03:38:00.429463+00:00, run_end_date=2024-04-05 03:38:02.125193+00:00, run_duration=1.69573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:36:00+00:00, data_interval_end=2024-04-05 03:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:38:02.143897775Z [2024-04-05T03:38:02.143+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:38:00+00:00, run_after=2024-04-05T03:40:00+00:00 2024-04-05T03:38:02.217371687Z [2024-04-05T03:38:02.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:36:00+00:00 exited with status success for try_number 1 2024-04-05T03:38:02.227454811Z [2024-04-05T03:38:02.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:36:00+00:00, map_index=-1, run_start_date=2024-04-05 03:38:01.476327+00:00, run_end_date=2024-04-05 03:38:01.977477+00:00, run_duration=0.50115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:38:00.488166+00:00, queued_by_job_id=1, pid=10298 2024-04-05T03:38:07.163521927Z [2024-04-05T03:38:07.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:38:07.164266122Z [2024-04-05T03:38:07.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:37:00+00:00, run_id=scheduled__2024-04-05T03:37:00+00:00, run_start_date=2024-04-05 03:38:00.432364+00:00, run_end_date=2024-04-05 03:38:07.163825+00:00, run_duration=6.731461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:37:00+00:00, data_interval_end=2024-04-05 03:38:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:38:07.175486919Z [2024-04-05T03:38:07.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:38:00+00:00, run_after=2024-04-05T03:39:00+00:00 2024-04-05T03:38:07.184944882Z [2024-04-05T03:38:07.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:38:07.185600899Z [2024-04-05T03:38:07.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:37:00+00:00, run_id=scheduled__2024-04-05T03:37:00+00:00, run_start_date=2024-04-05 03:38:00.430833+00:00, run_end_date=2024-04-05 03:38:07.185194+00:00, run_duration=6.754361, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:37:00+00:00, data_interval_end=2024-04-05 03:38:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:38:07.197434659Z [2024-04-05T03:38:07.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:38:00+00:00, run_after=2024-04-05T03:39:00+00:00 2024-04-05T03:38:07.262426892Z [2024-04-05T03:38:07.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:37:00+00:00 exited with status success for try_number 1 2024-04-05T03:38:07.262834309Z [2024-04-05T03:38:07.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:37:00+00:00 exited with status success for try_number 1 2024-04-05T03:38:07.272342596Z [2024-04-05T03:38:07.271+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:37:00+00:00, map_index=-1, run_start_date=2024-04-05 03:38:03.875574+00:00, run_end_date=2024-04-05 03:38:06.142300+00:00, run_duration=2.266726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:38:00.488166+00:00, queued_by_job_id=1, pid=10329 2024-04-05T03:38:07.273016523Z [2024-04-05T03:38:07.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:37:00+00:00, map_index=-1, run_start_date=2024-04-05 03:38:03.852854+00:00, run_end_date=2024-04-05 03:38:06.885832+00:00, run_duration=3.032978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:38:00.488166+00:00, queued_by_job_id=1, pid=10328 2024-04-05T03:39:00.930670519Z [2024-04-05T03:39:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:39:00+00:00, run_after=2024-04-05T03:40:00+00:00 2024-04-05T03:39:00.943127426Z [2024-04-05T03:39:00.942+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:39:01.033522528Z [2024-04-05T03:39:01.033+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:39:01.033551654Z 2024-04-05T03:39:01.033555525Z 2024-04-05T03:39:01.033628038Z [2024-04-05T03:39:01.033+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:39:01.033856537Z [2024-04-05T03:39:01.033+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:39:01.034568757Z [2024-04-05T03:39:01.034+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:39:01.034579268Z 2024-04-05T03:39:01.034582895Z 2024-04-05T03:39:01.039656635Z [2024-04-05T03:39:01.039+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:39:01.039889032Z [2024-04-05T03:39:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:39:01.040177412Z [2024-04-05T03:39:01.040+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:39:01.040378479Z [2024-04-05T03:39:01.040+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:39:01.280647258Z [2024-04-05T03:39:01.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:38:00+00:00 exited with status queued for try_number 1 2024-04-05T03:39:01.280904300Z [2024-04-05T03:39:01.280+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:38:00+00:00 exited with status queued for try_number 1 2024-04-05T03:39:01.290149434Z [2024-04-05T03:39:01.289+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bffe10b-3134-42bc-be48-409992d20dfe 2024-04-05T03:39:01.290409316Z [2024-04-05T03:39:01.290+0000] {scheduler_job.py:635} INFO - Setting external_id for to e817697d-7ec7-47e0-9a9d-ec13ca094f57 2024-04-05T03:39:06.936551340Z [2024-04-05T03:39:06.935+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:39:06.936606449Z [2024-04-05T03:39:06.935+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:38:00+00:00, run_id=scheduled__2024-04-05T03:38:00+00:00, run_start_date=2024-04-05 03:39:00.956517+00:00, run_end_date=2024-04-05 03:39:06.935644+00:00, run_duration=5.979127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:38:00+00:00, data_interval_end=2024-04-05 03:39:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:39:06.947964321Z [2024-04-05T03:39:06.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:39:00+00:00, run_after=2024-04-05T03:40:00+00:00 2024-04-05T03:39:07.013578353Z [2024-04-05T03:39:07.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:38:00+00:00 exited with status success for try_number 1 2024-04-05T03:39:07.021041003Z [2024-04-05T03:39:07.020+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:38:00+00:00, map_index=-1, run_start_date=2024-04-05 03:39:04.230693+00:00, run_end_date=2024-04-05 03:39:06.829988+00:00, run_duration=2.599295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:39:01.035313+00:00, queued_by_job_id=1, pid=10383 2024-04-05T03:39:08.112128150Z [2024-04-05T03:39:08.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:39:08.113090283Z [2024-04-05T03:39:08.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:38:00+00:00, run_id=scheduled__2024-04-05T03:38:00+00:00, run_start_date=2024-04-05 03:39:00.959521+00:00, run_end_date=2024-04-05 03:39:08.112016+00:00, run_duration=7.152495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:38:00+00:00, data_interval_end=2024-04-05 03:39:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:39:08.123519803Z [2024-04-05T03:39:08.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:39:00+00:00, run_after=2024-04-05T03:40:00+00:00 2024-04-05T03:39:08.165713947Z [2024-04-05T03:39:08.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:38:00+00:00 exited with status success for try_number 1 2024-04-05T03:39:08.178185917Z [2024-04-05T03:39:08.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:38:00+00:00, map_index=-1, run_start_date=2024-04-05 03:39:04.289688+00:00, run_end_date=2024-04-05 03:39:07.205464+00:00, run_duration=2.915776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:39:01.035313+00:00, queued_by_job_id=1, pid=10384 2024-04-05T03:40:00.851091582Z [2024-04-05T03:40:00.850+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:40:00+00:00, run_after=2024-04-05T03:45:00+00:00 2024-04-05T03:40:00.861034700Z [2024-04-05T03:40:00.860+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:40:00.878150695Z [2024-04-05T03:40:00.877+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:40:00+00:00, run_after=2024-04-05T03:41:00+00:00 2024-04-05T03:40:00.886686908Z [2024-04-05T03:40:00.886+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:40:00.966606654Z [2024-04-05T03:40:00.966+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T03:40:00.966657431Z 2024-04-05T03:40:00.966665498Z 2024-04-05T03:40:00.966673035Z 2024-04-05T03:40:00.966680038Z 2024-04-05T03:40:00.966714830Z [2024-04-05T03:40:00.966+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:40:00.966756171Z [2024-04-05T03:40:00.966+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:40:00.966873321Z [2024-04-05T03:40:00.966+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:40:00.966969097Z [2024-04-05T03:40:00.966+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:40:00.967714738Z [2024-04-05T03:40:00.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:40:00.967729404Z 2024-04-05T03:40:00.967770198Z 2024-04-05T03:40:00.967776165Z 2024-04-05T03:40:00.967779828Z 2024-04-05T03:40:00.971930611Z [2024-04-05T03:40:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:40:00.972012427Z [2024-04-05T03:40:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:40:00.972184826Z [2024-04-05T03:40:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:40:00.972260314Z [2024-04-05T03:40:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:40:00.972432115Z [2024-04-05T03:40:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:40:00.972519023Z [2024-04-05T03:40:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:40:00.972702328Z [2024-04-05T03:40:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:40:00.972825832Z [2024-04-05T03:40:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:40:01.333802470Z [2024-04-05T03:40:01.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status queued for try_number 1 2024-04-05T03:40:01.334194703Z [2024-04-05T03:40:01.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:38:00+00:00 exited with status queued for try_number 1 2024-04-05T03:40:01.334727447Z [2024-04-05T03:40:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:39:00+00:00 exited with status queued for try_number 1 2024-04-05T03:40:01.335059866Z [2024-04-05T03:40:01.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:39:00+00:00 exited with status queued for try_number 1 2024-04-05T03:40:01.354498829Z [2024-04-05T03:40:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e9b83c8-0fd8-4124-9483-924446c5a238 2024-04-05T03:40:01.354877196Z [2024-04-05T03:40:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to adfd7d86-5776-4014-91f4-9b64ca6eaa9a 2024-04-05T03:40:01.355230527Z [2024-04-05T03:40:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c391c69-df9a-47bd-9255-94c3f4b14779 2024-04-05T03:40:01.355682195Z [2024-04-05T03:40:01.355+0000] {scheduler_job.py:635} INFO - Setting external_id for to a7b07e54-cfaa-41b3-9df2-49e324b5a283 2024-04-05T03:40:03.254295171Z [2024-04-05T03:40:03.244+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:40:03.254328696Z [2024-04-05T03:40:03.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:38:00+00:00, run_id=scheduled__2024-04-05T03:38:00+00:00, run_start_date=2024-04-05 03:40:00.898229+00:00, run_end_date=2024-04-05 03:40:03.246322+00:00, run_duration=2.348093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:38:00+00:00, data_interval_end=2024-04-05 03:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:40:03.260801996Z [2024-04-05T03:40:03.260+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:40:00+00:00, run_after=2024-04-05T03:42:00+00:00 2024-04-05T03:40:03.577330764Z [2024-04-05T03:40:03.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:38:00+00:00 exited with status success for try_number 1 2024-04-05T03:40:03.607563651Z [2024-04-05T03:40:03.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:38:00+00:00, map_index=-1, run_start_date=2024-04-05 03:40:01.978497+00:00, run_end_date=2024-04-05 03:40:02.774123+00:00, run_duration=0.795626, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:40:00.968727+00:00, queued_by_job_id=1, pid=10420 2024-04-05T03:40:06.712722291Z [2024-04-05T03:40:06.710+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:40:06.712751350Z 2024-04-05T03:40:06.712755806Z [2024-04-05T03:40:06.711+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:40:06.712760183Z [2024-04-05T03:40:06.711+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:40:06.712763375Z 2024-04-05T03:40:06.718606881Z [2024-04-05T03:40:06.718+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:40:06.719978522Z [2024-04-05T03:40:06.719+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:40:06.787089505Z [2024-04-05T03:40:06.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status queued for try_number 1 2024-04-05T03:40:06.787282137Z [2024-04-05T03:40:06.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status success for try_number 1 2024-04-05T03:40:06.794229846Z [2024-04-05T03:40:06.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87228e12-6ecb-4653-9ed3-beb199af87bd 2024-04-05T03:40:06.794523837Z [2024-04-05T03:40:06.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:35:00+00:00, map_index=-1, run_start_date=2024-04-05 03:40:04.450208+00:00, run_end_date=2024-04-05 03:40:05.774477+00:00, run_duration=1.324269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:40:00.968727+00:00, queued_by_job_id=1, pid=10451 2024-04-05T03:40:07.925950820Z [2024-04-05T03:40:07.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:40:07.926340627Z [2024-04-05T03:40:07.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:39:00+00:00, run_id=scheduled__2024-04-05T03:39:00+00:00, run_start_date=2024-04-05 03:40:00.900310+00:00, run_end_date=2024-04-05 03:40:07.925837+00:00, run_duration=7.025527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:39:00+00:00, data_interval_end=2024-04-05 03:40:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:40:07.937298224Z [2024-04-05T03:40:07.936+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:40:00+00:00, run_after=2024-04-05T03:41:00+00:00 2024-04-05T03:40:07.946358951Z [2024-04-05T03:40:07.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:40:07.946531596Z [2024-04-05T03:40:07.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:39:00+00:00, run_id=scheduled__2024-04-05T03:39:00+00:00, run_start_date=2024-04-05 03:40:00.899265+00:00, run_end_date=2024-04-05 03:40:07.946242+00:00, run_duration=7.046977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:39:00+00:00, data_interval_end=2024-04-05 03:40:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:40:07.959123441Z [2024-04-05T03:40:07.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:40:00+00:00, run_after=2024-04-05T03:41:00+00:00 2024-04-05T03:40:08.020089734Z [2024-04-05T03:40:08.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:39:00+00:00 exited with status success for try_number 1 2024-04-05T03:40:08.020123753Z [2024-04-05T03:40:08.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:39:00+00:00 exited with status success for try_number 1 2024-04-05T03:40:08.041505055Z [2024-04-05T03:40:08.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:39:00+00:00, map_index=-1, run_start_date=2024-04-05 03:40:04.825184+00:00, run_end_date=2024-04-05 03:40:07.135231+00:00, run_duration=2.310047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:40:00.968727+00:00, queued_by_job_id=1, pid=10452 2024-04-05T03:40:08.042810969Z [2024-04-05T03:40:08.042+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:39:00+00:00, map_index=-1, run_start_date=2024-04-05 03:40:06.019399+00:00, run_end_date=2024-04-05 03:40:07.701244+00:00, run_duration=1.681845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:40:00.968727+00:00, queued_by_job_id=1, pid=10480 2024-04-05T03:40:10.244824641Z [2024-04-05T03:40:10.244+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:40:10.244854731Z 2024-04-05T03:40:10.245523513Z [2024-04-05T03:40:10.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:40:10.247238535Z [2024-04-05T03:40:10.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:40:10.247255504Z 2024-04-05T03:40:10.252845667Z [2024-04-05T03:40:10.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:40:10.253319760Z [2024-04-05T03:40:10.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:40:10.313952191Z [2024-04-05T03:40:10.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status queued for try_number 1 2024-04-05T03:40:10.314040571Z [2024-04-05T03:40:10.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status success for try_number 1 2024-04-05T03:40:10.319589832Z [2024-04-05T03:40:10.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 650b9b27-a193-48cc-98b9-2f4f5911c769 2024-04-05T03:40:10.319927483Z [2024-04-05T03:40:10.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:35:00+00:00, map_index=-1, run_start_date=2024-04-05 03:40:08.888709+00:00, run_end_date=2024-04-05 03:40:09.237802+00:00, run_duration=0.349093, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:40:06.712101+00:00, queued_by_job_id=1, pid=10501 2024-04-05T03:40:13.171352370Z [2024-04-05T03:40:13.171+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:40:13.171391196Z 2024-04-05T03:40:13.171961528Z [2024-04-05T03:40:13.171+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:40:13.175948292Z [2024-04-05T03:40:13.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:40:13.175972470Z 2024-04-05T03:40:13.181424710Z [2024-04-05T03:40:13.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:40:13.181474615Z [2024-04-05T03:40:13.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:40:13.261150993Z [2024-04-05T03:40:13.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status queued for try_number 1 2024-04-05T03:40:13.261418760Z [2024-04-05T03:40:13.261+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status success for try_number 1 2024-04-05T03:40:13.271932498Z [2024-04-05T03:40:13.271+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d83a45b-b3ac-41dc-8343-cd56a7762a2d 2024-04-05T03:40:13.277212529Z [2024-04-05T03:40:13.276+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:35:00+00:00, map_index=0, run_start_date=2024-04-05 03:40:12.021832+00:00, run_end_date=2024-04-05 03:40:12.451918+00:00, run_duration=0.430086, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:40:10.248562+00:00, queued_by_job_id=1, pid=10526 2024-04-05T03:40:15.884347729Z [2024-04-05T03:40:15.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:40:15.885147860Z [2024-04-05T03:40:15.884+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:35:00+00:00, run_id=scheduled__2024-04-05T03:35:00+00:00, run_start_date=2024-04-05 03:40:00.896956+00:00, run_end_date=2024-04-05 03:40:15.884754+00:00, run_duration=14.987798, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:35:00+00:00, data_interval_end=2024-04-05 03:40:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:40:15.892414581Z [2024-04-05T03:40:15.891+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:40:00+00:00, run_after=2024-04-05T03:45:00+00:00 2024-04-05T03:40:15.934545530Z [2024-04-05T03:40:15.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:35:00+00:00 exited with status success for try_number 1 2024-04-05T03:40:15.942183051Z [2024-04-05T03:40:15.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:35:00+00:00, map_index=-1, run_start_date=2024-04-05 03:40:15.116274+00:00, run_end_date=2024-04-05 03:40:15.483255+00:00, run_duration=0.366981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:40:13.178537+00:00, queued_by_job_id=1, pid=10538 2024-04-05T03:40:46.057855871Z [2024-04-05T03:40:46.057+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:40:46.057906180Z 2024-04-05T03:40:46.058296922Z [2024-04-05T03:40:46.057+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-05T03:40:46.059903278Z [2024-04-05T03:40:46.059+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:40:46.059946348Z 2024-04-05T03:40:46.065730330Z [2024-04-05T03:40:46.065+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240405034044_116969', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:40:46.066390307Z [2024-04-05T03:40:46.065+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240405034044_116969', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-05T03:40:46.122268741Z [2024-04-05T03:40:46.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240405034044_116969 exited with status queued for try_number 1 2024-04-05T03:40:46.128091289Z [2024-04-05T03:40:46.127+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19b087a0-8643-4b8c-9a54-608354db1534 2024-04-05T03:40:47.301914848Z [2024-04-05T03:40:47.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:40:47.302367820Z [2024-04-05T03:40:47.301+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-05 03:40:44.982008+00:00, run_id=vdu_alarm_20240405034044_116969, run_start_date=2024-04-05 03:40:46.026528+00:00, run_end_date=2024-04-05 03:40:47.301717+00:00, run_duration=1.275189, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 03:40:44.982008+00:00, data_interval_end=2024-04-05 03:40:44.982008+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-05T03:40:47.305578556Z [2024-04-05T03:40:47.305+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-05T03:40:47.335011145Z [2024-04-05T03:40:47.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240405034044_116969 exited with status success for try_number 1 2024-04-05T03:40:47.340707003Z [2024-04-05T03:40:47.340+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240405034044_116969, map_index=-1, run_start_date=2024-04-05 03:40:46.700588+00:00, run_end_date=2024-04-05 03:40:47.117694+00:00, run_duration=0.417106, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:40:46.060826+00:00, queued_by_job_id=1, pid=10540 2024-04-05T03:41:01.023350555Z [2024-04-05T03:41:01.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:41:00+00:00, run_after=2024-04-05T03:42:00+00:00 2024-04-05T03:41:01.032178039Z [2024-04-05T03:41:01.031+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:41:01.092717663Z [2024-04-05T03:41:01.091+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:41:01.092754332Z 2024-04-05T03:41:01.092759898Z 2024-04-05T03:41:01.093016927Z [2024-04-05T03:41:01.092+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:41:01.093407078Z [2024-04-05T03:41:01.093+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:41:01.094522029Z [2024-04-05T03:41:01.094+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:41:01.094537985Z 2024-04-05T03:41:01.094541531Z 2024-04-05T03:41:01.101161762Z [2024-04-05T03:41:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:41:01.101526597Z [2024-04-05T03:41:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:41:01.102183077Z [2024-04-05T03:41:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:41:01.102648863Z [2024-04-05T03:41:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:41:01.287687635Z [2024-04-05T03:41:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status queued for try_number 1 2024-04-05T03:41:01.287720387Z [2024-04-05T03:41:01.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status queued for try_number 1 2024-04-05T03:41:01.295330255Z [2024-04-05T03:41:01.294+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb9c8525-dffa-470e-86cd-7cb84553112b 2024-04-05T03:41:01.295620664Z [2024-04-05T03:41:01.295+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3fce852-e620-4d13-96db-681ddb08a864 2024-04-05T03:41:06.746007128Z [2024-04-05T03:41:06.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:41:06.746442614Z [2024-04-05T03:41:06.746+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:40:00+00:00, run_id=scheduled__2024-04-05T03:40:00+00:00, run_start_date=2024-04-05 03:41:01.045350+00:00, run_end_date=2024-04-05 03:41:06.746035+00:00, run_duration=5.700685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:40:00+00:00, data_interval_end=2024-04-05 03:41:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:41:06.755484146Z [2024-04-05T03:41:06.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:41:00+00:00, run_after=2024-04-05T03:42:00+00:00 2024-04-05T03:41:06.792828638Z [2024-04-05T03:41:06.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status success for try_number 1 2024-04-05T03:41:06.797751553Z [2024-04-05T03:41:06.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:40:00+00:00, map_index=-1, run_start_date=2024-04-05 03:41:03.886669+00:00, run_end_date=2024-04-05 03:41:06.652403+00:00, run_duration=2.765734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:41:01.095364+00:00, queued_by_job_id=1, pid=10573 2024-04-05T03:41:07.849606603Z [2024-04-05T03:41:07.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:41:07.849756369Z [2024-04-05T03:41:07.849+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:40:00+00:00, run_id=scheduled__2024-04-05T03:40:00+00:00, run_start_date=2024-04-05 03:41:01.047261+00:00, run_end_date=2024-04-05 03:41:07.849497+00:00, run_duration=6.802236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:40:00+00:00, data_interval_end=2024-04-05 03:41:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:41:07.860173186Z [2024-04-05T03:41:07.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:41:00+00:00, run_after=2024-04-05T03:42:00+00:00 2024-04-05T03:41:07.897132459Z [2024-04-05T03:41:07.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status success for try_number 1 2024-04-05T03:41:07.905055089Z [2024-04-05T03:41:07.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:40:00+00:00, map_index=-1, run_start_date=2024-04-05 03:41:03.886247+00:00, run_end_date=2024-04-05 03:41:07.238325+00:00, run_duration=3.352078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:41:01.095364+00:00, queued_by_job_id=1, pid=10572 2024-04-05T03:41:44.806861995Z [2024-04-05T03:41:44.805+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:42:00.847544988Z [2024-04-05T03:42:00.846+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:42:00+00:00, run_after=2024-04-05T03:43:00+00:00 2024-04-05T03:42:00.859931631Z [2024-04-05T03:42:00.859+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:42:00.870067525Z [2024-04-05T03:42:00.869+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:42:00.952778567Z [2024-04-05T03:42:00.952+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:42:00.952805612Z 2024-04-05T03:42:00.952809773Z 2024-04-05T03:42:00.952814189Z 2024-04-05T03:42:00.953206609Z [2024-04-05T03:42:00.952+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:42:00.953650906Z [2024-04-05T03:42:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:42:00.954038221Z [2024-04-05T03:42:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:42:00.955155756Z [2024-04-05T03:42:00.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:42:00.955168041Z 2024-04-05T03:42:00.955172251Z 2024-04-05T03:42:00.955175694Z 2024-04-05T03:42:00.960678838Z [2024-04-05T03:42:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:42:00.961224749Z [2024-04-05T03:42:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:42:00.961929855Z [2024-04-05T03:42:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:42:00.962352785Z [2024-04-05T03:42:00.962+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:42:00.963079548Z [2024-04-05T03:42:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:42:00.963405981Z [2024-04-05T03:42:00.963+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:42:01.289656658Z [2024-04-05T03:42:01.288+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status queued for try_number 1 2024-04-05T03:42:01.289819590Z [2024-04-05T03:42:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:41:00+00:00 exited with status queued for try_number 1 2024-04-05T03:42:01.290021791Z [2024-04-05T03:42:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:41:00+00:00 exited with status queued for try_number 1 2024-04-05T03:42:01.307486951Z [2024-04-05T03:42:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64e99613-9181-45b1-8e11-7ed14374f03b 2024-04-05T03:42:01.307760688Z [2024-04-05T03:42:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to a26eecee-b642-4a5a-b91e-66c7a8c9267a 2024-04-05T03:42:01.308028643Z [2024-04-05T03:42:01.307+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31b1b429-adc9-42ea-b10a-91bbf4a62778 2024-04-05T03:42:03.875811243Z [2024-04-05T03:42:03.875+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:42:03.876204383Z [2024-04-05T03:42:03.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:40:00+00:00, run_id=scheduled__2024-04-05T03:40:00+00:00, run_start_date=2024-04-05 03:42:00.885717+00:00, run_end_date=2024-04-05 03:42:03.875817+00:00, run_duration=2.9901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:40:00+00:00, data_interval_end=2024-04-05 03:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:42:03.894418069Z [2024-04-05T03:42:03.894+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:42:00+00:00, run_after=2024-04-05T03:44:00+00:00 2024-04-05T03:42:04.020573494Z [2024-04-05T03:42:04.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status success for try_number 1 2024-04-05T03:42:04.026573181Z [2024-04-05T03:42:04.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:40:00+00:00, map_index=-1, run_start_date=2024-04-05 03:42:01.862074+00:00, run_end_date=2024-04-05 03:42:02.688981+00:00, run_duration=0.826907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:42:00.956664+00:00, queued_by_job_id=1, pid=10607 2024-04-05T03:42:07.010734308Z [2024-04-05T03:42:07.010+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:42:07.011174388Z [2024-04-05T03:42:07.010+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:41:00+00:00, run_id=scheduled__2024-04-05T03:41:00+00:00, run_start_date=2024-04-05 03:42:00.888857+00:00, run_end_date=2024-04-05 03:42:07.010810+00:00, run_duration=6.121953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:41:00+00:00, data_interval_end=2024-04-05 03:42:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:42:07.024791372Z [2024-04-05T03:42:07.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:42:00+00:00, run_after=2024-04-05T03:43:00+00:00 2024-04-05T03:42:07.032178454Z [2024-04-05T03:42:07.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:42:07.032684901Z [2024-04-05T03:42:07.032+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:41:00+00:00, run_id=scheduled__2024-04-05T03:41:00+00:00, run_start_date=2024-04-05 03:42:00.887428+00:00, run_end_date=2024-04-05 03:42:07.032089+00:00, run_duration=6.144661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:41:00+00:00, data_interval_end=2024-04-05 03:42:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:42:07.042851786Z [2024-04-05T03:42:07.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:42:00+00:00, run_after=2024-04-05T03:43:00+00:00 2024-04-05T03:42:07.072318674Z [2024-04-05T03:42:07.071+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:41:00+00:00 exited with status success for try_number 1 2024-04-05T03:42:07.072359183Z [2024-04-05T03:42:07.072+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:41:00+00:00 exited with status success for try_number 1 2024-04-05T03:42:07.079719574Z [2024-04-05T03:42:07.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:41:00+00:00, map_index=-1, run_start_date=2024-04-05 03:42:04.431070+00:00, run_end_date=2024-04-05 03:42:06.360562+00:00, run_duration=1.929492, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:42:00.956664+00:00, queued_by_job_id=1, pid=10638 2024-04-05T03:42:07.079869429Z [2024-04-05T03:42:07.079+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:41:00+00:00, map_index=-1, run_start_date=2024-04-05 03:42:04.203134+00:00, run_end_date=2024-04-05 03:42:06.645077+00:00, run_duration=2.441943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:42:00.956664+00:00, queued_by_job_id=1, pid=10637 2024-04-05T03:43:00.127932221Z [2024-04-05T03:43:00.127+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:43:00.145289888Z [2024-04-05T03:43:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:43:00+00:00, run_after=2024-04-05T03:44:00+00:00 2024-04-05T03:43:00.232771260Z [2024-04-05T03:43:00.232+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:43:00.232820831Z 2024-04-05T03:43:00.232831371Z 2024-04-05T03:43:00.233244116Z [2024-04-05T03:43:00.232+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:43:00.233771497Z [2024-04-05T03:43:00.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:43:00.235267681Z [2024-04-05T03:43:00.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:43:00.235294777Z 2024-04-05T03:43:00.235304752Z 2024-04-05T03:43:00.241596464Z [2024-04-05T03:43:00.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:43:00.242041833Z [2024-04-05T03:43:00.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:43:00.243380489Z [2024-04-05T03:43:00.243+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:43:00.243679520Z [2024-04-05T03:43:00.243+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:43:00.491832102Z [2024-04-05T03:43:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:42:00+00:00 exited with status queued for try_number 1 2024-04-05T03:43:00.491866589Z [2024-04-05T03:43:00.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:42:00+00:00 exited with status queued for try_number 1 2024-04-05T03:43:00.499781728Z [2024-04-05T03:43:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac955b00-6216-4879-8079-c6da54af097d 2024-04-05T03:43:00.499852848Z [2024-04-05T03:43:00.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 844bae8b-12fa-431a-b3a4-4c979c4396df 2024-04-05T03:43:04.562208853Z [2024-04-05T03:43:04.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:43:04.562643563Z [2024-04-05T03:43:04.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:42:00+00:00, run_id=scheduled__2024-04-05T03:42:00+00:00, run_start_date=2024-04-05 03:43:00.158228+00:00, run_end_date=2024-04-05 03:43:04.562158+00:00, run_duration=4.40393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:42:00+00:00, data_interval_end=2024-04-05 03:43:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:43:04.573752569Z [2024-04-05T03:43:04.573+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:43:00+00:00, run_after=2024-04-05T03:44:00+00:00 2024-04-05T03:43:04.629144724Z [2024-04-05T03:43:04.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:42:00+00:00 exited with status success for try_number 1 2024-04-05T03:43:04.636461244Z [2024-04-05T03:43:04.635+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:42:00+00:00, map_index=-1, run_start_date=2024-04-05 03:43:02.239137+00:00, run_end_date=2024-04-05 03:43:04.023390+00:00, run_duration=1.784253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:43:00.236663+00:00, queued_by_job_id=1, pid=10692 2024-04-05T03:43:06.113165077Z [2024-04-05T03:43:06.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:43:06.114520127Z [2024-04-05T03:43:06.114+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:42:00+00:00, run_id=scheduled__2024-04-05T03:42:00+00:00, run_start_date=2024-04-05 03:43:00.159781+00:00, run_end_date=2024-04-05 03:43:06.113515+00:00, run_duration=5.953734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:42:00+00:00, data_interval_end=2024-04-05 03:43:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:43:06.128163670Z [2024-04-05T03:43:06.127+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:43:00+00:00, run_after=2024-04-05T03:44:00+00:00 2024-04-05T03:43:06.160654033Z [2024-04-05T03:43:06.159+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:42:00+00:00 exited with status success for try_number 1 2024-04-05T03:43:06.166290303Z [2024-04-05T03:43:06.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:42:00+00:00, map_index=-1, run_start_date=2024-04-05 03:43:02.239051+00:00, run_end_date=2024-04-05 03:43:05.169555+00:00, run_duration=2.930504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:43:00.236663+00:00, queued_by_job_id=1, pid=10693 2024-04-05T03:44:00.167328662Z [2024-04-05T03:44:00.166+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:44:00.178663885Z [2024-04-05T03:44:00.178+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:44:00.196366235Z [2024-04-05T03:44:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:44:00+00:00, run_after=2024-04-05T03:45:00+00:00 2024-04-05T03:44:00.278999214Z [2024-04-05T03:44:00.278+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:44:00.279100144Z 2024-04-05T03:44:00.279195667Z 2024-04-05T03:44:00.279208064Z 2024-04-05T03:44:00.279283128Z [2024-04-05T03:44:00.278+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:44:00.279358976Z [2024-04-05T03:44:00.278+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:44:00.279371508Z [2024-04-05T03:44:00.279+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:44:00.280261304Z [2024-04-05T03:44:00.279+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:44:00.280279367Z 2024-04-05T03:44:00.280288155Z 2024-04-05T03:44:00.280319201Z 2024-04-05T03:44:00.284275632Z [2024-04-05T03:44:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:44:00.284409833Z [2024-04-05T03:44:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:44:00.284816196Z [2024-04-05T03:44:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:44:00.284886321Z [2024-04-05T03:44:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:44:00.285235855Z [2024-04-05T03:44:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:44:00.285265827Z [2024-04-05T03:44:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:44:00.619369019Z [2024-04-05T03:44:00.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:42:00+00:00 exited with status queued for try_number 1 2024-04-05T03:44:00.619409691Z [2024-04-05T03:44:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:43:00+00:00 exited with status queued for try_number 1 2024-04-05T03:44:00.619531335Z [2024-04-05T03:44:00.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:43:00+00:00 exited with status queued for try_number 1 2024-04-05T03:44:00.632020897Z [2024-04-05T03:44:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 193b2b7f-0523-4238-9956-c050e04ba3a9 2024-04-05T03:44:00.632108448Z [2024-04-05T03:44:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e70a863-5e64-48e9-8e4e-094a6e8d9f21 2024-04-05T03:44:00.633304764Z [2024-04-05T03:44:00.632+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9215ea9e-6a8c-40e8-84a8-6ff6eb32aeba 2024-04-05T03:44:01.911458514Z [2024-04-05T03:44:01.911+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:44:01.913069604Z [2024-04-05T03:44:01.912+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:42:00+00:00, run_id=scheduled__2024-04-05T03:42:00+00:00, run_start_date=2024-04-05 03:44:00.210548+00:00, run_end_date=2024-04-05 03:44:01.911366+00:00, run_duration=1.700818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:42:00+00:00, data_interval_end=2024-04-05 03:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:44:01.922288271Z [2024-04-05T03:44:01.921+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:44:00+00:00, run_after=2024-04-05T03:46:00+00:00 2024-04-05T03:44:01.972683593Z [2024-04-05T03:44:01.972+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:42:00+00:00 exited with status success for try_number 1 2024-04-05T03:44:01.982401519Z [2024-04-05T03:44:01.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:42:00+00:00, map_index=-1, run_start_date=2024-04-05 03:44:01.150325+00:00, run_end_date=2024-04-05 03:44:01.591955+00:00, run_duration=0.44163, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:44:00.281063+00:00, queued_by_job_id=1, pid=10728 2024-04-05T03:44:05.475652697Z [2024-04-05T03:44:05.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:44:05.478892173Z [2024-04-05T03:44:05.478+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:43:00+00:00, run_id=scheduled__2024-04-05T03:43:00+00:00, run_start_date=2024-04-05 03:44:00.211926+00:00, run_end_date=2024-04-05 03:44:05.475582+00:00, run_duration=5.263656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:43:00+00:00, data_interval_end=2024-04-05 03:44:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:44:05.512189613Z [2024-04-05T03:44:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:44:00+00:00, run_after=2024-04-05T03:45:00+00:00 2024-04-05T03:44:05.567318062Z [2024-04-05T03:44:05.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:43:00+00:00 exited with status success for try_number 1 2024-04-05T03:44:05.574432452Z [2024-04-05T03:44:05.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:43:00+00:00, map_index=-1, run_start_date=2024-04-05 03:44:02.493767+00:00, run_end_date=2024-04-05 03:44:04.467307+00:00, run_duration=1.97354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:44:00.281063+00:00, queued_by_job_id=1, pid=10749 2024-04-05T03:44:06.407767834Z [2024-04-05T03:44:06.407+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:44:06.408052246Z [2024-04-05T03:44:06.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:43:00+00:00, run_id=scheduled__2024-04-05T03:43:00+00:00, run_start_date=2024-04-05 03:44:00.213112+00:00, run_end_date=2024-04-05 03:44:06.407762+00:00, run_duration=6.19465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:43:00+00:00, data_interval_end=2024-04-05 03:44:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:44:06.434233279Z [2024-04-05T03:44:06.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:44:00+00:00, run_after=2024-04-05T03:45:00+00:00 2024-04-05T03:44:06.458740741Z [2024-04-05T03:44:06.458+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:43:00+00:00 exited with status success for try_number 1 2024-04-05T03:44:06.470059888Z [2024-04-05T03:44:06.469+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:43:00+00:00, map_index=-1, run_start_date=2024-04-05 03:44:03.272455+00:00, run_end_date=2024-04-05 03:44:05.545598+00:00, run_duration=2.273143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:44:00.281063+00:00, queued_by_job_id=1, pid=10768 2024-04-05T03:45:00.116328872Z [2024-04-05T03:45:00.115+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:45:00.130700061Z [2024-04-05T03:45:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:45:00+00:00, run_after=2024-04-05T03:50:00+00:00 2024-04-05T03:45:00.144307745Z [2024-04-05T03:45:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:45:00+00:00, run_after=2024-04-05T03:46:00+00:00 2024-04-05T03:45:00.244762227Z [2024-04-05T03:45:00.244+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:45:00.244792733Z 2024-04-05T03:45:00.244799599Z 2024-04-05T03:45:00.244804121Z 2024-04-05T03:45:00.245053924Z [2024-04-05T03:45:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:45:00.245334374Z [2024-04-05T03:45:00.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:45:00.245634319Z [2024-04-05T03:45:00.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:45:00.246626150Z [2024-04-05T03:45:00.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:45:00.246635864Z 2024-04-05T03:45:00.246639297Z 2024-04-05T03:45:00.246642327Z 2024-04-05T03:45:00.251485607Z [2024-04-05T03:45:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:45:00.251867050Z [2024-04-05T03:45:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:45:00.252391817Z [2024-04-05T03:45:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:45:00.252587051Z [2024-04-05T03:45:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:45:00.252983652Z [2024-04-05T03:45:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:45:00.253248758Z [2024-04-05T03:45:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:45:00.514209103Z [2024-04-05T03:45:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status queued for try_number 1 2024-04-05T03:45:00.514234674Z [2024-04-05T03:45:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:44:00+00:00 exited with status queued for try_number 1 2024-04-05T03:45:00.514238693Z [2024-04-05T03:45:00.513+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:44:00+00:00 exited with status queued for try_number 1 2024-04-05T03:45:00.523626785Z [2024-04-05T03:45:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc4eb636-b6ac-4ab8-b5e5-6379c724f525 2024-04-05T03:45:00.523971274Z [2024-04-05T03:45:00.523+0000] {scheduler_job.py:635} INFO - Setting external_id for to f90eaf9c-3b91-4008-8300-6bb3cc44b455 2024-04-05T03:45:00.524272434Z [2024-04-05T03:45:00.524+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8369089c-e0aa-423e-ad88-7452a96ca580 2024-04-05T03:45:05.969347417Z [2024-04-05T03:45:05.967+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:45:05.970087457Z [2024-04-05T03:45:05.969+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:44:00+00:00, run_id=scheduled__2024-04-05T03:44:00+00:00, run_start_date=2024-04-05 03:45:00.173887+00:00, run_end_date=2024-04-05 03:45:05.969250+00:00, run_duration=5.795363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:44:00+00:00, data_interval_end=2024-04-05 03:45:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:45:05.985920461Z [2024-04-05T03:45:05.984+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:45:00+00:00, run_after=2024-04-05T03:46:00+00:00 2024-04-05T03:45:06.039451967Z [2024-04-05T03:45:06.039+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:45:06.039478735Z 2024-04-05T03:45:06.042133617Z [2024-04-05T03:45:06.039+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:45:06.046864111Z [2024-04-05T03:45:06.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:45:06.046886298Z 2024-04-05T03:45:06.052414907Z [2024-04-05T03:45:06.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:45:06.052658150Z [2024-04-05T03:45:06.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:45:06.154832824Z [2024-04-05T03:45:06.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status queued for try_number 1 2024-04-05T03:45:06.154864283Z [2024-04-05T03:45:06.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status success for try_number 1 2024-04-05T03:45:06.156229269Z [2024-04-05T03:45:06.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:44:00+00:00 exited with status success for try_number 1 2024-04-05T03:45:06.172496431Z [2024-04-05T03:45:06.171+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:40:00+00:00, map_index=-1, run_start_date=2024-04-05 03:45:04.207209+00:00, run_end_date=2024-04-05 03:45:04.961665+00:00, run_duration=0.754456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:45:00.247780+00:00, queued_by_job_id=1, pid=10835 2024-04-05T03:45:06.172856808Z [2024-04-05T03:45:06.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:44:00+00:00, map_index=-1, run_start_date=2024-04-05 03:45:03.961181+00:00, run_end_date=2024-04-05 03:45:05.632689+00:00, run_duration=1.671508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:45:00.247780+00:00, queued_by_job_id=1, pid=10825 2024-04-05T03:45:06.173172184Z [2024-04-05T03:45:06.172+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0913fc3a-12b1-4bb6-b46f-c534d3ee92ac 2024-04-05T03:45:07.851972655Z [2024-04-05T03:45:07.851+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:45:07.853521051Z [2024-04-05T03:45:07.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:44:00+00:00, run_id=scheduled__2024-04-05T03:44:00+00:00, run_start_date=2024-04-05 03:45:00.176169+00:00, run_end_date=2024-04-05 03:45:07.853097+00:00, run_duration=7.676928, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:44:00+00:00, data_interval_end=2024-04-05 03:45:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:45:07.884076076Z [2024-04-05T03:45:07.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:45:00+00:00, run_after=2024-04-05T03:46:00+00:00 2024-04-05T03:45:07.942807137Z [2024-04-05T03:45:07.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:44:00+00:00 exited with status success for try_number 1 2024-04-05T03:45:07.950107548Z [2024-04-05T03:45:07.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:44:00+00:00, map_index=-1, run_start_date=2024-04-05 03:45:03.082560+00:00, run_end_date=2024-04-05 03:45:06.727314+00:00, run_duration=3.644754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:45:00.247780+00:00, queued_by_job_id=1, pid=10816 2024-04-05T03:45:09.754371543Z [2024-04-05T03:45:09.753+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:45:09.754409643Z 2024-04-05T03:45:09.754443701Z [2024-04-05T03:45:09.754+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:45:09.754987194Z [2024-04-05T03:45:09.754+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:45:09.755005083Z 2024-04-05T03:45:09.758437226Z [2024-04-05T03:45:09.758+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:45:09.758566547Z [2024-04-05T03:45:09.758+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:45:09.828283393Z [2024-04-05T03:45:09.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status queued for try_number 1 2024-04-05T03:45:09.828400923Z [2024-04-05T03:45:09.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status success for try_number 1 2024-04-05T03:45:09.837229382Z [2024-04-05T03:45:09.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3cd2301-2ceb-4e54-9431-fccbe33999f4 2024-04-05T03:45:09.837857612Z [2024-04-05T03:45:09.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:40:00+00:00, map_index=-1, run_start_date=2024-04-05 03:45:08.121248+00:00, run_end_date=2024-04-05 03:45:08.539239+00:00, run_duration=0.417991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:45:06.047931+00:00, queued_by_job_id=1, pid=10865 2024-04-05T03:45:13.565630478Z [2024-04-05T03:45:13.565+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:45:13.565696963Z 2024-04-05T03:45:13.565879443Z [2024-04-05T03:45:13.565+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:45:13.566682784Z [2024-04-05T03:45:13.566+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:45:13.566699026Z 2024-04-05T03:45:13.569582671Z [2024-04-05T03:45:13.569+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:45:13.569751537Z [2024-04-05T03:45:13.569+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:45:13.623500248Z [2024-04-05T03:45:13.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status queued for try_number 1 2024-04-05T03:45:13.623742530Z [2024-04-05T03:45:13.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status success for try_number 1 2024-04-05T03:45:13.632521003Z [2024-04-05T03:45:13.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to b06d3204-af8d-4519-bd76-a34f037b312f 2024-04-05T03:45:13.632836707Z [2024-04-05T03:45:13.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:40:00+00:00, map_index=0, run_start_date=2024-04-05 03:45:11.703782+00:00, run_end_date=2024-04-05 03:45:12.127123+00:00, run_duration=0.423341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:45:09.755401+00:00, queued_by_job_id=1, pid=10887 2024-04-05T03:45:16.267959311Z [2024-04-05T03:45:16.267+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:45:16.268515840Z [2024-04-05T03:45:16.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:40:00+00:00, run_id=scheduled__2024-04-05T03:40:00+00:00, run_start_date=2024-04-05 03:45:00.171141+00:00, run_end_date=2024-04-05 03:45:16.267807+00:00, run_duration=16.096666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:40:00+00:00, data_interval_end=2024-04-05 03:45:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:45:16.278239522Z [2024-04-05T03:45:16.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:45:00+00:00, run_after=2024-04-05T03:50:00+00:00 2024-04-05T03:45:17.417582373Z [2024-04-05T03:45:17.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:40:00+00:00 exited with status success for try_number 1 2024-04-05T03:45:17.425104740Z [2024-04-05T03:45:17.424+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:40:00+00:00, map_index=-1, run_start_date=2024-04-05 03:45:15.819441+00:00, run_end_date=2024-04-05 03:45:16.216692+00:00, run_duration=0.397251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:45:13.567152+00:00, queued_by_job_id=1, pid=10902 2024-04-05T03:46:00.349018012Z [2024-04-05T03:46:00.348+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:46:00.356826648Z [2024-04-05T03:46:00.356+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:46:00.368925489Z [2024-04-05T03:46:00.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:46:00+00:00, run_after=2024-04-05T03:47:00+00:00 2024-04-05T03:46:00.435593772Z [2024-04-05T03:46:00.435+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:46:00.435637846Z 2024-04-05T03:46:00.435651053Z 2024-04-05T03:46:00.435660115Z 2024-04-05T03:46:00.435700506Z [2024-04-05T03:46:00.435+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:46:00.435805549Z [2024-04-05T03:46:00.435+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:46:00.436062224Z [2024-04-05T03:46:00.435+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:46:00.436823595Z [2024-04-05T03:46:00.436+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:46:00.436838690Z 2024-04-05T03:46:00.436844283Z 2024-04-05T03:46:00.436849146Z 2024-04-05T03:46:00.443247590Z [2024-04-05T03:46:00.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:46:00.443558527Z [2024-04-05T03:46:00.443+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:46:00.444049292Z [2024-04-05T03:46:00.443+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:46:00.444259544Z [2024-04-05T03:46:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:46:00.444732060Z [2024-04-05T03:46:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:46:00.445010990Z [2024-04-05T03:46:00.444+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:46:00.738335096Z [2024-04-05T03:46:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:44:00+00:00 exited with status queued for try_number 1 2024-04-05T03:46:00.738371372Z [2024-04-05T03:46:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status queued for try_number 1 2024-04-05T03:46:00.738375248Z [2024-04-05T03:46:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status queued for try_number 1 2024-04-05T03:46:00.742042080Z [2024-04-05T03:46:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 414dccbb-7f93-4a30-bef6-b82d29f19201 2024-04-05T03:46:00.742056904Z [2024-04-05T03:46:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f28a04c-6c4d-4fc3-b0bd-6f902df171d9 2024-04-05T03:46:00.742081534Z [2024-04-05T03:46:00.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab7a5697-aca0-452d-b7f4-30a77361534f 2024-04-05T03:46:01.958145670Z [2024-04-05T03:46:01.957+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:46:01.959100250Z [2024-04-05T03:46:01.958+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:44:00+00:00, run_id=scheduled__2024-04-05T03:44:00+00:00, run_start_date=2024-04-05 03:46:00.379838+00:00, run_end_date=2024-04-05 03:46:01.958405+00:00, run_duration=1.578567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:44:00+00:00, data_interval_end=2024-04-05 03:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:46:01.979829880Z [2024-04-05T03:46:01.979+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:46:00+00:00, run_after=2024-04-05T03:48:00+00:00 2024-04-05T03:46:03.541372398Z [2024-04-05T03:46:03.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:44:00+00:00 exited with status success for try_number 1 2024-04-05T03:46:03.586766316Z [2024-04-05T03:46:03.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:44:00+00:00, map_index=-1, run_start_date=2024-04-05 03:46:01.364423+00:00, run_end_date=2024-04-05 03:46:01.868401+00:00, run_duration=0.503978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:46:00.439067+00:00, queued_by_job_id=1, pid=10906 2024-04-05T03:46:05.628650133Z [2024-04-05T03:46:05.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:46:05.646118138Z [2024-04-05T03:46:05.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:45:00+00:00, run_id=scheduled__2024-04-05T03:45:00+00:00, run_start_date=2024-04-05 03:46:00.381072+00:00, run_end_date=2024-04-05 03:46:05.635422+00:00, run_duration=5.25435, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:45:00+00:00, data_interval_end=2024-04-05 03:46:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:46:05.688150813Z [2024-04-05T03:46:05.687+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:46:00+00:00, run_after=2024-04-05T03:47:00+00:00 2024-04-05T03:46:06.588279140Z [2024-04-05T03:46:06.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:46:06.588444592Z [2024-04-05T03:46:06.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:45:00+00:00, run_id=scheduled__2024-04-05T03:45:00+00:00, run_start_date=2024-04-05 03:46:00.382346+00:00, run_end_date=2024-04-05 03:46:06.588134+00:00, run_duration=6.205788, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:45:00+00:00, data_interval_end=2024-04-05 03:46:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:46:06.601700688Z [2024-04-05T03:46:06.600+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:46:00+00:00, run_after=2024-04-05T03:47:00+00:00 2024-04-05T03:46:06.641181546Z [2024-04-05T03:46:06.640+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status success for try_number 1 2024-04-05T03:46:06.641926203Z [2024-04-05T03:46:06.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status success for try_number 1 2024-04-05T03:46:06.651193146Z [2024-04-05T03:46:06.650+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:45:00+00:00, map_index=-1, run_start_date=2024-04-05 03:46:03.535318+00:00, run_end_date=2024-04-05 03:46:05.522343+00:00, run_duration=1.987025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:46:00.439067+00:00, queued_by_job_id=1, pid=10936 2024-04-05T03:46:06.652223535Z [2024-04-05T03:46:06.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:45:00+00:00, map_index=-1, run_start_date=2024-04-05 03:46:03.865063+00:00, run_end_date=2024-04-05 03:46:06.394367+00:00, run_duration=2.529304, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:46:00.439067+00:00, queued_by_job_id=1, pid=10937 2024-04-05T03:46:44.883883350Z [2024-04-05T03:46:44.883+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:47:00.031134786Z [2024-04-05T03:47:00.030+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:47:00+00:00, run_after=2024-04-05T03:48:00+00:00 2024-04-05T03:47:00.038739056Z [2024-04-05T03:47:00.038+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:47:00.110804181Z [2024-04-05T03:47:00.110+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:47:00.110841681Z 2024-04-05T03:47:00.110849562Z 2024-04-05T03:47:00.111380770Z [2024-04-05T03:47:00.111+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:47:00.111770093Z [2024-04-05T03:47:00.111+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:47:00.112795124Z [2024-04-05T03:47:00.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:47:00.112823179Z 2024-04-05T03:47:00.112827278Z 2024-04-05T03:47:00.116849709Z [2024-04-05T03:47:00.116+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:47:00.117093635Z [2024-04-05T03:47:00.116+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:47:00.117519309Z [2024-04-05T03:47:00.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:47:00.117774627Z [2024-04-05T03:47:00.117+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:47:00.270923691Z [2024-04-05T03:47:00.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:46:00+00:00 exited with status queued for try_number 1 2024-04-05T03:47:00.271109550Z [2024-04-05T03:47:00.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:46:00+00:00 exited with status queued for try_number 1 2024-04-05T03:47:00.277482316Z [2024-04-05T03:47:00.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a57f0b1-1bc1-435b-9f19-d96570a816c5 2024-04-05T03:47:00.277826267Z [2024-04-05T03:47:00.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to d38fba0d-dc50-458d-8eed-1524c1f4f253 2024-04-05T03:47:05.355057135Z [2024-04-05T03:47:05.353+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:47:05.355932326Z [2024-04-05T03:47:05.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:46:00+00:00, run_id=scheduled__2024-04-05T03:46:00+00:00, run_start_date=2024-04-05 03:47:00.049650+00:00, run_end_date=2024-04-05 03:47:05.355160+00:00, run_duration=5.30551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:46:00+00:00, data_interval_end=2024-04-05 03:47:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:47:05.372229666Z [2024-04-05T03:47:05.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:47:00+00:00, run_after=2024-04-05T03:48:00+00:00 2024-04-05T03:47:05.383828377Z [2024-04-05T03:47:05.383+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:47:05.384553208Z [2024-04-05T03:47:05.384+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:46:00+00:00, run_id=scheduled__2024-04-05T03:46:00+00:00, run_start_date=2024-04-05 03:47:00.051105+00:00, run_end_date=2024-04-05 03:47:05.384023+00:00, run_duration=5.332918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:46:00+00:00, data_interval_end=2024-04-05 03:47:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:47:05.418976411Z [2024-04-05T03:47:05.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:47:00+00:00, run_after=2024-04-05T03:48:00+00:00 2024-04-05T03:47:05.528454222Z [2024-04-05T03:47:05.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:46:00+00:00 exited with status success for try_number 1 2024-04-05T03:47:05.534336036Z [2024-04-05T03:47:05.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:46:00+00:00, map_index=-1, run_start_date=2024-04-05 03:47:02.784726+00:00, run_end_date=2024-04-05 03:47:04.856943+00:00, run_duration=2.072217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:47:00.113778+00:00, queued_by_job_id=1, pid=10990 2024-04-05T03:47:06.614254819Z [2024-04-05T03:47:06.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:46:00+00:00 exited with status success for try_number 1 2024-04-05T03:47:06.626278625Z [2024-04-05T03:47:06.625+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:46:00+00:00, map_index=-1, run_start_date=2024-04-05 03:47:02.794717+00:00, run_end_date=2024-04-05 03:47:05.281184+00:00, run_duration=2.486467, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:47:00.113778+00:00, queued_by_job_id=1, pid=10991 2024-04-05T03:48:00.395318948Z [2024-04-05T03:48:00.394+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:48:00+00:00, run_after=2024-04-05T03:49:00+00:00 2024-04-05T03:48:00.405750769Z [2024-04-05T03:48:00.405+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:48:00.415908620Z [2024-04-05T03:48:00.415+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:48:00.506020826Z [2024-04-05T03:48:00.505+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:48:00.506053823Z 2024-04-05T03:48:00.506084470Z 2024-04-05T03:48:00.506089674Z 2024-04-05T03:48:00.506233920Z [2024-04-05T03:48:00.505+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:48:00.506472173Z [2024-04-05T03:48:00.506+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:48:00.506768633Z [2024-04-05T03:48:00.506+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:48:00.507777897Z [2024-04-05T03:48:00.507+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:48:00.507792244Z 2024-04-05T03:48:00.507796589Z 2024-04-05T03:48:00.507800556Z 2024-04-05T03:48:00.513720693Z [2024-04-05T03:48:00.513+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:48:00.514018237Z [2024-04-05T03:48:00.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:48:00.514465638Z [2024-04-05T03:48:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:48:00.514713942Z [2024-04-05T03:48:00.514+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:48:00.515093837Z [2024-04-05T03:48:00.514+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:48:00.515488771Z [2024-04-05T03:48:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:48:00.736848942Z [2024-04-05T03:48:00.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:46:00+00:00 exited with status queued for try_number 1 2024-04-05T03:48:00.736878342Z [2024-04-05T03:48:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:47:00+00:00 exited with status queued for try_number 1 2024-04-05T03:48:00.736895945Z [2024-04-05T03:48:00.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:47:00+00:00 exited with status queued for try_number 1 2024-04-05T03:48:00.750535789Z [2024-04-05T03:48:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to ddc0e44a-4b88-4e4e-9f4c-f14951191cea 2024-04-05T03:48:00.750828108Z [2024-04-05T03:48:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e96fa1d-44b4-4cb6-8ac7-3a4a61bbcfcc 2024-04-05T03:48:00.751046870Z [2024-04-05T03:48:00.750+0000] {scheduler_job.py:635} INFO - Setting external_id for to be11e69b-f2ac-4b4d-8f2f-12a977bd171e 2024-04-05T03:48:02.500367085Z [2024-04-05T03:48:02.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:48:02.501441039Z [2024-04-05T03:48:02.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:46:00+00:00, run_id=scheduled__2024-04-05T03:46:00+00:00, run_start_date=2024-04-05 03:48:00.433276+00:00, run_end_date=2024-04-05 03:48:02.500389+00:00, run_duration=2.067113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:46:00+00:00, data_interval_end=2024-04-05 03:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:48:02.542100172Z [2024-04-05T03:48:02.530+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:48:00+00:00, run_after=2024-04-05T03:50:00+00:00 2024-04-05T03:48:02.638113149Z [2024-04-05T03:48:02.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:46:00+00:00 exited with status success for try_number 1 2024-04-05T03:48:02.638150030Z [2024-04-05T03:48:02.637+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:46:00+00:00, map_index=-1, run_start_date=2024-04-05 03:48:01.337313+00:00, run_end_date=2024-04-05 03:48:01.974748+00:00, run_duration=0.637435, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:48:00.510014+00:00, queued_by_job_id=1, pid=11026 2024-04-05T03:48:06.480428517Z [2024-04-05T03:48:06.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:48:06.480929295Z [2024-04-05T03:48:06.480+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:47:00+00:00, run_id=scheduled__2024-04-05T03:47:00+00:00, run_start_date=2024-04-05 03:48:00.435564+00:00, run_end_date=2024-04-05 03:48:06.480286+00:00, run_duration=6.044722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:47:00+00:00, data_interval_end=2024-04-05 03:48:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:48:06.492796536Z [2024-04-05T03:48:06.492+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:48:00+00:00, run_after=2024-04-05T03:49:00+00:00 2024-04-05T03:48:06.504513534Z [2024-04-05T03:48:06.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:48:06.504740096Z [2024-04-05T03:48:06.504+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:47:00+00:00, run_id=scheduled__2024-04-05T03:47:00+00:00, run_start_date=2024-04-05 03:48:00.437678+00:00, run_end_date=2024-04-05 03:48:06.504416+00:00, run_duration=6.066738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:47:00+00:00, data_interval_end=2024-04-05 03:48:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:48:06.516219291Z [2024-04-05T03:48:06.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:48:00+00:00, run_after=2024-04-05T03:49:00+00:00 2024-04-05T03:48:06.555622798Z [2024-04-05T03:48:06.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:47:00+00:00 exited with status success for try_number 1 2024-04-05T03:48:06.555953918Z [2024-04-05T03:48:06.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:47:00+00:00 exited with status success for try_number 1 2024-04-05T03:48:06.561908644Z [2024-04-05T03:48:06.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:47:00+00:00, map_index=-1, run_start_date=2024-04-05 03:48:03.386876+00:00, run_end_date=2024-04-05 03:48:06.064298+00:00, run_duration=2.677422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:48:00.510014+00:00, queued_by_job_id=1, pid=11057 2024-04-05T03:48:06.562526979Z [2024-04-05T03:48:06.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:47:00+00:00, map_index=-1, run_start_date=2024-04-05 03:48:03.276577+00:00, run_end_date=2024-04-05 03:48:05.994338+00:00, run_duration=2.717761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:48:00.510014+00:00, queued_by_job_id=1, pid=11056 2024-04-05T03:49:00.746203249Z [2024-04-05T03:49:00.744+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:49:00.780246160Z [2024-04-05T03:49:00.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:49:00+00:00, run_after=2024-04-05T03:50:00+00:00 2024-04-05T03:49:00.866857071Z [2024-04-05T03:49:00.866+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:49:00.866920832Z 2024-04-05T03:49:00.866930932Z 2024-04-05T03:49:00.867524651Z [2024-04-05T03:49:00.867+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:49:00.867970486Z [2024-04-05T03:49:00.867+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:49:00.870040883Z [2024-04-05T03:49:00.869+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:49:00.870066897Z 2024-04-05T03:49:00.870072165Z 2024-04-05T03:49:00.875641416Z [2024-04-05T03:49:00.875+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:49:00.875855883Z [2024-04-05T03:49:00.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:49:00.876290307Z [2024-04-05T03:49:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:49:00.876513488Z [2024-04-05T03:49:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:49:01.131797594Z [2024-04-05T03:49:01.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:48:00+00:00 exited with status queued for try_number 1 2024-04-05T03:49:01.131830203Z [2024-04-05T03:49:01.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:48:00+00:00 exited with status queued for try_number 1 2024-04-05T03:49:01.142485551Z [2024-04-05T03:49:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e74304c-c45b-4d77-b15c-2346b63f3212 2024-04-05T03:49:01.142589969Z [2024-04-05T03:49:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to c849b05f-5ab9-4568-864d-e67413d53782 2024-04-05T03:49:06.901258298Z [2024-04-05T03:49:06.900+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:49:06.908918625Z [2024-04-05T03:49:06.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:48:00+00:00, run_id=scheduled__2024-04-05T03:48:00+00:00, run_start_date=2024-04-05 03:49:00.805140+00:00, run_end_date=2024-04-05 03:49:06.901471+00:00, run_duration=6.096331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:48:00+00:00, data_interval_end=2024-04-05 03:49:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:49:06.936363848Z [2024-04-05T03:49:06.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:49:00+00:00, run_after=2024-04-05T03:50:00+00:00 2024-04-05T03:49:06.947804289Z [2024-04-05T03:49:06.947+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:49:06.948419971Z [2024-04-05T03:49:06.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:48:00+00:00, run_id=scheduled__2024-04-05T03:48:00+00:00, run_start_date=2024-04-05 03:49:00.803368+00:00, run_end_date=2024-04-05 03:49:06.947997+00:00, run_duration=6.144629, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:48:00+00:00, data_interval_end=2024-04-05 03:49:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:49:06.973164983Z [2024-04-05T03:49:06.972+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:49:00+00:00, run_after=2024-04-05T03:50:00+00:00 2024-04-05T03:49:07.015774451Z [2024-04-05T03:49:07.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:48:00+00:00 exited with status success for try_number 1 2024-04-05T03:49:07.015998933Z [2024-04-05T03:49:07.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:48:00+00:00 exited with status success for try_number 1 2024-04-05T03:49:07.029173428Z [2024-04-05T03:49:07.028+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:48:00+00:00, map_index=-1, run_start_date=2024-04-05 03:49:02.979242+00:00, run_end_date=2024-04-05 03:49:05.967622+00:00, run_duration=2.98838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:49:00.871149+00:00, queued_by_job_id=1, pid=11103 2024-04-05T03:49:07.029911089Z [2024-04-05T03:49:07.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:48:00+00:00, map_index=-1, run_start_date=2024-04-05 03:49:03.643405+00:00, run_end_date=2024-04-05 03:49:06.449598+00:00, run_duration=2.806193, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:49:00.871149+00:00, queued_by_job_id=1, pid=11113 2024-04-05T03:50:00.352337646Z [2024-04-05T03:50:00.351+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:50:00+00:00, run_after=2024-04-05T03:51:00+00:00 2024-04-05T03:50:00.362056201Z [2024-04-05T03:50:00.361+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:50:00.374814098Z [2024-04-05T03:50:00.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:50:00+00:00, run_after=2024-04-05T03:55:00+00:00 2024-04-05T03:50:00.381758706Z [2024-04-05T03:50:00.381+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:50:00.464367898Z [2024-04-05T03:50:00.464+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T03:50:00.464392326Z 2024-04-05T03:50:00.464395949Z 2024-04-05T03:50:00.464399920Z 2024-04-05T03:50:00.464403083Z 2024-04-05T03:50:00.464665073Z [2024-04-05T03:50:00.464+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:50:00.464676021Z [2024-04-05T03:50:00.464+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:50:00.464845382Z [2024-04-05T03:50:00.464+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:50:00.465012153Z [2024-04-05T03:50:00.464+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:50:00.465669097Z [2024-04-05T03:50:00.465+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:50:00.465679663Z 2024-04-05T03:50:00.465683285Z 2024-04-05T03:50:00.465686728Z 2024-04-05T03:50:00.465692606Z 2024-04-05T03:50:00.469670344Z [2024-04-05T03:50:00.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:50:00.469808940Z [2024-04-05T03:50:00.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:50:00.470108855Z [2024-04-05T03:50:00.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:50:00.470248551Z [2024-04-05T03:50:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:50:00.470557938Z [2024-04-05T03:50:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:50:00.470700680Z [2024-04-05T03:50:00.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:50:00.471020964Z [2024-04-05T03:50:00.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:50:00.471211875Z [2024-04-05T03:50:00.471+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:50:00.946621017Z [2024-04-05T03:50:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status queued for try_number 1 2024-04-05T03:50:00.947512487Z [2024-04-05T03:50:00.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:48:00+00:00 exited with status queued for try_number 1 2024-04-05T03:50:00.947692131Z [2024-04-05T03:50:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:49:00+00:00 exited with status queued for try_number 1 2024-04-05T03:50:00.947961465Z [2024-04-05T03:50:00.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:49:00+00:00 exited with status queued for try_number 1 2024-04-05T03:50:00.967387005Z [2024-04-05T03:50:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a6fbadf-0556-48bf-abe6-868929129642 2024-04-05T03:50:00.967769129Z [2024-04-05T03:50:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b2c10e6-525c-44b4-9b28-40eaaba79a3d 2024-04-05T03:50:00.968034673Z [2024-04-05T03:50:00.967+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67fd4ae5-45a4-487d-ae6f-412407ae76c5 2024-04-05T03:50:00.968274748Z [2024-04-05T03:50:00.968+0000] {scheduler_job.py:635} INFO - Setting external_id for to f498f9f4-ea5a-411a-8bc5-2e5b3d480987 2024-04-05T03:50:02.345358471Z [2024-04-05T03:50:02.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:50:02.345401570Z [2024-04-05T03:50:02.341+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:48:00+00:00, run_id=scheduled__2024-04-05T03:48:00+00:00, run_start_date=2024-04-05 03:50:00.400643+00:00, run_end_date=2024-04-05 03:50:02.341120+00:00, run_duration=1.940477, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:48:00+00:00, data_interval_end=2024-04-05 03:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:50:02.365265160Z [2024-04-05T03:50:02.364+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:50:00+00:00, run_after=2024-04-05T03:52:00+00:00 2024-04-05T03:50:02.580207918Z [2024-04-05T03:50:02.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:48:00+00:00 exited with status success for try_number 1 2024-04-05T03:50:02.606536419Z [2024-04-05T03:50:02.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:48:00+00:00, map_index=-1, run_start_date=2024-04-05 03:50:01.457562+00:00, run_end_date=2024-04-05 03:50:01.946232+00:00, run_duration=0.48867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:50:00.466719+00:00, queued_by_job_id=1, pid=11149 2024-04-05T03:50:06.347662533Z [2024-04-05T03:50:06.347+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:50:06.347700281Z 2024-04-05T03:50:06.347873036Z [2024-04-05T03:50:06.347+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:50:06.348585841Z [2024-04-05T03:50:06.348+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:50:06.348599456Z 2024-04-05T03:50:06.351706669Z [2024-04-05T03:50:06.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:50:06.351905639Z [2024-04-05T03:50:06.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:50:06.429780632Z [2024-04-05T03:50:06.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status queued for try_number 1 2024-04-05T03:50:06.429992944Z [2024-04-05T03:50:06.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status success for try_number 1 2024-04-05T03:50:06.437027693Z [2024-04-05T03:50:06.436+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51885252-73d0-4991-8455-cc161dc4ad7d 2024-04-05T03:50:06.437486221Z [2024-04-05T03:50:06.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:45:00+00:00, map_index=-1, run_start_date=2024-04-05 03:50:04.087630+00:00, run_end_date=2024-04-05 03:50:04.892138+00:00, run_duration=0.804508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:50:00.466719+00:00, queued_by_job_id=1, pid=11190 2024-04-05T03:50:07.624869198Z [2024-04-05T03:50:07.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:50:07.625391843Z [2024-04-05T03:50:07.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:49:00+00:00, run_id=scheduled__2024-04-05T03:49:00+00:00, run_start_date=2024-04-05 03:50:00.401840+00:00, run_end_date=2024-04-05 03:50:07.624955+00:00, run_duration=7.223115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:49:00+00:00, data_interval_end=2024-04-05 03:50:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:50:07.644073490Z [2024-04-05T03:50:07.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:50:00+00:00, run_after=2024-04-05T03:51:00+00:00 2024-04-05T03:50:07.655899719Z [2024-04-05T03:50:07.655+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:50:07.656392090Z [2024-04-05T03:50:07.656+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:49:00+00:00, run_id=scheduled__2024-04-05T03:49:00+00:00, run_start_date=2024-04-05 03:50:00.403082+00:00, run_end_date=2024-04-05 03:50:07.655945+00:00, run_duration=7.252863, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:49:00+00:00, data_interval_end=2024-04-05 03:50:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:50:07.672688328Z [2024-04-05T03:50:07.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:50:00+00:00, run_after=2024-04-05T03:51:00+00:00 2024-04-05T03:50:07.726721298Z [2024-04-05T03:50:07.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:49:00+00:00 exited with status success for try_number 1 2024-04-05T03:50:07.727938432Z [2024-04-05T03:50:07.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:49:00+00:00 exited with status success for try_number 1 2024-04-05T03:50:07.741171304Z [2024-04-05T03:50:07.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:49:00+00:00, map_index=-1, run_start_date=2024-04-05 03:50:03.927102+00:00, run_end_date=2024-04-05 03:50:06.526401+00:00, run_duration=2.599299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:50:00.466719+00:00, queued_by_job_id=1, pid=11189 2024-04-05T03:50:07.741999485Z [2024-04-05T03:50:07.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:49:00+00:00, map_index=-1, run_start_date=2024-04-05 03:50:04.169702+00:00, run_end_date=2024-04-05 03:50:06.982324+00:00, run_duration=2.812622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:50:00.466719+00:00, queued_by_job_id=1, pid=11191 2024-04-05T03:50:09.873459051Z [2024-04-05T03:50:09.873+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:50:09.873488015Z 2024-04-05T03:50:09.873499134Z [2024-04-05T03:50:09.873+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:50:09.874363901Z [2024-04-05T03:50:09.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:50:09.874383081Z 2024-04-05T03:50:09.878106761Z [2024-04-05T03:50:09.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:50:09.878171218Z [2024-04-05T03:50:09.878+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:50:09.942796494Z [2024-04-05T03:50:09.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status queued for try_number 1 2024-04-05T03:50:09.943047005Z [2024-04-05T03:50:09.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status success for try_number 1 2024-04-05T03:50:09.951529927Z [2024-04-05T03:50:09.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a7969c2-f5db-4ef3-903e-36c576ca5518 2024-04-05T03:50:09.951865224Z [2024-04-05T03:50:09.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:45:00+00:00, map_index=-1, run_start_date=2024-04-05 03:50:08.687334+00:00, run_end_date=2024-04-05 03:50:09.082268+00:00, run_duration=0.394934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:50:06.349013+00:00, queued_by_job_id=1, pid=11230 2024-04-05T03:50:13.359910760Z [2024-04-05T03:50:13.359+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:50:13.359942604Z 2024-04-05T03:50:13.360330219Z [2024-04-05T03:50:13.359+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:50:13.361534654Z [2024-04-05T03:50:13.361+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:50:13.361550365Z 2024-04-05T03:50:13.365669685Z [2024-04-05T03:50:13.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:50:13.366004454Z [2024-04-05T03:50:13.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:50:13.443068852Z [2024-04-05T03:50:13.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status queued for try_number 1 2024-04-05T03:50:13.443223016Z [2024-04-05T03:50:13.443+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status success for try_number 1 2024-04-05T03:50:13.455020608Z [2024-04-05T03:50:13.454+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fb90a6e-4d85-4d8d-9c35-ff7709bccac1 2024-04-05T03:50:13.455993907Z [2024-04-05T03:50:13.454+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:45:00+00:00, map_index=0, run_start_date=2024-04-05 03:50:11.761185+00:00, run_end_date=2024-04-05 03:50:12.107257+00:00, run_duration=0.346072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:50:09.874907+00:00, queued_by_job_id=1, pid=11252 2024-04-05T03:50:16.040141606Z [2024-04-05T03:50:16.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:50:16.040616610Z [2024-04-05T03:50:16.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:45:00+00:00, run_id=scheduled__2024-04-05T03:45:00+00:00, run_start_date=2024-04-05 03:50:00.398917+00:00, run_end_date=2024-04-05 03:50:16.039984+00:00, run_duration=15.641067, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:45:00+00:00, data_interval_end=2024-04-05 03:50:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:50:16.048098535Z [2024-04-05T03:50:16.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:50:00+00:00, run_after=2024-04-05T03:55:00+00:00 2024-04-05T03:50:16.081473084Z [2024-04-05T03:50:16.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:45:00+00:00 exited with status success for try_number 1 2024-04-05T03:50:16.088785681Z [2024-04-05T03:50:16.088+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:45:00+00:00, map_index=-1, run_start_date=2024-04-05 03:50:15.231814+00:00, run_end_date=2024-04-05 03:50:15.633447+00:00, run_duration=0.401633, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:50:13.362241+00:00, queued_by_job_id=1, pid=11267 2024-04-05T03:51:00.585065956Z [2024-04-05T03:51:00.584+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:51:00.599410055Z [2024-04-05T03:51:00.599+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:51:00+00:00, run_after=2024-04-05T03:52:00+00:00 2024-04-05T03:51:00.685347696Z [2024-04-05T03:51:00.684+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:51:00.685374876Z 2024-04-05T03:51:00.685379327Z 2024-04-05T03:51:00.685390728Z [2024-04-05T03:51:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:51:00.685444571Z [2024-04-05T03:51:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:51:00.686133787Z [2024-04-05T03:51:00.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:51:00.686155918Z 2024-04-05T03:51:00.686160605Z 2024-04-05T03:51:00.691140454Z [2024-04-05T03:51:00.690+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:51:00.691420257Z [2024-04-05T03:51:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:51:00.691924385Z [2024-04-05T03:51:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:51:00.692146745Z [2024-04-05T03:51:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:51:00.942770039Z [2024-04-05T03:51:00.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status queued for try_number 1 2024-04-05T03:51:00.943017328Z [2024-04-05T03:51:00.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status queued for try_number 1 2024-04-05T03:51:00.953796263Z [2024-04-05T03:51:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd6a6441-fcaa-48a0-bbef-514c92ce1068 2024-04-05T03:51:00.953913130Z [2024-04-05T03:51:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7fc834f-851f-420b-aa42-495b378220fd 2024-04-05T03:51:05.743780119Z [2024-04-05T03:51:05.743+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:51:05.744459728Z [2024-04-05T03:51:05.744+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:50:00+00:00, run_id=scheduled__2024-04-05T03:50:00+00:00, run_start_date=2024-04-05 03:51:00.613832+00:00, run_end_date=2024-04-05 03:51:05.744059+00:00, run_duration=5.130227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:50:00+00:00, data_interval_end=2024-04-05 03:51:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:51:05.757569770Z [2024-04-05T03:51:05.757+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:51:00+00:00, run_after=2024-04-05T03:52:00+00:00 2024-04-05T03:51:06.883137041Z [2024-04-05T03:51:06.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:51:06.883781451Z [2024-04-05T03:51:06.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:50:00+00:00, run_id=scheduled__2024-04-05T03:50:00+00:00, run_start_date=2024-04-05 03:51:00.615431+00:00, run_end_date=2024-04-05 03:51:06.882994+00:00, run_duration=6.267563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:50:00+00:00, data_interval_end=2024-04-05 03:51:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:51:06.894043551Z [2024-04-05T03:51:06.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:51:00+00:00, run_after=2024-04-05T03:52:00+00:00 2024-04-05T03:51:06.925769578Z [2024-04-05T03:51:06.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status success for try_number 1 2024-04-05T03:51:06.926036003Z [2024-04-05T03:51:06.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status success for try_number 1 2024-04-05T03:51:06.935065987Z [2024-04-05T03:51:06.934+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:50:00+00:00, map_index=-1, run_start_date=2024-04-05 03:51:03.534499+00:00, run_end_date=2024-04-05 03:51:05.688570+00:00, run_duration=2.154071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:51:00.687342+00:00, queued_by_job_id=1, pid=11300 2024-04-05T03:51:06.935701351Z [2024-04-05T03:51:06.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:50:00+00:00, map_index=-1, run_start_date=2024-04-05 03:51:02.944094+00:00, run_end_date=2024-04-05 03:51:05.783550+00:00, run_duration=2.839456, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:51:00.687342+00:00, queued_by_job_id=1, pid=11281 2024-04-05T03:51:44.962048987Z [2024-04-05T03:51:44.961+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:52:00.387188977Z [2024-04-05T03:52:00.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:52:00+00:00, run_after=2024-04-05T03:53:00+00:00 2024-04-05T03:52:00.397357892Z [2024-04-05T03:52:00.396+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:52:00.405461147Z [2024-04-05T03:52:00.405+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:52:00.515420437Z [2024-04-05T03:52:00.514+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:52:00.515449986Z 2024-04-05T03:52:00.515455766Z 2024-04-05T03:52:00.515460600Z 2024-04-05T03:52:00.515475284Z [2024-04-05T03:52:00.515+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:52:00.515683427Z [2024-04-05T03:52:00.515+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:52:00.515808382Z [2024-04-05T03:52:00.515+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:52:00.516568131Z [2024-04-05T03:52:00.516+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:52:00.516576313Z 2024-04-05T03:52:00.516581384Z 2024-04-05T03:52:00.516585591Z 2024-04-05T03:52:00.520471062Z [2024-04-05T03:52:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:52:00.520569558Z [2024-04-05T03:52:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:52:00.521023857Z [2024-04-05T03:52:00.520+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:52:00.521088837Z [2024-04-05T03:52:00.520+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:52:00.521315785Z [2024-04-05T03:52:00.521+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:52:00.521394922Z [2024-04-05T03:52:00.521+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:52:00.810975551Z [2024-04-05T03:52:00.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status queued for try_number 1 2024-04-05T03:52:00.811264351Z [2024-04-05T03:52:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:51:00+00:00 exited with status queued for try_number 1 2024-04-05T03:52:00.811492298Z [2024-04-05T03:52:00.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:51:00+00:00 exited with status queued for try_number 1 2024-04-05T03:52:00.820027220Z [2024-04-05T03:52:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8bea9fe-5b0c-4862-988b-26fbd822852d 2024-04-05T03:52:00.820389643Z [2024-04-05T03:52:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7d689db-fca3-4596-9411-23c597c0479f 2024-04-05T03:52:00.820672227Z [2024-04-05T03:52:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ebd5266-19fb-4a67-8f86-8b9998033a05 2024-04-05T03:52:02.027974508Z [2024-04-05T03:52:02.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:52:02.028713520Z [2024-04-05T03:52:02.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:50:00+00:00, run_id=scheduled__2024-04-05T03:50:00+00:00, run_start_date=2024-04-05 03:52:00.418664+00:00, run_end_date=2024-04-05 03:52:02.027842+00:00, run_duration=1.609178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:50:00+00:00, data_interval_end=2024-04-05 03:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:52:02.049674468Z [2024-04-05T03:52:02.048+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:52:00+00:00, run_after=2024-04-05T03:54:00+00:00 2024-04-05T03:52:03.426082428Z [2024-04-05T03:52:03.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status success for try_number 1 2024-04-05T03:52:03.432211928Z [2024-04-05T03:52:03.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:50:00+00:00, map_index=-1, run_start_date=2024-04-05 03:52:01.440548+00:00, run_end_date=2024-04-05 03:52:01.982514+00:00, run_duration=0.541966, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:52:00.517426+00:00, queued_by_job_id=1, pid=11326 2024-04-05T03:52:05.649851473Z [2024-04-05T03:52:05.649+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:52:05.650315208Z [2024-04-05T03:52:05.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:51:00+00:00, run_id=scheduled__2024-04-05T03:51:00+00:00, run_start_date=2024-04-05 03:52:00.419914+00:00, run_end_date=2024-04-05 03:52:05.649718+00:00, run_duration=5.229804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:51:00+00:00, data_interval_end=2024-04-05 03:52:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:52:05.664141833Z [2024-04-05T03:52:05.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:52:00+00:00, run_after=2024-04-05T03:53:00+00:00 2024-04-05T03:52:05.719771987Z [2024-04-05T03:52:05.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:51:00+00:00 exited with status success for try_number 1 2024-04-05T03:52:05.725325071Z [2024-04-05T03:52:05.724+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:51:00+00:00, map_index=-1, run_start_date=2024-04-05 03:52:03.582579+00:00, run_end_date=2024-04-05 03:52:05.339868+00:00, run_duration=1.757289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:52:00.517426+00:00, queued_by_job_id=1, pid=11356 2024-04-05T03:52:08.517692033Z [2024-04-05T03:52:08.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:52:08.517892649Z [2024-04-05T03:52:08.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:51:00+00:00, run_id=scheduled__2024-04-05T03:51:00+00:00, run_start_date=2024-04-05 03:52:00.421247+00:00, run_end_date=2024-04-05 03:52:08.517465+00:00, run_duration=8.096218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:51:00+00:00, data_interval_end=2024-04-05 03:52:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:52:08.530072292Z [2024-04-05T03:52:08.529+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:52:00+00:00, run_after=2024-04-05T03:53:00+00:00 2024-04-05T03:52:08.556332748Z [2024-04-05T03:52:08.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:51:00+00:00 exited with status success for try_number 1 2024-04-05T03:52:08.561566576Z [2024-04-05T03:52:08.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:51:00+00:00, map_index=-1, run_start_date=2024-04-05 03:52:03.860722+00:00, run_end_date=2024-04-05 03:52:08.132270+00:00, run_duration=4.271548, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:52:00.517426+00:00, queued_by_job_id=1, pid=11357 2024-04-05T03:53:00.072533565Z [2024-04-05T03:53:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:53:00+00:00, run_after=2024-04-05T03:54:00+00:00 2024-04-05T03:53:00.082633242Z [2024-04-05T03:53:00.082+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:53:00.139822321Z [2024-04-05T03:53:00.139+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:53:00.139847240Z 2024-04-05T03:53:00.139851166Z 2024-04-05T03:53:00.140322145Z [2024-04-05T03:53:00.139+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:53:00.140617343Z [2024-04-05T03:53:00.140+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:53:00.141320827Z [2024-04-05T03:53:00.141+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:53:00.141332199Z 2024-04-05T03:53:00.141335832Z 2024-04-05T03:53:00.143818318Z [2024-04-05T03:53:00.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:53:00.144017051Z [2024-04-05T03:53:00.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:53:00.144297659Z [2024-04-05T03:53:00.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:53:00.144486524Z [2024-04-05T03:53:00.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:53:00.356724312Z [2024-04-05T03:53:00.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:52:00+00:00 exited with status queued for try_number 1 2024-04-05T03:53:00.357132394Z [2024-04-05T03:53:00.356+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:52:00+00:00 exited with status queued for try_number 1 2024-04-05T03:53:00.369916506Z [2024-04-05T03:53:00.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83b1929b-8e1d-4759-83c0-d19a7dbdb06e 2024-04-05T03:53:00.370350710Z [2024-04-05T03:53:00.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fc762a0-519b-4a9a-b57e-ceff37fdff42 2024-04-05T03:53:04.882908720Z [2024-04-05T03:53:04.882+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:53:04.884810033Z [2024-04-05T03:53:04.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:52:00+00:00, run_id=scheduled__2024-04-05T03:52:00+00:00, run_start_date=2024-04-05 03:53:00.093136+00:00, run_end_date=2024-04-05 03:53:04.882793+00:00, run_duration=4.789657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:52:00+00:00, data_interval_end=2024-04-05 03:53:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:53:04.899239211Z [2024-04-05T03:53:04.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:53:00+00:00, run_after=2024-04-05T03:54:00+00:00 2024-04-05T03:53:04.913800407Z [2024-04-05T03:53:04.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:53:04.913827151Z [2024-04-05T03:53:04.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:52:00+00:00, run_id=scheduled__2024-04-05T03:52:00+00:00, run_start_date=2024-04-05 03:53:00.094638+00:00, run_end_date=2024-04-05 03:53:04.913293+00:00, run_duration=4.818655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:52:00+00:00, data_interval_end=2024-04-05 03:53:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:53:04.934114550Z [2024-04-05T03:53:04.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:53:00+00:00, run_after=2024-04-05T03:54:00+00:00 2024-04-05T03:53:05.011426691Z [2024-04-05T03:53:05.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:52:00+00:00 exited with status success for try_number 1 2024-04-05T03:53:05.011586996Z [2024-04-05T03:53:05.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:52:00+00:00 exited with status success for try_number 1 2024-04-05T03:53:05.030748970Z [2024-04-05T03:53:05.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:52:00+00:00, map_index=-1, run_start_date=2024-04-05 03:53:02.110385+00:00, run_end_date=2024-04-05 03:53:03.805736+00:00, run_duration=1.695351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:53:00.141801+00:00, queued_by_job_id=1, pid=11413 2024-04-05T03:53:05.030800799Z [2024-04-05T03:53:05.030+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:52:00+00:00, map_index=-1, run_start_date=2024-04-05 03:53:02.027792+00:00, run_end_date=2024-04-05 03:53:04.070372+00:00, run_duration=2.04258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:53:00.141801+00:00, queued_by_job_id=1, pid=11412 2024-04-05T03:54:00.355526132Z [2024-04-05T03:54:00.355+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:54:00.363545909Z [2024-04-05T03:54:00.363+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:54:00.377080477Z [2024-04-05T03:54:00.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:54:00+00:00, run_after=2024-04-05T03:55:00+00:00 2024-04-05T03:54:00.445931908Z [2024-04-05T03:54:00.445+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:54:00.445960757Z 2024-04-05T03:54:00.445966042Z 2024-04-05T03:54:00.445969473Z 2024-04-05T03:54:00.446247757Z [2024-04-05T03:54:00.445+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:54:00.446504311Z [2024-04-05T03:54:00.446+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:54:00.447069651Z [2024-04-05T03:54:00.446+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:54:00.448567176Z [2024-04-05T03:54:00.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:54:00.448588618Z 2024-04-05T03:54:00.448596783Z 2024-04-05T03:54:00.448603090Z 2024-04-05T03:54:00.454619535Z [2024-04-05T03:54:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:54:00.454991747Z [2024-04-05T03:54:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:54:00.455693000Z [2024-04-05T03:54:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:54:00.456153615Z [2024-04-05T03:54:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:54:00.456606723Z [2024-04-05T03:54:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:54:00.456827747Z [2024-04-05T03:54:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:54:00.754678643Z [2024-04-05T03:54:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:52:00+00:00 exited with status queued for try_number 1 2024-04-05T03:54:00.754705268Z [2024-04-05T03:54:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:53:00+00:00 exited with status queued for try_number 1 2024-04-05T03:54:00.754709214Z [2024-04-05T03:54:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:53:00+00:00 exited with status queued for try_number 1 2024-04-05T03:54:00.774149543Z [2024-04-05T03:54:00.772+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c082fe3-7cea-42a7-baa2-4eac090190a1 2024-04-05T03:54:00.774174258Z [2024-04-05T03:54:00.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca3135de-a6d2-407d-aaf4-0da775579956 2024-04-05T03:54:00.774177977Z [2024-04-05T03:54:00.773+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2ced8b9-77ae-4d3b-9803-e449b290ba87 2024-04-05T03:54:02.039395511Z [2024-04-05T03:54:02.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:52:00+00:00 exited with status success for try_number 1 2024-04-05T03:54:02.046119535Z [2024-04-05T03:54:02.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:52:00+00:00, map_index=-1, run_start_date=2024-04-05 03:54:01.365651+00:00, run_end_date=2024-04-05 03:54:01.841818+00:00, run_duration=0.476167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:54:00.451464+00:00, queued_by_job_id=1, pid=11448 2024-04-05T03:54:02.330150787Z [2024-04-05T03:54:02.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:54:02.330186528Z [2024-04-05T03:54:02.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:52:00+00:00, run_id=scheduled__2024-04-05T03:52:00+00:00, run_start_date=2024-04-05 03:54:00.389740+00:00, run_end_date=2024-04-05 03:54:02.326791+00:00, run_duration=1.937051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:52:00+00:00, data_interval_end=2024-04-05 03:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:54:02.338010748Z [2024-04-05T03:54:02.337+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:54:00+00:00, run_after=2024-04-05T03:56:00+00:00 2024-04-05T03:54:05.916171757Z [2024-04-05T03:54:05.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:54:05.916480058Z [2024-04-05T03:54:05.916+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:53:00+00:00, run_id=scheduled__2024-04-05T03:53:00+00:00, run_start_date=2024-04-05 03:54:00.392802+00:00, run_end_date=2024-04-05 03:54:05.916078+00:00, run_duration=5.523276, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:53:00+00:00, data_interval_end=2024-04-05 03:54:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:54:05.934169326Z [2024-04-05T03:54:05.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:54:00+00:00, run_after=2024-04-05T03:55:00+00:00 2024-04-05T03:54:05.941896135Z [2024-04-05T03:54:05.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:54:05.942252933Z [2024-04-05T03:54:05.942+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:53:00+00:00, run_id=scheduled__2024-04-05T03:53:00+00:00, run_start_date=2024-04-05 03:54:00.391657+00:00, run_end_date=2024-04-05 03:54:05.941852+00:00, run_duration=5.550195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:53:00+00:00, data_interval_end=2024-04-05 03:54:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:54:05.952460633Z [2024-04-05T03:54:05.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:54:00+00:00, run_after=2024-04-05T03:55:00+00:00 2024-04-05T03:54:05.982465728Z [2024-04-05T03:54:05.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:53:00+00:00 exited with status success for try_number 1 2024-04-05T03:54:05.982598296Z [2024-04-05T03:54:05.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:53:00+00:00 exited with status success for try_number 1 2024-04-05T03:54:05.988969654Z [2024-04-05T03:54:05.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:53:00+00:00, map_index=-1, run_start_date=2024-04-05 03:54:02.836793+00:00, run_end_date=2024-04-05 03:54:05.438062+00:00, run_duration=2.601269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:54:00.451464+00:00, queued_by_job_id=1, pid=11478 2024-04-05T03:54:05.989491165Z [2024-04-05T03:54:05.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:53:00+00:00, map_index=-1, run_start_date=2024-04-05 03:54:02.928143+00:00, run_end_date=2024-04-05 03:54:05.303464+00:00, run_duration=2.375321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:54:00.451464+00:00, queued_by_job_id=1, pid=11479 2024-04-05T03:55:00.729453406Z [2024-04-05T03:55:00.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:55:00+00:00, run_after=2024-04-05T03:56:00+00:00 2024-04-05T03:55:00.745936317Z [2024-04-05T03:55:00.742+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:55:00.762575070Z [2024-04-05T03:55:00.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:55:00+00:00, run_after=2024-04-05T04:00:00+00:00 2024-04-05T03:55:00.856035456Z [2024-04-05T03:55:00.855+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:55:00.856064281Z 2024-04-05T03:55:00.856071144Z 2024-04-05T03:55:00.856074877Z 2024-04-05T03:55:00.856257473Z [2024-04-05T03:55:00.856+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:55:00.856466998Z [2024-04-05T03:55:00.856+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:55:00.856687078Z [2024-04-05T03:55:00.856+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:55:00.857718206Z [2024-04-05T03:55:00.857+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:55:00.857732443Z 2024-04-05T03:55:00.857739643Z 2024-04-05T03:55:00.857746021Z 2024-04-05T03:55:00.863042965Z [2024-04-05T03:55:00.862+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T03:55:00.863459601Z [2024-04-05T03:55:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:55:00.863875860Z [2024-04-05T03:55:00.863+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:55:00.864064039Z [2024-04-05T03:55:00.863+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:55:00.864338771Z [2024-04-05T03:55:00.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:55:00.864538519Z [2024-04-05T03:55:00.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:55:01.129674629Z [2024-04-05T03:55:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status queued for try_number 1 2024-04-05T03:55:01.129729263Z [2024-04-05T03:55:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:54:00+00:00 exited with status queued for try_number 1 2024-04-05T03:55:01.129890220Z [2024-04-05T03:55:01.129+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:54:00+00:00 exited with status queued for try_number 1 2024-04-05T03:55:01.141778019Z [2024-04-05T03:55:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d6cfe59-1423-4224-9807-b291ede8b020 2024-04-05T03:55:01.142396176Z [2024-04-05T03:55:01.141+0000] {scheduler_job.py:635} INFO - Setting external_id for to 788d86bf-add5-49ef-8801-558282b8d0e4 2024-04-05T03:55:01.142634927Z [2024-04-05T03:55:01.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66e61252-6213-49d8-bcd4-6c712fa55348 2024-04-05T03:55:05.653851441Z [2024-04-05T03:55:05.653+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:55:05.654236728Z [2024-04-05T03:55:05.653+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:54:00+00:00, run_id=scheduled__2024-04-05T03:54:00+00:00, run_start_date=2024-04-05 03:55:00.778461+00:00, run_end_date=2024-04-05 03:55:05.653760+00:00, run_duration=4.875299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:54:00+00:00, data_interval_end=2024-04-05 03:55:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:55:05.671042636Z [2024-04-05T03:55:05.670+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:55:00+00:00, run_after=2024-04-05T03:56:00+00:00 2024-04-05T03:55:05.727285591Z [2024-04-05T03:55:05.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:55:05.728020630Z [2024-04-05T03:55:05.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:54:00+00:00, run_id=scheduled__2024-04-05T03:54:00+00:00, run_start_date=2024-04-05 03:55:00.780115+00:00, run_end_date=2024-04-05 03:55:05.727226+00:00, run_duration=4.947111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:54:00+00:00, data_interval_end=2024-04-05 03:55:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:55:05.746415023Z [2024-04-05T03:55:05.745+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:55:00+00:00, run_after=2024-04-05T03:56:00+00:00 2024-04-05T03:55:05.773177216Z [2024-04-05T03:55:05.772+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:55:05.773202660Z 2024-04-05T03:55:05.773731781Z [2024-04-05T03:55:05.773+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:55:05.775335457Z [2024-04-05T03:55:05.774+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:55:05.775351529Z 2024-04-05T03:55:05.779504492Z [2024-04-05T03:55:05.779+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='split_metrics', run_id='scheduled__2024-04-05T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T03:55:05.779985983Z [2024-04-05T03:55:05.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'split_metrics', 'scheduled__2024-04-05T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:55:05.890288334Z [2024-04-05T03:55:05.889+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status queued for try_number 1 2024-04-05T03:55:05.890427822Z [2024-04-05T03:55:05.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status success for try_number 1 2024-04-05T03:55:05.890466051Z [2024-04-05T03:55:05.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:54:00+00:00 exited with status success for try_number 1 2024-04-05T03:55:05.890624317Z [2024-04-05T03:55:05.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:54:00+00:00 exited with status success for try_number 1 2024-04-05T03:55:05.905365851Z [2024-04-05T03:55:05.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T03:50:00+00:00, map_index=-1, run_start_date=2024-04-05 03:55:04.107419+00:00, run_end_date=2024-04-05 03:55:04.561951+00:00, run_duration=0.454532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:55:00.859048+00:00, queued_by_job_id=1, pid=11557 2024-04-05T03:55:05.905893650Z [2024-04-05T03:55:05.905+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:54:00+00:00, map_index=-1, run_start_date=2024-04-05 03:55:03.600690+00:00, run_end_date=2024-04-05 03:55:05.266841+00:00, run_duration=1.666151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:55:00.859048+00:00, queued_by_job_id=1, pid=11536 2024-04-05T03:55:05.906285033Z [2024-04-05T03:55:05.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:54:00+00:00, map_index=-1, run_start_date=2024-04-05 03:55:03.637868+00:00, run_end_date=2024-04-05 03:55:05.426156+00:00, run_duration=1.788288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:55:00.859048+00:00, queued_by_job_id=1, pid=11535 2024-04-05T03:55:05.906983065Z [2024-04-05T03:55:05.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 883c6f8c-daed-4376-8869-de7f5d5632a9 2024-04-05T03:55:09.190569859Z [2024-04-05T03:55:09.190+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:55:09.190601857Z 2024-04-05T03:55:09.190649345Z [2024-04-05T03:55:09.190+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:55:09.191254364Z [2024-04-05T03:55:09.191+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:55:09.191263414Z 2024-04-05T03:55:09.193705143Z [2024-04-05T03:55:09.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='collect_metrics', run_id='scheduled__2024-04-05T03:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T03:55:09.193939934Z [2024-04-05T03:55:09.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'collect_metrics', 'scheduled__2024-04-05T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T03:55:09.251041052Z [2024-04-05T03:55:09.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status queued for try_number 1 2024-04-05T03:55:09.251122379Z [2024-04-05T03:55:09.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.split_metrics run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status success for try_number 1 2024-04-05T03:55:09.259313952Z [2024-04-05T03:55:09.258+0000] {scheduler_job.py:635} INFO - Setting external_id for to 727bc2df-494a-4b6a-a231-64de8b4c8666 2024-04-05T03:55:09.259357689Z [2024-04-05T03:55:09.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=split_metrics, run_id=scheduled__2024-04-05T03:50:00+00:00, map_index=-1, run_start_date=2024-04-05 03:55:07.928029+00:00, run_end_date=2024-04-05 03:55:08.300851+00:00, run_duration=0.372822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:55:05.776245+00:00, queued_by_job_id=1, pid=11585 2024-04-05T03:55:12.020450878Z [2024-04-05T03:55:12.020+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T03:55:12.020479462Z 2024-04-05T03:55:12.020771697Z [2024-04-05T03:55:12.020+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:55:12.021432948Z [2024-04-05T03:55:12.021+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:55:12.021447724Z 2024-04-05T03:55:12.024055183Z [2024-04-05T03:55:12.023+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='send_prometheus', run_id='scheduled__2024-04-05T03:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:55:12.024236970Z [2024-04-05T03:55:12.023+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'send_prometheus', 'scheduled__2024-04-05T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T03:55:12.172030752Z [2024-04-05T03:55:12.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status queued for try_number 1 2024-04-05T03:55:12.172425155Z [2024-04-05T03:55:12.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.collect_metrics run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status success for try_number 1 2024-04-05T03:55:12.179391805Z [2024-04-05T03:55:12.179+0000] {scheduler_job.py:635} INFO - Setting external_id for to 755958a7-66da-4cf5-be0c-6a1855c51ffa 2024-04-05T03:55:12.179644528Z [2024-04-05T03:55:12.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=collect_metrics, run_id=scheduled__2024-04-05T03:50:00+00:00, map_index=0, run_start_date=2024-04-05 03:55:11.058618+00:00, run_end_date=2024-04-05 03:55:11.447025+00:00, run_duration=0.388407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:55:09.191645+00:00, queued_by_job_id=1, pid=11607 2024-04-05T03:55:14.670462533Z [2024-04-05T03:55:14.669+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:55:14.670480824Z [2024-04-05T03:55:14.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:50:00+00:00, run_id=scheduled__2024-04-05T03:50:00+00:00, run_start_date=2024-04-05 03:55:00.776039+00:00, run_end_date=2024-04-05 03:55:14.669636+00:00, run_duration=13.893597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:50:00+00:00, data_interval_end=2024-04-05 03:55:00+00:00, dag_hash=7a299c80aa705ced04e906276cb756f6 2024-04-05T03:55:14.678117556Z [2024-04-05T03:55:14.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:55:00+00:00, run_after=2024-04-05T04:00:00+00:00 2024-04-05T03:55:14.707879099Z [2024-04-05T03:55:14.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.send_prometheus run_id=scheduled__2024-04-05T03:50:00+00:00 exited with status success for try_number 1 2024-04-05T03:55:14.716960486Z [2024-04-05T03:55:14.716+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=send_prometheus, run_id=scheduled__2024-04-05T03:50:00+00:00, map_index=-1, run_start_date=2024-04-05 03:55:13.932289+00:00, run_end_date=2024-04-05 03:55:14.288710+00:00, run_duration=0.356421, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:55:12.021786+00:00, queued_by_job_id=1, pid=11622 2024-04-05T03:56:00.068976752Z [2024-04-05T03:56:00.068+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:56:00.081134107Z [2024-04-05T03:56:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:56:00+00:00, run_after=2024-04-05T03:57:00+00:00 2024-04-05T03:56:00.087601928Z [2024-04-05T03:56:00.087+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:56:00.151661701Z [2024-04-05T03:56:00.151+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:56:00.151693270Z 2024-04-05T03:56:00.151697446Z 2024-04-05T03:56:00.151700714Z 2024-04-05T03:56:00.151714063Z [2024-04-05T03:56:00.151+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:56:00.151762113Z [2024-04-05T03:56:00.151+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:56:00.151828794Z [2024-04-05T03:56:00.151+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:56:00.152360774Z [2024-04-05T03:56:00.152+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:56:00.152376856Z 2024-04-05T03:56:00.152381952Z 2024-04-05T03:56:00.152385975Z 2024-04-05T03:56:00.155833630Z [2024-04-05T03:56:00.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:56:00.155919447Z [2024-04-05T03:56:00.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:56:00.156192634Z [2024-04-05T03:56:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:56:00.156277120Z [2024-04-05T03:56:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:56:00.156469042Z [2024-04-05T03:56:00.156+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:56:00.156546917Z [2024-04-05T03:56:00.156+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:56:00.380541803Z [2024-04-05T03:56:00.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:54:00+00:00 exited with status queued for try_number 1 2024-04-05T03:56:00.380800530Z [2024-04-05T03:56:00.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:55:00+00:00 exited with status queued for try_number 1 2024-04-05T03:56:00.381045051Z [2024-04-05T03:56:00.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:55:00+00:00 exited with status queued for try_number 1 2024-04-05T03:56:00.391508513Z [2024-04-05T03:56:00.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2806e0da-debd-4ff8-8a6e-07f6ec994569 2024-04-05T03:56:00.391964510Z [2024-04-05T03:56:00.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1076a683-d45b-445f-a75c-be529256892d 2024-04-05T03:56:00.392581846Z [2024-04-05T03:56:00.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to b24c6fc5-f66d-41c4-aff2-2818e1d4cf48 2024-04-05T03:56:01.557278815Z [2024-04-05T03:56:01.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:56:01.557686902Z [2024-04-05T03:56:01.557+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:54:00+00:00, run_id=scheduled__2024-04-05T03:54:00+00:00, run_start_date=2024-04-05 03:56:00.097171+00:00, run_end_date=2024-04-05 03:56:01.557222+00:00, run_duration=1.460051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:54:00+00:00, data_interval_end=2024-04-05 03:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:56:01.571059061Z [2024-04-05T03:56:01.570+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:56:00+00:00, run_after=2024-04-05T03:58:00+00:00 2024-04-05T03:56:01.622906726Z [2024-04-05T03:56:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:54:00+00:00 exited with status success for try_number 1 2024-04-05T03:56:01.628418261Z [2024-04-05T03:56:01.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:54:00+00:00, map_index=-1, run_start_date=2024-04-05 03:56:00.961539+00:00, run_end_date=2024-04-05 03:56:01.355224+00:00, run_duration=0.393685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:56:00.152984+00:00, queued_by_job_id=1, pid=11626 2024-04-05T03:56:05.412625080Z [2024-04-05T03:56:05.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:56:05.413353188Z [2024-04-05T03:56:05.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:55:00+00:00, run_id=scheduled__2024-04-05T03:55:00+00:00, run_start_date=2024-04-05 03:56:00.099303+00:00, run_end_date=2024-04-05 03:56:05.412482+00:00, run_duration=5.313179, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:55:00+00:00, data_interval_end=2024-04-05 03:56:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:56:05.434221469Z [2024-04-05T03:56:05.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:56:00+00:00, run_after=2024-04-05T03:57:00+00:00 2024-04-05T03:56:05.444011801Z [2024-04-05T03:56:05.443+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:56:05.444559609Z [2024-04-05T03:56:05.444+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:55:00+00:00, run_id=scheduled__2024-04-05T03:55:00+00:00, run_start_date=2024-04-05 03:56:00.098309+00:00, run_end_date=2024-04-05 03:56:05.443916+00:00, run_duration=5.345607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:55:00+00:00, data_interval_end=2024-04-05 03:56:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:56:05.462330090Z [2024-04-05T03:56:05.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:56:00+00:00, run_after=2024-04-05T03:57:00+00:00 2024-04-05T03:56:05.502767356Z [2024-04-05T03:56:05.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:55:00+00:00 exited with status success for try_number 1 2024-04-05T03:56:05.502925603Z [2024-04-05T03:56:05.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:55:00+00:00 exited with status success for try_number 1 2024-04-05T03:56:05.515611052Z [2024-04-05T03:56:05.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:55:00+00:00, map_index=-1, run_start_date=2024-04-05 03:56:02.261154+00:00, run_end_date=2024-04-05 03:56:04.266500+00:00, run_duration=2.005346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:56:00.152984+00:00, queued_by_job_id=1, pid=11657 2024-04-05T03:56:05.515881084Z [2024-04-05T03:56:05.515+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:55:00+00:00, map_index=-1, run_start_date=2024-04-05 03:56:02.275475+00:00, run_end_date=2024-04-05 03:56:04.449702+00:00, run_duration=2.174227, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:56:00.152984+00:00, queued_by_job_id=1, pid=11656 2024-04-05T03:56:45.023390801Z [2024-04-05T03:56:45.022+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T03:57:00.041284261Z [2024-04-05T03:57:00.040+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:57:00+00:00, run_after=2024-04-05T03:58:00+00:00 2024-04-05T03:57:00.062049640Z [2024-04-05T03:57:00.061+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:57:00.122802023Z [2024-04-05T03:57:00.122+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:57:00.122846171Z 2024-04-05T03:57:00.122856480Z 2024-04-05T03:57:00.122889035Z [2024-04-05T03:57:00.122+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:57:00.122953610Z [2024-04-05T03:57:00.122+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:57:00.123634955Z [2024-04-05T03:57:00.123+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:57:00.123683900Z 2024-04-05T03:57:00.123693848Z 2024-04-05T03:57:00.126404713Z [2024-04-05T03:57:00.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:57:00.126629528Z [2024-04-05T03:57:00.126+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:57:00.126948628Z [2024-04-05T03:57:00.126+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:57:00.127168852Z [2024-04-05T03:57:00.127+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:57:00.274791976Z [2024-04-05T03:57:00.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:56:00+00:00 exited with status queued for try_number 1 2024-04-05T03:57:00.276962301Z [2024-04-05T03:57:00.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:56:00+00:00 exited with status queued for try_number 1 2024-04-05T03:57:00.286770564Z [2024-04-05T03:57:00.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5adef77-0dd2-4608-98ec-43f55da53d3d 2024-04-05T03:57:00.287070448Z [2024-04-05T03:57:00.286+0000] {scheduler_job.py:635} INFO - Setting external_id for to 664df54f-e571-4677-a475-c388e915f0c0 2024-04-05T03:57:04.218758126Z [2024-04-05T03:57:04.218+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:57:04.219291068Z [2024-04-05T03:57:04.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:56:00+00:00, run_id=scheduled__2024-04-05T03:56:00+00:00, run_start_date=2024-04-05 03:57:00.076784+00:00, run_end_date=2024-04-05 03:57:04.218633+00:00, run_duration=4.141849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:56:00+00:00, data_interval_end=2024-04-05 03:57:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:57:04.230144262Z [2024-04-05T03:57:04.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:57:00+00:00, run_after=2024-04-05T03:58:00+00:00 2024-04-05T03:57:04.248884709Z [2024-04-05T03:57:04.248+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:57:04.249774556Z [2024-04-05T03:57:04.249+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:56:00+00:00, run_id=scheduled__2024-04-05T03:56:00+00:00, run_start_date=2024-04-05 03:57:00.078835+00:00, run_end_date=2024-04-05 03:57:04.248747+00:00, run_duration=4.169912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:56:00+00:00, data_interval_end=2024-04-05 03:57:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:57:04.266815813Z [2024-04-05T03:57:04.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:57:00+00:00, run_after=2024-04-05T03:58:00+00:00 2024-04-05T03:57:04.309082705Z [2024-04-05T03:57:04.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:56:00+00:00 exited with status success for try_number 1 2024-04-05T03:57:04.310255021Z [2024-04-05T03:57:04.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:56:00+00:00 exited with status success for try_number 1 2024-04-05T03:57:04.332992763Z [2024-04-05T03:57:04.332+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:56:00+00:00, map_index=-1, run_start_date=2024-04-05 03:57:02.011785+00:00, run_end_date=2024-04-05 03:57:03.554311+00:00, run_duration=1.542526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:57:00.124074+00:00, queued_by_job_id=1, pid=11711 2024-04-05T03:57:04.334773656Z [2024-04-05T03:57:04.333+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:56:00+00:00, map_index=-1, run_start_date=2024-04-05 03:57:02.061277+00:00, run_end_date=2024-04-05 03:57:03.808218+00:00, run_duration=1.746941, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:57:00.124074+00:00, queued_by_job_id=1, pid=11712 2024-04-05T03:58:00.282959923Z [2024-04-05T03:58:00.282+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:58:00.303438507Z [2024-04-05T03:58:00.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:58:00+00:00, run_after=2024-04-05T03:59:00+00:00 2024-04-05T03:58:00.312373968Z [2024-04-05T03:58:00.312+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:58:00.392922058Z [2024-04-05T03:58:00.392+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T03:58:00.392946238Z 2024-04-05T03:58:00.392967921Z 2024-04-05T03:58:00.392971324Z 2024-04-05T03:58:00.393296856Z [2024-04-05T03:58:00.393+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T03:58:00.393447642Z [2024-04-05T03:58:00.393+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:58:00.393574195Z [2024-04-05T03:58:00.393+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:58:00.394310130Z [2024-04-05T03:58:00.394+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:58:00.394321388Z 2024-04-05T03:58:00.394325080Z 2024-04-05T03:58:00.394328416Z 2024-04-05T03:58:00.398282663Z [2024-04-05T03:58:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T03:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:58:00.398587642Z [2024-04-05T03:58:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T03:58:00.398913990Z [2024-04-05T03:58:00.398+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:58:00.399054475Z [2024-04-05T03:58:00.398+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:58:00.399284070Z [2024-04-05T03:58:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:58:00.399414011Z [2024-04-05T03:58:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:58:00.665787605Z [2024-04-05T03:58:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:56:00+00:00 exited with status queued for try_number 1 2024-04-05T03:58:00.665851832Z [2024-04-05T03:58:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:57:00+00:00 exited with status queued for try_number 1 2024-04-05T03:58:00.666011540Z [2024-04-05T03:58:00.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:57:00+00:00 exited with status queued for try_number 1 2024-04-05T03:58:00.677274836Z [2024-04-05T03:58:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to d38bf9ad-96a1-47af-a4ba-63bff6df2e70 2024-04-05T03:58:00.677455815Z [2024-04-05T03:58:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2a6a624-e235-4986-b885-5c4270ec6fd9 2024-04-05T03:58:00.677672721Z [2024-04-05T03:58:00.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52feef88-aaf4-45e7-ac5b-5cfc40e89b3e 2024-04-05T03:58:02.502932709Z [2024-04-05T03:58:02.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:58:02.502968873Z [2024-04-05T03:58:02.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 03:56:00+00:00, run_id=scheduled__2024-04-05T03:56:00+00:00, run_start_date=2024-04-05 03:58:00.324432+00:00, run_end_date=2024-04-05 03:58:02.499283+00:00, run_duration=2.174851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:56:00+00:00, data_interval_end=2024-04-05 03:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T03:58:02.522189717Z [2024-04-05T03:58:02.519+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T03:58:00+00:00, run_after=2024-04-05T04:00:00+00:00 2024-04-05T03:58:02.647928924Z [2024-04-05T03:58:02.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T03:56:00+00:00 exited with status success for try_number 1 2024-04-05T03:58:02.659801268Z [2024-04-05T03:58:02.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T03:56:00+00:00, map_index=-1, run_start_date=2024-04-05 03:58:01.395063+00:00, run_end_date=2024-04-05 03:58:01.866443+00:00, run_duration=0.47138, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:58:00.394997+00:00, queued_by_job_id=1, pid=11747 2024-04-05T03:58:05.955532791Z [2024-04-05T03:58:05.955+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:58:05.955676372Z [2024-04-05T03:58:05.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:57:00+00:00, run_id=scheduled__2024-04-05T03:57:00+00:00, run_start_date=2024-04-05 03:58:00.325782+00:00, run_end_date=2024-04-05 03:58:05.955391+00:00, run_duration=5.629609, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:57:00+00:00, data_interval_end=2024-04-05 03:58:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:58:05.982696537Z [2024-04-05T03:58:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:58:00+00:00, run_after=2024-04-05T03:59:00+00:00 2024-04-05T03:58:06.034142594Z [2024-04-05T03:58:06.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:57:00+00:00 exited with status success for try_number 1 2024-04-05T03:58:06.047622935Z [2024-04-05T03:58:06.047+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:57:00+00:00, map_index=-1, run_start_date=2024-04-05 03:58:03.399738+00:00, run_end_date=2024-04-05 03:58:05.821987+00:00, run_duration=2.422249, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:58:00.394997+00:00, queued_by_job_id=1, pid=11777 2024-04-05T03:58:07.533764944Z [2024-04-05T03:58:07.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:58:07.534248816Z [2024-04-05T03:58:07.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:57:00+00:00, run_id=scheduled__2024-04-05T03:57:00+00:00, run_start_date=2024-04-05 03:58:00.327035+00:00, run_end_date=2024-04-05 03:58:07.533884+00:00, run_duration=7.206849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:57:00+00:00, data_interval_end=2024-04-05 03:58:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:58:07.543961895Z [2024-04-05T03:58:07.543+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:58:00+00:00, run_after=2024-04-05T03:59:00+00:00 2024-04-05T03:58:07.598720978Z [2024-04-05T03:58:07.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:57:00+00:00 exited with status success for try_number 1 2024-04-05T03:58:07.603414956Z [2024-04-05T03:58:07.603+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:57:00+00:00, map_index=-1, run_start_date=2024-04-05 03:58:03.710073+00:00, run_end_date=2024-04-05 03:58:06.520240+00:00, run_duration=2.810167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:58:00.394997+00:00, queued_by_job_id=1, pid=11778 2024-04-05T03:59:00.397157291Z [2024-04-05T03:59:00.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:59:00+00:00, run_after=2024-04-05T04:00:00+00:00 2024-04-05T03:59:00.406512900Z [2024-04-05T03:59:00.406+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T03:59:00.474443652Z [2024-04-05T03:59:00.473+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T03:59:00.474474872Z 2024-04-05T03:59:00.474479744Z 2024-04-05T03:59:00.474683022Z [2024-04-05T03:59:00.474+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:59:00.475024342Z [2024-04-05T03:59:00.474+0000] {scheduler_job.py:425} INFO - DAG vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 has 0/16 running and queued tasks 2024-04-05T03:59:00.475947659Z [2024-04-05T03:59:00.475+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T03:59:00.475982207Z 2024-04-05T03:59:00.475996760Z 2024-04-05T03:59:00.479677201Z [2024-04-05T03:59:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:59:00.480057469Z [2024-04-05T03:59:00.479+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T03:59:00.480472770Z [2024-04-05T03:59:00.480+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T03:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T03:59:00.480722040Z [2024-04-05T03:59:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T03:59:00.670964798Z [2024-04-05T03:59:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:58:00+00:00 exited with status queued for try_number 1 2024-04-05T03:59:00.671082928Z [2024-04-05T03:59:00.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:58:00+00:00 exited with status queued for try_number 1 2024-04-05T03:59:00.679087798Z [2024-04-05T03:59:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to b22c3acb-4d96-4812-a971-8abf5b14a537 2024-04-05T03:59:00.679143821Z [2024-04-05T03:59:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c2b265e-605b-411e-b07e-87a477f910bf 2024-04-05T03:59:04.602828063Z [2024-04-05T03:59:04.602+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:59:04.603076508Z [2024-04-05T03:59:04.602+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:58:00+00:00, run_id=scheduled__2024-04-05T03:58:00+00:00, run_start_date=2024-04-05 03:59:00.419818+00:00, run_end_date=2024-04-05 03:59:04.602700+00:00, run_duration=4.182882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:58:00+00:00, data_interval_end=2024-04-05 03:59:00+00:00, dag_hash=1503d4143d6b305fc74c5c71f1aaa62f 2024-04-05T03:59:04.629680933Z [2024-04-05T03:59:04.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:59:00+00:00, run_after=2024-04-05T04:00:00+00:00 2024-04-05T03:59:04.688983327Z [2024-04-05T03:59:04.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:58:00+00:00 exited with status success for try_number 1 2024-04-05T03:59:04.689011458Z [2024-04-05T03:59:04.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:58:00+00:00, map_index=-1, run_start_date=2024-04-05 03:59:02.438242+00:00, run_end_date=2024-04-05 03:59:04.129788+00:00, run_duration=1.691546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:59:00.476613+00:00, queued_by_job_id=1, pid=11832 2024-04-05T03:59:05.735898295Z [2024-04-05T03:59:05.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T03:59:05.736536622Z [2024-04-05T03:59:05.736+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, execution_date=2024-04-05 03:58:00+00:00, run_id=scheduled__2024-04-05T03:58:00+00:00, run_start_date=2024-04-05 03:59:00.421156+00:00, run_end_date=2024-04-05 03:59:05.735806+00:00, run_duration=5.31465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 03:58:00+00:00, data_interval_end=2024-04-05 03:59:00+00:00, dag_hash=f547128f70ba86daae94ee7eebafb95b 2024-04-05T03:59:05.746609170Z [2024-04-05T03:59:05.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9 to 2024-04-05T03:59:00+00:00, run_after=2024-04-05T04:00:00+00:00 2024-04-05T03:59:05.784633377Z [2024-04-05T03:59:05.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T03:58:00+00:00 exited with status success for try_number 1 2024-04-05T03:59:05.792797024Z [2024-04-05T03:59:05.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ac3844aa-e1b1-43ef-a88b-51f6128e76d9, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T03:58:00+00:00, map_index=-1, run_start_date=2024-04-05 03:59:02.596487+00:00, run_end_date=2024-04-05 03:59:04.755231+00:00, run_duration=2.158744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 03:59:00.476613+00:00, queued_by_job_id=1, pid=11833 2024-04-05T01:26:19.262775692Z 2024-04-05T01:26:19.275825277Z Cleaning logs every 900 seconds 2024-04-05T01:26:19.275837140Z Trimming airflow logs to 15 days. 2024-04-05T01:30:00.366114070Z Trimming airflow logs to 15 days. 2024-04-05T01:30:01.394819196Z Trimming airflow logs to 15 days. 2024-04-05T01:45:00.440894309Z Trimming airflow logs to 15 days. 2024-04-05T01:45:01.478439623Z Trimming airflow logs to 15 days. 2024-04-05T02:00:00.522195787Z Trimming airflow logs to 15 days. 2024-04-05T02:00:01.545018912Z Trimming airflow logs to 15 days. 2024-04-05T02:15:00.600573096Z Trimming airflow logs to 15 days. 2024-04-05T02:15:01.630452237Z Trimming airflow logs to 15 days. 2024-04-05T02:30:00.674455442Z Trimming airflow logs to 15 days. 2024-04-05T02:30:01.712180198Z Trimming airflow logs to 15 days. 2024-04-05T02:45:00.765138069Z Trimming airflow logs to 15 days. 2024-04-05T02:45:01.801858413Z Trimming airflow logs to 15 days. 2024-04-05T03:00:00.874641704Z Trimming airflow logs to 15 days. 2024-04-05T03:00:01.906270516Z Trimming airflow logs to 15 days. 2024-04-05T03:15:00.942695758Z Trimming airflow logs to 15 days. 2024-04-05T03:15:01.962746701Z Trimming airflow logs to 15 days. 2024-04-05T03:30:01.014396463Z Trimming airflow logs to 15 days. 2024-04-05T03:45:00.052562149Z Trimming airflow logs to 15 days. 2024-04-05T03:45:01.073039206Z Trimming airflow logs to 15 days.